Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about the dataset #1

Open
X-funbean opened this issue Jun 29, 2023 · 1 comment
Open

Questions about the dataset #1

X-funbean opened this issue Jun 29, 2023 · 1 comment

Comments

@X-funbean
Copy link

Hi, NICO++ is a wonderful dataset for DG and OOD researches, but I'm confused at the training and testing protocols of it.

In your paper NICO++: Towards Better Benchmarking for Domain Generalization, the track1, i.e. classical DG problem is evaluated by training on 6 domains and then testing on the other 4 domains, as showed in table 5:
image.

However, the downloaded dataset only contains 6 domains, as showed in the figures below:
image
I wonder if this is the full version of NICO++. Am I missing anything to reimplement the results in the paper.

On the other hand, I notice that there is a 'public_test_flat' folder along with the 'train' folder, with 13907 images without meaningful file names. Are these images used for testing? If so, how to evaulate the results without groundtruth labeling?

Looking forward to your reply.

@BrianXiao1
Copy link

Same Question. Where are the rest 4 domains? lol
@X-funbean 哥 这个问题你解决了吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants