Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

class overlap between train and test data #1

Open
sudarshan1994 opened this issue Apr 13, 2019 · 1 comment
Open

class overlap between train and test data #1

sudarshan1994 opened this issue Apr 13, 2019 · 1 comment

Comments

@sudarshan1994
Copy link

I am not able to find out how class overlap between train and test data is being maintained. Typically in few shot learning evaluation, few classes are never shown to the model, and on test time we evaluate the model by giving it N examples from those classes that have not been shown to the model. I am not sure if this separation is maintained in the code.

@ylsung
Copy link
Owner

ylsung commented Apr 16, 2019

Hi,

In this code, the few shot classes of testing data are same as which of validation data if the random seed is specified. Therefore, the separation is not maintained in the code. However, this is indeed an issue, and I will address it as soon as possible. Thank you pointing out this bug!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants