Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to use classification token in CvT? #336

Open
Yash-10 opened this issue Nov 21, 2024 · 0 comments
Open

Allow to use classification token in CvT? #336

Yash-10 opened this issue Nov 21, 2024 · 0 comments

Comments

@Yash-10
Copy link

Yash-10 commented Nov 21, 2024

Thanks for the amazing collection of ViT implementations!

As far as I see from the CvT paper, it also allows for a class token (like in ViT but which was removed in SimpleViT by the authors of the SimpleViT paper). Whereas it seems that the CvT code in this repository does not implement it. Is this by design choice, or do you think it might be worth adding an option for a classification token? If it's the former, maybe that can be clarified in the README? I'm not sure if there have been benchmark tests in the literature with and without a classification token.

For reference, I was looking at the CvT code that came with the paper (this line) and there seems to be an option called with_cls_token.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant