New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Idefics2's perceiver how to make attentionamsk to None? #2078

Open

lucasjinreal opened this issue May 21, 2024 · 0 comments

lucasjinreal commented May 21, 2024

I set atttentionmask to None, but the model doesn't learned well, my inputs didn't padded so I dont want attention mask. How to resolve this?

I also tried add a all ones attnetionmask, but the result also very worse.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment