Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Visualization of attention weights in FlatFormer #15

Open
bunnyveil opened this issue Sep 4, 2024 · 0 comments
Open

Visualization of attention weights in FlatFormer #15

bunnyveil opened this issue Sep 4, 2024 · 0 comments

Comments

@bunnyveil
Copy link

I would like to express my gratitude for your work on FlatFormer. I am currently exploring the model and would like to visualize the attention weights generated during inference. Could you please guide me on how to implement the visualization of attention weights within FlatFormer? Specifically, I am looking for existing code snippets that could help me generate visualizations similar to what might be seen in transformer models.
Any assistance or direction on this matter would be greatly appreciated. Thank you in advance for your time and support.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant