Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sims数据集报错:AssertionError: embed_dim must be divisible by num_heads #6

Open
xiajili opened this issue Apr 24, 2023 · 1 comment

Comments

@xiajili
Copy link

xiajili commented Apr 24, 2023

作者您好,请问一下,在运行sims数据集时,总是报错:AssertionError: embed_dim must be divisible by num_heads,发现是在multihead_attention中,由于self.head_dim * num_heads == self.embed_dim不符合所致,在mosi数据集中,sequence_length为(50,50,50),而sims数据集的sequence_length为 (39, 400, 55),50可以被25整除,39不能被25整除,想请问一下sims数据集(unaligned_39.pkl)还需要进行进一步处理吗?还是代码中的问题?

期待您的答疑!

@Columbine21
Copy link
Collaborator

在使用 ch-sims 数据时,最直接的方法是把 head_dim 设置为1。原始配置应该是mosi的设置;

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants