Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regarding Attention Size #3

Open
andyjung12 opened this issue Jan 6, 2023 · 1 comment
Open

Regarding Attention Size #3

andyjung12 opened this issue Jan 6, 2023 · 1 comment

Comments

@andyjung12
Copy link

The paper said that the attention size is 64, but on the config file, the attention size is 32. Which one is correct?

@pquochuy
Copy link
Owner

pquochuy commented Jan 6, 2023

The value in the config is just the default value. The actual value is passed via the command in the bash script file. If you look at, for example,
https://github.com/pquochuy/xsleepnet/blob/master/sleepedf-20/tensorflow_nets/xsleepnet1/run_1chan.sh
the value 64 is passed to the parameter seq_attention_size1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants