attention maps generated in pre-training stage or fine-turning stage

[Shicheng-Guo]

Dear Jerry,

Thank you so much for the great contribution to the filed to develop this awesome pretraining model. The manuscript doesn't explicitly mention whether the attention maps (DNABERT-viz) are generated during the pretraining stage or the fine-tuning stage. Could you please more some explicitly explanation.

Thanks.

Shicheng