Skip to content

Multihead finetune pt and default models #711

Answered by ilyes319
marcob3 asked this question in Q&A
Discussion options

You must be logged in to vote

Hey, the pt_head corresponds to the head for the pretraining replay set. This head is there to ensure that the model does not forget too much during finetuning. The default head is the head that is used for your own training set.
When you do MD you do not have to pick a head, it will automatically use the one from your data.
If you want to select another head, you can do atoms.info["head"] = "pt_head", but I advise you not to do that.

Replies: 1 comment 2 replies

Comment options

You must be logged in to vote
2 replies
@marcob3
Comment options

@ilyes319
Comment options

Answer selected by ilyes319
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants