Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the results of DMS fitness in the ProteinGym benchmark #57

Open
jiaolifengmi opened this issue Aug 21, 2024 · 1 comment
Open

the results of DMS fitness in the ProteinGym benchmark #57

jiaolifengmi opened this issue Aug 21, 2024 · 1 comment

Comments

@jiaolifengmi
Copy link

Thank you very much for your wonderful work. I have some questions about the verification of DMS fitness in the ProteinGym benchmark. I noticed that the "substitution DMS benchmark" in the ProteinGym benchmark contains 217 groups of proteins, but in your experimental verification, only the There are 63 groups of proteins, and only 46 groups of proteins have the same names. Can you provide us with how your ProteinGym data set is constructed and why it is so different from the original proteinGym?

@LTEnjoy
Copy link
Contributor

LTEnjoy commented Aug 21, 2024

Hi, thank you for you interest in our work!

The ProteinGym benchmark is actually its 1.0 version. The ProteinGym dataset used in our paper is the 0.1 version, which was mentioned in https://arxiv.org/abs/2205.13760. At the time this paper was submitted, such 1.0 version was not published yet, so we only tested on the older version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants