New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问hf格式的llama模型有公开的测试代码吗 #25

Open

WUHU-G opened this issue Jun 16, 2023 · 4 comments

WUHU-G commented Jun 16, 2023

No description provided.

Contributor

jxhe commented Jul 3, 2023

目前我们在将ceval集成到 lm-evaluation-harness 中，敬请期待。

ylwangy commented Jul 9, 2023

目前我们在将ceval集成到 lm-evaluation-harness 中，敬请期待。

请问预计什么时候呢？谢谢！

Contributor

jxhe commented Jul 13, 2023

我们已经在lm-evaluation-harness中发起了PR，正在等待merge: EleutherAI/lm-evaluation-harness#664

Collaborator

HYZ17 commented Jul 14, 2023 •

edited

Loading

目前我们在将ceval集成到 lm-evaluation-harness 中，敬请期待。

请问预计什么时候呢？谢谢！

已经完成merge！参考：https://github.com/EleutherAI/lm-evaluation-harness/blob/master/docs/task_table.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment