New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluation on NLP tasks and training time #36

Open

KebinWu opened this issue Sep 30, 2024 · 1 comment

KebinWu commented Sep 30, 2024

Thanks for the nice work. I would appreciate your kind answers on the following two questions.

how long does it take to finish the whole training (three stages)? and what's the training time for each stage?
Since you are also adding RefinedWeb to the model training, do you also have the evaluation on NLP tasks and then compare it with the Phi-1.5 model? I guess there will be some performance drops, but just wonder how much the decrease can be.

Looking forward to your reply, thank you.

Collaborator

Sierkinhane commented Oct 1, 2024

Hi, it takes around three weeks. As we focus on multimodal understanding and generation, we haven't evaluated Show-o on NLP tasks. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment