Skip to content

Issues: mlcommons/modelbench

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

fix scoring bug
#730 opened Dec 5, 2024 by wpietri
post-launch static content updates
#726 opened Dec 3, 2024 by wpietri
Upgrade huggingface sdk
#724 opened Dec 2, 2024 by rogthefrog
annotator postmortem
#723 opened Dec 2, 2024 by wpietri
milestone: 1.0! milestone A goal that other cards add up to
#721 opened Nov 30, 2024 by wpietri
Pacify the smoke tests
#716 opened Nov 26, 2024 by rogthefrog
Solve thread hang issue
#715 opened Nov 26, 2024 by wpietri
New new grading function
#709 opened Nov 22, 2024 by rogthefrog
Peter's emergency Mistral run
#708 opened Nov 22, 2024 by wpietri
Update bands with Kurt's newest code
#704 opened Nov 21, 2024 by rogthefrog
Include NVIDIA SUTs in benchmark
#692 opened Nov 18, 2024 by wpietri
Add more checks to consistency checker
#689 opened Nov 14, 2024 by bkorycki
productionize gpt SUT
#687 opened Nov 14, 2024 by wpietri
Add Microsoft Phi 3.5 MoE
#678 opened Nov 12, 2024 by wpietri
Add Microsoft Phi 3.5 mini
#677 opened Nov 12, 2024 by wpietri
Make official Llama SUT
#676 opened Nov 12, 2024 by wpietri
Add proper anthropic SUT
#675 opened Nov 12, 2024 by wpietri
Update ensemble join method
#667 opened Nov 4, 2024 by bkorycki
operational improvements, round 3
#665 opened Nov 1, 2024 by wpietri
ProTip! Exclude everything labeled bug with -label:bug.