Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ZhihongShao authored Oct 11, 2023
1 parent 4d3ac8c commit a2406b9
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -59,9 +59,9 @@ ToRA is a series of Tool-integrated Reasoning Agents designed to solve challengi
| [<img src="./docs/static/images/tora_logo.png" width="16" alt="ToRA" /> ToRA-Code-13B](https://huggingface.co/llm-agents/tora-code-13b-v1.0) | 13B | 75.8 | 48.1 | 71.3 |
| ToRA-Code-13B + self-consistency (k=50) | 13B | 80.4 | 55.1 | - |
| [<img src="./docs/static/images/tora_logo.png" width="16" alt="ToRA" /> ToRA-Code-34B<sup>*</sup>](https://huggingface.co/llm-agents/tora-code-34b-v1.0) | 34B | 80.7 | **51.0** | 74.8 |
| ToRA-Code-34B + self-consistency (k=50) | 34B | 85.1 | **60.0** | - |
| ToRA-Code-34B + self-consistency (k=50) | 34B | 85.1 | <u>**60.0**</u> | - |
| [<img src="./docs/static/images/tora_logo.png" width="16" alt="ToRA" /> ToRA-70B](https://huggingface.co/llm-agents/tora-70b-v1.0) | 70B | **84.3** | 49.7 | **76.9** |
| ToRA-70B + self-consistency (k=50) | 70B | **88.3** | 56.9 | - |
| ToRA-70B + self-consistency (k=50) | 70B | <u>**88.3**</u> | 56.9 | - |

- <sup>*</sup>ToRA-Code-34B is currently the first and only open-source model to achieve over 50% accuracy (pass@1) on the MATH dataset, which significantly outperforms GPT-4’s CoT result (51.0 vs. 42.5), and is competitive with GPT-4 solving problems with programs. By open-sourcing our codes and models, we hope more breakthroughs will come!

Expand Down

0 comments on commit a2406b9

Please sign in to comment.