Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
jeinlee1991 committed Mar 23, 2024
1 parent b58034f commit 11f27a6
Showing 1 changed file with 32 additions and 27 deletions.
59 changes: 32 additions & 27 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -166,19 +166,23 @@
| 类别 | 大模型 | 分类能力 | 信息抽取能力 | 阅读理解能力 | 表格问答 | 总分 | 排名 |
|----|----------------------------|------|--------|--------|------|------|----|
| 开源 | internlm2-chat-7b | 86 | 81 | 72.7 | 82.7 | 80.6 | 1 |
| 开源 | Baichuan2-7B-Chat | 88 | 76 | 83.3 | 69 | 79.1 | 2 |
| 开源 | openbuddy-zephyr-7b | 82 | 83 | 74.0 | 72 | 77.8 | 3 |
| 开源 | BlueLM-7B-Chat | 82 | 83 | 74.0 | 72 | 77.8 | 4 |
| 开源 | Baichuan2-7B-Chat | 88 | 76 | 83.3 | 69.0 | 79.1 | 2 |
| 开源 | BlueLM-7B-Chat | 82 | 83 | 74.0 | 72.0 | 77.8 | 3 |
| 开源 | openbuddy-zephyr-7b | 82 | 83 | 74.0 | 72.0 | 77.8 | 4 |
| 开源 | Qwen1.5-7B-Chat | 80 | 76 | 76.0 | 70.7 | 75.7 | 5 |
| 开源 | openbuddy-mistral-7b-v13.1 | 79 | 72 | 73.3 | 76 | 75.1 | 6 |
| 开源 | Qwen-7B-Chat | 89 | 72 | 74.0 | 59 | 73.5 | 7 |
| 开源 | chatglm3-6b | 82 | 68 | 78.7 | 60 | 72.2 | 8 |
| 开源 | Qwen1.5-4B-Chat | 75 | 65 | 79.3 | 63.0 | 70.6 | 9 |
| 开源 | Yi-6B-Chat | 73 | 71 | 66.0 | 64.7 | 68.7 | 10 |
| 开源 | Qwen-1_8B-Chat | 73 | 66 | 75.3 | 51.3 | 66.4 | 11 |
| 开源 | openbuddy-openllama-3b-v10 | 64 | 60 | 61.3 | 40.7 | 56.5 | 12 |
| 开源 | Qwen1.5-1.8B-Chat | 57 | 58 | 52.7 | 48.0 | 53.9 | 13 |
| 开源 | Qwen1.5-0.5B-Chat | 44 | 40 | 60.0 | 34.7 | 44.7 | 14 |
| 开源 | 谷歌gemma-7b-it(new) | 72 | 79 | 74.0 | 76.0 | 75.3 | 6 |
| 开源 | openbuddy-mistral-7b-v13.1 | 79 | 72 | 73.3 | 76.0 | 75.1 | 7 |
| 开源 | MiniCPM-2B-dpo(new) | 79 | 77 | 74.0 | 66.0 | 74.0 | 8 |
| 开源 | Qwen-7B-Chat | 89 | 72 | 74.0 | 59.0 | 73.5 | 9 |
| 开源 | chatglm3-6b | 82 | 68 | 78.7 | 60.0 | 72.2 | 10 |
| 开源 | Qwen1.5-4B-Chat | 75 | 65 | 79.3 | 63.0 | 70.6 | 11 |
| 开源 | miniCPM-2B-sft(new) | 72 | 72 | 77.3 | 53.3 | 68.7 | 12 |
| 开源 | Yi-6B-Chat | 73 | 71 | 66.0 | 64.7 | 68.7 | 13 |
| 开源 | Qwen-1_8B-Chat | 73 | 66 | 75.3 | 51.3 | 66.4 | 14 |
| 开源 | openbuddy-openllama-3b-v10 | 64 | 60 | 61.3 | 40.7 | 56.5 | 15 |
| 开源 | 谷歌gemma-2b-it(new) | 56 | 60 | 60.0 | 43.3 | 54.8 | 16 |
| 开源 | Qwen1.5-1.8B-Chat | 57 | 58 | 52.7 | 48.0 | 53.9 | 17 |
| 开源 | Qwen1.5-0.5B-Chat | 44 | 40 | 60.0 | 34.7 | 44.7 | 18 |

<br><br>

Expand All @@ -199,21 +203,22 @@
<br><br>

#### (3) 30B以上大模型排行榜
| 类别 | 大模型 | 分类能力 | 信息抽取能力 | 阅读理解能力 | 表格问答 | 总分 | 排名 |
|----|------------------------------|------|--------|--------|------|---------|----|
| 开源 | Qwen-72B-Chat | 89 | 80 | 92.7 | 87.3 | 87.3 | 1 |
| 开源 | Qwen1.5-72B-Chat | 89 | 84 | 88.0 | 87.3 | 87.1 | 2 |
| 开源 | deepseek-llm-67b-chat | 87 | 81 | 86.7 | 92.0 | 86.7 | 3 |
| 开源 | tigerbot-70b-chat-v2 | 97 | 84 | 80.0 | 85 | 86.5 | 4 |
| 开源 | openbuddy-deepseek-67b | 86 | 89 | 84.7 | 85 | 86.2 | 5 |
| 开源 | XVERSE-65B-Chat | 83 | 84 | 84.0 | 89 | 85.0 | 6 |
| 开源 | tigerbot-70b-chat-v3 | 94 | 85 | 84.0 | 71 | 83.5 | 7 |
| 开源 | openbuddy-llama2-70b-v10.1 | 86 | 84 | 86.7 | 76 | 83.2 | 8 |
| 开源 | Yi-34B-Chat | 88 | 82 | 84.7 | 77 | 82.9 | 9 |
| 开源 | aquilachat2-34b | 77 | 82 | 88.0 | 83 | 82.5 | 10 |
| 开源 | openbuddy-mixtral-7bx8-v17.1 | 86 | 73 | 86.0 | 82.0 | 81.8 | 11 |
| 开源 | openbuddy-llama-65b-v8 | 68 | 84 | 79.3 | 76 | 76.8 | 12 |
| 开源 | Llama-2-70b-chat | 86 | 66 | 73.3 | 69 | 73.6|13 | |
| 类别 | 大模型 | 分类能力 | 信息抽取能力 | 阅读理解能力 | 表格问答 | 总分 | 排名 |
|----|------------------------------|------|--------|--------|------|------|----|
| 开源 | Qwen-72B-Chat | 89 | 80 | 92.7 | 87.3 | 87.3 | 1 |
| 开源 | Qwen1.5-72B-Chat | 89 | 84 | 88.0 | 87.3 | 87.1 | 2 |
| 开源 | AquilaChat2-70B-Expr(new) | 82 | 84 | 92.0 | 89.3 | 86.8 | 3 |
| 开源 | deepseek-llm-67b-chat | 87 | 81 | 86.7 | 92.0 | 86.7 | 4 |
| 开源 | tigerbot-70b-chat-v2 | 97 | 84 | 80.0 | 85.0 | 86.5 | 5 |
| 开源 | openbuddy-deepseek-67b | 86 | 89 | 84.7 | 85.0 | 86.2 | 6 |
| 开源 | XVERSE-65B-Chat | 83 | 84 | 84.0 | 89.0 | 85.0 | 7 |
| 开源 | tigerbot-70b-chat-v3 | 94 | 85 | 84.0 | 71.0 | 83.5 | 8 |
| 开源 | openbuddy-llama2-70b-v10.1 | 86 | 84 | 86.7 | 76.0 | 83.2 | 9 |
| 开源 | Yi-34B-Chat | 88 | 82 | 84.7 | 77.0 | 82.9 | 10 |
| 开源 | aquilachat2-34b | 77 | 82 | 88.0 | 83.0 | 82.5 | 11 |
| 开源 | openbuddy-mixtral-7bx8-v17.1 | 86 | 73 | 86.0 | 82.0 | 81.8 | 12 |
| 开源 | openbuddy-llama-65b-v8 | 68 | 84 | 79.3 | 76.0 | 76.8 | 13 |
| 开源 | Llama-2-70b-chat | 86 | 66 | 73.3 | 69.0 | 73.6 | 14 |

<br><br>

Expand Down

0 comments on commit 11f27a6

Please sign in to comment.