Metric: 8k (higher is better)
| # | Model↕ | 8k▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GPT-4-Turbo-0125 | 56.5 | No | GPT-4 Technical Report | 2023-03-15 | Code |
| 2 | GPT-4-Turbo-1106 | 53.5 | No | GPT-4 Technical Report | 2023-03-15 | Code |
| 3 | Claude-2 | 17 | No | - | - | - |
| 4 | GPT-3.5-Turbo-1106 | 17 | No | - | - | - |
| 5 | InternLM2-7b | 13.4 | No | InternLM2 Technical Report | 2024-03-26 | Code |
| 6 | ChatGLM3-6b-32k | 3.4 | No | GLM-130B: An Open Bilingual Pre-trained Model | 2022-10-05 | Code |
| 7 | Vicuna-13b-v1.5-16k | 2.2 | No | Judging LLM-as-a-Judge with MT-Bench and Chatbot... | 2023-06-09 | Code |
| 8 | LongChat-7b-v1.5-32k | 1.9 | No | Judging LLM-as-a-Judge with MT-Bench and Chatbot... | 2023-06-09 | Code |
| 9 | Vicuna-7b-v1.5-16k | 1.8 | No | Judging LLM-as-a-Judge with MT-Bench and Chatbot... | 2023-06-09 | Code |
| 10 | ChatGLM2-6b-32k | 1.6 | No | GLM-130B: An Open Bilingual Pre-trained Model | 2022-10-05 | Code |