Question Answering on MMLU (College Physics)
Metric: Accuracy (higher is better)
Metric: Accuracy (higher is better)
| # | Model↕ | Accuracy▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Chinchilla (few-shot, k=5) | 46.1 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 2 | GAL 120B (zero-shot) | 42.2 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 3 | Gopher (few-shot, k=5) | 34.3 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 4 | OPT (few-shot, k=5) | 21.6 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 5 | BLOOM (few-shot, k=5) | 18.6 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |