Metric: Validation perplexity (lower is better)
| # | Model↕ | Validation perplexity▲ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GAL 120B | 17.26 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 2 | GAL 30B | 17.27 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 3 | GAL 6.7B | 17.29 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 4 | GAL 1.3B | 17.58 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 5 | GAL 125M | 20.62 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |