Metric: Validation perplexity (lower is better)
| # | Model↕ | Validation perplexity▲ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GAL 120B | 3.14 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 2 | GAL 30B | 4.28 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 3 | GAL 6.7B | 7.76 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 4 | GAL 1.3B | 12.53 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 5 | GAL 125M | 16.35 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |