Metric: Validation perplexity (lower is better)
| # | Model↕ | Validation perplexity▲ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GAL 120B | 5.54 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 2 | GAL 30B | 8.23 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 3 | GAL 6.7B | 11.58 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 4 | GAL 1.3B | 15.82 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |
| 5 | GAL 125M | 19.05 | No | Galactica: A Large Language Model for Science | 2022-11-16 | Code |