TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Question Answering/MMLU (Formal Logic)

Question Answering on MMLU (Formal Logic)

Metric: Accuracy (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕Accuracy▼Extra DataPaperDate↕Code
1Gopher (few-shot, k=5)35.7NoGalactica: A Large Language Model for Science2022-11-16Code
2Chinchilla (few-shot, k=5)33.3NoGalactica: A Large Language Model for Science2022-11-16Code
3GAL 120B (zero-shot)32.5NoGalactica: A Large Language Model for Science2022-11-16Code
4OPT (few-shot, k=5)29.4NoGalactica: A Large Language Model for Science2022-11-16Code
5BLOOM (few-shot, k=5)26.2NoGalactica: A Large Language Model for Science2022-11-16Code