GPT-3 175B (1 shot)

Reported on 2 benchmarks across 1 task · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Common Sense ReasoningonARC (Challenge)
Accuracy· uses extra data· 2020-05-28
53.2
best: 96.4 (GPT-4 (few-shot, k=25))
SOTA
Language Models are Few-Shot Learners arXiv:2005.14165
Common Sense ReasoningonARC (Easy)
Accuracy· 2020-05-28
71.2
best: 95.2 (ST-MoE-32B 269B (fine-tuned))
SOTA
Language Models are Few-Shot Learners arXiv:2005.14165