Gopher (zero-shot)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Question AnsweringonSIQA
Accuracy· 2021-12-08
50.6
best: 83.2 (Unicorn 11B (fine-tuned))
Scaling Language Models: Methods, Analysis & Insights from Training Gopher arXiv:2112.11446
Question AnsweringonBoolQ
Accuracy· 2021-12-08
79.3
best: 99.87 (Mistral-Nemo 12B (HPT))
Scaling Language Models: Methods, Analysis & Insights from Training Gopher arXiv:2112.11446