TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Gopher (few-shot, k=5)

Gopher (few-shot, k=5)

Reported on 14 benchmarks across 1 task · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing14 results

  • Question AnsweringonMMLU (Econometrics)
    Accuracy· 2022-11-16
    43
    SOTA
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (Formal Logic)
    Accuracy· 2022-11-16
    35.7
    SOTA
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (College Biology)
    Accuracy· 2022-11-16
    70.8
    best: 95.8 (Med-PaLM 2 (ER))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (High School Computer Science)
    Accuracy· 2022-11-16
    54
    best: 70 (GAL 120B (zero-shot))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (College Chemistry)
    Accuracy· 2022-11-16
    45
    best: 51 (Chinchilla (few-shot, k=5))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (Astronomy)
    Accuracy· 2022-11-16
    65.8
    best: 73 (Chinchilla (few-shot, k=5))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (Electrical Engineer)
    Accuracy· 2022-11-16
    60
    best: 62.8 (GAL 120B (zero-shot))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (High School Biology)
    Accuracy· 2022-11-16
    71.3
    best: 80.3 (Chinchilla (few-shot, k=5))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (High School Mathematics)
    Accuracy· 2022-11-16
    23.7
    best: 32.6 (GAL 120B (zero-shot))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (Elementary Mathematics)
    Accuracy· 2022-11-16
    33.6
    best: 41.5 (Chinchilla (few-shot, k=5))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (Abstract Algebra)
    Accuracy· 2022-11-16
    25
    best: 33.3 (GAL 30B (zero-shot))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (High School Statistics)
    Accuracy· 2022-11-16
    50
    best: 58.8 (Chinchilla (few-shot, k=5))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (College Physics)
    Accuracy· 2022-11-16
    34.3
    best: 46.1 (Chinchilla (few-shot, k=5))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Question AnsweringonMMLU (College Mathematics)
    Accuracy· 2022-11-16
    37
    best: 43 (GAL 120B (zero-shot))
    Galactica: A Large Language Model for SciencearXiv:2211.09085