TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/EPT

EPT

Reported on 12 benchmarks across 4 tasks

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base12 results

  • Mathematical Question AnsweringonMAWPS
    Accuracy (%)
    88.7
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Mathematical Question AnsweringonMAWPS
    Accuracy (%)
    84.51
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Mathematical Question AnsweringonALG514
    Accuracy (%)
    81.31
    best: 83 (MixedSP)
  • Mathematical Question AnsweringonALG514
    Accuracy (%)
    73.91
    best: 83 (MixedSP)
  • Mathematical Question AnsweringonDRAW-1K
    Accuracy (%)
    63.5
  • Mathematical Question AnsweringonDRAW-1K
    Accuracy (%)
    59.5
    best: 63.5
  • Mathematical ReasoningonMAWPS
    Accuracy (%)
    88.7
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Mathematical ReasoningonMAWPS
    Accuracy (%)
    84.51
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Mathematical ReasoningonALG514
    Accuracy (%)
    81.31
    best: 83 (MixedSP)
  • Mathematical ReasoningonALG514
    Accuracy (%)
    73.91
    best: 83 (MixedSP)
  • Mathematical ReasoningonDRAW-1K
    Accuracy (%)
    63.5
  • Mathematical ReasoningonDRAW-1K
    Accuracy (%)
    59.5
    best: 63.5

Natural Language Processing6 results

  • Question AnsweringonMAWPS
    Accuracy (%)
    88.7
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Question AnsweringonMAWPS
    Accuracy (%)
    84.51
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Question AnsweringonALG514
    Accuracy (%)
    81.31
    best: 83 (MixedSP)
  • Question AnsweringonALG514
    Accuracy (%)
    73.91
    best: 83 (MixedSP)
  • Question AnsweringonDRAW-1K
    Accuracy (%)
    63.5
  • Question AnsweringonDRAW-1K
    Accuracy (%)
    59.5
    best: 63.5

Reasoning6 results

  • Math Word Problem SolvingonMAWPS
    Accuracy (%)
    88.7
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Math Word Problem SolvingonMAWPS
    Accuracy (%)
    84.51
    best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
  • Math Word Problem SolvingonALG514
    Accuracy (%)
    81.31
    best: 83 (MixedSP)
  • Math Word Problem SolvingonALG514
    Accuracy (%)
    73.91
    best: 83 (MixedSP)
  • Math Word Problem SolvingonDRAW-1K
    Accuracy (%)
    63.5
  • Math Word Problem SolvingonDRAW-1K
    Accuracy (%)
    59.5
    best: 63.5