TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MathCoder-L-70B

MathCoder-L-70B

Reported on 6 benchmarks across 5 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning3 results

  • Math Word Problem SolvingonSVAMP
    Execution Accuracy· uses extra data· 2023-10-05
    84.9
    best: 93.9 (GPT-4 (Teaching-Inspired))
    MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731
  • Arithmetic ReasoningonGSM8K
    Accuracy· uses extra data· 2023-10-05
    83.9
    best: 97.72 (Claude 3.5 Sonnet (HPT))
    MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731
  • Arithmetic ReasoningonGSM8K
    Parameters (Billion)· uses extra data· 2023-10-05
    70
    best: 540 (PaLM 540B (Self Improvement, Self Consistency))
    MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731

Knowledge Base2 results

  • Mathematical Question AnsweringonSVAMP
    Execution Accuracy· uses extra data· 2023-10-05
    84.9
    best: 93.9 (GPT-4 (Teaching-Inspired))
    MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731
  • Mathematical ReasoningonSVAMP
    Execution Accuracy· uses extra data· 2023-10-05
    84.9
    best: 93.9 (GPT-4 (Teaching-Inspired))
    MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731

Natural Language Processing1 result

  • Question AnsweringonSVAMP
    Execution Accuracy· uses extra data· 2023-10-05
    84.9
    best: 93.9 (GPT-4 (Teaching-Inspired))
    MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731