Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/ATHENA (roberta-large)

ATHENA (roberta-large)

Reported on 20 benchmarks across 4 tasks · 1 paper · 8 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base10 results

Mathematical Question AnsweringonSVAMP (1:N)
Execution Accuracy· 2023-11-02
67.8
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical Question AnsweringonASDiv-A
Execution Accuracy· 2023-11-02
91
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical ReasoningonSVAMP (1:N)
Execution Accuracy· 2023-11-02
67.8
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical ReasoningonASDiv-A
Execution Accuracy· 2023-11-02
91
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical Question AnsweringonMath23K
Accuracy (training-test)· 2023-11-02
86.5
best: 87.1 (Multi-view* (ours))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical Question AnsweringonMAWPS
Accuracy (%)· 2023-11-02
93
best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical Question AnsweringonSVAMP
Execution Accuracy· 2023-11-02
54.8
best: 93.9 (GPT-4 (Teaching-Inspired))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical ReasoningonMath23K
Accuracy (training-test)· 2023-11-02
86.5
best: 87.1 (Multi-view* (ours))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical ReasoningonMAWPS
Accuracy (%)· 2023-11-02
93
best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Mathematical ReasoningonSVAMP
Execution Accuracy· 2023-11-02
54.8
best: 93.9 (GPT-4 (Teaching-Inspired))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036

Natural Language Processing5 results

Question AnsweringonSVAMP (1:N)
Execution Accuracy· 2023-11-02
67.8
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Question AnsweringonASDiv-A
Execution Accuracy· 2023-11-02
91
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Question AnsweringonMath23K
Accuracy (training-test)· 2023-11-02
86.5
best: 87.1 (Multi-view* (ours))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Question AnsweringonMAWPS
Accuracy (%)· 2023-11-02
93
best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Question AnsweringonSVAMP
Execution Accuracy· 2023-11-02
54.8
best: 93.9 (GPT-4 (Teaching-Inspired))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036

Reasoning5 results

Math Word Problem SolvingonSVAMP (1:N)
Execution Accuracy· 2023-11-02
67.8
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Math Word Problem SolvingonASDiv-A
Execution Accuracy· 2023-11-02
91
SOTA
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Math Word Problem SolvingonMath23K
Accuracy (training-test)· 2023-11-02
86.5
best: 87.1 (Multi-view* (ours))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Math Word Problem SolvingonMAWPS
Accuracy (%)· 2023-11-02
93
best: 95.7 (OpenMath-CodeLlama-70B (w/ code))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036
Math Word Problem SolvingonSVAMP
Execution Accuracy· 2023-11-02
54.8
best: 93.9 (GPT-4 (Teaching-Inspired))
ATHENA: Mathematical Reasoning with Thought Expansion arXiv:2311.01036