RoBERTaGen

Reported on 4 benchmarks across 4 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base2 results

Mathematical Question AnsweringonMath23K
Accuracy (5-fold)· 2021-09-02
76.6
best: 94.3 (GPT-4 (Teaching-Inspired))
MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers arXiv:2109.00799
Mathematical ReasoningonMath23K
Accuracy (5-fold)· 2021-09-02
76.6
best: 94.3 (GPT-4 (Teaching-Inspired))
MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers arXiv:2109.00799

Natural Language Processing1 result

Question AnsweringonMath23K
Accuracy (5-fold)· 2021-09-02
76.6
best: 94.3 (GPT-4 (Teaching-Inspired))
MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers arXiv:2109.00799

Reasoning1 result

Math Word Problem SolvingonMath23K
Accuracy (5-fold)· 2021-09-02
76.6
best: 94.3 (GPT-4 (Teaching-Inspired))
MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers arXiv:2109.00799