Mathematical Reasoning on Math23K

Metric: Accuracy (5-fold) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Accuracy (5-fold)▼	Extra Data	Paper	Date↕	Code
1	GPT-4 (Teaching-Inspired)	94.3	No	Teaching-Inspired Integrated Prompting Framework...	2024-10-10	Code
2	Multi-view* (ours)	85.2	Yes	Multi-View Reasoning: Consistent Contrastive Lea...	2022-10-21	Code
3	Generate and Rank	84.3	No	Generate & Rank: A Multi-task Framework for Math...	2021-09-07	-
4	Exp-Tree	84.1	No	An Expression Tree Decoding Strategy for Mathema...	2023-10-14	Code
5	REAL2: Memory-augmented Solver	83.18	No	-	-	-
6	Roberta-DeductReasoner	83	No	Learning to Reason Deductively: Math Word Proble...	2022-03-19	Code
7	MWP-BERT	82.4	No	MWP-BERT: Numeracy-Augmented Pre-training for Ma...	2021-07-28	Code
8	Recall and Learn	80.8	No	Recall and Learn: A Memory-augmented Solver for ...	2021-09-27	Code
9	RoBERTaGen	76.6	No	MWPToolkit: An Open-Source Framework for Deep Le...	2021-09-02	Code
10	GTS w/ Data Augmentation	75.9	No	-	-	-
11	Graph2Tree	75.5	No	-	-	Code
12	SAU-Solver	74.84	No	Semantically-Aligned Universal Tree-Structured S...	2020-10-14	Code
13	GTS	74.3	No	-	-	Code
14	GROUP-ATT	66.9	No	-	-	Code
15	Hybrid model w/ SNI	64.7	No	-	-	-

#1GPT-4 (Teaching-Inspired)SOTA
94.3
Accuracy (5-fold)· 2024-10-10
Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models Code
#2Multi-view* (ours)SOTA
85.2
Accuracy (5-fold)· Extra Data· 2022-10-21
Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem Code
#3Generate and RankSOTA
84.3
Accuracy (5-fold)· 2021-09-07
Generate & Rank: A Multi-task Framework for Math Word Problems
#4Exp-Tree
84.1
Accuracy (5-fold)· 2023-10-14
An Expression Tree Decoding Strategy for Mathematical Equation Generation Code
#5REAL2: Memory-augmented Solver
83.18
Accuracy (5-fold)
No paper
#6Roberta-DeductReasoner
83
Accuracy (5-fold)· 2022-03-19
Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction Code
#7MWP-BERTSOTA
82.4
Accuracy (5-fold)· 2021-07-28
MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving Code
#8Recall and Learn
80.8
Accuracy (5-fold)· 2021-09-27
Recall and Learn: A Memory-augmented Solver for Math Word Problems Code
#9RoBERTaGen
76.6
Accuracy (5-fold)· 2021-09-02
MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers Code
#10GTS w/ Data Augmentation
75.9
Accuracy (5-fold)
No paper
#11Graph2Tree
75.5
Accuracy (5-fold)
No paperCode
#12SAU-SolverSOTA
74.84
Accuracy (5-fold)· 2020-10-14
Semantically-Aligned Universal Tree-Structured Solver for Math Word Problems Code
#13GTS
74.3
Accuracy (5-fold)
No paperCode
#14GROUP-ATT
66.9
Accuracy (5-fold)
No paperCode
#15Hybrid model w/ SNI
64.7
Accuracy (5-fold)
No paper