Question Answering on Geometry3K

Metric: Accuracy (%) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Hide extra data

Sort:

#	Model↕	Accuracy (%)▼	Extra Data	Paper	Date↕	Code
1	Human Expert	90.9	No	Inter-GPS: Interpretable Geometry Problem Solvin...	2021-05-10	Code
2	Inter-GPS (GT)	78.3	No	Inter-GPS: Interpretable Geometry Problem Solvin...	2021-05-10	Code
3	PGDPNet	74.1	No	Plane Geometry Diagram Parsing	2022-05-19	Code
4	GOLD	69.1	No	GOLD: Geometry Problem Solver with Natural Langu...	2024-05-01	Code
5	GAPS	68	Yes	GAPS: Geometry-Aware Problem Solver	2024-01-29	-
6	Inter-GPS	57.5	No	Inter-GPS: Interpretable Geometry Problem Solvin...	2021-05-10	Code
7	Human	56.9	No	Inter-GPS: Interpretable Geometry Problem Solvin...	2021-05-10	Code
8	Random	25	No	Inter-GPS: Interpretable Geometry Problem Solvin...	2021-05-10	Code

#1Human ExpertSOTA
90.9
Accuracy (%)· 2021-05-10
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning Code
#2Inter-GPS (GT)
78.3
Accuracy (%)· 2021-05-10
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning Code
#3PGDPNet
74.1
Accuracy (%)· 2022-05-19
Plane Geometry Diagram Parsing Code
#4GOLD
69.1
Accuracy (%)· 2024-05-01
GOLD: Geometry Problem Solver with Natural Language Description Code
#5GAPS
68
Accuracy (%)· Extra Data· 2024-01-29
GAPS: Geometry-Aware Problem Solver
#6Inter-GPS
57.5
Accuracy (%)· 2021-05-10
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning Code
#7Human
56.9
Accuracy (%)· 2021-05-10
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning Code
#8Random
25
Accuracy (%)· 2021-05-10
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning Code