Semantic Parsing on WikiTableQuestions

Metric: Accuracy (Dev) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Accuracy (Dev)▼	Extra Data	Paper	Date↕	Code
1	Binder	65	No	Binding Language Models in Symbolic Languages	2022-10-06	Code
2	Dater	64.8	No	Large Language Models are Versatile Decomposers:...	2023-01-31	Code
3	LEVER	64.6	No	LEVER: Learning to Verify Language-to-Code Gener...	2023-02-16	Code
4	OmniTab-Large	62.5	No	OmniTab: Pretraining with Natural and Synthetic ...	2022-07-08	Code
5	ReasTAP-Large	59.7	No	ReasTAP: Injecting Table Reasoning Skills During...	2022-10-22	Code
6	TAPEX-Large	57	No	TAPEX: Table Pre-training via Learning a Neural ...	2021-07-16	Code
7	MAPO + TABERTLarge (K = 3)	52.2	No	TaBERT: Pretraining for Joint Understanding of T...	2020-05-17	Code
8	T5-3b(UnifiedSKG)	50.65	No	UnifiedSKG: Unifying and Multi-Tasking Structure...	2022-01-16	Code
9	Structured Attention	43.7	No	Learning Semantic Parsers from Denotations with ...	2019-09-09	Code

#1BinderSOTA
65
Accuracy (Dev)· 2022-10-06
Binding Language Models in Symbolic Languages Code
#2Dater
64.8
Accuracy (Dev)· 2023-01-31
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning Code
#3LEVER
64.6
Accuracy (Dev)· 2023-02-16
LEVER: Learning to Verify Language-to-Code Generation with Execution Code
#4OmniTab-LargeSOTA
62.5
Accuracy (Dev)· 2022-07-08
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering Code
#5ReasTAP-Large
59.7
Accuracy (Dev)· 2022-10-22
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples Code
#6TAPEX-LargeSOTA
57
Accuracy (Dev)· 2021-07-16
TAPEX: Table Pre-training via Learning a Neural SQL Executor Code
#7MAPO + TABERTLarge (K = 3)SOTA
52.2
Accuracy (Dev)· 2020-05-17
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data Code
#8T5-3b(UnifiedSKG)
50.65
Accuracy (Dev)· 2022-01-16
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Code
#9Structured AttentionSOTA
43.7
Accuracy (Dev)· 2019-09-09
Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs Code