Table-based Fact Verification on TabFact

Metric: Test (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Test▼	Extra Data	Paper	Date↕	Code
1	ARTEMIS-DA	93.1	No	ARTEMIS-DA: An Advanced Reasoning and Transforma...	2024-12-18	-
2	Dater	93	No	Large Language Models are Versatile Decomposers:...	2023-01-31	Code
3	PASTA	89.3	No	PASTA: Table-Operations Aware Fact Verification ...	2022-11-05	Code
4	Chain-of-Table	86.61	No	Chain-of-Table: Evolving Tables in the Reasoning...	2024-01-09	Code
5	Binder	86	No	Binding Language Models in Symbolic Languages	2022-10-06	Code
6	Tab-PoT	85.77	No	Efficient Prompting for LLM-based Generative Int...	2024-06-14	-
7	ReasTAP-Large	84.9	No	ReasTAP: Injecting Table Reasoning Skills During...	2022-10-22	Code
8	TAPEX-Large	84.2	No	TAPEX: Table Pre-training via Learning a Neural ...	2021-07-16	Code
9	T5-3b(UnifiedSKG)	83.68	No	UnifiedSKG: Unifying and Multi-Tasking Structure...	2022-01-16	Code
10	Salience-aware TAPAS	82.1	No	Table-based Fact Verification with Salience-awar...	2021-09-09	Code
11	TAPAS-Large classifier with Counterfactual + Synthetic pre-training	81	No	Understanding tables with intermediate pre-train...	2020-10-01	Code
12	TabSQLify (col+row)	79.5	No	TabSQLify: Enhancing Reasoning Capabilities of L...	2024-04-15	Code
13	NormTab (Targeted) + SQL	68.9	No	NormTab: Improving Symbolic Reasoning in LLMs Th...	2024-06-25	Code
14	Table-BERT-Horizontal-T+F-Template	65.12	No	TabFact: A Large-scale Dataset for Table-based F...	2019-09-05	Code
15	BERT classifier w/o Table	50.5	No	TabFact: A Large-scale Dataset for Table-based F...	2019-09-05	Code

#1ARTEMIS-DASOTA
93.1
Test· 2024-12-18
ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics
#2DaterSOTA
93
Test· 2023-01-31
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning Code
#3PASTASOTA
89.3
Test· 2022-11-05
PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training Code
#4Chain-of-Table
86.61
Test· 2024-01-09
Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding Code
#5BinderSOTA
86
Test· 2022-10-06
Binding Language Models in Symbolic Languages Code
#6Tab-PoT
85.77
Test· 2024-06-14
Efficient Prompting for LLM-based Generative Internet of Things
#7ReasTAP-Large
84.9
Test· 2022-10-22
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples Code
#8TAPEX-LargeSOTA
84.2
Test· 2021-07-16
TAPEX: Table Pre-training via Learning a Neural SQL Executor Code
#9T5-3b(UnifiedSKG)
83.68
Test· 2022-01-16
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Code
#10Salience-aware TAPAS
82.1
Test· 2021-09-09
Table-based Fact Verification with Salience-aware Learning Code
#11TAPAS-Large classifier with Counterfactual + Synthetic pre-trainingSOTA
81
Test· 2020-10-01
Understanding tables with intermediate pre-training Code
#12TabSQLify (col+row)
79.5
Test· 2024-04-15
TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition Code
#13NormTab (Targeted) + SQL
68.9
Test· 2024-06-25
NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization Code
#14Table-BERT-Horizontal-T+F-TemplateSOTA
65.12
Test· 2019-09-05
TabFact: A Large-scale Dataset for Table-based Fact Verification Code
#15BERT classifier w/o Table
50.5
Test· 2019-09-05
TabFact: A Large-scale Dataset for Table-based Fact Verification Code