Text-To-SQL on spider

Metric: Exact Match Accuracy (Test) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Exact Match Accuracy (Test)▼	Extra Data	Paper	Date↕	Code
1	T5-SR	72.4	No	T5-SR: A Unified Seq-to-Seq Decoding Strategy fo...	2023-06-14	Code
2	RESDSQL-3B + NatSQL	72	No	RESDSQL: Decoupling Schema Linking and Skeleton ...	2023-02-12	Code
3	T5-3B + PICARD	71.9	No	PICARD: Parsing Incrementally for Constrained Au...	2021-09-10	Code
4	SADGA + GAP	70.1	No	SADGA: Structure-Aware Dual Graph Aggregation Ne...	2021-11-01	Code
5	PET-SQL	66.6	No	PET-SQL: A Prompt-Enhanced Two-Round Refinement ...	2024-03-13	Code
6	DIN-SQL + GPT-4	60	No	DIN-SQL: Decomposed In-Context Learning of Text-...	2023-04-21	Code
7	RYANSQL (BERT)	58.2	No	RYANSQL: Recursively Applying Sketch-based Slot ...	2020-04-07	Code

#1T5-SRSOTA
72.4
Exact Match Accuracy (Test)· 2023-06-14
T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing Code
#2RESDSQL-3B + NatSQLSOTA
72
Exact Match Accuracy (Test)· 2023-02-12
RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL Code
#3T5-3B + PICARDSOTA
71.9
Exact Match Accuracy (Test)· 2021-09-10
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models Code
#4SADGA + GAP
70.1
Exact Match Accuracy (Test)· 2021-11-01
SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL Code
#5PET-SQL
66.6
Exact Match Accuracy (Test)· 2024-03-13
PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency Code
#6DIN-SQL + GPT-4
60
Exact Match Accuracy (Test)· 2023-04-21
DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction Code
#7RYANSQL (BERT)SOTA
58.2
Exact Match Accuracy (Test)· 2020-04-07
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases Code