Text-To-SQL on spider

Metric: Execution Accuracy (Test) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

#	Model↕	Execution Accuracy (Test)▼	Extra Data	Paper	Date↕	Code
1	XiYan-SQL	89.65	No	A Preview of XiYan-SQL: A Multi-Generator Ensemb...	2024-11-13	Code
2	PET-SQL	87.6	No	PET-SQL: A Prompt-Enhanced Two-Round Refinement ...	2024-03-13	Code
3	DAIL-SQL + GPT-4 + Self-Consistency	86.6	No	Text-to-SQL Empowered by Large Language Models: ...	2023-08-29	Code
4	DIN-SQL + GPT-4	85.3	No	DIN-SQL: Decomposed In-Context Learning of Text-...	2023-04-21	Code
5	MSc-SQL	84.7	No	MSc-SQL: Multi-Sample Critiquing Small Language ...	2024-10-16	Code
6	MARLO + Claude 2.1	84	No	Learning Metadata-Agnostic Representations for T...	2024-10-17	-
7	C3 + ChatGPT + Zero-Shot	82.3	No	C3: Zero-shot Text-to-SQL with ChatGPT	2023-07-14	Code
8	RESDSQL-3B + NatSQL	79.9	No	RESDSQL: Decoupling Schema Linking and Skeleton ...	2023-02-12	Code
9	T5-3B+NatSQL+Token Preprocessing	78	No	Improving Generalization in Language Model-Based...	2023-05-27	Code
10	Graphix-3B+PICARD	77.6	No	Graphix-T5: Mixing Pre-Trained Transformers with...	2023-01-18	Code
11	T5-SR	75.2	No	T5-SR: A Unified Seq-to-Seq Decoding Strategy fo...	2023-06-14	Code
12	T5-3B + PICARD	75.1	No	PICARD: Parsing Incrementally for Constrained Au...	2021-09-10	Code