Text-To-SQL on SPIDER

Metric: Execution Accuracy (in Dev) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Execution Accuracy (in Dev)▼	Extra Data	Paper	Date↕	Code
1	RASAT+PICARD	80.5	No	RASAT: Integrating Relational Structures into Pr...	2022-05-14	Code
2	T5-3B+PICARD	79.3	No	PICARD: Parsing Incrementally for Constrained Au...	2021-09-10	Code
3	RASAT	76.6	No	RASAT: Integrating Relational Structures into Pr...	2022-05-14	Code
4	T5-3B	74.4	No	PICARD: Parsing Incrementally for Constrained Au...	2021-09-10	Code

#1RASAT+PICARDSOTA
80.5
Execution Accuracy (in Dev)· 2022-05-14
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL Code
#2T5-3B+PICARDSOTA
79.3
Execution Accuracy (in Dev)· 2021-09-10
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models Code
#3RASAT
76.6
Execution Accuracy (in Dev)· 2022-05-14
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL Code
#4T5-3B
74.4
Execution Accuracy (in Dev)· 2021-09-10
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models Code