Code Generation on WikiSQL

Metric: Execution Accuracy (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Execution Accuracy▼	Extra Data	Paper	Date↕	Code
1	NL2SQL-RULE	89.2	No	Content Enhanced BERT-based Text-to-SQL Generation	2019-10-16	Code
2	TypeSQL+TC (Yu et al., 2018)+	82.6	No	TypeSQL: Knowledge-based Type-Aware Neural Text-...	2018-04-25	Code
3	Tranx	78.6	No	TRANX: A Transition-based Neural Abstract Syntax...	2018-10-05	Code
4	STAMP+RL (Sun et al., 2018)+	74.6	No	Semantic Parsing with Syntax- and Table-Aware SQ...	2018-04-23	-
5	STAMP (Sun et al., 2018)+	74.4	No	Semantic Parsing with Syntax- and Table-Aware SQ...	2018-04-23	-
6	TypeSQL (Yu et al., 2018)	73.5	No	TypeSQL: Knowledge-based Type-Aware Neural Text-...	2018-04-25	Code
7	PT-MAML (Huang et al., 2018)	68	No	Natural Language to Structured Query Generation ...	2018-03-02	Code
8	Bidirectional Attention for SQL Generation	62.5	No	Bidirectional Attention for SQL Generation	2017-12-30	Code
9	Seq2SQL (Zhong et al., 2017)	59.4	No	Seq2SQL: Generating Structured Queries from Natu...	2017-08-31	Code
10	Seq2Seq (Zhong et al., 2017)	35.9	No	Seq2SQL: Generating Structured Queries from Natu...	2017-08-31	Code

#1NL2SQL-RULESOTA
89.2
Execution Accuracy· 2019-10-16
Content Enhanced BERT-based Text-to-SQL Generation Code
#2TypeSQL+TC (Yu et al., 2018)+SOTA
82.6
Execution Accuracy· 2018-04-25
TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation Code
#3Tranx
78.6
Execution Accuracy· 2018-10-05
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation Code
#4STAMP+RL (Sun et al., 2018)+SOTA
74.6
Execution Accuracy· 2018-04-23
Semantic Parsing with Syntax- and Table-Aware SQL Generation
#5STAMP (Sun et al., 2018)+
74.4
Execution Accuracy· 2018-04-23
Semantic Parsing with Syntax- and Table-Aware SQL Generation
#6TypeSQL (Yu et al., 2018)
73.5
Execution Accuracy· 2018-04-25
TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation Code
#7PT-MAML (Huang et al., 2018)SOTA
68
Execution Accuracy· 2018-03-02
Natural Language to Structured Query Generation via Meta-Learning Code
#8Bidirectional Attention for SQL GenerationSOTA
62.5
Execution Accuracy· 2017-12-30
Bidirectional Attention for SQL Generation Code
#9Seq2SQL (Zhong et al., 2017)SOTA
59.4
Execution Accuracy· 2017-08-31
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning Code
#10Seq2Seq (Zhong et al., 2017)
35.9
Execution Accuracy· 2017-08-31
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning Code