RYANSQL (BERT)

Reported on 4 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Semantic Parsingonspider
Exact Match Accuracy (Dev)· 2020-04-07
66.6
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases arXiv:2004.03125
Semantic Parsingonspider
Exact Match Accuracy (Test)· 2020-04-07
58.2
best: 72.4 (T5-SR)
SOTA
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases arXiv:2004.03125
Text-To-SQLonspider
Exact Match Accuracy (Dev)· 2020-04-07
66.6
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases arXiv:2004.03125
Text-To-SQLonspider
Exact Match Accuracy (Test)· 2020-04-07
58.2
best: 72.4 (T5-SR)
SOTA
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases arXiv:2004.03125