datagpt-sql-7B

Reported on 4 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Semantic Parsingonspider
Exact Match Accuracy (Dev)· uses extra data· 2024-09-24
80.3
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL arXiv:2409.15985
Semantic Parsingonspider
Execution Accuracy (Dev)· uses extra data· 2024-09-24
84.8
best: 87.2 (datagpt-sql-7B + InvalidSQL-Feedback)
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL arXiv:2409.15985
Text-To-SQLonspider
Exact Match Accuracy (Dev)· uses extra data· 2024-09-24
80.3
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL arXiv:2409.15985
Text-To-SQLonspider
Execution Accuracy (Dev)· uses extra data· 2024-09-24
84.8
best: 87.2 (datagpt-sql-7B + InvalidSQL-Feedback)
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL arXiv:2409.15985