Metric: Execution Accuracy (Dev) (higher is better)
| # | Model↕ | Execution Accuracy (Dev)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | datagpt-sql-7B + InvalidSQL-Feedback | 87.2 | Yes | DataGpt-SQL-7B: An Open-Source Language Model fo... | 2024-09-24 | - |
| 2 | datagpt-sql-7B | 84.8 | Yes | DataGpt-SQL-7B: An Open-Source Language Model fo... | 2024-09-24 | - |
| 3 | DAIL-SQL + GPT-4 + Self-Consistency | 84.4 | No | Text-to-SQL Empowered by Large Language Models: ... | 2023-08-29 | Code |
| 4 | RESDSQL-3B + NatSQL | 84.1 | No | RESDSQL: Decoupling Schema Linking and Skeleton ... | 2023-02-12 | Code |
| 5 | MARLO + Claude 2.1 | 83.6 | No | Learning Metadata-Agnostic Representations for T... | 2024-10-17 | - |
| 6 | code-davinci-002 175B (LEVER) | 81.9 | No | LEVER: Learning to Verify Language-to-Code Gener... | 2023-02-16 | Code |
| 7 | C3 + ChatGPT + Zero-Shot | 81.8 | No | C3: Zero-shot Text-to-SQL with ChatGPT | 2023-07-14 | Code |
| 8 | Graphix-3B+PICARD | 81 | No | Graphix-T5: Mixing Pre-Trained Transformers with... | 2023-01-18 | Code |
| 9 | T5-3B+NatSQL+Token Preprocessing | 73.7 | No | Improving Generalization in Language Model-Based... | 2023-05-27 | Code |
| 10 | DELLM + GPT-4 | 71.68 | No | Knowledge-to-SQL: Enhancing SQL Generation with ... | 2024-02-18 | Code |