Metric: Accuracy (higher is better)
| # | Model↕ | Accuracy▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | RESDSQL-3B + NatSQL | 84.1 | No | RESDSQL: Decoupling Schema Linking and Skeleton ... | 2023-02-12 | Code |
| 2 | code-davinci-002 175B (LEVER) | 81.9 | No | LEVER: Learning to Verify Language-to-Code Gener... | 2023-02-16 | Code |
| 3 | RASAT+PICARD | 75.5 | No | RASAT: Integrating Relational Structures into Pr... | 2022-05-14 | Code |
| 4 | Graphix-3B + PICARD | 74 | No | Graphix-T5: Mixing Pre-Trained Transformers with... | 2023-01-18 | Code |
| 5 | T5-3B + PICARD | 71.9 | No | PICARD: Parsing Incrementally for Constrained Au... | 2021-09-10 | Code |
| 6 | SADGA + GAP | 70.1 | No | SADGA: Structure-Aware Dual Graph Aggregation Ne... | 2021-11-01 | Code |
| 7 | RATSQL + GAP | 69.7 | No | Learning Contextual Representations for Semantic... | 2020-12-18 | Code |
| 8 | RATSQL + Grammar-Augmented Pre-Training | 69.6 | No | GraPPa: Grammar-Augmented Pre-Training for Table... | 2020-09-29 | Code |
| 9 | RATSQL + BERT | 65.6 | No | RAT-SQL: Relation-Aware Schema Encoding and Link... | 2019-11-10 | Code |
| 10 | Exact Set Matching | 19.7 | No | Spider: A Large-Scale Human-Labeled Dataset for ... | 2018-09-24 | Code |