TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/DIN-SQL + GPT-4

DIN-SQL + GPT-4

Reported on 8 benchmarks across 2 tasks · 1 paper · 6 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Semantic Parsingonspider
    Execution Accuracy (Test)· 2023-04-21
    85.3
    best: 89.65 (XiYan-SQL)
    SOTA
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Semantic ParsingonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Dev)· 2023-04-21
    50.72
    best: 74.32 (DSAIR + GPT-4o)
    SOTA
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Semantic ParsingonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Test)· 2023-04-21
    55.9
    best: 75.63 (XiYan-SQL)
    SOTA
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Text-To-SQLonspider
    Execution Accuracy (Test)· 2023-04-21
    85.3
    best: 89.65 (XiYan-SQL)
    SOTA
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Text-To-SQLonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Dev)· 2023-04-21
    50.72
    best: 74.32 (DSAIR + GPT-4o)
    SOTA
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Text-To-SQLonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Test)· 2023-04-21
    55.9
    best: 75.63 (XiYan-SQL)
    SOTA
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Semantic Parsingonspider
    Exact Match Accuracy (Test)· 2023-04-21
    60
    best: 72.4 (T5-SR)
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015
  • Text-To-SQLonspider
    Exact Match Accuracy (Test)· 2023-04-21
    60
    best: 72.4 (T5-SR)
    DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionarXiv:2304.11015