TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/DAIL-SQL + GPT-4 + Self-Consistency

DAIL-SQL + GPT-4 + Self-Consistency

Reported on 6 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing6 results

  • Semantic Parsingonspider
    Execution Accuracy (Dev)· 2023-08-29
    84.4
    best: 87.2 (datagpt-sql-7B + InvalidSQL-Feedback)
    SOTA
    Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationarXiv:2308.15363
  • Semantic Parsingonspider
    Execution Accuracy (Test)· 2023-08-29
    86.6
    best: 89.65 (XiYan-SQL)
    SOTA
    Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationarXiv:2308.15363
  • Text-To-SQLonspider
    Execution Accuracy (Dev)· 2023-08-29
    84.4
    best: 87.2 (datagpt-sql-7B + InvalidSQL-Feedback)
    SOTA
    Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationarXiv:2308.15363
  • Text-To-SQLonspider
    Execution Accuracy (Test)· 2023-08-29
    86.6
    best: 89.65 (XiYan-SQL)
    SOTA
    Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationarXiv:2308.15363
  • Semantic Parsingonspider
    Exact Match Accuracy (Dev)· 2023-08-29
    74.4
    best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
    Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationarXiv:2308.15363
  • Text-To-SQLonspider
    Exact Match Accuracy (Dev)· 2023-08-29
    74.4
    best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
    Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationarXiv:2308.15363