TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/XiYan-SQL

XiYan-SQL

Reported on 8 benchmarks across 2 tasks · 1 paper · 8 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Semantic Parsingonspider
    Execution Accuracy (Test)· 2024-11-13
    89.65
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Semantic ParsingonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Dev)· 2024-11-13
    73.34
    best: 74.32 (DSAIR + GPT-4o)
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Semantic ParsingonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Test)· 2024-11-13
    75.63
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Semantic ParsingonSQL-Eval
    Execution Accuracy· 2024-11-13
    69.86
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Text-To-SQLonspider
    Execution Accuracy (Test)· 2024-11-13
    89.65
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Text-To-SQLonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Dev)· 2024-11-13
    73.34
    best: 74.32 (DSAIR + GPT-4o)
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Text-To-SQLonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
    Execution Accuracy % (Test)· 2024-11-13
    75.63
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599
  • Text-To-SQLonSQL-Eval
    Execution Accuracy· 2024-11-13
    69.86
    SOTA
    A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQLarXiv:2411.08599