Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Graphix-3B+PICARD

Graphix-3B+PICARD

Reported on 6 benchmarks across 2 tasks · 1 paper · 6 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing6 results

Semantic Parsingonspider
Exact Match Accuracy (Dev)· 2023-01-18
77.1
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing arXiv:2301.07507
Semantic Parsingonspider
Execution Accuracy (Dev)· 2023-01-18
81
best: 87.2 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing arXiv:2301.07507
Semantic Parsingonspider
Execution Accuracy (Test)· 2023-01-18
77.6
best: 89.65 (XiYan-SQL)
SOTA
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing arXiv:2301.07507
Text-To-SQLonspider
Exact Match Accuracy (Dev)· 2023-01-18
77.1
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing arXiv:2301.07507
Text-To-SQLonspider
Execution Accuracy (Dev)· 2023-01-18
81
best: 87.2 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing arXiv:2301.07507
Text-To-SQLonspider
Execution Accuracy (Test)· 2023-01-18
77.6
best: 89.65 (XiYan-SQL)
SOTA
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing arXiv:2301.07507