DELLM + MAC-SQL

Reported on 2 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Semantic ParsingonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
Execution Accuracy % (Dev)· 2024-02-18
48.92
best: 74.32 (DSAIR + GPT-4o)
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM arXiv:2402.11517
Text-To-SQLonBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)
Execution Accuracy % (Dev)· 2024-02-18
48.92
best: 74.32 (DSAIR + GPT-4o)
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM arXiv:2402.11517