Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/T5-3B + PICARD

T5-3B + PICARD

Reported on 9 benchmarks across 3 tasks · 1 paper · 9 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

Semantic Parsingonspider
Accuracy· 2021-09-10
71.9
best: 84.1 (RESDSQL-3B + NatSQL)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Semantic Parsingonspider
Exact Match Accuracy (Dev)· 2021-09-10
75.5
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Semantic Parsingonspider
Exact Match Accuracy (Test)· 2021-09-10
71.9
best: 72.4 (T5-SR)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Semantic Parsingonspider
Execution Accuracy (Test)· 2021-09-10
75.1
best: 89.65 (XiYan-SQL)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Text-To-SQLonspider
Exact Match Accuracy (Dev)· 2021-09-10
75.5
best: 81.6 (datagpt-sql-7B + InvalidSQL-Feedback)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Text-To-SQLonspider
Exact Match Accuracy (Test)· 2021-09-10
71.9
best: 72.4 (T5-SR)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Text-To-SQLonspider
Execution Accuracy (Test)· 2021-09-10
75.1
best: 89.65 (XiYan-SQL)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093

Speech2 results

DialogueonCoSQL
interaction match accuracy· 2021-09-10
23.7
best: 26.5 (RASAT+PICARD)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
DialogueonCoSQL
question match accuracy· 2021-09-10
54.6
best: 55.7 (RASAT+PICARD)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093