T5-3B+PICARD

Reported on 4 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Semantic ParsingonSPIDER
Exact Match Accuracy (in Dev)· 2021-09-10
75.5
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Semantic ParsingonSPIDER
Execution Accuracy (in Dev)· 2021-09-10
79.3
best: 80.5 (RASAT+PICARD)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Text-To-SQLonSPIDER
Exact Match Accuracy (in Dev)· 2021-09-10
75.5
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093
Text-To-SQLonSPIDER
Execution Accuracy (in Dev)· 2021-09-10
79.3
best: 80.5 (RASAT+PICARD)
SOTA
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models arXiv:2109.05093