RASAT

Reported on 4 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Semantic ParsingonSPIDER
Exact Match Accuracy (in Dev)· 2022-05-14
72.6
best: 75.5 (T5-3B+PICARD)
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL arXiv:2205.06983
Semantic ParsingonSPIDER
Execution Accuracy (in Dev)· 2022-05-14
76.6
best: 80.5 (RASAT+PICARD)
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL arXiv:2205.06983
Text-To-SQLonSPIDER
Exact Match Accuracy (in Dev)· 2022-05-14
72.6
best: 75.5 (T5-3B+PICARD)
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL arXiv:2205.06983
Text-To-SQLonSPIDER
Execution Accuracy (in Dev)· 2022-05-14
76.6
best: 80.5 (RASAT+PICARD)
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL arXiv:2205.06983