TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/RESDSQL: Decoupling Schema Linking and Skeleton Parsing fo...

RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL

Haoyang Li, Jing Zhang, Cuiping Li, Hong Chen

2023-02-12Semantic ParsingText-To-SQLSQL ParsingLanguage Modelling
PaperPDFCode(official)

Abstract

One of the recent best attempts at Text-to-SQL is the pre-trained language model. Due to the structural property of the SQL queries, the seq2seq model takes the responsibility of parsing both the schema items (i.e., tables and columns) and the skeleton (i.e., SQL keywords). Such coupled targets increase the difficulty of parsing the correct SQL queries especially when they involve many schema items and logic operators. This paper proposes a ranking-enhanced encoding and skeleton-aware decoding framework to decouple the schema linking and the skeleton parsing. Specifically, for a seq2seq encoder-decode model, its encoder is injected by the most relevant schema items instead of the whole unordered ones, which could alleviate the schema linking effort during SQL parsing, and its decoder first generates the skeleton and then the actual SQL query, which could implicitly constrain the SQL parsing. We evaluate our proposed framework on Spider and its three robustness variants: Spider-DK, Spider-Syn, and Spider-Realistic. The experimental results show that our framework delivers promising performance and robustness. Our code is available at https://github.com/RUCKBReasoning/RESDSQL.

Results

TaskDatasetMetricValueModel
Semantic ParsingspiderAccuracy84.1RESDSQL-3B + NatSQL
Semantic ParsingspiderExact Match Accuracy (Dev)80.5RESDSQL-3B + NatSQL
Semantic ParsingspiderExact Match Accuracy (Test)72RESDSQL-3B + NatSQL
Semantic ParsingspiderExecution Accuracy (Dev)84.1RESDSQL-3B + NatSQL
Semantic ParsingspiderExecution Accuracy (Test)79.9RESDSQL-3B + NatSQL
Text-To-SQLspiderExact Match Accuracy (Dev)80.5RESDSQL-3B + NatSQL
Text-To-SQLspiderExact Match Accuracy (Test)72RESDSQL-3B + NatSQL
Text-To-SQLspiderExecution Accuracy (Dev)84.1RESDSQL-3B + NatSQL
Text-To-SQLspiderExecution Accuracy (Test)79.9RESDSQL-3B + NatSQL

Related Papers

Visual-Language Model Knowledge Distillation Method for Image Quality Assessment2025-07-21Making Language Model a Hierarchical Classifier and Generator2025-07-17VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learning2025-07-17The Generative Energy Arena (GEA): Incorporating Energy Awareness in Large Language Model (LLM) Human Evaluations2025-07-17Inverse Reinforcement Learning Meets Large Language Model Post-Training: Basics, Advances, and Opportunities2025-07-17Assay2Mol: large language model-based drug design using BioAssay context2025-07-16Describe Anything Model for Visual Question Answering on Text-rich Images2025-07-16InstructFLIP: Exploring Unified Vision-Language Model for Face Anti-spoofing2025-07-16