Semantic Parsing on MMSQL

Metric: TDEX (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	TDEX▼	Extra Data	Paper	Date↕	Code
1	GPT-4 Turbo	67	No	Evaluating and Enhancing LLMs for Multi-turn Tex...	2024-12-21	Code
2	Gemini-1.5 Flash	65.8	No	Evaluating and Enhancing LLMs for Multi-turn Tex...	2024-12-21	Code
3	GPT-3.5 Turbo	64.1	No	Evaluating and Enhancing LLMs for Multi-turn Tex...	2024-12-21	Code
4	Llama3-8B	64	No	Evaluating and Enhancing LLMs for Multi-turn Tex...	2024-12-21	Code
5	Llama3-70B	62.8	No	Evaluating and Enhancing LLMs for Multi-turn Tex...	2024-12-21	Code
6	SQLCoder-8B	30.7	No	Evaluating and Enhancing LLMs for Multi-turn Tex...	2024-12-21	Code

#1GPT-4 TurboSOTA
67
TDEX· 2024-12-21
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types Code
#2Gemini-1.5 Flash
65.8
TDEX· 2024-12-21
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types Code
#3GPT-3.5 Turbo
64.1
TDEX· 2024-12-21
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types Code
#4Llama3-8B
64
TDEX· 2024-12-21
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types Code
#5Llama3-70B
62.8
TDEX· 2024-12-21
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types Code
#6SQLCoder-8B
30.7
TDEX· 2024-12-21
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types Code