Question Answering on WebQuestions

Metric: EM (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	EM▼	Extra Data	Paper	Date↕	Code
1	PoG-GPT4 (Tan et al., 2024)	84.6	No	Paths-over-Graph: Knowledge Graph Empowered Larg...	2024-10-18	Code
2	CoA	70.7	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
3	CoA w/o actions	64.7	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
4	DSP	59.4	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
5	DSP	59.4	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
6	FiE+PAQ	56.3	Yes	FiE: Building a Global Probability Space by Leve...	2022-11-18	-
7	FiE	52.4	No	FiE: Building a Global Probability Space by Leve...	2022-11-18	-
8	FiDO	51.1	No	FiDO: Fusion-in-Decoder optimized for stronger p...	2022-12-15	-
9	RAG	45.2	No	Retrieval-Augmented Generation for Knowledge-Int...	2020-05-22	Code
10	Few-shot	44.7	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
11	Few-shot	44.7	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
12	PaLM-540B (Few-Shot)	43.5	No	PaLM: Scaling Language Modeling with Pathways	2022-04-05	Code
13	Zero-shot	43	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
14	Zero-shot	43	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
15	T5.1.1-XXL+SSM	42.8	No	Exploring the Limits of Transfer Learning with a...	2019-10-23	Code
16	CoT	42.5	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
17	CoT	42.5	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
18	DPR	42.4	No	Dense Passage Retrieval for Open-Domain Question...	2020-04-10	Code
19	GPT-3-175B (Few-Shot)	41.5	No	Language Models are Few-Shot Learners	2020-05-28	Code
20	REALM	40.7	No	REALM: Retrieval-Augmented Language Model Pre-Tr...	2020-02-10	Code
21	React	38.3	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
22	React	38.3	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
23	ORQA	36.4	No	Latent Retrieval for Weakly Supervised Open Doma...	2019-06-01	Code
24	Self-Ask	31.1	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
25	Self-Ask	31.1	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
26	PaLM 2-L (one-shot)	28.2	No	PaLM 2 Technical Report	2023-05-17	Code
27	PaLM 2-M (one-shot)	26.9	No	PaLM 2 Technical Report	2023-05-17	Code
28	ToT	26.3	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
29	ToT	26.3	No	Chain-of-Action: Faithful and Multimodal Questio...	2024-03-26	Code
30	GPT-3-175B (One-Shot)	25.3	No	Language Models are Few-Shot Learners	2020-05-28	Code
31	PaLM-540B (One-Shot)	22.6	No	PaLM: Scaling Language Modeling with Pathways	2022-04-05	Code
32	PaLM 2-S (one-shot)	21.8	No	PaLM 2 Technical Report	2023-05-17	Code
33	GLaM 62B/64E (Zero-Shot)	15.5	No	GLaM: Efficient Scaling of Language Models with ...	2021-12-13	-
34	GPT-3-175B (Zero-Shot)	14.4	No	Language Models are Few-Shot Learners	2020-05-28	Code
35	PaLM-540B (Zero-Shot)	10.6	No	PaLM: Scaling Language Modeling with Pathways	2022-04-05	Code