Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Datasets/GrailQA

GrailQA

Strongly Generalizable Question Answering

TextsIntroduced 2020-11-16

GrailQA is a new large-scale, high-quality dataset for question answering on knowledge bases (KBQA) on Freebase with 64,331 questions annotated with both answers and corresponding logical forms in different syntax (i.e., SPARQL, S-expression, etc.). It can be used to test three levels of generalization in KBQA: i.i.d., compositional, and zero-shot.

Benchmarks

Question Answering/Compositional EM Question Answering/Compositional F1 Question Answering/EM Question Answering/I.I.D. EM Question Answering/I.I.D. F1 Question Answering/Overall EM Question Answering/Overall F1 Question Answering/Zero-shot EM Question Answering/Zero-shot F1

Related Benchmarks

GrailQA-Compositional/Question Generation/BLEU GrailQA-Compositional/Question Generation/FactSpotter GrailQA-Compositional/Question Generation/METEOR GrailQA-IID/Question Generation/BLEU GrailQA-IID/Question Generation/FactSpotter GrailQA-IID/Question Generation/METEOR GrailQA-Zero-Shot/Question Generation/FactSpotter GrailQA-Zero-Shot/Question Generation/METEOR GrailQA-Zero-Shot/Question Generation/bleu

Statistics

Papers: 34
Benchmarks: 9

Links

Tasks

Knowledge Base Question Answering Question Answering Question Generation