TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/UniK-QA: Unified Representations of Structured and Unstruc...

UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering

Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Schlichtkrull, Sonal Gupta, Yashar Mehdad, Scott Yih

2020-12-29Findings (NAACL) 2022 7Question AnsweringKnowledge Base Question AnsweringOpen-Domain Question Answering
PaperPDFCode(official)

Abstract

We study open-domain question answering with structured, unstructured and semi-structured knowledge sources, including text, tables, lists and knowledge bases. Departing from prior work, we propose a unifying approach that homogenizes all sources by reducing them to text and applies the retriever-reader model which has so far been limited to text sources only. Our approach greatly improves the results on knowledge-base QA tasks by 11 points, compared to latest graph-based methods. More importantly, we demonstrate that our unified knowledge (UniK-QA) model is a simple and yet effective way to combine heterogeneous sources of knowledge, advancing the state-of-the-art results on two popular question answering benchmarks, NaturalQuestions and WebQuestions, by 3.5 and 2.6 points, respectively. The code of UniK-QA is available at: https://github.com/facebookresearch/UniK-QA.

Results

TaskDatasetMetricValueModel
Question AnsweringTIQP@142.5Unik-Qa
Question AnsweringNatural Questions (long)EM54.9UniK-QA
Question AnsweringWebQuestionsExact Match57.7UniK-QA
Question AnsweringNatural QuestionsExact Match54.9UniK-QA
Question AnsweringTQAExact Match65.5UniK-QA
Question AnsweringWebQuestionsSPHits@179.1UniK-QA (T5-large)
Question AnsweringWebQuestionsSPHits@176.7UniK-QA (T5-base)
Open-Domain Question AnsweringWebQuestionsExact Match57.7UniK-QA
Open-Domain Question AnsweringNatural QuestionsExact Match54.9UniK-QA
Open-Domain Question AnsweringTQAExact Match65.5UniK-QA

Related Papers

From Roots to Rewards: Dynamic Tree Reasoning with RL2025-07-17Enter the Mind Palace: Reasoning and Planning for Long-term Active Embodied Question Answering2025-07-17Vision-and-Language Training Helps Deploy Taxonomic Knowledge but Does Not Fundamentally Alter It2025-07-17City-VLM: Towards Multidomain Perception Scene Understanding via Multimodal Incomplete Learning2025-07-17Describe Anything Model for Visual Question Answering on Text-rich Images2025-07-16Is This Just Fantasy? Language Model Representations Reflect Human Judgments of Event Plausibility2025-07-16Warehouse Spatial Question Answering with LLM Agent2025-07-14Evaluating Attribute Confusion in Fashion Text-to-Image Generation2025-07-09