TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/OpenIE6: Iterative Grid Labeling and Coordination Analysis...

OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction

Keshav Kolluru, Vaibhav Adlakha, Samarth Aggarwal, Mausam, Soumen Chakrabarti

2020-10-07EMNLP 2020 11Open Information Extraction
PaperPDFCode(official)

Abstract

A recent state-of-the-art neural open information extraction (OpenIE) system generates extractions iteratively, requiring repeated encoding of partial outputs. This comes at a significant computational cost. On the other hand, sequence labeling approaches for OpenIE are much faster, but worse in extraction quality. In this paper, we bridge this trade-off by presenting an iterative labeling-based system that establishes a new state of the art for OpenIE, while extracting 10x faster. This is achieved through a novel Iterative Grid Labeling (IGL) architecture, which treats OpenIE as a 2-D grid labeling task. We improve its performance further by applying coverage (soft) constraints on the grid at training time. Moreover, on observing that the best OpenIE systems falter at handling coordination structures, our OpenIE system also incorporates a new coordination analyzer built with the same IGL architecture. This IGL based coordination analyzer helps our OpenIE system handle complicated coordination structures, while also establishing a new state of the art on the task of coordination analysis, with a 12.3 pts improvement in F1 over previous analyzers. Our OpenIE system, OpenIE6, beats the previous systems by as much as 4 pts in F1, while being much faster.

Results

TaskDatasetMetricValueModel
Open Information ExtractionCaRBF154OpenIE 6 (CIGL-OIE)
Open Information ExtractionCaRBF153.5IMoJIE
Open Information ExtractionCaRBF152.7OpenIE 6
Open Information ExtractionCaRBF148.5SpanOIE
Open Information ExtractionCaRBF148OpenIE5
Open Information ExtractionCaRBF145ClausIE
Open Information ExtractionCaRBF145ClausIE
Open Information ExtractionCaRBF141.9MinIE
Open Information ExtractionCaRBF128.2SenseOIE
Open Information ExtractionWiRe57F140CIGL-OIE + IGL-CA (OpenIE6)
Open Information ExtractionWiRe57F136.8CIGL-OIE
Open Information ExtractionWiRe57F136IMoJIE
Open Information ExtractionWiRe57F135.4OpenIE5
Open Information ExtractionWiRe57F134.9IGL-OIE
Open Information ExtractionWiRe57F134.4OpenIE4
Open Information ExtractionWiRe57F133.2ClausIE
Open Information ExtractionWiRe57F131.9SpanOIE
Open Information ExtractionWiRe57F128.5MinIE
Open Information ExtractionWiRe57F126.4RnnOIE
Open Information ExtractionWiRe57F110.7SenseOIE

Related Papers

ChatPD: An LLM-driven Paper-Dataset Networking System2025-05-28Long-context Non-factoid Question Answering in Indic Languages2025-04-18Few-shot Continual Relation Extraction via Open Information Extraction2025-02-23Testing Prompt Engineering Methods for Knowledge Extraction from Text2025-02-18Challenges in Expanding Portuguese Resources: A View from Open Information Extraction2025-01-21Neon: News Entity-Interaction Extraction for Enhanced Question Answering2024-11-19$\textit{BenchIE}^{FL}$ : A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark2024-07-23Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs2024-06-27