TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/A Densely Connected Criss-Cross Attention Network for Docu...

A Densely Connected Criss-Cross Attention Network for Document-level Relation Extraction

Liang Zhang, Yidong Cheng

2022-03-26Relation ExtractionLogical ReasoningDocument-level Relation Extraction
PaperPDF

Abstract

Document-level relation extraction (RE) aims to identify relations between two entities in a given document. Compared with its sentence-level counterpart, document-level RE requires complex reasoning. Previous research normally completed reasoning through information propagation on the mention-level or entity-level document-graph, but rarely considered reasoning at the entity-pair-level.In this paper, we propose a novel model, called Densely Connected Criss-Cross Attention Network (Dense-CCNet), for document-level RE, which can complete logical reasoning at the entity-pair-level. Specifically, the Dense-CCNet performs entity-pair-level logical reasoning through the Criss-Cross Attention (CCA), which can collect contextual information in horizontal and vertical directions on the entity-pair matrix to enhance the corresponding entity-pair representation. In addition, we densely connect multiple layers of the CCA to simultaneously capture the features of single-hop and multi-hop logical reasoning.We evaluate our Dense-CCNet model on three public document-level RE datasets, DocRED, CDR, and GDA. Experimental results demonstrate that our model achieves state-of-the-art performance on these three datasets.

Results

TaskDatasetMetricValueModel
Relation ExtractionDocREDF162.55Dense-CCNet-BERTbase
Relation ExtractionDocREDIgn F160.46Dense-CCNet-BERTbase
Relation ExtractionGDAF186.44Dense-CCNet-SciBERTbase
Relation ExtractionCDRF177.06Dense-CCNet-SciBERTbase

Related Papers

DocIE@XLLM25: In-Context Learning for Information Extraction using Fully Synthetic Demonstrations2025-07-08FEVO: Financial Knowledge Expansion and Reasoning Evolution for Large Language Models2025-07-08MiCo: Multi-image Contrast for Reinforcement Visual Reasoning2025-06-27Multiple Streams of Relation Extraction: Enriching and Recalling in Transformers2025-06-25Chaining Event Spans for Temporal Relation Grounding2025-06-17Discrete JEPA: Learning Discrete Token Representations without Reconstruction2025-06-17SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models2025-06-15CAPO: Reinforcing Consistent Reasoning in Medical Decision-Making2025-06-15