TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/DDRel: A New Dataset for Interpersonal Relation Classifica...

DDRel: A New Dataset for Interpersonal Relation Classification in Dyadic Dialogues

Qi Jia, Hongru Huang, Kenny Q. Zhu

2020-12-04Relation ExtractionDialog Relation ExtractionGeneral ClassificationRelation Classification
PaperPDFCode(official)

Abstract

Interpersonal language style shifting in dialogues is an interesting and almost instinctive ability of human. Understanding interpersonal relationship from language content is also a crucial step toward further understanding dialogues. Previous work mainly focuses on relation extraction between named entities in texts. In this paper, we propose the task of relation classification of interlocutors based on their dialogues. We crawled movie scripts from IMSDb, and annotated the relation labels for each session according to 13 pre-defined relationships. The annotated dataset DDRel consists of 6300 dyadic dialogue sessions between 694 pair of speakers with 53,126 utterances in total. We also construct session-level and pair-level relation classification tasks with widely-accepted baselines. The experimental results show that this task is challenging for existing models and the dataset will be useful for future research.

Results

TaskDatasetMetricValueModel
Relation ExtractionDDRelPair-level 13-class Acc39.73BERT
Relation ExtractionDDRelPair-level 4-class Acc58.13BERT
Relation ExtractionDDRelPair-level 6-class Acc42.33BERT
Relation ExtractionDDRelSession-level 13-class Acc39.4BERT
Relation ExtractionDDRelSession-level 4-class Acc47.1BERT
Relation ExtractionDDRelSession-level 6-class Acc41.87BERT

Related Papers

DocIE@XLLM25: In-Context Learning for Information Extraction using Fully Synthetic Demonstrations2025-07-08Multiple Streams of Relation Extraction: Enriching and Recalling in Transformers2025-06-25Chaining Event Spans for Temporal Relation Grounding2025-06-17Summarization for Generative Relation Extraction in the Microbiome Domain2025-06-10Conservative Bias in Large Language Models: Measuring Relation Predictions2025-06-09Comparative Analysis of AI Agent Architectures for Entity Relationship Classification2025-06-03CREFT: Sequential Multi-Agent LLM for Character Relation Extraction2025-05-30Generating Diverse Training Samples for Relation Extraction with Large Language Models2025-05-29