TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/DiaASQ : A Benchmark of Conversational Aspect-based Sentim...

DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis

Bobo Li, Hao Fei, Fei Li, Yuhan Wu, Jinsong Zhang, Shengqiong Wu, Jingye Li, Yijiang Liu, Lizi Liao, Tat-Seng Chua, Donghong Ji

2022-11-10Sentiment AnalysisOpinion MiningAspect-Based Sentiment AnalysisConversational Sentiment Quadruple ExtractionAspect-Based Sentiment Analysis (ABSA)
PaperPDFCode(official)

Abstract

The rapid development of aspect-based sentiment analysis (ABSA) within recent decades shows great potential for real-world society. The current ABSA works, however, are mostly limited to the scenario of a single text piece, leaving the study in dialogue contexts unexplored. To bridge the gap between fine-grained sentiment analysis and conversational opinion mining, in this work, we introduce a novel task of conversational aspect-based sentiment quadruple analysis, namely DiaASQ, aiming to detect the quadruple of target-aspect-opinion-sentiment in a dialogue. We manually construct a large-scale high-quality DiaASQ dataset in both Chinese and English languages. We deliberately develop a neural model to benchmark the task, which advances in effectively performing end-to-end quadruple prediction, and manages to incorporate rich dialogue-specific and discourse feature representations for better cross-utterance quadruple extraction. We hope the new benchmark will spur more advancements in the sentiment analysis community.

Results

TaskDatasetMetricValueModel
Sentiment AnalysisDiaASQ (ZH)Pair F1 (aspect-opinion)45.44E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Pair F1 (target-aspect)48.61E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Pair F1 (target-opinion)43.31E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Quad F1 (identification)37.51E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Quad F1 (micro)34.94E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Span F1 (aspect)76.94E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Span F1 (opinion)59.35E2E-DiaASQ
Sentiment AnalysisDiaASQ (ZH)Span F1 (target)90.23E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Pair F1 (aspect-opinion)44.27E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Pair F1 (target-aspect)47.91E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Pair F1 (target-opinion)45.58E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Quad F1 (identification)36.8E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Quad F1 (micro)33.31E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Span F1 (aspect)74.71E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Span F1 (opinion)60.22E2E-DiaASQ
Sentiment AnalysisDiaASQ (EN)Span F1 (target)88.62E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Pair F1 (aspect-opinion)45.44E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Pair F1 (target-aspect)48.61E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Pair F1 (target-opinion)43.31E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Quad F1 (identification)37.51E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Quad F1 (micro)34.94E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Span F1 (aspect)76.94E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Span F1 (opinion)59.35E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (ZH)Span F1 (target)90.23E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Pair F1 (aspect-opinion)44.27E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Pair F1 (target-aspect)47.91E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Pair F1 (target-opinion)45.58E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Quad F1 (identification)36.8E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Quad F1 (micro)33.31E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Span F1 (aspect)74.71E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Span F1 (opinion)60.22E2E-DiaASQ
Aspect-Based Sentiment Analysis (ABSA)DiaASQ (EN)Span F1 (target)88.62E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Pair F1 (aspect-opinion)45.44E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Pair F1 (target-aspect)48.61E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Pair F1 (target-opinion)43.31E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Quad F1 (identification)37.51E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Quad F1 (micro)34.94E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Span F1 (aspect)76.94E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Span F1 (opinion)59.35E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (ZH)Span F1 (target)90.23E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Pair F1 (aspect-opinion)44.27E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Pair F1 (target-aspect)47.91E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Pair F1 (target-opinion)45.58E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Quad F1 (identification)36.8E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Quad F1 (micro)33.31E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Span F1 (aspect)74.71E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Span F1 (opinion)60.22E2E-DiaASQ
Aspect-Category-Opinion-Sentiment Quadruple ExtractionDiaASQ (EN)Span F1 (target)88.62E2E-DiaASQ

Related Papers

AdaptiSent: Context-Aware Adaptive Attention for Multimodal Aspect-Based Sentiment Analysis2025-07-17AI Wizards at CheckThat! 2025: Enhancing Transformer-Based Embeddings with Sentiment for Subjectivity Detection in News Articles2025-07-15DCR: Quantifying Data Contamination in LLMs Evaluation2025-07-15SentiDrop: A Multi Modal Machine Learning model for Predicting Dropout in Distance Learning2025-07-14GNN-CNN: An Efficient Hybrid Model of Convolutional and Graph Neural Networks for Text Representation2025-07-10MT2-CSD: A New Dataset and Multi-Semantic Knowledge Fusion Method for Conversational Stance Detection2025-06-26FINN-GL: Generalized Mixed-Precision Extensions for FPGA-Accelerated LSTMs2025-06-25Unpacking Generative AI in Education: Computational Modeling of Teacher and Student Perspectives in Social Media Discourse2025-06-19