TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/InstructABSA: Instruction Learning for Aspect Based Sentim...

InstructABSA: Instruction Learning for Aspect Based Sentiment Analysis

Kevin Scaria, Himanshu Gupta, Siddharth Goyal, Saurabh Arjun Sawant, Swaroop Mishra, Chitta Baral

2023-02-16Sentiment AnalysisAspect ExtractionAspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Term ExtractionSentiment Classification
PaperPDFCode(official)

Abstract

We introduce InstructABSA, an instruction learning paradigm for Aspect-Based Sentiment Analysis (ABSA) subtasks. Our method introduces positive, negative, and neutral examples to each training sample, and instruction tune the model (Tk-Instruct) for ABSA subtasks, yielding significant performance improvements. Experimental results on the Sem Eval 2014, 15, and 16 datasets demonstrate that InstructABSA outperforms the previous state-of-the-art (SOTA) approaches on Term Extraction (ATE), Sentiment Classification(ATSC) and Sentiment Pair Extraction (ASPE) subtasks. In particular, InstructABSA outperforms the previous state-of-the-art (SOTA) on the Rest14 ATE subtask by 5.69% points, the Rest15 ATSC subtask by 9.59% points, and the Lapt14 AOPE subtask by 3.37% points, surpassing 7x larger models. We also get competitive results on AOOE, AOPE, and AOSTE subtasks indicating strong generalization ability to all subtasks. Exploring sample efficiency reveals that just 50% train data is required to get competitive results with other instruction tuning approaches. Lastly, we assess the quality of instructions and observe that InstructABSA's performance experiences a decline of ~10% when adding misleading examples.

Results

TaskDatasetMetricValueModel
Sentiment AnalysisSemEval 2014 Task 4 Subtask 1+2F179.34InstructABSA
Sentiment AnalysisSemEval-2014 Task-4Laptop (Acc)80.56InstructABSA
Sentiment AnalysisSemEval-2014 Task-4Mean Acc (Restaurant + Laptop)81.5InstructABSA
Sentiment AnalysisSemEval-2014 Task-4Restaurant (Acc)82.44InstructABSA
Sentiment AnalysisSemEval 2014 Task 4 Subtask 1+2F179.34InstructABSA
Sentiment AnalysisSemEval 2014 Task 4 Sub Task 1Laptop (F1)92.3InstructABSA
Sentiment AnalysisSemEval 2014 Task 4 Sub Task 1Restaurant (F1)92.76InstructABSA
Sentiment AnalysisSemEval 2014 Task 4 LaptopF179.34InstructABSA
Sentiment AnalysisSemEval-2014 Task-4Laptop (F1)92.3InstructABSA
Sentiment AnalysisSemEval-2014 Task-4Mean F1 (Laptop + Restaurant)92.53InstructABSA
Sentiment AnalysisSemEval-2014 Task-4Restaurant (F1)92.76InstructABSA
Sentiment AnalysisSemEval 2014 Task 4 Sub Task 1Laptop (F1)92.3InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval-2014 Task-4Laptop (Acc)80.56InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval-2014 Task-4Mean Acc (Restaurant + Laptop)81.5InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval-2014 Task-4Restaurant (Acc)82.44InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval 2014 Task 4 Subtask 1+2F179.34InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval 2014 Task 4 Sub Task 1Laptop (F1)92.3InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval 2014 Task 4 Sub Task 1Restaurant (F1)92.76InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval 2014 Task 4 LaptopF179.34InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval-2014 Task-4Laptop (F1)92.3InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval-2014 Task-4Mean F1 (Laptop + Restaurant)92.53InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval-2014 Task-4Restaurant (F1)92.76InstructABSA
Aspect-Based Sentiment Analysis (ABSA)SemEval 2014 Task 4 Sub Task 1Laptop (F1)92.3InstructABSA
Aspect ExtractionSemEval-2014 Task-4Laptop (F1)92.3InstructABSA
Aspect ExtractionSemEval-2014 Task-4Mean F1 (Laptop + Restaurant)92.53InstructABSA
Aspect ExtractionSemEval-2014 Task-4Restaurant (F1)92.76InstructABSA
Aspect ExtractionSemEval 2014 Task 4 Sub Task 1Laptop (F1)92.3InstructABSA

Related Papers

AdaptiSent: Context-Aware Adaptive Attention for Multimodal Aspect-Based Sentiment Analysis2025-07-17AI Wizards at CheckThat! 2025: Enhancing Transformer-Based Embeddings with Sentiment for Subjectivity Detection in News Articles2025-07-15DCR: Quantifying Data Contamination in LLMs Evaluation2025-07-15SentiDrop: A Multi Modal Machine Learning model for Predicting Dropout in Distance Learning2025-07-14GNN-CNN: An Efficient Hybrid Model of Convolutional and Graph Neural Networks for Text Representation2025-07-10Enhancing Automatic Term Extraction with Large Language Models via Syntactic Retrieval2025-06-26FINN-GL: Generalized Mixed-Precision Extensions for FPGA-Accelerated LSTMs2025-06-25Unpacking Generative AI in Education: Computational Modeling of Teacher and Student Perspectives in Social Media Discourse2025-06-19