TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Datasets/SemEval-2014 Task-4

SemEval-2014 Task-4

Introduced 2014-08-01

Sentiment analysis is increasingly viewed as a vital task both from an academic and a commercial standpoint. The majority of current approaches, however, attempt to detect the overall polarity of a sentence, paragraph, or text span, regardless of the entities mentioned (e.g., laptops, restaurants) and their aspects (e.g., battery, screen; food, service). By contrast, this task is concerned with aspect based sentiment analysis (ABSA), where the goal is to identify the aspects of given target entities and the sentiment expressed towards each aspect. Datasets consisting of customer reviews with human-authored annotations identifying the mentioned aspects of the target entities and the sentiment polarity of each aspect will be provided.

Subtask 2: Aspect term polarity

For a given set of aspect terms within a sentence, determine whether the polarity of each aspect term is positive, negative, neutral or conflict (i.e., both positive and negative).

For example:

“I loved their fajitas” → {fajitas: positive} “I hated their fajitas, but their salads were great” → {fajitas: negative, salads: positive} “The fajitas are their first plate” → {fajitas: neutral} “The fajitas were great to taste, but not to see” → {fajitas: conflict}

Benchmarks

Aspect Category Detection/Average RecallAspect Category Detection/Hit@5Aspect Category Detection/MRRAspect Category Detection/NDCGAspect Extraction/Laptop (F1)Aspect Extraction/Restaurant (F1)Aspect Extraction/Mean F1 (Laptop + Restaurant)Aspect-Based Sentiment Analysis (ABSA)/Mean Acc (Restaurant + Laptop)Aspect-Based Sentiment Analysis (ABSA)/Restaurant (Acc)Aspect-Based Sentiment Analysis (ABSA)/Laptop (Acc)Aspect-Based Sentiment Analysis (ABSA)/Laptop (F1)Aspect-Based Sentiment Analysis (ABSA)/Restaurant (F1)Aspect-Based Sentiment Analysis (ABSA)/Mean F1 (Laptop + Restaurant)Aspect-Based Sentiment Analysis (ABSA)/Restaurant 2014 (F1)Aspect-Based Sentiment Analysis (ABSA)/Laptop 2014 (F1)Aspect-Based Sentiment Analysis (ABSA)/Restaurant 2015 (F1)Aspect-Based Sentiment Analysis (ABSA)/Restaurant 2016 (F1)Sentiment Analysis/Mean Acc (Restaurant + Laptop)Sentiment Analysis/Restaurant (Acc)Sentiment Analysis/Laptop (Acc)Sentiment Analysis/Laptop (F1)Sentiment Analysis/Restaurant (F1)Sentiment Analysis/Mean F1 (Laptop + Restaurant)Sentiment Analysis/Restaurant 2014 (F1)Sentiment Analysis/Laptop 2014 (F1)Sentiment Analysis/Restaurant 2015 (F1)Sentiment Analysis/Restaurant 2016 (F1)

Statistics

Papers
107
Benchmarks
27

Links

Homepage

Tasks

Aspect Category DetectionAspect ExtractionAspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect-oriented Opinion ExtractionSentiment Analysis