TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/A simple but tough-to-beat baseline for the Fake News Chal...

A simple but tough-to-beat baseline for the Fake News Challenge stance detection task

Benjamin Riedel, Isabelle Augenstein, Georgios P. Spithourakis, Sebastian Riedel

2017-07-11MisinformationFact CheckingStance Detection
PaperPDFCodeCodeCodeCodeCodeCodeCodeCodeCode(official)

Abstract

Identifying public misinformation is a complicated and challenging task. An important part of checking the veracity of a specific claim is to evaluate the stance different news sources take towards the assertion. Automatic stance evaluation, i.e. stance detection, would arguably facilitate the process of fact checking. In this paper, we present our stance detection system which claimed third place in Stage 1 of the Fake News Challenge. Despite our straightforward approach, our system performs at a competitive level with the complex ensembles of the top two winning teams. We therefore propose our system as the 'simple but tough-to-beat baseline' for the Fake News Challenge stance detection task.

Results

TaskDatasetMetricValueModel
Fake News DetectionFNC-1Per-class Accuracy (Agree)44.043rd place at FNC-1 - Team UCL Machine Reading (Riedel et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Disagree)6.63rd place at FNC-1 - Team UCL Machine Reading (Riedel et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Discuss)81.383rd place at FNC-1 - Team UCL Machine Reading (Riedel et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Unrelated)97.93rd place at FNC-1 - Team UCL Machine Reading (Riedel et al., 2017)
Fake News DetectionFNC-1Weighted Accuracy81.723rd place at FNC-1 - Team UCL Machine Reading (Riedel et al., 2017)

Related Papers

PiMRef: Detecting and Explaining Ever-evolving Spear Phishing Emails with Knowledge Base Invariants2025-07-21SHIELD: A Secure and Highly Enhanced Integrated Learning for Robust Deepfake Detection against Adversarial Attacks2025-07-17Leveraging Pre-Trained Visual Models for AI-Generated Video Detection2025-07-17Journalism-Guided Agentic In-Context Learning for News Stance Detection2025-07-15KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection2025-07-13LLM-Stackelberg Games: Conjectural Reasoning Equilibria and Their Applications to Spearphishing2025-07-12Multi-Agent Retrieval-Augmented Framework for Evidence-Based Counterspeech Against Health Misinformation2025-07-09LLMs are Introvert2025-07-08