TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/On the Benefit of Combining Neural, Statistical and Extern...

On the Benefit of Combining Neural, Statistical and External Features for Fake News Identification

Gaurav Bhatt, Aman Sharma, Shivam Sharma, Ankush Nagpal, Balasubramanian Raman, Ankush Mittal

2017-12-11Feature EngineeringOpen-Ended Question AnsweringFake News DetectionStance Detection
PaperPDFCode

Abstract

Identifying the veracity of a news article is an interesting problem while automating this process can be a challenging task. Detection of a news article as fake is still an open question as it is contingent on many factors which the current state-of-the-art models fail to incorporate. In this paper, we explore a subtask to fake news identification, and that is stance detection. Given a news article, the task is to determine the relevance of the body and its claim. We present a novel idea that combines the neural, statistical and external features to provide an efficient solution to this problem. We compute the neural embedding from the deep recurrent model, statistical features from the weighted n-gram bag-of-words model and handcrafted external features with the help of feature engineering heuristics. Finally, using deep neural layer all the features are combined, thereby classifying the headline-body news pair as agree, disagree, discuss, or unrelated. We compare our proposed technique with the current state-of-the-art models on the fake news challenge dataset. Through extensive experiments, we find that the proposed model outperforms all the state-of-the-art techniques including the submissions to the fake news challenge.

Results

TaskDatasetMetricValueModel
Fake News DetectionFNC-1Per-class Accuracy (Agree)43.82Bhatt et al.
Fake News DetectionFNC-1Per-class Accuracy (Disagree)6.31Bhatt et al.
Fake News DetectionFNC-1Per-class Accuracy (Discuss)85.68Bhatt et al.
Fake News DetectionFNC-1Per-class Accuracy (Unrelated)98.04Bhatt et al.
Fake News DetectionFNC-1Weighted Accuracy83.08Bhatt et al.
Fake News DetectionFNC-1Per-class Accuracy (Agree)31.8Baseline based on skip-thought embeddings (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Discuss)81.2Baseline based on skip-thought embeddings (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Unrelated)91.18Baseline based on skip-thought embeddings (Bhatt et al., 2017)
Fake News DetectionFNC-1Weighted Accuracy76.18Baseline based on skip-thought embeddings (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Agree)50.7Baseline based on word2vec + hand-crafted features (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Disagree)9.61Baseline based on word2vec + hand-crafted features (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Discuss)53.38Baseline based on word2vec + hand-crafted features (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Unrelated)96.05Baseline based on word2vec + hand-crafted features (Bhatt et al., 2017)
Fake News DetectionFNC-1Weighted Accuracy72.78Baseline based on word2vec + hand-crafted features (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Agree)38.04Neural baseline based on bi-directional LSTMs (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Disagree)4.59Neural baseline based on bi-directional LSTMs (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Discuss)58.132Neural baseline based on bi-directional LSTMs (Bhatt et al., 2017)
Fake News DetectionFNC-1Per-class Accuracy (Unrelated)78.27Neural baseline based on bi-directional LSTMs (Bhatt et al., 2017)
Fake News DetectionFNC-1Weighted Accuracy63.11Neural baseline based on bi-directional LSTMs (Bhatt et al., 2017)

Related Papers

DCR: Quantifying Data Contamination in LLMs Evaluation2025-07-15Journalism-Guided Agentic In-Context Learning for News Stance Detection2025-07-15KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection2025-07-13LLMs are Introvert2025-07-08Advancing Magnetic Materials Discovery -- A structure-based machine learning approach for magnetic ordering and magnetic moment prediction2025-07-02Prompt Mechanisms in Medical Imaging: A Comprehensive Survey2025-06-28Quantum Reinforcement Learning Trading Agent for Sector Rotation in the Taiwan Stock Market2025-06-26Temporal-Aware Graph Attention Network for Cryptocurrency Transaction Fraud Detection2025-06-26