Some Like it Hoax: Automated Fake News Detection in Social Networks

TL;DR

This paper introduces automated methods for detecting fake news on social networks by analyzing user engagement patterns, achieving over 99% accuracy in classifying Facebook posts as hoaxes or not.

Contribution

The paper presents two novel classification techniques, including a boolean crowdsourcing adaptation, for high-accuracy hoax detection based on user likes.

Findings

Achieved over 99% classification accuracy.

Methods are robust even with limited training data.

Effective even when focusing on users who like both hoax and non-hoax posts.

Abstract

In recent years, the reliability of information on the Internet has emerged as a crucial issue of modern society. Social network sites (SNSs) have revolutionized the way in which information is spread by allowing users to freely share content. As a consequence, SNSs are also increasingly used as vectors for the diffusion of misinformation and hoaxes. The amount of disseminated information and the rapidity of its diffusion make it practically impossible to assess reliability in a timely manner, highlighting the need for automatic hoax detection systems. As a contribution towards this objective, we show that Facebook posts can be classified with high accuracy as hoaxes or non-hoaxes on the basis of the users who "liked" them. We present two classification techniques, one based on logistic regression, the other on a novel adaptation of boolean crowdsourcing algorithms. On a dataset consisting of 15,500 Facebook posts and 909,236 users, we obtain classification accuracies exceeding 99% even when the training set contains less than 1% of the posts. We further show that our techniques are robust: they work even when we restrict our attention to the users who like both hoax and non-hoax posts. These results suggest that mapping the diffusion pattern of information can be a useful component of automatic hoax detection systems.