Fact-Checking Meets Fauxtography: Verifying Claims About Images

TL;DR

This paper addresses the challenge of automating fact-checking for image-related claims on social media by creating a new dataset and exploring feature-based models, showing promising results in verifying image claims.

Contribution

The paper introduces a new dataset for fact-checking claims about images and evaluates feature-based models to improve verification accuracy.

Findings

Significant improvement over baseline models

New dataset enables further research

Effective features for claim-image relationship modeling

Abstract

The recent explosion of false claims in social media and on the Web in general has given rise to a lot of manual fact-checking initiatives. Unfortunately, the number of claims that need to be fact-checked is several orders of magnitude larger than what humans can handle manually. Thus, there has been a lot of research aiming at automating the process. Interestingly, previous work has largely ignored the growing number of claims about images. This is despite the fact that visual imagery is more influential than text and naturally appears alongside fake news. Here we aim at bridging this gap. In particular, we create a new dataset for this problem, and we explore a variety of features modeling the claim, the image, and the relationship between the claim and the image. The evaluation results show sizable improvements over the baseline. We release our dataset, hoping to enable further research on fact-checking claims about images.