Harmful Visual Content Manipulation Matters in Misinformation Detection Under Multimedia Scenarios

TL;DR

This paper introduces HAVC-M4D, a novel weakly supervised multimodal misinformation detection method that captures manipulation and intention features in visual content, significantly improving detection accuracy.

Contribution

The study proposes a new approach that considers manipulation and intention features in visual content, addressing limitations of existing methods that overlook these indicators.

Findings

HAVC-M4D outperforms existing MMD methods across four datasets.

Incorporating manipulation and intention features improves detection accuracy.

The framework effectively handles positive and unlabeled learning scenarios.

Abstract

Nowadays, the widespread dissemination of misinformation across numerous social media platforms has led to severe negative effects on society. To address this challenge, the automatic detection of misinformation, particularly under multimedia scenarios, has gained significant attention from both academic and industrial communities, leading to the emergence of a research task known as Multimodal Misinformation Detection (MMD). Typically, current MMD approaches focus on capturing the semantic relationships and inconsistency between various modalities but often overlook certain critical indicators within multimodal content. Recent research has shown that manipulated features within visual content in social media articles serve as valuable clues for MMD. Meanwhile, we argue that the potential intentions behind the manipulation, e.g., harmful and harmless, also matter in MMD. Therefore, in this study, we aim to identify such multimodal misinformation by capturing two types of features: manipulation features, which represent if visual content has been manipulated, and intention features, which assess the nature of these manipulations, distinguishing between harmful and harmless intentions. Unfortunately, the manipulation and intention labels that supervise these features to be discriminative are unknown. To address this, we introduce two weakly supervised indicators as substitutes by incorporating supplementary datasets focused on image manipulation detection and framing two different classification tasks as positive and unlabeled learning issues. With this framework, we introduce an innovative MMD approach, titled Harmful Visual Content Manipulation Matters in MMD (HAVC-M4 D). Comprehensive experiments conducted on four prevalent MMD datasets indicate that HAVC-M4 D significantly and consistently enhances the performance of existing MMD methods.