Capture Artifacts via Progressive Disentangling and Purifying Blended Identities for Deepfake Detection

TL;DR

This paper introduces a novel Deepfake detection method that employs progressive disentangling and purifying of blended identities to more accurately isolate artifact features, improving detection robustness across unknown datasets.

Contribution

The proposed approach combines coarse- and fine-grained disentangling with a new correlation compression module and contrast loss, providing a more reliable and effective artifact feature extraction for Deepfake detection.

Findings

Enhanced detection accuracy on unseen datasets.

Effective separation of artifact features from identity information.

Robustness against diverse Deepfake generation techniques.

Abstract

The Deepfake technology has raised serious concerns regarding privacy breaches and trust issues. To tackle these challenges, Deepfake detection technology has emerged. Current methods over-rely on the global feature space, which contains redundant information independent of the artifacts. As a result, existing Deepfake detection techniques suffer performance degradation when encountering unknown datasets. To reduce information redundancy, the current methods use disentanglement techniques to roughly separate the fake faces into artifacts and content information. However, these methods lack a solid disentanglement foundation and cannot guarantee the reliability of their disentangling process. To address these issues, a Deepfake detection method based on progressive disentangling and purifying blended identities is innovatively proposed in this paper. Based on the artifact generation mechanism, the coarse- and fine-grained strategies are combined to ensure the reliability of the disentanglement method. Our method aims to more accurately capture and separate artifact features in fake faces. Specifically, we first perform the coarse-grained disentangling on fake faces to obtain a pair of blended identities that require no additional annotation to distinguish between source face and target face. Then, the artifact features from each identity are separated to achieve fine-grained disentanglement. To obtain pure identity information and artifacts, an Identity-Artifact Correlation Compression module (IACC) is designed based on the information bottleneck theory, effectively reducing the potential correlation between identity information and artifacts. Additionally, an Identity-Artifact Separation Contrast Loss is designed to enhance the independence of artifact features post-disentangling. Finally, the classifier only focuses on pure artifact features to achieve a generalized Deepfake detector.