The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detection
Andrii Yermakov, Jan Cech, Mario Fritz, Jiri Matas

TL;DR
This paper introduces the Alpha Blending Hypothesis, suggesting deepfake detectors mainly search for compositing artifacts rather than semantic anomalies, and proposes a new method achieving state-of-the-art generalization.
Contribution
The paper formulates the Alpha Blending Hypothesis, validates it experimentally, and develops BlenD, a method that improves cross-dataset deepfake detection without using generated deepfakes during training.
Findings
Deepfake detectors are highly sensitive to self-blended images and non-generative manipulations.
BlenD achieves the best average cross-dataset generalization on 15 datasets.
Ensemble of blending searchers and resilient models reaches 94.0% AUROC.
Abstract
Recent deepfake detection methods demonstrate improved cross-dataset generalization, yet the underlying mechanisms remain underexplored. We introduce the Alpha Blending Hypothesis, positing that state-of-the-art frame-based detectors primarily function as alpha blending searchers; rather than learning semantic anomalies or specific generative neural fingerprints, they localize low-level compositing artifacts introduced during the integration of manipulated faces into target frames. We experimentally validate the hypothesis, demonstrating that deepfake detectors exhibit high sensitivity to the so-called self-blended images (SBI) and non-generative manipulations. We propose the method BlenD that leverages a large-scale, diverse dataset of real-only facial images augmented with SBI. This approach achieves the best average cross-dataset generalization on 15 compositional deepfake datasets…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
