Open Set Face Forgery Detection via Dual-Level Evidence Collection

TL;DR

This paper introduces DLED, a novel approach for open set face forgery detection that estimates uncertainty using dual-level evidence, effectively identifying new fake categories and outperforming existing methods.

Contribution

The paper formulates the open set face forgery detection problem and proposes DLED, which leverages spatial and frequency evidence for uncertainty estimation, achieving state-of-the-art results.

Findings

DLED surpasses baseline models by 20% on novel fake categories.

DLED performs competitively on binary real-vs-fake detection.

Comprehensive experiments validate DLED's effectiveness across diverse settings.

Abstract

The surge in face forgeries has increasingly undermined confidence in the authenticity of online content. As generation algorithms rapidly evolve, new fake categories will constantly emerge, severely challenging existing face forgery detection methods. Although face forgery detection has recently improved, current techniques remain largely confined to binary Real-vs-Fake classification or the recognition of known fake categories. Moreover, they fail to identify the emergence of entirely new forgery methods. In this work, we study the Open Set Face Forgery Detection (OSFFD) problem, which requires the detection model to identify novel fake categories. To enhance its real-world applicability, we reformulate the OSFFD problem and address it through uncertainty estimation. Specifically, we propose the Dual-Level Evidential face forgery Detection (DLED) approach, which estimates prediction uncertainty by extracting and integrating category-specific evidence on the spatial and frequency levels. Comprehensive experiments across diverse settings demonstrate that our proposed DLED approach achieves state-of-the-art performance. Notably, it surpasses various existing baseline models by a $20\%$ margin on average when identifying forgeries from novel fake categories. Concurrently, our DLED method yields competitive performance on the standard binary Real-versus-Fake face forgery detection task.