WeDefense: A Toolkit to Defend Against Fake Audio

TL;DR

WeDefense is an open-source toolkit designed to standardize and facilitate the benchmarking, detection, and localization of fake audio generated by AI, supporting fair comparison of different solutions.

Contribution

It introduces the first unified toolkit for fake audio detection and localization, including comprehensive features like augmentation, calibration, and analysis tools.

Findings

Supports both detection and localization of fake audio

Provides standardized evaluation metrics and protocols

Includes interactive demos for practical use

Abstract

The advances in generative AI have enabled the creation of synthetic audio which is perceptually indistinguishable from real, genuine audio. Although this stellar progress enables many positive applications, it also raises risks of misuse, such as for impersonation, disinformation and fraud. Despite a growing number of open-source fake audio detection codes released through numerous challenges and initiatives, most are tailored to specific competitions, datasets or models. A standardized and unified toolkit that supports the fair benchmarking and comparison of competing solutions with not just common databases, protocols, metrics, but also a shared codebase, is missing. To address this, we propose WeDefense, the first open-source toolkit to support both fake audio detection and localization. Beyond model training, WeDefense emphasizes critical yet often overlooked components: flexible input and augmentation, calibration, score fusion, standardized evaluation metrics, and analysis tools for deeper understanding and interpretation. The toolkit is publicly available at https://github.com/zlin0/wedefense with interactive demos for fake audio detection and localization.