Audio Deepfake Attribution: An Initial Dataset and Investigation

TL;DR

This paper introduces the first dataset for audio deepfake attribution and proposes a novel method, CRML, to identify the source of deepfake audio, including unknown tools, in real-world scenarios.

Contribution

It presents a new dataset for audio deepfake attribution and a novel CRML method for open-set identification of audio generation tools.

Findings

CRML effectively addresses open-set risks in real-world scenarios.

The dataset enables comprehensive evaluation of attribution methods.

CRML improves discriminative representation learning for known and unknown classes.

Abstract

The rapid progress of deep speech synthesis models has posed significant threats to society such as malicious manipulation of content. This has led to an increase in studies aimed at detecting so-called deepfake audio. However, existing works focus on the binary detection of real audio and fake audio. In real-world scenarios such as model copyright protection and digital evidence forensics, binary classification alone is insufficient. It is essential to identify the source of deepfake audio. Therefore, audio deepfake attribution has emerged as a new challenge. To this end, we designed the first deepfake audio dataset for the attribution of audio generation tools, called Audio Deepfake Attribution (ADA), and conducted a comprehensive investigation on system fingerprints. To address the challenges of attribution of continuously emerging unknown audio generation tools in the real world, we propose the Class-Representation Multi-Center Learning (CRML) method for open-set audio deepfake attribution (OSADA). CRML enhances the global directional variation of representations, ensuring the learning of discriminative representations with strong intra-class similarity and inter-class discrepancy among known classes. Finally, the strong class discrimination capability learned from known classes is extended to both known and unknown classes. Experimental results demonstrate that the CRML method effectively addresses open-set risks in real-world scenarios. The dataset is publicly available at: https://zenodo.org/records/13318702, and https://zenodo.org/records/13340666.