The VoicePrivacy 2020 Challenge Evaluation Plan

TL;DR

The VoicePrivacy 2020 Challenge establishes a framework for developing and benchmarking speech anonymization tools to enhance privacy in voice technology, including datasets, attack models, and evaluation metrics.

Contribution

It defines the voice anonymization task, introduces baseline solutions, and sets up evaluation protocols for privacy-preserving speech technology.

Findings

Two anonymization baselines evaluated

Objective evaluation results reported

Framework for privacy benchmarking established

Abstract

The VoicePrivacy Challenge aims to promote the development of privacy preservation tools for speech technology by gathering a new community to define the tasks of interest and the evaluation methodology, and benchmarking solutions through a series of challenges. In this document, we formulate the voice anonymization task selected for the VoicePrivacy 2020 Challenge and describe the datasets used for system development and evaluation. We also present the attack models and the associated objective and subjective evaluation metrics. We introduce two anonymization baselines and report objective evaluation results.