Enforcing Speech Content Privacy in Environmental Sound Recordings using Segment-wise Waveform Reversal

TL;DR

This paper presents a waveform segment reversal method combined with voice activity detection to effectively obscure speech in environmental recordings, protecting privacy while maintaining audio quality and scene integrity.

Contribution

The authors introduce a novel waveform reversal approach with a detection pipeline for targeted speech privacy enforcement, demonstrating its effectiveness through comprehensive evaluation.

Findings

97.9% reduction in speech intelligibility (WER)

Minimal impact on sound source detectability (2.7% SCAD drop)

High audio quality preserved (FAD of 1.40)

Abstract

Environmental sound recordings often contain intelligible speech, raising privacy concerns that limit analysis, sharing and reuse of data. In this paper, we introduce a method that renders speech unintelligible while preserving both the integrity of the acoustic scene, and the overall audio quality. Our approach involves reversing waveform segments to distort speech content. This process is enhanced through a voice activity detection and speech separation pipeline, which allows for more precise targeting of speech. In order to demonstrate the effectivness of the proposed approach, we consider a three-part evaluation protocol that assesses: 1) speech intelligibility using Word Error Rate (WER), 2) sound sources detectability using Sound source Classification Accuracy-Drop (SCAD) from a widely used pre-trained model, and 3) audio quality using the Fr\'echet Audio Distance (FAD), computed with our reference dataset that contains unaltered speech. Experiments on this simulated evaluation dataset, which consists of linear mixtures of speech and environmental sound scenes, show that our method achieves satisfactory speech intelligibility reduction (97.9% WER), minimal degradation of the sound sources detectability (2.7% SCAD), and high perceptual quality (FAD of 1.40). An ablation study further highlights the contribution of each component of the pipeline. We also show that incorporating random splicing to our speech content privacy enforcement method can enhance the algorithm's robustness to attempt to recover the clean speech, at a slight cost of audio quality.