Microphone Occlusion Mitigation for Own-Voice Enhancement in Head-Worn Microphone Arrays Using Switching-Adaptive Beamforming

TL;DR

This paper investigates methods to improve own-voice enhancement in head-worn microphone arrays when microphones become occluded, proposing switching and adaptive beamforming techniques to handle changing transfer functions.

Contribution

It introduces a hybrid switching-adaptive beamforming approach to mitigate microphone occlusion effects in head-worn microphone arrays, addressing a rarely studied challenge.

Findings

Switching-adaptive beamforming improves noise reduction.

Hybrid approach reduces own-voice distortion.

Methods are robust against voice activity detection errors.

Abstract

Enhancing the user's own-voice for head-worn microphone arrays is an important task in noisy environments to allow for easier speech communication and user-device interaction. However, a rarely addressed challenge is the change of the microphones' transfer functions when one or more of the microphones gets occluded by skin, clothes or hair. The underlying problem for beamforming-based speech enhancement is the (potentially rapidly) changing transfer functions of both the own-voice and the noise component that have to be accounted for to achieve optimal performance. In this paper, we address the problem of an occluded microphone in a head-worn microphone array. We investigate three alternative mitigation approaches by means of (i) conventional adaptive beamforming, (ii) switching between a-priori estimates of the beamformer coefficients for the occluded and unoccluded state, and (iii) a hybrid approach using a switching-adaptive beamformer. In an evaluation with real-world recordings and simulated occlusion, we demonstrate the advantages of the different approaches in terms of noise reduction, own-voice distortion and robustness against voice activity detection errors.