Performance and Robustness of Signal-Dependent vs. Signal-Independent Binaural Signal Matching with Wearable Microphone Arrays

TL;DR

This paper systematically compares signal-dependent and signal-independent binaural signal matching methods for wearable microphone arrays, demonstrating that signal-dependent approaches improve performance in high direct-to-reverberant ratio scenarios and maintain robustness against source direction estimation errors.

Contribution

It provides a comprehensive analysis of signal-dependent versus signal-independent binaural signal matching, introducing two signal-dependent methods and evaluating their performance through simulations and listening tests.

Findings

Signal-dependent BSM improves source direction accuracy.

Performance degrades gracefully with source estimation errors.

Signal-dependent BSM outperforms signal-independent BSM in high DRR conditions.

Abstract

The increasing popularity of spatial audio in applications such as teleconferencing, entertainment, and virtual reality has led to the recent developments of binaural reproduction methods. However, only a few of these methods are well-suited for wearable and mobile arrays, which typically consist of a small number of microphones. One such method is binaural signal matching (BSM), which has been shown to produce high-quality binaural signals for wearable arrays. However, BSM may be suboptimal in cases of high direct-to-reverberant ratio (DRR) as it is based on the diffuse sound field assumption. To overcome this limitation, previous studies incorporated sound-field models other than diffuse. However, performance may be sensitive to signal estimation errors. This paper aims to provide a systematic and comprehensive analysis of signal-dependent vs. signal-independent BSM, so that the benefits and limitations of the methods become clearer. Two signal-dependent BSM-based methods designed for high DRR scenarios that incorporate a sound field model composed of direct and reverberant components are investigated mathematically, using simulations, and finally validated by a listening test, and compared to the signal-independent BSM. The results show that signal-dependent BSM can significantly improve performance, in particular in the direction of the source, while presenting only a negligible degradation in other directions. Furthermore, when source direction estimation is inaccurate, performance of of the signal-dependent BSM degrade to equal that of the signal-independent BSM, presenting a desired robustness quality.