A microscopic investigation of the effect of random envelope fluctuations on phoneme-in-noise perception

TL;DR

This study demonstrates that random envelope fluctuations in background noise can influence phoneme discrimination, revealing a form of informational masking that affects speech perception even without changes in signal-to-noise ratio.

Contribution

It introduces a microscopic analysis showing how noise envelope fluctuations predict phoneme responses, highlighting their role in informational masking during speech perception.

Findings

Envelope fluctuations predict responses better than chance.

Noise fluctuations account for up to 13.3% of response variance.

Similar effects observed in simulations with artificial listeners.

Abstract

In this study, we investigated the effect of specific noise realizations on the discrimination of two consonants, /b/ and /d/. For this purpose, we collected data from twelve participants, who listened to the words /aba/ or /ada/ embedded in one of three background noises. All noises had the same long-term spectrum but differed in the amount of random envelope fluctuations. The data were analyzed on a trial-by-trial basis using the reverse-correlation method. The results revealed that it is possible to predict the categorical responses with better-than-chance accuracy purely based on the spectro-temporal distribution of the random envelope fluctuations of the corresponding noises, without taking into account the actual targets or the signal-to-noise ratios used in the trials. The effect of the noise fluctuations explained on average 8.1% of the participants' responses in white noise, a proportion that increased up to 13.3% for noises with a larger amount of fluctuations. The estimated time-frequency weights revealed that the measured effect originated from confusions between noise fluctuations and relevant acoustic cues from the target words. Substantially similar conclusions were obtained from simulations using an artificial listener. We argue that this token-specific effect of noise is a form of informational masking.