Acoustic Features of Emotional Vocalizations Account for Early Modulations of Event‐Related Brain Potentials

TL;DR

This study shows that early brain responses to emotional sounds are mostly influenced by acoustic features like intensity and pitch, not just the emotion itself.

Contribution

The study demonstrates that acoustic features, not emotion per se, largely explain early ERP modulations in emotional vocalizations.

Findings

Early ERP amplitudes for sad vocalizations were lower than for other emotions, explained by acoustic intensity.

Acoustic intensity and pitch account for most ERP modulations in emotional vocalizations.

ERP differences between emotions at longer latencies are also largely explained by acoustic features.

Abstract

Emotion is key to human communication, and inferring emotion in a speaker's voice is a cross‐cultural and cross‐linguistic capability. Electroencephalography (EEG) studies of neural mechanisms supporting emotion perception have reported that early components of the event‐related potential (ERP) are modulated by emotion. However, the nature of emotion's effect, especially on the P200 component, is disputed. We hypothesized that early acoustic features of emotional utterances might account for ERP modulations previously attributed to emotion. We recorded multi‐channel EEG from healthy participants (n = 30) tasked with recognizing the emotion of utterances. We used 50 vocalizations in five emotions—anger, happiness, neutral, sadness and pleasure—drawn from the Montreal Affective Voices dataset. We statistically quantified instantaneous associations between ERP amplitudes, emotion categories, and acoustic features, specifically, intensity, pitch, first formant, and second formant. We found that shortly after utterance onset (120–250 ms, i.e., P200, early P300) ERP amplitude for sad vocalizations was less than for other emotional categories. Moreover, ERP amplitude at around 180 ms for happy vocalization was less than for anger, sadness, and pleasure. Our analysis showed that acoustic intensity explains most of these early‐latency effects. We also found that, at longer latency (220–500 ms; late P200, P300) ERP amplitude for neutral vocalizations was less than for other emotional categories. Furthermore, there were also ERP differences between anger and happiness, anger and pleasure, anger and sadness, happiness and pleasure, as well as happiness and sadness in shorter windows during this late period. Acoustic pitch and, to a lesser degree, acoustic intensity explain most of these later effects. We conclude that acoustic features can account for early ERP modulations evoked by emotional utterances. Because previous studies used a variety of stimuli, our result likely resolves previous disputes on emotion's effect on P200.

Electroencephalography (EEG) studies of the perception of emotional speech indicate that early components of event‐related brain potentials (ERPs) are modulated by emotion. However, the direction and size of emotion's effect on these ERPs is disputed. We recorded ERPs in response to emotional speech (non‐linguistic vocalizations, e.g., laughter) and performed detailed statistical analysis of these responses and speech acoustics. We observed early ERP modulations by emotion. However, modulations were mostly explained by acoustic features, particularly intensity and pitch.

Figures