Mapping Emotions in the Brain: A Bi-Hemispheric Neural Model with Explainable Deep Learning

TL;DR

This paper introduces an explainable deep learning framework for emotion recognition from EEG signals, revealing neurophysiologically meaningful hemispheric activation patterns and enhancing interpretability of dual-hemispheric neural models.

Contribution

It extends LIME for structured bi-hemispheric EEG inputs, providing interpretable insights into neural correlates of emotions in deep learning models.

Findings

Emotion-specific hemispheric activation patterns identified

Global channel importance profiles align with neurophysiological knowledge

Lateralization behavior varies with emotional states

Abstract

Recent advances have shown promise in emotion recognition from electroencephalogram (EEG) signals by employing bi-hemispheric neural architectures that incorporate neuroscientific priors into deep learning models. However, interpretability remains a significant limitation for their application in sensitive fields such as affective computing and cognitive modeling. In this work, we introduce a post-hoc interpretability framework tailored to dual-stream EEG classifiers, extending the Local Interpretable Model-Agnostic Explanations (LIME) approach to accommodate structured, bi-hemispheric inputs. Our method adapts LIME to handle structured two-branch inputs corresponding to left and right-hemisphere EEG channel groups. It decomposes prediction relevance into per-channel contributions across hemispheres and emotional classes. We apply this framework to a previously validated dual-branch recurrent neural network trained on EmoNeuroDB, a dataset of EEG recordings captured during a VR-based emotion elicitation task. The resulting explanations reveal emotion-specific hemispheric activation patterns consistent with known neurophysiological phenomena, such as frontal lateralization in joy and posterior asymmetry in sadness. Furthermore, we aggregate local explanations across samples to derive global channel importance profiles, enabling a neurophysiologically grounded interpretation of the model's decisions. Correlation analysis between symmetric electrodes further highlights the model's emotion-dependent lateralization behavior, supporting the functional asymmetries reported in affective neuroscience.