# From Imagination to Immersion: The Impact of Augmented Reality Instruction on Musical Emotion Processing: An fNIRS Hyperscanning Study

## TL;DR

This study shows how augmented reality improves emotional engagement in music learning by activating specific brain networks.

## Contribution

It identifies unique neural mechanisms of AR instruction in enhancing emotional arousal during music education.

## Key findings

- AR instruction improved emotional arousal more than visual imagery or no instruction.
- AR activated brain regions linked to social cognition and multisensory integration.
- Both methods enhanced inter-brain synchronization in emotion-related brain areas.

## Abstract

Background: This study addresses a common challenge in music education: students’ limited emotional engagement during music listening. Objectives: This study compared two teaching methods—externally guided augmented reality (AR) integration and internally generated simulation—in terms of their neural and behavioral differences in guiding students’ visual mental imagery and influencing their musical affect processing. Methods: Using Chinese Pipa music appreciation as our experimental paradigm, we employed fNIRS hyperscanning to record inter-brain synchronization (IBS) during teacher–student interactions across three instructional conditions (AR group, n = 27; visual imagery group, n = 27; no-instruction group, n = 27), while simultaneously assessing students’ performance in music–emotion processing tasks (emotion recognition and experience). Results: At the behavioral level, both instructional methods significantly enhanced students’ ability to differentiate emotional valence in music compared to the control condition. Crucially, the AR approach demonstrated a unique advantage in augmenting emotional arousal. Neurally, both teaching methods significantly enhanced IBS in brain regions associated with emotion evaluation (lOFC) and imaginative reasoning (bilateral dlPFC). Beyond these shared neural correlates, AR instruction specifically engaged additional brain networks supporting social cognition (lFPC) and multisensory integration (rANG). Furthermore, we identified a significant positive correlation between lFPC-IBS and improved emotional arousal exclusively in the AR group. Conclusions: The visual imagery group primarily enhances emotional music processing through neural alignment in core emotional brain regions, while augmented reality instruction creates unique advantages by additionally activating brain networks associated with social cognition and cross-modal integration. This research provides neuroscientific evidence for the dissociable mechanisms through which different teaching approaches enhance music–emotion learning, offering important implications for developing evidence-based educational technologies.