Augmented Reality Visualization for Musical Instrument Learning

TL;DR

This paper presents augmented reality visualization designs for learning musical instruments, including drum kits and guitars, evaluated through case studies to assess their effectiveness and limitations.

Contribution

It introduces novel AR visualization prototypes for drums and guitars, exploring different display modalities and their impact on instrument learning.

Findings

AR visualizations are effective for instrument learning

Different display modalities offer unique advantages

Design and technical limitations were identified

Abstract

We contribute two design studies for augmented reality visualizations that support learning musical instruments. First, we designed simple, glanceable encodings for drum kits, which we display through a projector. As second instrument, we chose guitar and designed visualizations to be displayed either on a screen as an augmented mirror or as an optical see-through AR headset. These modalities allow us to also show information around the instrument and in 3D. We evaluated our prototypes through case studies and our results demonstrate the general effectivity and revealed design-related and technical limitations.