Augmented Reality Visualization for Musical Instrument Learning
Frank Heyen, Michael Sedlmair

TL;DR
This paper presents augmented reality visualization designs for learning musical instruments, including drum kits and guitars, evaluated through case studies to assess their effectiveness and limitations.
Contribution
It introduces novel AR visualization prototypes for drums and guitars, exploring different display modalities and their impact on instrument learning.
Findings
AR visualizations are effective for instrument learning
Different display modalities offer unique advantages
Design and technical limitations were identified
Abstract
We contribute two design studies for augmented reality visualizations that support learning musical instruments. First, we designed simple, glanceable encodings for drum kits, which we display through a projector. As second instrument, we chose guitar and designed visualizations to be displayed either on a screen as an augmented mirror or as an optical see-through AR headset. These modalities allow us to also show information around the instrument and in 3D. We evaluated our prototypes through case studies and our results demonstrate the general effectivity and revealed design-related and technical limitations.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMusic Technology and Sound Studies · Interactive and Immersive Displays · Augmented Reality Applications
