Sonic interaction with a virtual orchestra of factory machinery

TL;DR

This paper introduces an immersive virtual environment where users conduct a factory machinery orchestra, receiving spatialized audio and visual feedback, demonstrating interactive sonic experiences in a large-scale immersive system.

Contribution

It presents a novel immersive application combining spatialized sound and visual feedback for interactive musical experiences with factory machinery.

Findings

Successful implementation of spatialized audio feedback

Engagement of users in conducting virtual machinery

Application demonstrated in a large immersive setup

Abstract

This paper presents an immersive application where users receive sound and visual feedbacks on their interactions with a virtual environment. In this application, the users play the part of conductors of an orchestra of factory machines since each of their actions on interaction devices triggers a pair of visual and audio responses. Audio stimuli were spatialized around the listener. The application was exhibited during the 2013 Science and Music day and designed to be used in a large immersive system with head tracking, shutter glasses and a 10.2 loudspeaker configuration.