Resonant Processing of Instrumental Sound Controlled by Spatial Position

TL;DR

This paper introduces a novel acoustic instrument that uses spatial position and pitch tracking to control a resonance model, enabling real-time sound modification through motion and pitch inputs.

Contribution

It presents a new method for controlling a resonance model of an instrument via spatial and pitch tracking, integrating multiple technologies for versatile sound manipulation.

Findings

Spatial position modifies resonance filter parameters.

Simplicial interpolation maps position to sound parameters.

The system allows real-time, adaptable control of acoustic sound.

Abstract

We present an acoustic musical instrument played through a resonance model of another sound. The resonance model is controlled in real time as part of the composite instrument. Our implementation uses an electric violin, whose spatial position modifies filter parameters of the resonance model. Simplicial interpolation defines the mapping from spatial position to filter parameters. With some effort, pitch tracking can also control the filter parameters. The individual technologies -- motion tracking, pitch tracking, resonance models -- are easily adapted to other instruments.