Problems and Prospects for Intimate Musical Control of Computers

TL;DR

This paper discusses the development of live performance computer-based musical instruments emphasizing ease of use, low latency, and programmability, with applications demonstrated in real performances and future research directions.

Contribution

It introduces custom controllers, adaptations of gestural interfaces, a programmable connectivity processor, and the use of OSC protocol for musical control.

Findings

Successful implementation of custom controllers and interfaces

Low latency and reliable gesture-to-music mapping achieved

Applications demonstrated in real musical performances

Abstract

In this paper we describe our efforts towards the development of live performance computer-based musical instrumentation. Our design criteria include initial ease of use coupled with a long term potential for virtuosity, minimal and low variance latency, and clear and simple strategies for programming the relationship between gesture and musical result. We present custom controllers and unique adaptations of standard gestural interfaces, a programmable connectivity processor, a communications protocol called Open Sound Control (OSC), and a variety of metaphors for musical control. We further describe applications of our technology to a variety of real musical performances and directions for future research.