ExSampling: a system for the real-time ensemble performance of field-recorded environmental sounds

TL;DR

ExSampling is a system that combines field recordings and deep learning to enable real-time environmental sound performances with automated mapping to music production software.

Contribution

It introduces an integrated system that automates sound mapping from field recordings to live music performance environments using deep learning.

Findings

Enables real-time environmental sound performances.

Automates sound mapping to Ableton Live.

Fosters interaction among recorders, composers, and performers.

Abstract

We propose ExSampling: an integrated system of recording application and Deep Learning environment for a real-time music performance of environmental sounds sampled by field recording. Automated sound mapping to Ableton Live tracks by Deep Learning enables field recording to be applied to real-time performance, and create interactions among sound recorders, composers and performers.