Using perceptive subbands analysis to perform audio scenes cartography

TL;DR

This paper introduces a method for audio scene mapping using perceptive subband analysis, enabling the detection and tracking of multiple fixed and mobile sound sources in stereo recordings.

Contribution

It presents a novel approach combining perceptive subband analysis with temporal laws and correlation to perform real-time audio scene cartography.

Findings

Successfully tested with 2 to 4 fixed sources

Able to track mobile sources in stereo recordings

Demonstrated real-time stereo recording simulations

Abstract

Audio scene cartography for real or simulated stereo recordings is presented. This audio scene analysis is performed doing successively: a perceptive 10-subbands analysis, calculation of temporal laws for relative delays and gains between both channels of each subband using a short-time cons\-tant scene assumption and channels inter-correlation which permit to follow a mobile source in its moves, calculation of global and subbands histograms whose peaks give the incidence information for fixed sources. Audio scenes composed of 2 to 4 fixed sources or with a fixed source and a mobile one have been already successfully tested. Further extensions and applications will be discussed. Audio illustrations of audio scenes, subband analysis and demonstration of real-time stereo recording simulations will be given.Paper 6340 presented at the 118th Convention of the Audio Engineering Society, Barcelona, 2005