1-D CNN based Acoustic Scene Classification via Reducing Layer-wise Dimensionality

TL;DR

This paper introduces a novel low-dimensional embedding approach for acoustic scene classification using intermediate CNN layer representations, PCA, and dictionary learning, outperforming traditional time-frequency methods.

Contribution

It proposes a new framework that leverages intermediate CNN features and automatic subspace approximation for improved acoustic scene classification.

Findings

Deeper CNN layers provide more compression.

70% dimensionality reduction maintains performance.

Outperforms traditional time-frequency based methods.

Abstract

This paper presents an alternate representation framework to commonly used time-frequency representation for acoustic scene classification (ASC). A raw audio signal is represented using a pre-trained convolutional neural network (CNN) using its various intermediate layers. The study assumes that the representations obtained from the intermediate layers lie in low-dimensions intrinsically. To obtain low-dimensional embeddings, principal component analysis is performed, and the study analyzes that only a few principal components are significant. However, the appropriate number of significant components are not known. To address this, an automatic dictionary learning framework is utilized that approximates the underlying subspace. Further, the low-dimensional embeddings are aggregated in a late-fusion manner in the ensemble framework to incorporate hierarchical information learned at various intermediate layers. The experimental evaluation is performed on publicly available DCASE 2017 and 2018 ASC datasets on a pre-trained 1-D CNN, SoundNet. Empirically, it is observed that deeper layers show more compression ratio than others. At 70% compression ratio across different datasets, the performance is similar to that obtained without performing any dimensionality reduction. The proposed framework outperforms the time-frequency representation based methods.