Structural and Statistical Audio Texture Knowledge Distillation for Acoustic Classification

TL;DR

This paper introduces SSATKD, a novel knowledge distillation framework that enhances environmental sound classification by integrating low-level audio textures with high-level context, showing consistent improvements across diverse datasets.

Contribution

The paper presents a new distillation framework combining structural and statistical audio textures with high-level features, improving sound classification accuracy.

Findings

Consistent accuracy improvements across four diverse datasets.

Effective with both convolutional and transformer-based teacher models.

Robust performance with different teacher adaptation strategies.

Abstract

While knowledge distillation has shown success in various audio tasks, its application to environmental sound classification often overlooks essential low-level audio texture features needed to capture local patterns in complex acoustic environments. To address this gap, the Structural and Statistical Audio Texture Knowledge Distillation (SSATKD) framework is proposed, which combines high-level contextual information with low-level structural and statistical audio textures extracted from intermediate layers. To evaluate its generalizability across diverse acoustic domains, SSATKD is tested on four datasets within the environmental sound classification domain, including two passive sonar datasets (DeepShip and Vessel Type Underwater Acoustic Data (VTUAD)) and two general environmental sound datasets (Environmental Sound Classification 50 (ESC-50) and Tampere University of Technology (TUT) Acoustic Scenes). Two teacher adaptation strategies are explored: classifier-head-only adaptation and full fine-tuning. The framework is further evaluated using various convolutional and transformer-based teacher models. Experimental results demonstrate consistent accuracy improvements across all datasets and settings, confirming the effectiveness and robustness of SSATKD in real-world sound classification tasks.