On Temporal Guidance and Iterative Refinement in Audio Source Separation

TL;DR

This paper introduces a novel audio source separation method that combines fine-grained temporal sound event detection with iterative refinement, significantly improving separation quality in complex sound scenes.

Contribution

It proposes a new approach that integrates Transformer-based sound event detection with iterative refinement for enhanced audio source separation.

Findings

Achieved second place in DCASE Challenge 2025 Task 4

Significant improvements in audio tagging accuracy

Enhanced source separation quality through iterative refinement

Abstract

Spatial semantic segmentation of sound scenes (S5) involves the accurate identification of active sound classes and the precise separation of their sources from complex acoustic mixtures. Conventional systems rely on a two-stage pipeline - audio tagging followed by label-conditioned source separation - but are often constrained by the absence of fine-grained temporal information critical for effective separation. In this work, we address this limitation by introducing a novel approach for S5 that enhances the synergy between the event detection and source separation stages. Our key contributions are threefold. First, we fine-tune a pre-trained Transformer to detect active sound classes. Second, we utilize a separate instance of this fine-tuned Transformer to perform sound event detection (SED), providing the separation module with detailed, time-varying guidance. Third, we implement an iterative refinement mechanism that progressively enhances separation quality by recursively reusing the separator's output from previous iterations. These advancements lead to significant improvements in both audio tagging and source separation performance, as demonstrated by our system's second-place finish in Task 4 of the DCASE Challenge 2025. Our implementation and model checkpoints are available in our GitHub repository: https://github.com/theMoro/dcase25task4 .