Uniphore's submission to Fearless Steps Challenge Phase-2
Karthik Pandia D S, Cosimo Spera

TL;DR
This paper presents supervised CNN-based systems for speech activity detection and speaker identification in the Fearless Steps Challenge Phase-2, achieving competitive results through a shared architecture and innovative voting-based identification.
Contribution
It introduces a unified CNN architecture for both SAD and SID tasks and proposes a two-level voting method for speaker identification.
Findings
Speech detection score of 5.96% on dev set
Speaker retrieval accuracy of over 82%
Shared CNN architecture for SAD and SID tasks
Abstract
We propose supervised systems for speech activity detection (SAD) and speaker identification (SID) tasks in Fearless Steps Challenge Phase-2. The proposed systems for both the tasks share a common convolutional neural network (CNN) architecture. Mel spectrogram is used as features. For speech activity detection, the spectrogram is divided into smaller overlapping chunks. The network is trained to recognize the chunks. The network architecture and the training steps used for the SID task are similar to that of the SAD task, except that longer spectrogram chunks are used. We propose a two-level identification method for SID task. First, for each chunk, a set of speakers is hypothesized based on the neural network posterior probabilities. Finally, the speaker identity of the utterance is identified using the chunk-level hypotheses by applying a voting rule. On SAD task, a detection cost…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSpeech Recognition and Synthesis · Speech and Audio Processing · Music and Audio Processing
