Active Bird2Vec: Towards End-to-End Bird Sound Monitoring with Transformers
Lukas Rauch, Raphael Schwinger, Moritz Wirth, Bernhard Sick, Sven, Tomforde, Christoph Scholz

TL;DR
Active Bird2Vec introduces an end-to-end transformer-based approach for bird sound monitoring, combining self-supervised learning and active learning to improve recognition accuracy and reduce labeling efforts.
Contribution
It presents a novel framework that bypasses spectrograms, integrates SSL and DAL, and evaluates transformer models for bird sound recognition.
Findings
Transformer models effectively recognize bird sounds.
SSL and DAL reduce labeling requirements.
Framework accelerates bioacoustic research.
Abstract
We propose a shift towards end-to-end learning in bird sound monitoring by combining self-supervised (SSL) and deep active learning (DAL). Leveraging transformer models, we aim to bypass traditional spectrogram conversions, enabling direct raw audio processing. ActiveBird2Vec is set to generate high-quality bird sound representations through SSL, potentially accelerating the assessment of environmental changes and decision-making processes for wind farms. Additionally, we seek to utilize the wide variety of bird vocalizations through DAL, reducing the reliance on extensively labeled datasets by human experts. We plan to curate a comprehensive set of tasks through Huggingface Datasets, enhancing future comparability and reproducibility of bioacoustic research. A comparative analysis between various transformer models will be conducted to evaluate their proficiency in bird sound…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAnimal Vocal Communication and Behavior · Marine animal studies overview · Species Distribution and Climate Change
