Diving with Penguins: Detecting Penguins and their Prey in Animal-borne Underwater Videos via Deep Learning
Kejia Zhang, Mingyu Yang, Stephen D. J. Lang, Alistair M. McInnes,, Richard B. Sherley, Tilo Burghardt

TL;DR
This paper presents a deep learning system for detecting penguins, fish, and predation behaviors in underwater videos, providing valuable tools and datasets for marine biology conservation efforts.
Contribution
It introduces a robust deep learning detector for penguins and fish, along with the first attempt at automated predation behavior recognition in underwater penguin videos.
Findings
Penguin detector achieves [email protected]%.
Fish detector achieves [email protected]%.
First results on behavior recognition in marine predator videos.
Abstract
African penguins (Spheniscus demersus) are an endangered species. Little is known regarding their underwater hunting strategies and associated predation success rates, yet this is essential for guiding conservation. Modern bio-logging technology has the potential to provide valuable insights, but manually analysing large amounts of data from animal-borne video recorders (AVRs) is time-consuming. In this paper, we publish an animal-borne underwater video dataset of penguins and introduce a ready-to-deploy deep learning system capable of robustly detecting penguins ([email protected]%) and also instances of fish ([email protected]%). We note that the detectors benefit explicitly from air-bubble learning to improve accuracy. Extending this detector towards a dual-stream behaviour recognition network, we also provide the first results for identifying predation behaviour in penguin underwater videos.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFish Ecology and Management Studies · Animal Vocal Communication and Behavior · Marine animal studies overview
