AnimalWeb: A Large-Scale Hierarchical Dataset of Annotated Animal Faces

TL;DR

AnimalWeb is a comprehensive, large-scale dataset of annotated animal faces across many species, designed to advance automatic understanding of animal facial expressions and behaviors, thereby improving animal healthcare and psychology research.

Contribution

The paper introduces AnimalWeb, a large, hierarchically structured dataset of 21.9K annotated animal faces from 334 species, enabling new research in animal face analysis.

Findings

Benchmark results reveal the dataset's challenging nature.

Demonstrated potential for multi-task face analysis applications.

Room for algorithmic improvements in face detection and recognition.

Abstract

Being heavily reliant on animals, it is our ethical obligation to improve their well-being by understanding their needs. Several studies show that animal needs are often expressed through their faces. Though remarkable progress has been made towards the automatic understanding of human faces, this has regrettably not been the case with animal faces. There exists significant room and appropriate need to develop automatic systems capable of interpreting animal faces. Among many transformative impacts, such a technology will foster better and cheaper animal healthcare, and further advance animal psychology understanding. We believe the underlying research progress is mainly obstructed by the lack of an adequately annotated dataset of animal faces, covering a wide spectrum of animal species. To this end, we introduce a large-scale, hierarchical annotated dataset of animal faces, featuring 21.9K faces from 334 diverse species and 21 animal orders across biological taxonomy. These faces are captured `in-the-wild' conditions and are consistently annotated with 9 landmarks on key facial features. The proposed dataset is structured and scalable by design; its development underwent four systematic stages involving rigorous, manual annotation effort of over 6K man-hours. We benchmark it for face alignment using the existing art under novel problem settings. Results showcase its challenging nature, unique attributes and present definite prospects for novel, adaptive, and generalized face-oriented CV algorithms. We further benchmark the dataset for face detection and fine-grained recognition tasks, to demonstrate multi-task applications and room for improvement. Experiments indicate that this dataset will push the algorithmic advancements across many related CV tasks and encourage the development of novel systems for animal facial behaviour monitoring. We will make the dataset publicly available.