WildIng: A Wildlife Image Invariant Representation Model for Geographical Domain Shift

TL;DR

WildIng is a novel wildlife image representation model that combines text descriptions with image features to improve the generalization of wildlife identification models across different geographical regions, addressing domain shift issues.

Contribution

WildIng introduces a new approach that integrates textual descriptions with image features to enhance robustness against geographical domain shifts in wildlife monitoring.

Findings

WildIng improves accuracy of foundation models by 30% under domain shift.

Experiments on datasets from America and Africa demonstrate enhanced generalization.

WildIng outperforms existing models in cross-region wildlife identification.

Abstract

Wildlife monitoring is crucial for studying biodiversity loss and climate change. Camera trap images provide a non-intrusive method for analyzing animal populations and identifying ecological patterns over time. However, manual analysis is time-consuming and resource-intensive. Deep learning, particularly foundation models, has been applied to automate wildlife identification, achieving strong performance when tested on data from the same geographical locations as their training sets. Yet, despite their promise, these models struggle to generalize to new geographical areas, leading to significant performance drops. For example, training an advanced vision-language model, such as CLIP with an adapter, on an African dataset achieves an accuracy of 84.77%. However, this performance drops significantly to 16.17% when the model is tested on an American dataset. This limitation partly arises because existing models rely predominantly on image-based representations, making them sensitive to geographical data distribution shifts, such as variation in background, lighting, and environmental conditions. To address this, we introduce WildIng, a Wildlife image Invariant representation model for geographical domain shift. WildIng integrates text descriptions with image features, creating a more robust representation to geographical domain shifts. By leveraging textual descriptions, our approach captures consistent semantic information, such as detailed descriptions of the appearance of the species, improving generalization across different geographical locations. Experiments show that WildIng enhances the accuracy of foundation models such as BioCLIP by 30% under geographical domain shift conditions. We evaluate WildIng on two datasets collected from different regions, namely America and Africa. The code and models are publicly available at https://github.com/Julian075/CATALOG/tree/WildIng.