Holstein-Friesian Re-Identification using Multiple Cameras and Self-Supervision on a Working Farm

TL;DR

This paper introduces a multi-camera, self-supervised approach for accurate individual cow identification on a working farm, utilizing a new dataset and achieving over 96% accuracy without manual labeling.

Contribution

The study presents a novel farm-scale dataset and demonstrates that combining multi-camera data with self-supervised learning significantly improves cattle re-identification accuracy.

Findings

Achieved over 96% single image identification accuracy.

Multi-camera data enhances self-supervised identification performance.

Framework enables automatic cattle identification with minimal human verification.

Abstract

We present MultiCamCows2024, a farm-scale image dataset filmed across multiple cameras for the biometric identification of individual Holstein-Friesian cattle exploiting their unique black and white coat-patterns. Captured by three ceiling-mounted visual sensors covering adjacent barn areas over seven days on a working dairy farm, the dataset comprises 101,329 images of 90 cows, plus underlying original CCTV footage. The dataset is provided with full computer vision recognition baselines, that is both a supervised and self-supervised learning framework for individual cow identification trained on cattle tracklets. We report a performance above 96% single image identification accuracy from the dataset and demonstrate that combining data from multiple cameras during learning enhances self-supervised identification. We show that our framework enables automatic cattle identification, barring only the simple human verification of tracklet integrity during data collection. Crucially, our study highlights that multi-camera, supervised and self-supervised components in tandem not only deliver highly accurate individual cow identification, but also achieve this efficiently with no labelling of cattle identities by humans. We argue that this improvement in efficacy has practical implications for livestock management, behaviour analysis, and agricultural monitoring. For reproducibility and practical ease of use, we publish all key software and code including re-identification components and the species detector with this paper, available at https://tinyurl.com/MultiCamCows2024.