A Comparison of Deep Learning and Established Methods for Calf Behaviour Monitoring

TL;DR

This study compares deep learning methods with the Rocket algorithm for classifying calf behaviors from accelerometer data, finding Rocket outperforms all tested deep learning models in accuracy.

Contribution

The paper provides a comprehensive comparison of Rocket and 11 deep learning methods for animal activity classification, highlighting Rocket's superior performance in this context.

Findings

Rocket outperforms all tested deep learning models in classification accuracy.

Deep learning methods did not match Rocket's performance despite proper configuration.

Rocket's simplicity and data encoding contribute to its effectiveness.

Abstract

In recent years, there has been considerable progress in research on human activity recognition using data from wearable sensors. This technology also has potential in the context of animal welfare in livestock science. In this paper, we report on research on animal activity recognition in support of welfare monitoring. The data comes from collar-mounted accelerometer sensors worn by Holstein and Jersey calves, the objective being to detect changes in behaviour indicating sickness or stress. A key requirement in detecting changes in behaviour is to be able to classify activities into classes, such as drinking, running or walking. In Machine Learning terms, this is a time-series classification task, and in recent years, the Rocket family of methods have emerged as the state-of-the-art in this area. We have over 27 hours of labelled time-series data from 30 calves for our analysis. Using this data as a baseline, we present Rocket's performance on a 6-class classification task. Then, we compare this against the performance of 11 Deep Learning (DL) methods that have been proposed as promising methods for time-series classification. Given the success of DL in related areas, it is reasonable to expect that these methods will perform well here as well. Surprisingly, despite taking care to ensure that the DL methods are configured correctly, none of them match Rocket's performance. A possible explanation for the impressive success of Rocket is that it has the data encoding benefits of DL models in a much simpler classification framework.