Non-contact detection of post-regurgitation deep inhalation in calves using infrared thermography and deep learning-based nostril segmentation

TL;DR

This study introduces a non-contact method using infrared thermography and deep learning to detect deep inhalation in calves after regurgitation, which is a key part of rumination.

Contribution

The novel approach uses non-contact infrared thermography and deep learning for detecting post-regurgitation deep inhalation in calves.

Findings

PRDI events show significantly deeper inspiratory minima compared to non-rumination inhalation (p < 0.001).

A threshold was identified to distinguish PRDI from NRI with a balanced accuracy and G-mean of 0.72.

The method provides proof-of-concept for non-contact detection of post-regurgitation respiratory features.

Abstract

Continuous monitoring of rumination is highly informative for assessing cattle health and welfare. Traditional methods for rumination detection, such as pressure sensors, accelerometers, and acoustic sensors, require direct attachment to animals, which can be costly and stressful for the animals. This study proposes a non-contact approach for characterizing post-regurgitation deep inhalation (PRDI) in calves using infrared thermography and deep learning-based nostril segmentation. Synchronized RGB and temperature data were collected from 8 calves across 28 imaging sessions, during which rumination was visually confirmed. Deep learning algorithms were used to automatically segment the nostril region in each RGB frame, enabling temperature data extraction from the segmented regions to obtain breathing patterns. Visual observation of the video recordings was used to annotate the timing of regurgitation within the breathing patterns. Breathing patterns were analyzed to distinguish PRDI from other inhalation events not associated with rumination (non-rumination inhalation, NRI), with particular attention to deeper inspiratory minima that occur immediately after regurgitation. Statistical analysis demonstrated that PRDI events exhibit significantly deeper minima compared to NRI (p < 0.001). An optimal threshold for distinguishing PRDI from NRI within the breathing patterns was identified, achieving a balanced accuracy and G-mean of 0.72, with an area under the receiver operating characteristic curve (AUC) of 0.76. This study is preliminary in nature, largely due to the short recording durations and limited sample size, both of which inherently constrain the robustness and generalizability of the results. Nevertheless, the findings provide clear proof-of-concept evidence that post-regurgitation respiratory features can be detected using a fully non-contact approach.

Figures