Neonatal jaundice detection using a vision transformer-based deep learning model

TL;DR

This paper presents a deep learning model using Vision Transformers for non-invasive detection of neonatal jaundice via smartphone images, offering a low-cost and accurate alternative to traditional methods.

Contribution

The study introduces a Vision Transformer-based model for neonatal jaundice detection that outperforms existing methods in accuracy and generalizability.

Findings

The T2T-ViT model achieved 99% performance across multiple metrics for neonatal jaundice detection.

Transformer-based models outperformed convolutional and traditional machine learning models in this task.

The approach is feasible for scalable, non-invasive screening in low-resource settings.

Abstract

Neonatal jaundice is a prevalent and potentially serious condition that can lead to severe complications if undiagnosed or untreated. While traditional diagnostic methods like blood sampling are invasive and time-consuming, and transcutaneous bilirubinometers remain costly, smartphone-based image analysis offers a promising low-cost, non-invasive alternative. However, most existing solutions rely on traditional machine learning techniques with limited accuracy and generalizability. In this study, we introduce a deep learning approach based on the Vision Transformer (T2T-ViT) and compare its performance with three other models, ResNet, Support Vector Machine (SVM), and K-Nearest Neighbors (k-NN), using a clinically annotated dataset of neonatal skin images captured via a smartphone camera. The models were evaluated using multiple performance metrics including accuracy, precision, recall, F1-score, Matthews Correlation Coefficient (MCC), and Area under the Curve (AUC). The T2T-ViT model achieved 99% across all metrics, significantly outperforming both convolutional and traditional machine learning models. These findings demonstrate the feasibility of applying transformer-based deep learning architectures for accessible, scalable, and accurate non-invasive neonatal jaundice screening, potentially enabling early intervention in resource-limited settings. This approach could serve as an accessible, scalable screening tool for neonatal jaundice detection, particularly in low-resource clinical settings.

Figures