# Improvements in Image Registration, Segmentation, and Artifact Removal in ThermOcular Imaging System

## TL;DR

This paper improves the ThermOcular system for measuring eye surface temperature by enhancing image registration, segmentation, and artifact removal.

## Contribution

The paper introduces EyeTags, advanced segmentation models, and methods to remove eyelash and blink artifacts in ocular thermography.

## Key findings

- The OCRNet-HRNet-w18 model achieved 96.21% MIOU in segmentation accuracy.
- A new method effectively eliminates eyelash artifacts in infrared frames.
- An improved blink detection algorithm enhances measurement precision.

## Abstract

The assessment of ocular surface temperature (OST) plays a pivotal role in the diagnosis and management of various ocular diseases. This paper introduces significant enhancements to the ThermOcular system, initially developed for precise OST measurement using infrared (IR) thermography. These advancements focus on accuracy improvements that reduce user dependency and increase the system’s diagnostic capabilities. A novel addition to the system includes the use of EyeTags, which assist clinicians in selecting control points more easily, thus reducing errors associated with manual selection. Furthermore, the integration of state-of-the-art semantic segmentation models trained on the newest dataset is explored. Among these, the OCRNet-HRNet-w18 model achieved a segmentation accuracy of 96.21% MIOU, highlighting the effectiveness of the improved pipeline. Additionally, the challenge of eliminating eyelashes in IR frames, which cause artifactual measurement errors in OST assessments, is addressed. Through a newly developed method, the influence of eyelashes is eliminated, thereby enhancing the precision of temperature readings. Moreover, an algorithm for blink detection and elimination is implemented, significantly improving upon the basic methods previously utilized. These innovations not only enhance the reliability of OST measurements, but also contribute to the system’s efficiency and diagnostic accuracy, marking a significant step forward in ocular health monitoring and diagnostics.