Exploiting Intermediate Reconstructions in Optical Coherence Tomography for Test-Time Adaption of Medical Image Segmentation

TL;DR

This paper introduces IRTTA, a method that leverages intermediate reconstructions in optical coherence tomography to adapt segmentation models at test time, improving accuracy and providing uncertainty estimates without altering existing processes.

Contribution

The novel contribution is exploiting intermediate reconstruction representations during test-time adaptation to enhance segmentation accuracy and uncertainty estimation in medical imaging.

Findings

Improved segmentation accuracy using intermediate reconstructions.

Enabled uncertainty estimation without extra computational cost.

Enhanced test-time adaptation for low-cost medical imaging devices.

Abstract

Primary health care frequently relies on low-cost imaging devices, which are commonly used for screening purposes. To ensure accurate diagnosis, these systems depend on advanced reconstruction algorithms designed to approximate the performance of high-quality counterparts. Such algorithms typically employ iterative reconstruction methods that incorporate domain-specific prior knowledge. However, downstream task performance is generally assessed using only the final reconstructed image, thereby disregarding the informative intermediate representations generated throughout the reconstruction process. In this work, we propose IRTTA to exploit these intermediate representations at test-time by adapting the normalization-layer parameters of a frozen downstream network via a modulator network that conditions on the current reconstruction timescale. The modulator network is learned during test-time using an averaged entropy loss across all individual timesteps. Variation among the timestep-wise segmentations additionally provides uncertainty estimates at no extra cost. This approach enhances segmentation performance and enables semantically meaningful uncertainty estimation, all without modifying either the reconstruction process or the downstream model.