OTCXR: Rethinking Self-supervised Alignment using Optimal Transport for Chest X-ray Analysis

TL;DR

OTCXR introduces an optimal transport-based self-supervised learning framework for chest X-ray analysis, improving semantic alignment and feature representation by capturing both local and global contextual information.

Contribution

The paper proposes OTCXR, a novel SSL method that integrates optimal transport with a cross-viewpoint semantics module to enhance semantic invariance in chest X-ray representations.

Findings

OTCXR outperforms state-of-the-art methods on multiple chest X-ray datasets.

The framework effectively captures both local details and global context.

Enhanced representations improve thoracic disease diagnosis accuracy.

Abstract

Self-supervised learning (SSL) has emerged as a promising technique for analyzing medical modalities such as X-rays due to its ability to learn without annotations. However, conventional SSL methods face challenges in achieving semantic alignment and capturing subtle details, which limits their ability to accurately represent the underlying anatomical structures and pathological features. To address these limitations, we propose OTCXR, a novel SSL framework that leverages optimal transport (OT) to learn dense semantic invariance. By integrating OT with our innovative Cross-Viewpoint Semantics Infusion Module (CV-SIM), OTCXR enhances the model's ability to capture not only local spatial features but also global contextual dependencies across different viewpoints. This approach enriches the effectiveness of SSL in the context of chest radiographs. Furthermore, OTCXR incorporates variance and covariance regularizations within the OT framework to prioritize clinically relevant information while suppressing less informative features. This ensures that the learned representations are comprehensive and discriminative, particularly beneficial for tasks such as thoracic disease diagnosis. We validate OTCXR's efficacy through comprehensive experiments on three publicly available chest X-ray datasets. Our empirical results demonstrate the superiority of OTCXR over state-of-the-art methods across all evaluated tasks, confirming its capability to learn semantically rich representations.