Consecutive Knowledge Meta-Adaptation Learning for Unsupervised Medical Diagnosis

TL;DR

This paper introduces CLKM, a meta-adaptation framework for unsupervised medical diagnosis that continually adapts to new lesion domains while retaining prior knowledge, addressing domain gaps and catastrophic forgetting.

Contribution

The paper proposes a novel meta-adaptation framework with semantic and representation phases for online continual learning in medical image diagnosis.

Findings

Effective in online continual adaptation to multiple lesion domains

Reduces catastrophic forgetting in sequential domain adaptation

Improves diagnostic accuracy across diverse lesion datasets

Abstract

Deep learning-based Computer-Aided Diagnosis (CAD) has attracted appealing attention in academic researches and clinical applications. Nevertheless, the Convolutional Neural Networks (CNNs) diagnosis system heavily relies on the well-labeled lesion dataset, and the sensitivity to the variation of data distribution also restricts the potential application of CNNs in CAD. Unsupervised Domain Adaptation (UDA) methods are developed to solve the expensive annotation and domain gaps problem and have achieved remarkable success in medical image analysis. Yet existing UDA approaches only adapt knowledge learned from the source lesion domain to a single target lesion domain, which is against the clinical scenario: the new unlabeled target domains to be diagnosed always arrive in an online and continual manner. Moreover, the performance of existing approaches degrades dramatically on previously learned target lesion domains, due to the newly learned knowledge overwriting the previously learned knowledge (i.e., catastrophic forgetting). To deal with the above issues, we develop a meta-adaptation framework named Consecutive Lesion Knowledge Meta-Adaptation (CLKM), which mainly consists of Semantic Adaptation Phase (SAP) and Representation Adaptation Phase (RAP) to learn the diagnosis model in an online and continual manner. In the SAP, the semantic knowledge learned from the source lesion domain is transferred to consecutive target lesion domains. In the RAP, the feature-extractor is optimized to align the transferable representation knowledge across the source and multiple target lesion domains.