AH-OCDA: Amplitude-based Curriculum Learning and Hopfield Segmentation Model for Open Compound Domain Adaptation

TL;DR

This paper introduces AH-OCDA, a novel approach combining amplitude-based curriculum learning and Hopfield segmentation to improve open compound domain adaptation without domain labels, achieving state-of-the-art results.

Contribution

It proposes a new method that leverages FFT-based curriculum learning and Hopfield networks to handle unlabeled compound and open domains in segmentation tasks.

Findings

Achieves state-of-the-art performance on OCDA benchmarks.

Effectively adapts to continuously changing compound domains.

Handles unseen open domains without prior domain labels.

Abstract

Open compound domain adaptation (OCDA) is a practical domain adaptation problem that consists of a source domain, target compound domain, and unseen open domain. In this problem, the absence of domain labels and pixel-level segmentation labels for both compound and open domains poses challenges to the direct application of existing domain adaptation and generalization methods. To address this issue, we propose Amplitude-based curriculum learning and a Hopfield segmentation model for Open Compound Domain Adaptation (AH-OCDA). Our method comprises two complementary components: 1) amplitude-based curriculum learning and 2) Hopfield segmentation model. Without prior knowledge of target domains within the compound domains, amplitude-based curriculum learning gradually induces the semantic segmentation model to adapt from the near-source compound domain to the far-source compound domain by ranking unlabeled compound domain images through Fast Fourier Transform (FFT). Additionally, the Hopfield segmentation model maps segmentation feature distributions from arbitrary domains to the feature distributions of the source domain. AH-OCDA achieves state-of-the-art performance on two OCDA benchmarks and extended open domains, demonstrating its adaptability to continuously changing compound domains and unseen open domains.