Propensity-driven Uncertainty Learning for Sample Exploration in Source-Free Active Domain Adaptation

TL;DR

ProULearn introduces a novel framework for source-free active domain adaptation that intelligently selects informative samples using propensity-driven uncertainty estimation, improving adaptation performance without source data access.

Contribution

It proposes a new homogeneity propensity estimation and correlation-based sample selection method for effective, noise-robust domain adaptation without source data.

Findings

Outperforms state-of-the-art methods on four benchmark datasets.

Effectively identifies representative and challenging samples.

Reduces reliance on frequent human annotations.

Abstract

Source-free active domain adaptation (SFADA) addresses the challenge of adapting a pre-trained model to new domains without access to source data while minimizing the need for target domain annotations. This scenario is particularly relevant in real-world applications where data privacy, storage limitations, or labeling costs are significant concerns. Key challenges in SFADA include selecting the most informative samples from the target domain for labeling, effectively leveraging both labeled and unlabeled target data, and adapting the model without relying on source domain information. Additionally, existing methods often struggle with noisy or outlier samples and may require impractical progressive labeling during training. To effectively select more informative samples without frequently requesting human annotations, we propose the Propensity-driven Uncertainty Learning (ProULearn) framework. ProULearn utilizes a novel homogeneity propensity estimation mechanism combined with correlation index calculation to evaluate feature-level relationships. This approach enables the identification of representative and challenging samples while avoiding noisy outliers. Additionally, we develop a central correlation loss to refine pseudo-labels and create compact class distributions during adaptation. In this way, ProULearn effectively bridges the domain gap and maximizes adaptation performance. The principles of informative sample selection underlying ProULearn have broad implications beyond SFADA, offering benefits across various deep learning tasks where identifying key data points or features is crucial. Extensive experiments on four benchmark datasets demonstrate that ProULearn outperforms state-of-the-art methods in domain adaptation scenarios.