Exploring Human-in-the-Loop Test-Time Adaptation by Synergizing Active Learning and Model Selection

TL;DR

This paper introduces a novel Human-In-the-Loop Test-Time Adaptation approach that combines active learning and model selection to improve hyper-parameter robustness and performance across multiple datasets.

Contribution

It proposes a synergistic HILTTA method that integrates active learning with model selection, employing regularization to prevent overfitting and enhance adaptation.

Findings

Outperforms state-of-the-art HILTTA methods on 5 datasets

Prevents worst hyper-parameter choices across TTA methods

Compatible with existing TTA techniques

Abstract

Existing test-time adaptation (TTA) approaches often adapt models with the unlabeled testing data stream. A recent attempt relaxed the assumption by introducing limited human annotation, referred to as Human-In-the-Loop Test-Time Adaptation (HILTTA) in this study. The focus of existing HILTTA studies lies in selecting the most informative samples to label, a.k.a. active learning. In this work, we are motivated by a pitfall of TTA, i.e. sensitivity to hyper-parameters, and propose to approach HILTTA by synergizing active learning and model selection. Specifically, we first select samples for human annotation (active learning) and then use the labeled data to select optimal hyper-parameters (model selection). To prevent the model selection process from overfitting to local distributions, multiple regularization techniques are employed to complement the validation objective. A sample selection strategy is further tailored by considering the balance between active learning and model selection purposes. We demonstrate on 5 TTA datasets that the proposed HILTTA approach is compatible with off-the-shelf TTA methods and such combinations substantially outperform the state-of-the-art HILTTA methods. Importantly, our proposed method can always prevent choosing the worst hyper-parameters on all off-the-shelf TTA methods. The source code is available at https://github.com/Yushu-Li/HILTTA.