Exploring Adversarially Robust Training for Unsupervised Domain Adaptation

TL;DR

This paper investigates enhancing the adversarial robustness of unsupervised domain adaptation models by systematically studying adversarial training variants and proposing a new method called ARTUDA, which improves robustness without labeled target data.

Contribution

It introduces ARTUDA, a novel adversarially robust training method specifically designed for unsupervised domain adaptation, addressing the challenge of unlabeled target data.

Findings

ARTUDA consistently improves adversarial robustness across multiple benchmarks.

The study evaluates various adversarial training variants for UDA.

Experimental results show enhanced model reliability against attacks.

Abstract

Unsupervised Domain Adaptation (UDA) methods aim to transfer knowledge from a labeled source domain to an unlabeled target domain. UDA has been extensively studied in the computer vision literature. Deep networks have been shown to be vulnerable to adversarial attacks. However, very little focus is devoted to improving the adversarial robustness of deep UDA models, causing serious concerns about model reliability. Adversarial Training (AT) has been considered to be the most successful adversarial defense approach. Nevertheless, conventional AT requires ground-truth labels to generate adversarial examples and train models, which limits its effectiveness in the unlabeled target domain. In this paper, we aim to explore AT to robustify UDA models: How to enhance the unlabeled data robustness via AT while learning domain-invariant features for UDA? To answer this question, we provide a systematic study into multiple AT variants that can potentially be applied to UDA. Moreover, we propose a novel Adversarially Robust Training method for UDA accordingly, referred to as ARTUDA. Extensive experiments on multiple adversarial attacks and UDA benchmarks show that ARTUDA consistently improves the adversarial robustness of UDA models. Code is available at https://github.com/shaoyuanlo/ARTUDA