Quantitatively Measuring and Contrastively Exploring Heterogeneity for Domain Generalization

TL;DR

This paper introduces HTCL, a two-stage contrastive learning method that quantitatively measures and exploits domain heterogeneity to improve generalization to unseen domains.

Contribution

It proposes a novel contrastive metric for domain heterogeneity and a two-stage learning framework that enhances domain generalization by better utilizing heterogeneity information.

Findings

HTCL effectively identifies the most heterogeneous domain divisions.

The method achieves superior generalization performance on benchmark datasets.

Contrastive learning improves the utilization of domain labels for domain generalization.

Abstract

Domain generalization (DG) is a prevalent problem in real-world applications, which aims to train well-generalized models for unseen target domains by utilizing several source domains. Since domain labels, i.e., which domain each data point is sampled from, naturally exist, most DG algorithms treat them as a kind of supervision information to improve the generalization performance. However, the original domain labels may not be the optimal supervision signal due to the lack of domain heterogeneity, i.e., the diversity among domains. For example, a sample in one domain may be closer to another domain, its original label thus can be the noise to disturb the generalization learning. Although some methods try to solve it by re-dividing domains and applying the newly generated dividing pattern, the pattern they choose may not be the most heterogeneous due to the lack of the metric for heterogeneity. In this paper, we point out that domain heterogeneity mainly lies in variant features under the invariant learning framework. With contrastive learning, we propose a learning potential-guided metric for domain heterogeneity by promoting learning variant features. Then we notice the differences between seeking variance-based heterogeneity and training invariance-based generalizable model. We thus propose a novel method called Heterogeneity-based Two-stage Contrastive Learning (HTCL) for the DG task. In the first stage, we generate the most heterogeneous dividing pattern with our contrastive metric. In the second stage, we employ an invariance-aimed contrastive learning by re-building pairs with the stable relation hinted by domains and classes, which better utilizes generated domain labels for generalization learning. Extensive experiments show HTCL better digs heterogeneity and yields great generalization performance.