Domain Decorrelation with Potential Energy Ranking

TL;DR

This paper introduces Potential Energy Ranking (PoER), a method that decouples object and domain features in images to improve domain generalization in deep learning, achieving state-of-the-art results.

Contribution

PoER is a novel approach that promotes learning label-discriminative features while filtering domain-related correlations, enhancing domain-invariant feature extraction.

Findings

PoER improves top-1 accuracy by at least 1.20% on benchmarks.

PoER achieves top performance in the ECCV 2022 NICO Challenge.

PoER effectively decouples object and domain features in neural networks.

Abstract

Machine learning systems, especially the methods based on deep learning, enjoy great success in modern computer vision tasks under experimental settings. Generally, these classic deep learning methods are built on the \emph{i.i.d.} assumption, supposing the training and test data are drawn from a similar distribution independently and identically. However, the aforementioned \emph{i.i.d.} assumption is in general unavailable in the real-world scenario, and as a result, leads to sharp performance decay of deep learning algorithms. Behind this, domain shift is one of the primary factors to be blamed. In order to tackle this problem, we propose using \textbf{Po}tential \textbf{E}nergy \textbf{R}anking (PoER) to decouple the object feature and the domain feature (\emph{i.e.,} appearance feature) in given images, promoting the learning of label-discriminative features while filtering out the irrelevant correlations between the objects and the background. PoER helps the neural networks to capture label-related features which contain the domain information first in shallow layers and then distills the label-discriminative representations out progressively, enforcing the neural networks to be aware of the characteristic of objects and background which is vital to the generation of domain-invariant features. PoER reports superior performance on domain generalization benchmarks, improving the average top-1 accuracy by at least 1.20\% compared to the existing methods. Moreover, we use PoER in the ECCV 2022 NICO Challenge\footnote{https://nicochallenge.com}, achieving top place with only a vanilla ResNet-18. The code has been made available at https://github.com/ForeverPs/PoER.