# Prototype-oriented contrastive mean-teacher for unsupervised domain adaptive object detection

## TL;DR

This paper introduces a new framework for adapting object detectors to new domains without labeled data, using a combination of contrastive learning and prototype alignment.

## Contribution

The novel contribution is the Prototype-oriented Contrastive Mean Teacher (PoCoMT) framework, which integrates contrastive learning, prototype learning, and mean-teacher self-training for unsupervised domain adaptation.

## Key findings

- PoCoMT generates more diverse and reliable pseudo-boxes through entropy maximization and semantic consistency.
- The Prototype Alignment Network (ProtoAN) reduces intra- and inter-domain contrastive losses and aligns class structures.
- Extensive experiments show PoCoMT achieves state-of-the-art performance in unsupervised domain adaptive object detection.

## Abstract

Unsupervised domain adaptive object detection (UDA-OD) aims to deploy a detector trained on source domain(s) to a new, unlabeled target domain. Carrying out mean-teacher self-training for UDA-OD poses a significant challenge, given that its success depends heavily on the quality of pseudo boxes. While many earlier researches have mainly centered on cross-domain transferability, they often neglect the rich intra- and inter-domain semantic structures. As a result, this neglect empirically restricts the discriminative abilities of the learning model. In our study, we have found a notable alignment and synergy across contrastive learning, prototype learning, and mean-teacher self-training. Building on this insight, we introduce the Prototype-oriented C
ontrastive Mean Teacher (PoCoMT) for UDA-OD, a thorough and flexible framework that seamlessly integrates these three techniques to extract the most beneficial learning signals. Specifically, PoCoMT firstly generate more diverse and reliable probabilistic outputs from self-training through maximizing information entropy and maintaining semantic consistency; secondly, PoCoMT strives to reduce both intra-domain and inter-domain prototypical contrastive learning losses by elaborately designing a Prototype Alignment Network (ProtoAN) module, which fosters intra-domain feature aggregation, aligns inter-domain class structures, and reduces semantic loss between weak and strong augmentations of target domain data. Our ProtoAN can serve as a plugin module for traditional self-training frameworks to tackle the key problem of semantic loss in UDA-OD. Extensive experiments demonstrate that PoCoMT attains new state-of-the-art performance.