# Task-Assisted Domain Adaptation with Anchor Tasks

## TL;DR

This paper introduces a task-assisted domain adaptation method using anchor tasks and a reeze technique to improve model generalization from synthetic to real images, especially for surface normal estimation.

## Contribution

It proposes a novel approach combining anchor tasks and a cross-task guidance learning technique to enhance domain adaptation performance.

## Key findings

- reeze outperforms competing methods.
- Using anchor tasks on both domains improves results.
- Achieves performance comparable to shape-from-shading methods.

## Abstract

Some tasks, such as surface normals or single-view depth estimation, require per-pixel ground truth that is difficult to obtain on real images but easy to obtain on synthetic. However, models learned on synthetic images often do not generalize well to real images due to the domain shift. Our key idea to improve domain adaptation is to introduce a separate anchor task (such as facial landmarks) whose annotations can be obtained at no cost or are already available on both synthetic and real datasets. To further leverage the implicit relationship between the anchor and main tasks, we apply our \freeze technique that learns the cross-task guidance on the source domain with the final network layers, and use it on the target domain. We evaluate our methods on surface normal estimation on two pairs of datasets (indoor scenes and faces) with two kinds of anchor tasks (semantic segmentation and facial landmarks). We show that blindly applying domain adaptation or training the auxiliary task on only one domain may hurt performance, while using anchor tasks on both domains is better behaved. Our \freeze technique outperforms competing approaches, reaching performance in facial images on par with a recently popular surface normal estimation method using shape from shading domain knowledge.