A Theory of Multiple-Source Adaptation with Limited Target Labeled Data

TL;DR

This paper develops a theoretical framework and algorithms for multiple-source domain adaptation with limited labeled target data, demonstrating both strong guarantees and practical effectiveness through experiments.

Contribution

It introduces a new family of algorithms based on model selection for multiple-source adaptation with limited target labels, addressing key theoretical challenges.

Findings

Algorithms achieve favorable theoretical guarantees.

Experimental results show practical effectiveness.

Addresses obstacles in alternative techniques.

Abstract

We present a theoretical and algorithmic study of the multiple-source domain adaptation problem in the common scenario where the learner has access only to a limited amount of labeled target data, but where the learner has at disposal a large amount of labeled data from multiple source domains. We show that a new family of algorithms based on model selection ideas benefits from very favorable guarantees in this scenario and discuss some theoretical obstacles affecting some alternative techniques. We also report the results of several experiments with our algorithms that demonstrate their practical effectiveness.