Minimax optimal adaptive structured transfer learning through semi-parametric domain-varying coefficient model

TL;DR

This paper introduces a semiparametric domain-varying coefficient model for transfer learning that adaptively leverages source domains while avoiding negative transfer, achieving minimax optimality and enabling reliable inference.

Contribution

It proposes a novel structured transfer learning framework with an adaptive estimator that is both computationally efficient and theoretically optimal under heterogeneity.

Findings

Estimator is minimax rate-optimal.

Provides asymptotic distribution for inference.

Effectively balances information sharing and negative transfer risk.

Abstract

Transfer learning aims to improve inference in a target domain by leveraging information from related source domains, but its effectiveness critically depends on how cross-domain heterogeneity is modeled and controlled. When the conditional mechanism linking covariates and responses varies across domains, indiscriminate information pooling can lead to negative transfer, degrading performance relative to target-only estimation. We study a multi-source, single-target transfer learning problem under conditional distributional drift and propose a semiparametric domain-varying coefficient model (DVCM), in which domain-relatedness is encoded through an observable domain identifier. This framework generalizes classical varying-coefficient models to structured transfer learning and interpolates between invariant and fully heterogeneous regimes. Building on this model, we develop an adaptive transfer learning estimator that selectively borrows strength from informative source domains while provably safeguarding against negative transfer. Our estimator is computationally efficient and easy to implement; we also show that it is minimax rate-optimal and derive its asymptotic distribution, enabling valid uncertainty quantification and hypothesis testing despite data-adaptive pooling and shrinkage. Our results precisely characterize the interplay among domain heterogeneity, the smoothness of the underlying mean function, and the number of source domains and are corroborated by comprehensive numerical experiments and two real-data applications.