Transfer learning for high-dimensional Factor-augmented sparse linear model

TL;DR

This paper develops transfer learning methods for high-dimensional factor-augmented sparse linear models, improving estimation accuracy by leveraging auxiliary datasets while addressing correlated predictors and latent factors.

Contribution

It introduces a novel transfer learning framework with source detection and model validation techniques for high-dimensional, factor-structured data.

Findings

Significant estimation accuracy improvements demonstrated in numerical studies

Effective source detection algorithm with proven consistency

Robustness of methods under dataset heterogeneity

Abstract

In this paper, we study transfer learning for high-dimensional factor-augmented sparse linear models, motivated by applications in economics and finance where strongly correlated predictors and latent factor structures pose major challenges for reliable estimation. Our framework simultaneously mitigates the impact of high correlation and removes the additional contributions of latent factors, thereby reducing potential model misspecification in conventional linear modeling. In such settings, the target dataset is often limited, but multiple heterogeneous auxiliary sources may provide additional information. We develop transfer learning procedures that effectively leverage these auxiliary datasets to improve estimation accuracy, and establish non-asymptotic $\ell_1$- and $\ell_2$-error bounds for the proposed estimators. To prevent negative transfer, we introduce a data-driven source detection algorithm capable of identifying informative auxiliary datasets and prove its consistency. In addition, we provide a hypothesis testing framework for assessing the adequacy of the factor model, together with a procedure for constructing simultaneous confidence intervals for the regression coefficients of interest. Numerical studies demonstrate that our methods achieve substantial gains in estimation accuracy and remain robust under heterogeneity across datasets. Overall, our framework offers a theoretical foundation and a practically scalable solution for incorporating heterogeneous auxiliary information in settings with highly correlated features and latent factor structures.