Estimation and Model Identification of Locally Stationary Varying-Coefficient Additive Models

TL;DR

This paper introduces a three-step spline estimation method and a two-stage penalty procedure for locally stationary varying-coefficient additive models, enabling effective estimation and model identification in high-dimensional nonparametric regression.

Contribution

It develops a novel three-step spline estimation and a two-stage penalty method for identifying additive and varying-coefficient components in locally stationary models.

Findings

The estimators are consistent with optimal $L_{2}$ convergence rates.

The identification procedure reliably distinguishes pure additive and varying-coefficient terms.

Simulation studies confirm the effectiveness of the proposed methods.

Abstract

Nonparametric regression models with locally stationary covariates have received increasing interest in recent years. As a nice relief of "curse of dimensionality" induced by large dimension of covariates, additive regression model is commonly used. However, in locally stationary context, to catch the dynamic nature of regression function, we adopt a flexible varying-coefficient additive model where the regression function has the form $\alpha_{0}\left(u\right)+\sum_{k=1}^{p}\alpha_{k}\left(u\right)\beta_{k}\left(x_{k}\right).$ For this model, we propose a three-step spline estimation method for each univariate nonparametric function, and show its consistency and $L_{2}$ rate of convergence. Furthermore, based upon the three-step estimators, we develop a two-stage penalty procedure to identify pure additive terms and varying-coefficient terms in varying-coefficient additive model. As expected, we demonstrate that the proposed identification procedure is consistent, and the penalized estimators achieve the same $L_{2}$ rate of convergence as the polynomial spline estimators. Simulation studies are presented to illustrate the finite sample performance of the proposed three-step spline estimation method and two-stage model selection procedure.