Efficient smoothness selection for nonparametric Markov-switching models via quasi restricted maximum likelihood

TL;DR

This paper introduces an efficient method for selecting the smoothness parameter in nonparametric Markov-switching models using penalized splines, significantly reducing computational costs and improving estimation accuracy.

Contribution

It proposes a novel approach that exploits the structure of penalized splines as random effects to enable fast and reliable smoothness selection in complex Markov-switching models.

Findings

Reduces computational burden compared to existing methods.

Improves fixed effects parameter estimation accuracy.

Facilitates practical application of nonparametric Markov-switching models.

Abstract

Markov-switching models are powerful tools that allow capturing complex patterns from time series data driven by latent states. Recent work has highlighted the benefits of estimating components of these models nonparametrically, enhancing their flexibility and reducing biases, which in turn can improve state decoding, forecasting, and overall inference. Formulating such models using penalized splines is straightforward, but practically feasible methods for a data-driven smoothness selection in these models are still lacking. Traditional techniques, such as cross-validation and information criteria-based selection suffer from major drawbacks, most importantly their reliance on computationally expensive grid search methods, hampering practical usability for Markov-switching models. Michelot (2022) suggested treating spline coefficients as random effects with a multivariate normal distribution and using the R package TMB (Kristensen et al., 2016) for marginal likelihood maximization. While this method avoids grid search and typically results in adequate smoothness selection, it entails a nested optimization problem, thus being computationally demanding. We propose to exploit the simple structure of penalized splines treated as random effects, thereby greatly reducing the computational burden while potentially improving fixed effects parameter estimation accuracy. Our proposed method offers a reliable and efficient mechanism for smoothness selection, rendering the estimation of Markov-switching models involving penalized splines feasible for complex data structures.