Fast Bayesian Basis Selection for Functional Data Representation with Correlated Errors

TL;DR

This paper introduces a fast Bayesian basis selection method for functional data that accounts for correlated errors and uses a variational EM algorithm, outperforming traditional methods in various datasets.

Contribution

It presents a novel Bayesian approach with a VEM algorithm for basis selection in functional data, explicitly modeling correlated errors and improving computational efficiency.

Findings

Effectively identifies true data structure across scenarios.

Estimates basis coefficients and within-curve correlation accurately.

Demonstrates superior or comparable performance to existing methods.

Abstract

Functional data analysis finds widespread application across various fields. While functional data are intrinsically infinite-dimensional, in practice, they are observed only at a finite set of points, typically over a dense grid. As a result, smoothing techniques are often used to approximate the observed data as functions. In this work, we propose a novel Bayesian approach for selecting basis functions for smoothing one or multiple curves simultaneously. Our method differentiates from other Bayesian approaches in two key ways: (i) by accounting for correlated errors and (ii) by developing a variational Expectation-Maximization (VEM) algorithm, which is faster than Markov chain Monte Carlo (MCMC) methods such as Gibbs sampling. Simulation studies demonstrate that our method effectively identifies the true underlying structure of the data across various scenarios, and it is applicable to different types of functional data. Our VEM algorithm not only recovers the basis coefficients and the correct set of basis functions but also estimates the existing within-curve correlation. When applied to the motorcycle, LIDAR (LIght Detection And Ranging) experiment and Canadian weather datasets, our method demonstrates comparable, and in some cases superior, performance in terms of adjusted R2 compared to regression splines, smoothing splines, least absolute shrinkage and selection operator (LASSO) and Bayesian LASSO. Our proposed method is implemented in R and codes are available at https://github.com/acarolcruz/VB-Bases-Selection