Machine Learning Assisted Orthonormal Basis Selection for Functional Data Analysis

TL;DR

This paper introduces a data-driven machine learning method for selecting the most suitable orthonormal basis for functional data analysis, improving accuracy especially for sparse data and complex physical responses.

Contribution

It proposes a novel, machine learning-based approach for orthonormal basis selection using splinets, addressing the lack of formal criteria in basis choice.

Findings

Method improves basis selection efficiency for sparse data

Outperforms traditional bases in complex physical system analysis

Reduces mean square error in functional data transformations

Abstract

In implementations of the functional data methods, the effect of the initial choice of an orthonormal basis has not gained much attention in the past. Typically, several standard bases such as Fourier, wavelets, splines, etc. are considered to transform observed functional data and a choice is made without any formal criteria indicating which of the bases is preferable for the initial transformation of the data into functions. In an attempt to address this issue, we propose a strictly data-driven method of orthogonal basis selection. The method uses recently introduced orthogonal spline bases called the splinets obtained by efficient orthogonalization of the B-splines. The algorithm learns from the data in the machine learning style to efficiently place knots. The optimality criterion is based on the average (per functional data point) mean square error and is utilized both in the learning algorithms and in comparison studies. The latter indicates efficiency that is particularly evident for the sparse functional data and to a lesser degree in analyses of responses to complex physical systems.