Dynamic Prediction of High-density Generalized Functional Data with Fast Generalized Functional Principal Component Analysis

TL;DR

This paper introduces a fast, scalable generalized functional principal component analysis method for dynamic prediction of complex, high-density biomedical data, enabling accurate out-of-sample forecasts with high computational efficiency.

Contribution

It develops a novel, efficient approach for dynamic prediction in large-scale, high-density data using fast GFPCA, capable of handling complex nonlinear patterns and providing out-of-sample predictions without reestimating parameters.

Findings

Outperforms existing methods in predictive accuracy

Demonstrates high computational efficiency on large datasets

Provides personalized, out-of-sample predictions

Abstract

Dynamic prediction, which typically refers to the prediction of future outcomes using historical records, is often of interest in biomedical research. For datasets with large sample sizes, high measurement density, and complex correlation structures, traditional methods are often infeasible because of the computational burden associated with both data scale and model complexity. Moreover, many models do not directly facilitate out-of-sample predictions for generalized outcomes. To address these issues, we develop a novel approach for dynamic predictions based on a recently developed method estimating complex patterns of variation for exponential family data: fast Generalized Functional Principal Components Analysis (fGFPCA). Our method is able to handle large-scale, high-density repeated measures much more efficiently with its implementation feasible even on personal computational resources (e.g., a standard desktop or laptop computer). The proposed method makes highly flexible and accurate predictions of future trajectories for data that exhibit high degrees of nonlinearity, and allows for out-of-sample predictions to be obtained without reestimating any parameters. A simulation study is designed and implemented to illustrate the advantages of this method. To demonstrate its practical utility, we also conducted a case study to predict diurnal active/inactive patterns using accelerometry data from the National Health and Nutrition Examination Survey (NHANES) 2011-2014. Both the simulation study and the data application demonstrate the better predictive performance and high computational efficiency of the proposed method compared to existing methods. The proposed method also obtains more personalized prediction that improves as more information becomes available, which is an essential goal of dynamic prediction that other methods fail to achieve.