Minimax estimation of Functional Principal Components from noisy discretized functional data: the case of smooth processes

TL;DR

This paper investigates the minimax estimation of covariance eigenfunctions and eigenvalues in functional PCA with noisy, discretized data, revealing the interplay between kernel smoothness and spectral properties.

Contribution

It introduces a new class of processes controlling smoothness and spectral gaps, deriving minimax bounds, and proposing a wavelet-based estimator that adapts to H"older smoothness.

Findings

Minimax lower bounds depend on spectral difficulty and discretization.

Proposed wavelet estimator achieves near-optimal rates for eigenfunction estimation.

Framework applies to classical Gaussian processes and elucidates phase transitions.

Abstract

We study the minimax estimation of covariance eigenfunctions and eigenvalues in functional principal component analysis when $n$ trajectories are observed at $p$ common grid points with additive noise. We consider covariance kernels with arbitrary H\"older smoothness and no prescribed parametric decay of the eigenvalues. In this setting, kernel smoothness and local spectral separation play distinct roles: a minimax inconsistency result over the smoothness-only class shows that kernel regularity alone is not sufficient for minimax-consistent eigenfunction estimation. To capture this interplay, we introduce a class of processes that jointly controls the H\"older smoothness of the covariance kernel and a local relative inverse eigengap quantity at the target index $\ell$. Over this class, we derive non-asymptotic minimax lower bounds for eigenfunction estimation that disentangle sampling variability, discretization and spectral effects, revealing rates of order $\delta_\ell n^{-1}+p^{-2\alpha}$, where $\delta_\ell$ quantifies the spectral difficulty. We also obtain non-asymptotic lower bounds for eigenvalue estimation under a relative squared-error loss. We then construct a computable wavelet projection estimator based on Coiflet scaling functions and a quadrature scheme designed to accommodate arbitrary H\"older smoothness. For eigenfunction estimation, this estimator matches the minimax dependence on the sample size and grid resolution, up to the natural spectral factor, for any H\"older index $\alpha>0$. Finally, we show that the proposed framework covers several classical Gaussian processes and Karhunen--Lo\`eve constructions. In particular, a Karhunen--Lo\`eve based criterion links spectral decay, eigenfunction regularity and covariance-kernel smoothness, and yields controlled simulation settings illustrating the predicted phase transitions and least-favourable discretization effects.