Randomized low-rank approximation of parameter-dependent matrices

TL;DR

This paper introduces a method for low-rank approximation of parameter-dependent matrices using constant randomized dimension reduction matrices, enabling efficient and reliable approximations across parameters.

Contribution

It proposes a novel approach applying the same DRM across all parameters, improving efficiency and smoothness in low-rank approximations for parameter-dependent matrices.

Findings

Constant DRMs do not reduce approximation quality.

The methods reliably produce quasi-best low-rank approximations.

Theoretical bounds support the effectiveness of the approach.

Abstract

This work considers the low-rank approximation of a matrix $A(t)$ depending on a parameter $t$ in a compact set $D \subset \mathbb{R}^d$. Application areas that give rise to such problems include computational statistics and dynamical systems. Randomized algorithms are an increasingly popular approach for performing low-rank approximation and they usually proceed by multiplying the matrix with random dimension reduction matrices (DRMs). Applying such algorithms directly to $A(t)$ would involve different, independent DRMs for every $t$, which is not only expensive but also leads to inherently non-smooth approximations. In this work, we propose to use constant DRMs, that is, $A(t)$ is multiplied with the same DRM for every $t$. The resulting parameter-dependent extensions of two popular randomized algorithms, the randomized singular value decomposition and the generalized Nystr\"{o}m method, are computationally attractive, especially when $A(t)$ admits an affine linear decomposition with respect to $t$. We perform a probabilistic analysis for both algorithms, deriving bounds on the expected value as well as failure probabilities for the approximation error when using Gaussian random DRMs. Both, the theoretical results and numerical experiments, show that the use of constant DRMs does not impair their effectiveness; our methods reliably return quasi-best low-rank approximations.