Efficient error estimators for Generalized Nystr\"om

TL;DR

This paper extends fast leave-one-out error estimators to the generalized Nyström method, enabling efficient accuracy assessment for low-rank approximations of large rectangular matrices without extra matrix access.

Contribution

It introduces three new leave-one-out error estimators for the generalized Nyström decomposition, broadening the applicability of efficient error estimation techniques.

Findings

The proposed estimators accurately predict approximation errors.

Numerical experiments validate the effectiveness of the new estimators.

The methods improve scalability in large-scale matrix computations.

Abstract

Randomized algorithms in numerical linear algebra have proven to be effective in ameliorating issues of scalability when working with large matrices, efficiently producing accurate low-rank approximations. A key remaining challenge, however, is to efficiently assess the approximation accuracy of randomized methods without additional expensive matrix accesses. Recent work has addressed this issue by deriving fast leave-one-out error estimators for the randomized SVD and Nystr\"om decomposition, enabling accurate error estimation with no additional matrix accesses. In this work, we extend the leave-one-out framework to the generalized Nystr\"om decomposition, an approach that can be applied to general rectangular matrices. We do this by deriving three new leave-one-out error estimators and validating their effectiveness through numerical experiments.