Towards an Efficient Shifted Cholesky QR for Applications in Model Order Reduction using pyMOR

TL;DR

This paper introduces an efficient shifted Cholesky QR algorithm tailored for model order reduction, emphasizing iterative orthogonalization of high-dimensional, possibly ill-conditioned vectors, with validation through numerical experiments.

Contribution

It proposes an improved shifting strategy and updating scheme for Cholesky QR, enhancing performance and stability in MOR applications involving high-dimensional and ill-conditioned matrices.

Findings

Enhanced stability for ill-conditioned matrices.

Improved performance in iterative orthogonalization.

Validated effectiveness through numerical experiments.

Abstract

Many model order reduction (MOR) methods rely on the computation of an orthonormal basis of a subspace onto which the large full order model is projected. Numerically, this entails the orthogonalization of a set of vectors. The nature of the MOR process imposes several requirements for the orthogonalization process. Firstly, MOR is oftentimes performed in an adaptive or iterative manner, where the quality of the reduced order model, i.e., the dimension of the reduced subspace, is decided on the fly. Therefore, it is important that the orthogonalization routine can be executed iteratively. Secondly, one possibly has to deal with high-dimensional arrays of abstract vectors that do not allow explicit access to entries, making it difficult to employ so-called `orthogonal triangularization algorithms' such as Householder QR. For these reasons, (modified) Gram-Schmidt-type algorithms are commonly used in MOR applications. These methods belong to the category of `triangular orthogonalization' algorithms that do not rely on elementwise access to the vectors and can be easily updated. Recently, algorithms like shifted Cholesky QR have gained attention. These also belong to the aforementioned category and have proven their aptitude for MOR algorithms in previous studies. A key benefit of these methods is that they are communication-avoiding, leading to vastly superior performance on memory-bandwidth-limited problems and parallel or distributed architectures. This work formulates an efficient updating scheme for Cholesky QR algorithms and proposes an improved shifting strategy for highly ill-conditioned matrices. The proposed algorithmic extensions are validated with numerical experiments on a laptop and computation server.