Toward genuine efficiency and cluster robustness of preconditioned CG-like eigensolvers
Ming Zhou, Klaus Neymeyr

TL;DR
This paper introduces a cluster-robust variant of the LOPCG eigensolver that improves efficiency and convergence stability for Hermitian eigenvalue problems by using asymptotic recurrences and strategic search direction corrections.
Contribution
It develops a new class of vector iterations that enhances LOPCG's robustness and efficiency for clustered eigenvalues through innovative recurrence and correction strategies.
Findings
Reduces the number of steps needed for convergence.
Significantly decreases total computational time.
Improves stability in clustered eigenvalue computations.
Abstract
The performance of eigenvalue problem solvers (eigensolvers) depends on various factors such as preconditioning and eigenvalue distribution. Developing stable and rapidly converging vectorwise eigensolvers is a crucial step in improving the overall efficiency of their blockwise implementations. The present paper is concerned with the locally optimal block preconditioned conjugate gradient (LOBPCG) method for Hermitian eigenvalue problems, and motivated by two recently proposed alternatives for its single-vector version LOPCG. A common basis of these eigensolvers is the well-known CG method for linear systems. However, the optimality of CG search directions cannot perfectly be transferred to CG-like eigensolvers. In particular, while computing clustered eigenvalues, LOPCG and its alternatives suffer from frequent delays, leading to a staircase-shaped convergence behavior which cannot be…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMatrix Theory and Algorithms · Model Reduction and Neural Networks · Tensor decomposition and applications
