Look-Ahead in the Two-Sided Reduction to Compact Band Forms for Symmetric Eigenvalue Problems and the SVD

TL;DR

This paper introduces look-ahead strategies in reduction algorithms to compact band forms for symmetric eigenvalue problems and SVD, improving performance by overcoming bottlenecks and optimizing block size choices.

Contribution

It proposes novel look-ahead algorithms for reduction to band forms, including an alternative approach for SVD, enhancing efficiency over traditional methods.

Findings

Enhanced reduction algorithms with look-ahead improve performance.

Alternative band form for SVD enables effective look-ahead strategies.

Block size choice significantly impacts algorithm efficiency.

Abstract

We address the reduction to compact band forms, via unitary similarity transformations, for the solution of symmetric eigenvalue problems and the computation of the singular value decomposition (SVD). Concretely, in the first case we revisit the reduction to symmetric band form while, for the second case, we propose a similar alternative, which transforms the original matrix to (unsymmetric) band form, replacing the conventional reduction method that produces a triangular--band output. In both cases, we describe algorithmic variants of the standard Level-3 BLAS-based procedures, enhanced with look-ahead, to overcome the performance bottleneck imposed by the panel factorization. Furthermore, our solutions employ an algorithmic block size that differs from the target bandwidth, illustrating the important performance benefits of this decision. Finally, we show that our alternative compact band form for the SVD is key to introduce an effective look-ahead strategy into the corresponding reduction procedure.