Performant Tridiagonal Factorization of Skew-Symmetric Matrices

TL;DR

This paper introduces a high-performance method for tridiagonal factorization of skew-symmetric matrices, enabling efficient determinant computation and system solving, with optimized parallel CPU implementations leveraging BLIS capabilities.

Contribution

It develops a novel, efficient algorithm for skew-symmetric matrix factorization into LTL^T form, utilizing FLAME methodology and BLIS enhancements for superior performance.

Findings

Achieves significantly faster performance than previous algorithms.

Demonstrates effective parallel CPU implementations with reduced memory traffic.

Provides a prototype C++ API for correct-by-construction algorithm translation.

Abstract

The factorization of skew-symmetric matrices is a critically understudied area of dense linear algebra, particularly in comparison to that of general and symmetric matrices. While some algorithms can be adapted from the symmetric case, the cost of algorithms can be reduced by exploiting skew-symmetry. This work examines the factorization of a skew-symmetric matrix $X$ into its $LTL^T$ decomposition, where $L$ is unit lower triangular and $T$ is tridiagonal. This is also known as a triangular tridiagonalization. This operation is a means for computing the determinant of $X$ as the square of the (cheaply-computed) Pfaffian of the skew-symmetric tridiagonal matrix $T$ as well as for solving systems of equations, across fields such as quantum electronic structure and machine learning. Its application also often requires pivoting in order to improve numerical stability. We compare and contrast previously-published algorithms with those systematically derived using the FLAME methodology. Performant parallel CPU implementations are achieved by fusing operations at multiple levels in order to reduce memory traffic overhead. A key factor is the employment of new capabilities of the BLAS-like Library Instantion Software (BLIS) framework, which now supports casting level-2 and level-3 BLAS-like operations by leveraging its gemm and other kernels, hierarchical parallelism, and cache blocking. A prototype, concise C++ API facilitates the translation of correct-by-construction algorithms into correct code. Experiments verify that the resulting implementations greatly exceed the performance of previous work.