Optimal Preconditioning is a Geodesically Convex Optimization Problem

TL;DR

This paper presents a unified, geodesically convex optimization framework for computing near-optimal preconditioners for linear and polynomial systems, enabling efficient algorithms with convergence guarantees.

Contribution

It introduces the first theoretical framework for preconditioning polynomial systems using geodesic convexity, extending prior linear system preconditioning methods.

Findings

Condition number minimization is geodesically convex under certain norms.

Explicit gradient formulas and convergence rates are derived.

First preconditioning algorithm with theoretical guarantees for polynomial systems.

Abstract

We introduce a unified framework for computing approximately-optimal preconditioners for solving linear and non-linear systems of equations. We demonstrate that the condition number minimization problem, under structured transformations such as diagonal and block-diagonal preconditioners, is geodesically convex with respect to unitarily invariant norms, including the Frobenius and Bombieri--Weyl norms. This allows us to introduce efficient first-order algorithms with precise convergence guarantees. For linear systems, we analyze the action of symmetric Lie subgroups $G \subseteq \GL_m(\CC) \times \GL_n(\CC)$ on the input matrix and prove that the logarithm of the condition number is a smooth geodesically convex function on the associated Riemannian quotient manifold. We obtain explicit gradient formulas, show Lipschitz continuity, and prove convergence rates for computing the optimal Frobenius condition number: $\widetilde{O}(1/\eps^2)$ iterations for general two-sided preconditioners and $\widetilde{O}(\kappa_F^2 \log(1/\eps))$ for strongly convex cases such as left preconditioning. We extend our framework to consider preconditioning of polynomial systems $\f(x) = 0$, where $\f$ is a system of multivariate polynomials. We analyze the local condition number $\mu(\f, \xi)$, at a root $\xi$ and prove that it also admits a geodesically convex formulation under appropriate group actions. We deduce explicit formulas for the Riemannian gradients and present convergence bounds for the corresponding optimization algorithms. To the best of our knowledge, this is the first preconditioning algorithm with theoretical guarantees for polynomial systems.