Exploring Benefits of Linear Solver Parallelism on Modern Nonlinear Optimization Applications

TL;DR

This paper investigates how parallel linear solvers affect the performance of Ipopt in solving large-scale nonlinear optimization problems, comparing different solvers and providing recommendations for various problem types.

Contribution

It introduces a new open-source heterogeneous parallel linear solver and evaluates multiple solvers across diverse NLP problem classes.

Findings

Parallel linear solver scalability impacts Ipopt performance.

Performance varies across different NLP problem classes.

Recommendations improve solver selection for specific applications.

Abstract

The advent of efficient interior point optimization methods has enabled the tractable solution of large-scale linear and nonlinear programming (NLP) problems. A prominent example of such a method is seen in Ipopt, a widely-used, open-source nonlinear optimization solver. Algorithmically, Ipopt depends on the use of a sparse symmetric indefinite linear system solver, which is heavily employed within the optimization of barrier subproblems. As such, the performance and reliability of Ipopt is dependent on the properties of the selected linear solver. Inspired by a trend in mathematical programming toward solving larger and more challenging NLPs, this work explores two core questions: first, how does the scalability of available linear solvers, many of which exhibit shared-memory parallelism, impact Ipopt performance; and second, does the best linear solver vary across NLP problem classes, including nonlinear network problems and problems constrained by partial differential equations? To better understand these properties, this paper first describes available open- and closed-source, serial and parallel linear solvers and the fundamental differences among them. Second, it introduces the coupling of a new open-source linear solver capable of heterogeneous parallelism over multi-core central processing units and graphics processing units. Third, it compares linear solvers using a variety of mathematical programming problems, including standard test problems for linear and nonlinear optimization, optimal power flow benchmarks, and scalable two- and three-dimensional partial differential equation and optimal control problems. Finally, linear solver recommendations are provided to maximize Ipopt performance across different application domains.