Parallel-in-iteration optimization using multigrid reduction-in-time

TL;DR

This paper introduces a parallel-in-iteration optimization framework using multigrid reduction-in-time (MGRIT) to accelerate convergence of gradient-based methods, demonstrated on convex and nonsmooth problems with promising parallel speedups.

Contribution

The work adapts parallel-in-time algorithms, specifically MGRIT, to optimize iterative algorithms, enabling parallelization across iterations for faster convergence in large-scale problems.

Findings

MGRIT achieves fast convergence similar to PDE diffusion problems.

Parallel speedup predictions align with theoretical models.

Applicable to both smooth and nonsmooth optimization problems.

Abstract

Standard gradient-based iteration algorithms for optimization, such as gradient descent and its various proximal-based extensions to nonsmooth problems, are known to converge slowly for ill-conditioned problems, sometimes requiring many tens of thousands of iterations in practice. Since these iterations are computed sequentially, they may present a computational bottleneck in large-scale parallel simulations. In this work, we present a "parallel-in-iteration" framework that allows one to parallelize across these iterations using multiple processors with the objective of reducing the wall-clock time needed to solve the underlying optimization problem. Our methodology is based on re-purposing parallel time integration algorithms for time-dependent differential equations, motivated by the fact that optimization algorithms often have interpretations as discretizations of time-dependent differential equations (such as gradient flow). Specifically in this work, we use the parallel-in-time method of multigrid reduction-in-time (MGRIT), but note that our approach permits in principle the use of any other parallel-in-time method. We numerically demonstrate the efficacy of our approach on two different model problems, including a standard convex quadratic problem and the nonsmooth elastic obstacle problem in one and two spatial dimensions. For our model problems, we observe fast MGRIT convergence analogous to its prototypical performance on partial differential equations of diffusion type. Some theory is presented to connect the convergence of MGRIT to the convergence of the underlying optimization algorithm. Theoretically predicted parallel speedup results are also provided.