Accelerating Conjugate Gradient Solvers for Homogenization Problems with Unitary Neural Operators

TL;DR

This paper introduces UNO-CG, a hybrid solver that combines machine learning and classical methods to accelerate conjugate gradient solvers for homogenization problems involving complex microstructures, ensuring convergence and robustness.

Contribution

The paper presents UNO-CG, a novel hybrid solver using Unitary Neural Operators as preconditioners to speed up conjugate gradient methods while guaranteeing convergence.

Findings

UNO-CG significantly reduces iteration counts.

It is competitive with handcrafted preconditioners.

It performs well across various boundary conditions.

Abstract

Rapid and reliable solvers for parametric partial differential equations (PDEs) are needed in many scientific and engineering disciplines. For example, there is a growing demand for composites and architected materials with heterogeneous microstructures. Designing such materials and predicting their behavior in practical applications requires solving homogenization problems for a wide range of material parameters and microstructures. While classical numerical solvers offer reliable and accurate solutions supported by a solid theoretical foundation, their high computational costs and slow convergence remain limiting factors. As a result, scientific machine learning is emerging as a promising alternative. However, such approaches often lack guaranteed accuracy and physical consistency. This raises the question of whether it is possible to develop hybrid approaches that combine the advantages of both data-driven methods and classical solvers. To address this, we introduce UNO-CG, a hybrid solver that accelerates conjugate gradient (CG) solvers using specially designed machine-learned preconditioners, while ensuring convergence by construction. As a preconditioner, we propose Unitary Neural Operators as a modification of Fourier Neural Operators. Our method can be interpreted as a data-driven discovery of Green's functions, which are then used to accelerate iterative solvers. We evaluate UNO-CG on various homogenization problems involving heterogeneous microstructures and millions of degrees of freedom. Our results demonstrate that UNO-CG enables a substantial reduction in the number of iterations and is competitive with handcrafted preconditioners for homogenization problems that involve expert knowledge. Moreover, UNO-CG maintains strong performance across a variety of boundary conditions, where many specialized solvers are not applicable, highlighting its versatility and robustness.