Taylor approximation and variance reduction for PDE-constrained optimal control under uncertainty

TL;DR

This paper introduces a scalable computational framework that uses Taylor approximation and variance reduction techniques to efficiently solve high-dimensional PDE-constrained optimal control problems under uncertainty, demonstrating significant computational savings and scalability.

Contribution

The work develops a novel, scalable method combining Taylor expansion, randomized trace estimation, and control variates for PDE-constrained control under high-dimensional uncertainty, enabling efficient solutions.

Findings

Accurate approximation of mean and variance using Taylor expansion.

Significant computational savings with variance reduction techniques.

Scalability demonstrated up to one million uncertain parameters.

Abstract

In this work we develop a scalable computational framework for the solution of PDE-constrained optimal control under high-dimensional uncertainty. Specifically, we consider a mean-variance formulation of the control objective and employ a Taylor expansion with respect to the uncertain parameter either to directly approximate the control objective or as a control variate for variance reduction. The expressions for the mean and variance of the Taylor approximation are known analytically, although their evaluation requires efficient computation of the trace of the (preconditioned) Hessian of the control objective. We propose to estimate this trace by solving a generalized eigenvalue problem using a randomized algorithm that only requires the action of the Hessian on a small number of random directions. Then, the computational work does not depend on the nominal dimension of the uncertain parameter, but depends only on the effective dimension, thus ensuring scalability to high-dimensional problems. Moreover, to increase the estimation accuracy of the mean and variance of the control objective by the Taylor approximation, we use it as a control variate for variance reduction, which results in considerable computational savings (several orders of magnitude) compared to a plain Monte Carlo method. We demonstrate the accuracy, efficiency, and scalability of the proposed computational method for two examples with high-dimensional uncertain parameters: subsurface flow in a porous medium modeled as an elliptic PDE, and turbulent jet flow modeled by the Reynolds-averaged Navier--Stokes equations coupled with a nonlinear advection-diffusion equation characterizing model uncertainty. In particular, for the latter more challenging example we show scalability of our algorithm up to one million parameters resulting from discretization of the uncertain parameter field.