Goal oriented error estimation for adaptive sampling of PINNS

TL;DR

This paper introduces a goal-oriented adaptive sampling method for PINNs and Deep Ritz methods, using a DWR-based error estimator to improve convergence in approximating PDE solutions and goal functionals.

Contribution

It proposes a novel importance sampling strategy guided by an error estimator, enhancing the efficiency of training PINNs and Deep Ritz methods for goal functional accuracy.

Findings

Adaptive sampling accelerates convergence of the functional error.

The method improves minimization of the target functional during training.

Numerical experiments validate the effectiveness of the proposed strategy.

Abstract

Physics-Informed Neural Networks (PINNs) are mesh-free approaches for the numerical approximation of partial differential equations, where a neural network is trained by minimizing a loss function derived from the governing equations and boundary conditions. The Deep Ritz method can be interpreted as a particular variational form of a PINN, where the loss corresponds to the minimization of an energy functional associated with a symmetric positive definite problem. In this work, we study the approximation of the Laplace equation using both the classical PINN formulation and its variational counterpart, the Deep Ritz method, with the objective of accurately estimating prescribed goal functionals. When standard sampling strategies, such as uniform or loss-based sampling, are employed during training, the convergence of the functional error and the attained minimal functional value can be slow. To address this issue, we introduce a functional-oriented importance sampling strategy that can be applied to both PINNs and the Deep Ritz method. The key ingredient is the construction of a reliable and accurate estimator for the error in a given quantity of interest. This estimator is derived using concepts from the Dual Weighted Residual (DWR) framework and is implemented entirely within the neural network setting. It is then used to adaptively guide the sampling of training points in the computational domain, focusing computational effort on regions that have the strongest influence on the functional value. Numerical experiments demonstrate that the proposed adaptive sampling strategy significantly accelerates the convergence of the functional error and improves the minimization of the target functional during training for both PINN and Deep Ritz formulations.