Deep collocation method: A framework for solving PDEs using neural networks with error control

TL;DR

This paper introduces an adaptive deep collocation framework using neural networks with error control to efficiently solve PDEs, improving accuracy and robustness through iterative basis expansion and adaptive strategies.

Contribution

It presents a novel adaptive collocation method with error-guided basis construction and adaptive point selection for neural network PDE solvers.

Findings

Achieves high accuracy in solving complex PDEs.

Demonstrates robustness and efficiency through numerical experiments.

Provides theoretical error estimates for the method.

Abstract

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and computational efficiency. To address these challenges, we propose an adaptive method that uses single-hidden-layer neural networks to construct basis functions guided by the equation residual. The approximate solution is computed within the space spanned by these basis functions, employing a collocation least squares scheme. As the approximation space gradually expands, the solution is iteratively refined; meanwhile, the progressive improvements serve as reliable {\it a posteriori} error indicators that guide the termination of the sequential updates. Additionally, we introduce adaptive strategies for collocation point selection and parameter initialization to enhance robustness and improve the expressiveness of the neural networks. We also derive the approximation error estimate and validate the proposed method with several numerical experiments on various challenging PDEs, demonstrating both high accuracy and robustness of the proposed method.