Solving PDEs With Deep Neural Nets under General Boundary Conditions

TL;DR

This paper enhances physics-informed neural networks for solving PDEs by integrating natural gradient methods with time-stepping schemes to better handle complex boundary conditions, improving accuracy and stability.

Contribution

It extends the TENG framework to Dirichlet boundary conditions, combining natural gradient optimization with numerical schemes for improved PDE solving.

Findings

Heun method achieves higher accuracy due to second-order corrections.

Euler method offers computational efficiency for simpler problems.

The approach effectively enforces Dirichlet boundary conditions in neural PDE solvers.

Abstract

Partial Differential Equations (PDEs) are central to modeling complex systems across physical, biological, and engineering domains, yet traditional numerical methods often struggle with high-dimensional or complex problems. Physics-Informed Neural Networks (PINNs) have emerged as an efficient alternative by embedding physics-based constraints into deep learning frameworks, but they face challenges in achieving high accuracy and handling complex boundary conditions. In this work, we extend the Time-Evolving Natural Gradient (TENG) framework to address Dirichlet boundary conditions, integrating natural gradient optimization with numerical time-stepping schemes, including Euler and Heun methods, to ensure both stability and accuracy. By incorporating boundary condition penalty terms into the loss function, the proposed approach enables precise enforcement of Dirichlet constraints. Experiments on the heat equation demonstrate the superior accuracy of the Heun method due to its second-order corrections and the computational efficiency of the Euler method for simpler scenarios. This work establishes a foundation for extending the framework to Neumann and mixed boundary conditions, as well as broader classes of PDEs, advancing the applicability of neural network-based solvers for real-world problems.