PINNsAgent: Automated PDE Surrogation with Large Language Models

TL;DR

PINNsAgent is a framework that uses large language models and novel knowledge transfer techniques to automate and improve the accuracy of solving PDEs with physics-informed neural networks.

Contribution

It introduces PINNsAgent, combining physics-guided knowledge replay and memory tree reasoning to automate hyperparameter tuning and architecture search for PINNs.

Findings

Effective automation of PINNs surrogation process

Significant accuracy improvements on benchmark PDEs

Enhanced knowledge transfer across similar PDE problems

Abstract

Solving partial differential equations (PDEs) using neural methods has been a long-standing scientific and engineering research pursuit. Physics-Informed Neural Networks (PINNs) have emerged as a promising alternative to traditional numerical methods for solving PDEs. However, the gap between domain-specific knowledge and deep learning expertise often limits the practical application of PINNs. Previous works typically involve manually conducting extensive PINNs experiments and summarizing heuristic rules for hyperparameter tuning. In this work, we introduce PINNsAgent, a novel surrogation framework that leverages large language models (LLMs) and utilizes PINNs as a foundation to bridge the gap between domain-specific knowledge and deep learning. Specifically, PINNsAgent integrates (1) Physics-Guided Knowledge Replay (PGKR), which encodes the essential characteristics of PDEs and their associated best-performing PINNs configurations into a structured format, enabling efficient knowledge transfer from solved PDEs to similar problems and (2) Memory Tree Reasoning, a strategy that effectively explores the search space for optimal PINNs architectures. By leveraging LLMs and exploration strategies, PINNsAgent enhances the automation and efficiency of PINNs-based solutions. We evaluate PINNsAgent on 14 benchmark PDEs, demonstrating its effectiveness in automating the surrogation process and significantly improving the accuracy of PINNs-based solutions.