Data-Driven Discovery of PDEs via the Adjoint Method
Mohsen Sadr, Tony Tohme, Kamal Youcef-Toumi

TL;DR
This paper introduces an adjoint-based method for discovering PDEs from data, leveraging variational calculus to efficiently compute gradients, and demonstrates superior performance over existing methods like PDE-FIND on various datasets.
Contribution
The paper presents a novel adjoint method for PDE discovery that improves gradient computation and outperforms existing techniques on large and noisy datasets.
Findings
Accurately identifies PDE form up to machine precision.
Outperforms PDE-FIND on large and noisy data sets.
Uses variational calculus for efficient gradient computation.
Abstract
In this work, we present an adjoint-based method for discovering the underlying governing partial differential equations (PDEs) given data. The idea is to consider a parameterized PDE in a general form and formulate a PDE-constrained optimization problem aimed at minimizing the error of the PDE solution from data. Using variational calculus, we obtain an evolution equation for the Lagrange multipliers (adjoint equations) allowing us to compute the gradient of the objective function with respect to the parameters of PDEs given data in a straightforward manner. In particular, we consider a family of parameterized PDEs encompassing linear, nonlinear, and spatial derivative candidate terms, and elegantly derive the corresponding adjoint equations. We show the efficacy of the proposed approach in identifying the form of the PDE up to machine accuracy, enabling the accurate discovery of PDEs…
Peer Reviews
Decision·ICLR 2025 Conference Withdrawn Submission
The topic looks very interesting.
The manuscript has not been well-written, so that the reader cannot find their motivation clearly. The theoretical part has been shown rigorously. The experiment part: description not clear
The paper is generally well-written, with clear explanations of the methodology and a solid foundation in the adjoint approach. The derivations are technically sound and should be accessible to readers familiar with inverse problems and PDEs.
(1) The approach presented here is relatively incremental, as the reconstruction of parameterized PDEs has been extensively studied within the inverse problem community for several decades. Many of the concepts explored, particularly adjoint-based parameter estimation, are already well-established. The paper would benefit from a more explicit discussion of how this work advances or differs from existing methods in the literature on PDE-constrained optimization and inverse problems. (2) The demon
- The proposed method archives good results on the considered PDEs considered compared to PDE-FIND - The experiments consider relevant settings, including coarse temporal resolution, noisy data, and ill-posed tasks - Using the adjoint method, it is possible find straightforward algorithms based on gradient descent
1. The algorithms proposed in the work implicitly (i) solve the forward PDE (1), which can be challenging and time consuming (line 242); (ii) solve the adjoint PDE model (7), which again can be challenging and time consuming (line 243); and (iii) compute gradients of the adjoint variables $\lambda$, which are only know implicitly through (7) (line 244). The manuscript does not thoroughly discuss how this affects the computational complexity of the proposed method and whether the choice of soluti
1. The idea of using adjoint equations to uncover underlying equations is interesting, and it seems to be new in the literature. 2. The theoretical derivations and analysis do a good job of explaining the key concepts of the framework. 3. Even in partial observations, when data at fine mesh is not available, the adjoint equations can discretize the general PDE on a finer mesh and, therefore, outperform other methods in the low data limit.
Please see below the comments that need to be further clarified. 1. The proposed framework is motivated by assuming a general PDE, which contains derivatives and their polynomials up to a certain degree. This is equivalent to basis functions in regression-based equation discovery frameworks, which is one of the major limitations of the basis-dependent discovery methods. Since, in an unknown scenario, the knowledge about the underlying physics will be minimal, one may need to consider a large nu
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical and Computational Modeling · Advanced Database Systems and Queries
