Data-Augmented Few-Shot Neural Emulator for Computer-Model System Identification

TL;DR

This paper introduces a data-augmentation method for training neural PDEs that improves sample efficiency and generalization by space-filling sampling of local states, outperforming traditional emulators.

Contribution

It proposes a novel data-augmentation strategy for neural PDE training that reduces redundancy and enhances accuracy with limited simulation data.

Findings

Neural PDEs trained on augmented data outperform those trained on trajectory data.

The method achieves high accuracy with only 10 simulation steps of data.

Augmented data improves long-horizon stability and generalization.

Abstract

Partial differential equations (PDEs) underpin the modeling of many natural and engineered systems. It can be convenient to express such models as neural PDEs rather than using traditional numerical PDE solvers by replacing part or all of the PDE's governing equations with a neural network representation. Neural PDEs are often easier to differentiate, linearize, reduce, or use for uncertainty quantification than the original numerical solver. They are usually trained on solution trajectories obtained by long-horizon rollout of the PDE solver. Here we propose a more sample-efficient data-augmentation strategy for generating neural PDE training data from a computer model by space-filling sampling of local "stencil" states. This approach removes a large degree of spatiotemporal redundancy present in trajectory data and oversamples states that may be rarely visited but help the neural PDE generalize across the state space. We demonstrate that accurate neural PDE stencil operators can be learned from synthetic training data generated by the computational equivalent of 10 timesteps' worth of numerical simulation. Accuracy is further improved if we assume access to a single full-trajectory simulation from the computer model, which is typically available in practice. Across several PDE systems, we show that our data-augmented stencil data yield better trained neural stencil operators, with clear performance gains compared with naively sampled stencil data from simulation trajectories. Finally, with only 10 solver steps' worth of augmented stencil data, our approach outperforms traditional ML emulators trained on thousands of trajectories in long-horizon rollout accuracy and stability.