Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling

TL;DR

This paper combines neural operators with diffusion models to improve spectral accuracy in turbulence surrogate modeling, enabling better high-frequency flow dynamics capture and longer stable forecasts.

Contribution

The novel integration of neural operators with diffusion models enhances spectral fidelity and forecasting stability in turbulent flow simulations.

Findings

Significant improvement in energy spectrum alignment.

Enhanced stability of autoregressive turbulence forecasts.

Better spectral fidelity demonstrated through POD analysis.

Abstract

We integrate neural operators with diffusion models to address the spectral limitations of neural operators in surrogate modeling of turbulent flows. While neural operators offer computational efficiency, they exhibit deficiencies in capturing high-frequency flow dynamics, resulting in overly smooth approximations. To overcome this, we condition diffusion models on neural operators to enhance the resolution of turbulent structures. Our approach is validated for different neural operators on diverse datasets, including a high Reynolds number jet flow simulation and experimental Schlieren velocimetry. The proposed method significantly improves the alignment of predicted energy spectra with true distributions compared to neural operators alone. This enables the diffusion models to stabilize longer forecasts through diffusion-corrected autoregressive rollouts, as we demonstrate in this work. Additionally, proper orthogonal decomposition analysis demonstrates enhanced spectral fidelity in space-time. This work establishes a new paradigm for combining generative models with neural operators to advance surrogate modeling of turbulent systems, and it can be used in other scientific applications that involve microstructure and high-frequency content. See our project page: vivekoommen.github.io/NO_DM