Expanding the Chaos: Neural Operator for Stochastic (Partial) Differential Equations
Dai Shi, Lequan Lin, Andi Han, Luke Thompson, Jos\'e Miguel Hern\'andez-Lobato, Zhiyong Wang, Junbin Gao

TL;DR
This paper introduces a neural operator framework based on Wiener-chaos expansions for efficiently learning solutions to stochastic differential equations and stochastic partial differential equations, enabling fast and accurate trajectory reconstructions.
Contribution
It develops a novel neural operator architecture leveraging Wiener-chaos expansions, explicitly modeling chaos coefficients for SDEs and SPDEs, and demonstrates its effectiveness across multiple applications.
Findings
Achieves competitive accuracy on SPDE benchmarks
Enables single-pass trajectory reconstruction from noise
Scalable approach for diverse stochastic modeling tasks
Abstract
Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with deep learning models promises fast solvers and new perspectives on classical learning tasks. In this work, we build on Wiener-chaos expansions (WCE) to design neural operator (NO) architectures for SDEs and SPDEs: we project driving noise paths onto orthonormal Wick-Hermite features and use NOs to parameterize the resulting chaos coefficients, enabling reconstruction of full trajectories from noise in a single forward pass. We also make the underlying WCE structure explicit for multi-dimensional SDEs and semilinear SPDEs by showing the coupled deterministic ODE/PDE systems governing these coefficients. Empirically, we achieve competitive accuracy…
Peer Reviews
Decision·Submitted to ICLR 2026
1. The method is well established under rigorous analysis. Detailed theoretical analysis and guarantees are provided. But I did not check all the details of the derivations. 2. The evaluations are conducted on various kinds of tasks, covering physical, image, graph, financial, and manifold domains, demonstrating the superiority and generalization of the proposed method.
1. My main concern is that the presentation of the practical aspect of the method is not good enough. The workflow of using the method is ambiguous. From the implementation perspective, many details are missing. Thus, it is hard to connect the established theory with practice. It is better to formalize the problem setup in Section 2. In Section 4 and Figure 2, where do Q-Brownian realization increments come from? Why does the workflow start with Q-Brownian motion? How to compute Wick features us
**I appreciate that all the technical explanations are rigorous.** Sometimes, the literature on machine learning with SPDEs can be a bit loose with technicalities (eg filtrations), so it is nice to see the submission take the maths seriously. At times this perspective might be pushed a bit too far, e.g., by including proofs of widely known statements from stochastic analysis, which distracts from the rest of the paper. Still, overall, I appreciate a rigorous treatment of SDEs in the machine lear
**I think that the contributions claimed in the abstract and intro are slightly overstated.** Concretely, the abstract mentions that Wiener Chaos Expansion (WCE) theory is being extended; however, Theorems 1 and 2 discuss the WCE of SPDEs, which is a standard result (e.g., Neufeld & Schmoker, 2024; Lototsky & Rozovskii, 2006). The remaining definitions, lemmas, and analyses in Appendices B and C are also standard results from stochastic analysis. Regarding the analysis of the SPDENO in Appendix
- The paper proposes a new neural operator specific to SPDEs and SDEs. - The paper introduces the theoretical foundation of this method, Weiner Chaos Expansion, in detail. - The experiments span many areas, from the numerical solutions of SPDEs to application problems like diffusion sampling and parameter estimation.
- The experiment does not consider these two models [Peiyan Hu, Qi Meng, Bingguang Chen, Shiqi Gong, Yue Wang, Wei Chen, Rongchan Zhu, Zhi-Ming Ma, and Tie-Yan Liu. Neural operator with regularity structure for modeling dynamics driven by spdes. arXiv preprint arXiv:2204.06255, 2022.], [Shiqi Gong, Peiyan Hu, Qi Meng, Yue Wang, Rongchan Zhu, Bingguang Chen, Zhiming Ma, Hao Ni, and Tie-Yan Liu. Deep latent regularity network for modeling stochastic partial differential equations. In Proceedings o
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsModel Reduction and Neural Networks · Generative Adversarial Networks and Image Synthesis · Probabilistic and Robust Engineering Design
