Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme

TL;DR

This paper introduces a multiscale inference scheme for diffusion models to improve probabilistic predictions of partially observable, long-memory dynamical systems, with applications to solar physics, capturing long-range dependencies effectively.

Contribution

The paper proposes a novel multiscale inference scheme for diffusion models that enhances long-range dependency modeling in partially observable dynamical systems.

Findings

Reduces bias in predicted distributions.

Improves stability of diffusion model rollouts.

Effectively captures long-range temporal dependencies.

Abstract

Conditional diffusion models provide a natural framework for probabilistic prediction of dynamical systems and have been successfully applied to fluid dynamics and weather prediction. However, in many settings, the available information at a given time represents only a small fraction of what is needed to predict future states, either due to measurement uncertainty or because only a small fraction of the state can be observed. This is true for example in solar physics, where we can observe the Sun's surface and atmosphere, but its evolution is driven by internal processes for which we lack direct measurements. In this paper, we tackle the probabilistic prediction of partially observable, long-memory dynamical systems, with applications to solar dynamics and the evolution of active regions. We show that standard inference schemes, such as autoregressive rollouts, fail to capture long-range dependencies in the data, largely because they do not integrate past information effectively. To overcome this, we propose a multiscale inference scheme for diffusion models, tailored to physical processes. Our method generates trajectories that are temporally fine-grained near the present and coarser as we move farther away, which enables capturing long-range temporal dependencies without increasing computational cost. When integrated into a diffusion model, we show that our inference scheme significantly reduces the bias of the predicted distributions and improves rollout stability.