Real-time forecasting of chaotic dynamics from sparse data and autoencoders

TL;DR

This paper introduces a stable, real-time forecasting method for chaotic systems using autoencoders, echo state networks, and data assimilation to handle sparse, noisy sensor data effectively.

Contribution

It proposes a novel three-step approach combining convolutional autoencoders, echo state networks, and ensemble Kalman filter for stable, real-time chaotic system prediction from sparse data.

Findings

Accurately forecasts chaotic PDEs like Kuramoto-Sivashinsky and Navier-Stokes.

Maintains stability and accuracy across various noise and sparsity levels.

Acts as a localization strategy reducing spurious correlations in high-dimensional systems.

Abstract

The real-time prediction of chaotic systems requires a nonlinear-reduced order model (ROM) to forecast the dynamics, and a stream of data from sensors to update the ROM. Data-driven ROMs are typically built with a two-step strategy: data compression in a lower-dimensional latent space, and prediction of the temporal dynamics on it. To achieve real-time prediction, however, there are two challenges to overcome: (i) ROMs of chaotic systems can become numerically unstable; and (ii) sensors' data are sparse, i.e., partial, and noisy. To overcome these challenges, we propose a three-step strategy: (i) a convolutional autoencoder (CAE) compresses the system's state onto a lower-dimensional latent space; (ii) a latent ROM (echo state network, ESN), which is formulated as a state-space model, predicts the temporal evolution on the latent space; and (iii) sequential data assimilation based on the Ensemble Kalman filter (EnKF) adaptively corrects the latent ROM by assimilating noisy and sparse measurements. This provides a numerically stable method (DA-CAE-ESN), which corrects itself every time that data becomes available from sensors. The DA-CAE-ESN is tested on spatio-temporally chaotic partial differential equations: the Kuramoto-Sivashinsky equation, and a two-dimensional Navier-Stokes equation (Kolmogorov flow). We show that the method provides accurate and stable forecasts across different levels of noise, sparsity, and sampling rates. As a by-product, the DA-CAE-ESN acts as a localization strategy that mitigates spurious correlations, which arise when applying the EnKF to high-dimensional systems. The DA-CAE-ESN provides a numerically stable method to perform real-time predictions, which opens opportunities for deploying data-driven latent models.