A probabilistic scheme for joint parameter estimation and state prediction in complex dynamical systems

TL;DR

This paper introduces a probabilistic nested filtering framework for joint parameter estimation and state prediction in complex, possibly chaotic dynamical systems, demonstrated on a high-dimensional meteorological model.

Contribution

It develops a novel nested filtering methodology combining Monte Carlo and filtering techniques for joint estimation and forecasting in nonlinear dynamical models.

Findings

Effective estimation and forecasting in a 4,000-dimensional Lorenz 96 system.

Comparison of different nested filter implementations.

Framework adaptable to various filtering methods.

Abstract

Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint estimation of the static parameters and the forecasting of the state variables of nonlinear, and possibly chaotic, dynamical models. The proposed scheme is essentially probabilistic. It aims at recursively computing the sequence of joint posterior probability distributions of the unknown model parameters and its (time varying) state variables conditional on the available observations. The latter are possibly partial and contaminated by noise. The new framework combines a Monte Carlo scheme to approximate the posterior distribution of the fixed parameters with filtering (or {\em data assimilation}) techniques to track and predict the distribution of the state variables. For this reason, we refer to the proposed methodology as {\em nested filtering}. In this paper we specifically explore the use of Gaussian filtering methods, but other approaches fit naturally within the new framework. As an illustrative example, we apply three different implementations of the methodology to the tracking of the state, and the estimation of the fixed parameters, of a stochastic two-scale Lorenz 96 system. This model is commonly used to assess data assimilation procedures in meteorology. For this example, we compare different nested filters and show estimation and forecasting results for a 4,000-dimensional system.