Dynamic Bayesian Learning for Spatiotemporal Mechanistic Models

TL;DR

This paper introduces a Bayesian learning framework for spatiotemporal mechanistic models that uses Gaussian process emulation to efficiently interpolate system outputs and facilitate inverse problem solving without costly iterative algorithms.

Contribution

It presents an exact inference approach for hierarchical matrix-variate models and a scalable transfer learning framework for large-scale emulation of spatiotemporal systems.

Findings

Efficient Bayesian emulation of complex dynamical systems.

Exact inference avoids iterative algorithms like MCMC.

Successful application to inverse problems in differential equations.

Abstract

We develop an approach for Bayesian learning of spatiotemporal dynamical mechanistic models. Such learning consists of statistical emulation of the mechanistic system that can efficiently interpolate the output of the system from arbitrary inputs. The emulated learner can then be used to train the system from noisy data achieved by melding information from observed data with the emulated mechanistic system. This joint melding of mechanistic systems employ hierarchical state-space models with Gaussian process regression. Assuming the dynamical system is controlled by a finite collection of inputs, Gaussian process regression learns the effect of these parameters through a number of training runs, driving the stochastic innovations of the spatiotemporal state-space component. This enables efficient modeling of the dynamics over space and time. This article details exact inference with analytically accessible posterior distributions in hierarchical matrix-variate Normal and Wishart models in designing the emulator. This step obviates expensive iterative algorithms such as Markov chain Monte Carlo or variational approximations. We also show how emulation is applicable to large-scale emulation by designing a dynamic Bayesian transfer learning framework. Inference on mechanistic model parameters proceeds using Markov chain Monte Carlo as a post-emulation step using the emulator as a regression component. We demonstrate this framework through solving inverse problems arising in the analysis of ordinary and partial nonlinear differential equations and, in addition, to a black-box computer model generating spatiotemporal dynamics across a graphical model.