Data assimilation for massive autonomous systems based on second-order adjoint method

TL;DR

This paper introduces a second-order adjoint data assimilation method tailored for massive autonomous systems, enabling efficient computation of optimal estimates and uncertainties with significantly reduced computational resources.

Contribution

The paper presents a novel second-order adjoint approach that efficiently computes inverse Hessian diagonal components, reducing complexity for large-scale autonomous models.

Findings

Successfully validated on a massive two-dimensional phase-field model.

Accurately reproduces known parameters and initial states.

Effectively evaluates uncertainties to aid experiment design.

Abstract

Data assimilation (DA) is a fundamental computational technique that integrates numerical simulation models and observation data on the basis of Bayesian statistics. Originally developed for meteorology, especially weather forecasting, DA is now an accepted technique in various scientific fields. One key issue that remains controversial is the implementation of DA in massive simulation models under limited computation time and resources. In this paper, we propose an adjoint-based DA method for massive autonomous models that produces optimum estimates and their uncertainties within practical computation time and resource constraints. The uncertainties are given as several diagonal components of an inverse Hessian matrix, which is the covariance matrix of a normal distribution that approximates the target posterior probability density function in the neighborhood of the optimum. Conventional algorithms for deriving the inverse Hessian matrix require $O(CN^2+N^3)$ computations and $O(N^2)$ memory, where $N$ is the number of degrees of freedom of a given autonomous system and $C$ is the number of computations needed to simulate time series of suitable length. The proposed method using a second-order adjoint method allows us to directly evaluate the diagonal components of the inverse Hessian matrix without computing all of its components. This drastically reduces the number of computations to $O(C)$ and the amount of memory to $O(N)$ for each diagonal component. The proposed method is validated through numerical tests using a massive two-dimensional Kobayashi's phase-field model. We confirm that the proposed method correctly reproduces the parameter and initial state assumed in advance, and successfully evaluates the uncertainty of the parameter. Such information regarding uncertainty is valuable, as it can be used to optimize the design of experiments.