An Approximate Bayesian Approach to Optimal Input Signal Design for System Identification

TL;DR

This paper introduces a Bayesian method for designing optimal input signals in system identification by maximizing a lower bound of mutual information, improving robustness over classical methods especially in complex, uncertain models.

Contribution

It develops a tractable Bayesian approach using MI lower bounds and an efficient algorithm to handle large data sets, advancing input design for nonlinear stochastic systems.

Findings

Bayesian MI-based input design outperforms classical methods.

The algorithm reduces computational complexity significantly.

Demonstrated effectiveness through multiple practical examples.

Abstract

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and nonlinearity. This paper develops a Bayesian approach that uses the mutual information (MI) between observations and parameters as the utility function. To address the computational intractability of the MI, we maximize a tractable MI lower bound. The method is then applied to the design of an input signals for the identification of quasi-linear stochastic dynamical systems. Evaluating the MI lower bound requires inversion of large covariance matrices whose dimensions scale with the number of data points $N$. To overcome this problem, an algorithm that reduces the dimension of the matrices to be inverted by a factor of $N$ is developed, making the approach feasible for long experiments. The proposed Bayesian method is compared with the average D-optimal design method, a semi-Bayesian approach, and its advantages are demonstrated. The effectiveness of the proposed method is further illustrated through four examples, including atomic sensor models, where the input signals that generates large MI are especially important for reducing the estimation error.