State Estimation of Continuous-time Dynamical Systems with Uncertain Inputs with Bounded Variation: Entropy, Bit Rates, and Relation with Switched Systems

TL;DR

This paper introduces a new concept of epsilon-estimation entropy for nonlinear continuous-time systems with uncertain inputs, establishing bounds on bit rates for state estimation and relating it to switched systems.

Contribution

It extends estimation entropy to systems with uncertain inputs, providing bounds, comparisons with existing definitions, and a state estimation algorithm.

Findings

Epsilon-estimation entropy lower bounds bit rate for state estimation.

Alternative entropy definitions are bounded by the new epsilon-estimation entropy.

Derived upper bounds for epsilon-estimation entropy and applied to examples.

Abstract

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation entropy of the system and show that it lower bounds the bit rate needed for state estimation. {$\epsilon$}-estimation entropy represents the exponential rate of the increase of the minimal number of functions that are adequate for {$\epsilon$}- approximating any trajectory of the system. We show that alternative entropy definitions using spanning or separating trajectories bound ours from both sides. On the other hand, we show that other commonly used definitions of entropy, for example the ones in [1], diverge to infinity. Thus, they are potentially not suitable for systems with uncertain inputs. We derive an upper bound on {$\epsilon$}-estimation entropy and estimation bit rates, and evaluate it for two examples. We present a state estimation algorithm that constructs a function that approximates a given trajectory up to an {$\epsilon$} error, given time-sampled and quantized measurements of state and input. We investigate the relation between {$\epsilon$}-estimation entropy and a previous notion for switched nonlinear systems and derive a new upper bound for the latter, showing the generality of our results on systems with uncertain inputs.