Frequency Theorem for discrete time stochastic system with multiplicative noise

TL;DR

This paper develops a frequency domain approach to determine optimal control for discrete-time stochastic systems with multiplicative noise, linking control existence to matrix inequalities and Lyapunov equations.

Contribution

It introduces necessary and sufficient frequency domain conditions for optimal control existence in stochastic systems with multiplicative noise.

Findings

Optimal control characterized by matrix inequalities in frequency domain

Lyapunov equations are essential for control solution existence

Strict frequency inequalities imply unique optimal control

Abstract

In this paper we consider the problem of minimizing a quadratic functional for a discrete-time linear stochastic system with multiplicative noise, on a standard probability space, in infinite time horizon. We show that the necessary and sufficient conditions for the existence of the optimal control can be formulated as matrix inequalities in frequency domain. Furthermore, we show that if the optimal control exists, then certain Lyapunov equations must have a solution. The optimal control is obtained by solving a deterministic linear-quadratic optimal control problem whose functional depends on the solution to the Lyapunov equations. Moreover, we show that under certain conditions, solvability of the Lyapunov equations is guaranteed. We also show that, if the frequency inequalities are strict, then the solution is unique up to equivalence.