# A Framework for Rate Efficient Control of Distributed Discrete Systems

## TL;DR

This paper develops a framework to minimize communication in distributed control systems modeled as Markov decision processes, balancing information exchange costs with control performance.

## Contribution

It introduces an information-theoretic approach to determine minimal control information exchange and proposes an optimization method for efficient control and messaging schemes.

## Key findings

- Derived minimum control information exchange for various models
- Enabled tradeoff analysis between communication cost and control performance
- Validated approach with wireless resource allocation examples

## Abstract

A key issue in the control of distributed discrete systems modeled as Markov decisions processes, is that often the state of the system is not directly observable at any single location in the system. The participants in the control scheme must share information with one another regarding the state of the system in order to collectively make informed control decisions, but this information sharing can be costly. Harnessing recent results from information theory regarding distributed function computation, in this paper we derive, for several information sharing model structures, the minimum amount of control information that must be exchanged to enable local participants to derive the same control decisions as an imaginary omniscient controller having full knowledge of the global state. Incorporating consideration for this amount of information that must be exchanged into the reward enables one to trade the competing objectives of minimizing this control information exchange and maximizing the performance of the controller. An alternating optimization framework is then provided to help find the efficient controllers and messaging schemes. A series of running examples from wireless resource allocation illustrate the ideas and design tradeoffs.