# An Overview for Markov Decision Processes in Queues and Networks

## TL;DR

This paper provides a comprehensive overview of Markov decision processes in queues and networks, highlighting historical evolution, key results, and future research directions to aid understanding and application in practical areas.

## Contribution

It offers a detailed synthesis of the development and current state of MDPs in queues and networks, including future research directions.

## Key findings

- Historical evolution of MDPs in queues and networks
- Summary of key theoretical results
- Identification of promising future research areas

## Abstract

Markov decision processes (MDPs) in queues and networks have been an interesting topic in many practical areas since the 1960s. This paper provides a detailed overview on this topic and tracks the evolution of many basic results. Also, this paper summarizes several interesting directions in the future research. We hope that this overview can shed light to MDPs in queues and networks, and also to their extensive applications in various practical areas.