Optimal control of multiple Markov switching stochastic system with application to portfolio decision

TL;DR

This paper develops an optimal control framework for hybrid stochastic systems with multiple, non-identical Markov switching diffusions, and applies it to a regime-switching portfolio optimization problem, deriving explicit solutions.

Contribution

It introduces a novel control approach for systems with multiple, non-identical Markov switching diffusions and applies it to a complex financial decision-making problem.

Findings

Derived a synthetic Markov chain for combined regime switching.

Formulated and solved the HJB equations for the control problem.

Obtained explicit solutions and value functions under specific assumptions.

Abstract

In this paper we set up an optimal control framework for a hybrid stochastic system with dual or multiple Markov switching diffusion processes, while Markov chains governing these switching diffusions are not identical as assumed by the existing literature. As an application and illustration of this model, we solve a portfolio choice problem for an investor facing financial and labor markets that are both regime switching. In continuous time context we combine two separate Markov chains into one synthetic Markov chain and derive its corresponding generator matrix, then state the HJB equations for the optimal control problem with the newly synthesized Markov switching diffusion. Furthermore, we derive explicit solutions and value functions under some reasonable specifications.