Positive recurrence of reflecting Brownian motion in three dimensions

TL;DR

This paper establishes necessary and sufficient conditions for the positive recurrence of three-dimensional reflecting Brownian motions, linking stability to fluid model attraction, and extends understanding beyond two dimensions.

Contribution

It provides the first complete characterization of stability for 3D SRBMs, confirming the fluid-based criterion as both necessary and sufficient.

Findings

Necessary and sufficient conditions for 3D SRBM stability

Verification reduces to simple computational checks

Fluid model attraction characterizes positive recurrence

Abstract

Consider a semimartingale reflecting Brownian motion (SRBM) $Z$ whose state space is the $d$-dimensional nonnegative orthant. The data for such a process are a drift vector $\theta$, a nonsingular $d\times d$ covariance matrix $\Sigma$, and a $d\times d$ reflection matrix $R$ that specifies the boundary behavior of $Z$. We say that $Z$ is positive recurrent, or stable, if the expected time to hit an arbitrary open neighborhood of the origin is finite for every starting state. In dimension $d=2$, necessary and sufficient conditions for stability are known, but fundamentally new phenomena arise in higher dimensions. Building on prior work by El Kharroubi, Ben Tahar and Yaacoubi [Stochastics Stochastics Rep. 68 (2000) 229--253, Math. Methods Oper. Res. 56 (2002) 243--258], we provide necessary and sufficient conditions for stability of SRBMs in three dimensions; to verify or refute these conditions is a simple computational task. As a byproduct, we find that the fluid-based criterion of Dupuis and Williams [Ann. Probab. 22 (1994) 680--702] is not only sufficient but also necessary for stability of SRBMs in three dimensions. That is, an SRBM in three dimensions is positive recurrent if and only if every path of the associated fluid model is attracted to the origin. The problem of recurrence classification for SRBMs in four and higher dimensions remains open.