On rate of convergence estimates for homogeneous discrete-time nonlinear Markov chains
Aleksandr Shchegolev

TL;DR
This paper presents an improved two-step convergence estimate for nonlinear homogeneous discrete-time Markov chains, potentially offering better rates and broader applicability than traditional one-step estimates.
Contribution
It generalizes convergence results by introducing a two-step estimate, improving convergence rates and applicability in cases where one-step conditions fail.
Findings
Two-step estimates can outperform one-step in convergence speed.
The new approach applies even when one-step conditions do not guarantee convergence.
Examples demonstrate improved convergence rates and broader applicability.
Abstract
The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the current probability distributions of the process apart from being dependent on the current state. Such processes often act as limits for large-scale systems of dependent Markov chains with interaction. The paper generalizes the convergence results by taking the estimate over two steps. Such an approach keeps the existence and uniqueness results under assumptions that are analogical to the one-step result. It is shown that such an approach may lead to a better rate of convergence. Several examples provided illustrating the fact that the suggested estimate may have a better rate of convergence than the original one. Also, it is shown that the new estimate…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPetri Nets in System Modeling · Markov Chains and Monte Carlo Methods · Gene Regulatory Network Analysis
