Asymptotics of Entropy Rate in Special Families of Hidden Markov Chains
Guangyue Han, Brian Marcus
TL;DR
This paper derives an asymptotic formula for the entropy rate of certain hidden Markov chains near a 'weak Black Hole' and explores its applications to channel behavior analysis.
Contribution
It introduces a new asymptotic formula for entropy rate in special hidden Markov chains, expanding understanding of their informational properties.
Findings
Asymptotic formula accurately describes entropy rate near 'weak Black Hole' conditions.
Application of the formula to analyze asymptotic behaviors of specific communication channels.
Provides theoretical insights into the entropy dynamics of complex stochastic processes.
Abstract
We derive an asymptotic formula for entropy rate of a hidden Markov chain around a "weak Black Hole". We also discuss applications of the asymptotic formula to the asymptotic behaviors of certain channels.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCellular Automata and Applications · Mathematical Dynamics and Fractals · Markov Chains and Monte Carlo Methods