On generators with infinite entropy
Boris Gurevich

TL;DR
This paper explores a class of stationary processes with infinite entropy where the metric entropy equals the conditional entropy, extending Pitskel's observation beyond Markov chains.
Contribution
It identifies non-Markov processes for which Pitskel's entropy equality holds, broadening understanding of entropy in stationary processes.
Findings
Identifies processes with infinite entropy where metric entropy equals conditional entropy
Extends Pitskel's observation beyond Markov chains
Provides examples of non-Markov processes satisfying the entropy relation
Abstract
Many years ago B.S. Pitskel observed that the metric entropy of the shift transformation in the sample space of a stationary random process with a countable number of states is equal to the conditional entropy if is a stationary Markov chain (in which case the above conditional entropy is , whether the entropy is finite or not, while in general the statement is not true. In this note we present a class of processes for which Pitskel's observation holds, despite the fact that no of these processes is a Markov chain of some order.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
Topicsadvanced mathematical theories
