An Upper Bound of the Information Flow From Children to Parent Node on Trees
Cassius Manuel

TL;DR
This paper establishes an upper bound on the information flow from children to parent nodes in trees with noisy channels, using a new measure called the memory vector, and discusses implications for reconstructing ancestral states.
Contribution
It introduces the memory vector as a novel information measure and derives conditions bounding children-to-parent information flow in tree-structured models.
Findings
Upper bound on children-to-parent information flow using memory vector
Conditions under which ancestral states cannot be reliably reconstructed
Implications for information transmission in noisy tree models
Abstract
We consider the transmission of a state from the root of a tree towards its leaves, assuming that each transmission occurs through a noisy channel. The states at the leaves are observed, while at deeper nodes we can compute the likelihood of each state given the observation. In this sense, information flows from child nodes towards the parent node. Here we find an upper bound of this children-to-parent information flow. To do so, first we introduce a new measure of information, the memory vector, whose norm quantifies whether all states have the same likelihood. Then we find conditions such that the norm of the memory vector at the parent node can be linearly bounded by the sum of norms at the child nodes. We also describe the reconstruction problem of estimating the ancestral state at the root given the observation at the leaves. We infer sufficient conditions under which the original…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural dynamics and brain function · Advanced Memory and Neural Computing · Neural Networks and Applications
