Hidden information and regularities of information dynamics IR
Vladimir S. Lerner

TL;DR
This paper introduces a novel entropy functional that uncovers hidden information in stochastic processes, revealing regularities and evolutionary dynamics beyond traditional measures, and models hierarchical information networks and their genetic codes.
Contribution
It develops an information law based on maximizing information extraction from minimal data, and introduces the information path functional for modeling process dynamics and hierarchical structures.
Findings
Reveals hidden information not captured by Shannon entropy.
Establishes an information law for process regularities.
Models hierarchical information networks and genetic codes.
Abstract
The introduced entropy functional's (EF) information measure of random process integrates multiple information contributions along the process trajectories, evaluating both the states' and between states' bound information connections. This measure reveals information that is hidden by traditional information measures, which commonly use Shannon's entropy function for each selected stationary states of the process. The hidden information is important for evaluation of missing connections, disclosing the process' meaningful information, which enables producing logic of the information. The presentation consists of three Parts. In Part 1R-revised we analyze mechanism of arising information regularities from a stochastic process, measured by EF, independently of the process' specific source and origin. Uncovering the process' regularities leads us to an information law, based on extracting…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGene Regulatory Network Analysis · Fractal and DNA sequence analysis · Neural Networks and Applications
