Foundations of Information Theory
Mark Burgin

TL;DR
This paper explores the foundational principles of information theory, proposing an ontological framework that aims to define the concept of information comprehensively across various contexts.
Contribution
It introduces an ontological foundation for information theory, providing a unified and encompassing definition of information based on fundamental principles.
Findings
Develops ontological principles reflecting basic features of information.
Proposes a comprehensive definition of information applicable across theories.
Lays groundwork for future theoretical and practical applications.
Abstract
Information is the basic concept of information theory. However, there is no definition of this concept that can encompass all uses of the term information in information theories and beyond. Many question a possibility of such a definition. However, foundations of information theory developed in the context of the general theory of information made it possible to build such a relevant and at the same time, encompassing definition. Foundations of information theory are built in a form of ontological principles, which reflect basic features of information and information processes.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsScientific Research and Philosophical Inquiry · Advanced Research in Systems and Signal Processing · Advanced Data Processing Techniques
