Information vs Thermodynamic Entropy
Phil Attard
TL;DR
This paper clarifies that Shannon information differs fundamentally from thermodynamic entropy and is unaffected by the Second Law of Thermodynamics, highlighting conceptual distinctions between information theory and thermodynamics.
Contribution
It demonstrates the fundamental difference between Shannon information and thermodynamic entropy, challenging common assumptions about their relationship.
Findings
Shannon information is not governed by the Second Law of Thermodynamics.
Thermodynamic entropy and Shannon information are conceptually distinct.
The paper clarifies misconceptions about entropy in information theory and thermodynamics.
Abstract
The Shannon information is shown to be different to the thermodynamic entropy, and indifferent to the Second Law of Thermodynamics.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Thermodynamics and Statistical Mechanics · Statistical Mechanics and Entropy