The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

TL;DR

This paper derives an exact entropy formula for an ideal gas using an information-theoretic approach, revealing new connections between statistical mechanics and information theory, including a quantum correction to the Sackur-Tetrode formula.

Contribution

It introduces the entropy of the multinomial distribution as the entropy of the physical system, providing a novel link between information theory and statistical mechanics.

Findings

Exact quantum correction to the Sackur-Tetrode entropy formula

Connection between microstate conditional entropy and Boltzmann-Planck entropy

Link between thermalization, information theory, and physical entropy

Abstract

The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy $\log(W)$ and between these two and the Gibbs correction term $\log(N!)$, thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.