# The Information Dynamics of Generative Diffusion

## TL;DR

This paper offers a unified theoretical framework for generative diffusion models, linking information theory, dynamics, and thermodynamics, and reveals how symmetry-breaking phenomena influence their information flow and variability.

## Contribution

It introduces a novel thermodynamic perspective on diffusion models, connecting entropy production, score function divergence, and phase transitions in the energy landscape.

## Key findings

- Generative bandwidth is governed by the divergence of the score function.
- Symmetry-breaking phase transitions influence trajectory bifurcations.
- Variance peaks in pathwise entropy reveal heterogeneity in uncertainty resolution.

## Abstract

Generative diffusion models have emerged as a powerful class of models in machine learning, yet a unified theoretical understanding of their operation is still developing. This paper provides an integrated perspective on generative diffusion by connecting the information-theoretic, dynamical, and thermodynamic aspects. We demonstrate that the rate of conditional entropy production during generation (i.e., the generative bandwidth) is directly governed by the expected divergence of the score function's vector field. This divergence, in turn, is linked to the branching of trajectories and generative bifurcations, which we characterize as symmetry-breaking phase transitions in the energy landscape. Beyond ensemble averages, we demonstrate that symmetry-breaking decisions are revealed by peaks in the variance of pathwise conditional entropy, capturing heterogeneity in how individual trajectories resolve uncertainty. Together, these results establish generative diffusion as a process of controlled, noise-induced symmetry breaking, in which the score function acts as a dynamic nonlinear filter that regulates both the rate and variability of information flow from noise to data.