Geometric Asymptotics of Score Mixing and Guidance in Diffusion Models

TL;DR

This paper analyzes the mathematical structure of score mixing in diffusion models, revealing geometric potentials that govern small-time generation dynamics and establishing convergence properties.

Contribution

It provides a rigorous geometric and asymptotic analysis of score mixing in diffusion models, connecting it to Clarke subgradient dynamics and Voronoi structures.

Findings

Small-time dynamics governed by explicit geometric potential.

Convergence of trajectories to critical points under certain conditions.

Piecewise quadratic potential in finite Dirac mixture case.

Abstract

Diffusion models are routinely guided in practice by combining multiple score fields, yet the mathematical structure of score mixing is still poorly understood. We study the small-time generation dynamics driven by mixed scores $$ s=\lambda\,\nabla\log u_1+(1-\lambda)\,\nabla\log u_2,\qquad \lambda\ge 0, $$ in the heat-flow framework, where $u_1,u_2$ are heat evolutions of two compactly supported probability measures. This single formulation covers both the mixture-of-experts regime $(0\leq \lambda\leq 1)$ and the classifier-free guidance regime $(\lambda>1)$. Exploiting a Laplace-Varadhan principle under a similarity-time rescaling, we show that the small-time generation dynamics is governed by the explicit geometric potential $$ \Phi_\lambda=\lambda d_1^2+(1-\lambda)d_2^2, $$ which depends only on the supports of the initial measures and on the mixing parameter. This gives a rigorous reduction from a singular, non-autonomous score-driven dynamics to autonomous Clarke-type subgradient inclusions. In the empirical setting of finite Dirac mixtures, the limiting potential is piecewise quadratic with a Voronoi-type structure; this rigidity yields convergence of all autonomous limiting trajectories to critical points and a conditional convergence criterion for the original generation flow toward local minimizers of the potential, with rate $\mathcal O(\sqrt t)$ in the smooth stable case.