One-Shot Generative Flows: Existence and Obstructions

TL;DR

This paper investigates the existence of straight-line flows in measure transport for generative modeling, revealing conditions under which such flows are possible or obstructed, especially for Gaussian versus multi-modal targets.

Contribution

It provides a structural theory characterizing when straight-line generative flows can exist, including explicit constructions for Gaussian endpoints and impossibility results for multi-modal targets.

Findings

Explicit straight-line processes for Gaussian endpoints.

Impossibility of straight-line flows for targets with well-separated modes.

Fundamental relationship between process behavior and flow geometry.

Abstract

We study dynamic measure transport for generative modeling, focusing on transport maps that connect a source measure $P_0$ to a target measure $P_1$ by integrating a velocity field of the form $v_t(x) = \mathbb{E}[\dot X_t \mid X_t = x]$, where $X_\bullet = (X_t)_t$ is a stochastic process satisfying $(X_0,X_1)\sim{P_0}\otimes{P_1}$ and $\dot X_t$ is its time derivative. We investigate when $X_\bullet$ induces a \emph{straight-line flow}: a flow whose pointwise acceleration vanishes and is therefore exactly integrable by any first-order method. First, we develop multiple characterizations of straight-line flows in terms of PDEs involving the conditional statistics of the process. Then, we prove that straight-line flows under endpoint independence exhibit a sharp dichotomy. On the one hand, we construct explicit, computable straight-line processes for arbitrary Gaussian endpoints. On the other hand, we show that straight-line processes do not exist for targets with sufficiently well-separated modes. We demonstrate this obstruction through a sequence of increasingly general impossibility theorems that uncover a fundamental relationship between the sample-path behavior of a process with independent endpoints and the space-time geometry of this process' flow map. Taken together, these results provide a structural theory of when straight-line generative flows can, and cannot, exist.