Flow matching achieves almost minimax optimal convergence
Kenji Fukumizu, Taiji Suzuki, Noboru Isobe, Kazusato Oko, Masanori, Koyama

TL;DR
This paper provides the first theoretical analysis showing that flow matching, a simpler alternative to diffusion models, can achieve near-minimax optimal convergence rates for large sample sizes under the $p$-Wasserstein distance.
Contribution
It establishes the convergence properties of flow matching, demonstrating its potential to match the performance of diffusion models in terms of convergence rates.
Findings
Flow matching achieves almost minimax optimal convergence for $1 \,\leq p \leq 2$.
Theoretical evidence that flow matching can reach convergence rates comparable to diffusion models.
Broader class of mean and variance functions analyzed for convergence conditions.
Abstract
Flow matching (FM) has gained significant attention as a simulation-free generative model. Unlike diffusion models, which are based on stochastic differential equations, FM employs a simpler approach by solving an ordinary differential equation with an initial condition from a normal distribution, thus streamlining the sample generation process. This paper discusses the convergence properties of FM for large sample size under the -Wasserstein distance, a measure of distributional discrepancy. We establish that FM can achieve an almost minimax optimal convergence rate for , presenting the first theoretical evidence that FM can reach convergence rates comparable to those of diffusion models. Our analysis extends existing frameworks by examining a broader class of mean and variance functions for the vector fields and identifies specific conditions necessary to attain…
Peer Reviews
Decision·ICLR 2025 Poster
- The paper is the first to present estimates for the Flow Matching framework, which shows that almost optimal minimax converges rates are achieved under several assumptions. - The paper is well written
This paper contains many points in common with the paper cited therein [1]. In particular, using Besov space for target density, B-splines for its approximation, etc. Many estimates are based on thouse from [1], see, for example, Appendix A.4--A.5 of the presented paper, where the citation on [1] are explicit. In paper [1] diffusion models are considered, but as shown in paper [2], Flow Matching approach includes, under certain conditions, Diffusion models approach. Thus, generalization or obta
It's interesting to know that FM have the same standard guarantees as DMs.
Mathematically, the paper does not shine as to novelty, it mostly chains known estimates, and applies them to FM. Like in similar papers for other models, some of the setups look like toy models, this may be because the mathematical theory is unavailable in general.
This paper provides (to my understanding) the first estimation rates for flow matching in the context of classical statistical estimation rates. This paper is similar in spirit to the FM paper of Lipman et al (2023), where they use different combinations of mean-variance parameters to define their path. While this work leverages many ideas from Oko et al. (2023), what is especially interesting is this idea that "optimal parameter choices" lead to minimax convergence rates, whereas other choices
The paper could be more clearly written, and the main text is very technical. This paper would benefit substantially from a small figure explaining the construction of the estimator at a high level, and also explaining the reason why the full minimax estimation is not possible. These are overall minor points, but I do believe the paper would benefit greatly from these modifications overall.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Control Systems Optimization · Reinforcement Learning in Robotics
MethodsDiffusion
