Variance-Reduction Guidance: Sampling Trajectory Optimization for Diffusion Models

TL;DR

This paper introduces Variance-Reduction Guidance (VRG), a technique that improves diffusion model sampling by optimizing trajectories to reduce prediction errors without altering the models.

Contribution

The paper proposes a novel, model-agnostic trajectory optimization method for diffusion models that enhances generation quality by statistically measuring and mitigating prediction errors.

Findings

VRG significantly improves diffusion model outputs.

The method is applicable to both conditional and unconditional generation.

Experiments show consistent quality enhancement across datasets.

Abstract

Diffusion models have become emerging generative models. Their sampling process involves multiple steps, and in each step the models predict the noise from a noisy sample. When the models make prediction, the output deviates from the ground truth, and we call such a deviation as \textit{prediction error}. The prediction error accumulates over the sampling process and deteriorates generation quality. This paper introduces a novel technique for statistically measuring the prediction error and proposes the Variance-Reduction Guidance (VRG) method to mitigate this error. VRG does not require model fine-tuning or modification. Given a predefined sampling trajectory, it searches for a new trajectory which has the same number of sampling steps but produces higher quality results. VRG is applicable to both conditional and unconditional generation. Experiments on various datasets and baselines demonstrate that VRG can significantly improve the generation quality of diffusion models. Source code is available at https://github.com/shifengxu/VRG.