Diverse Score Distillation
Yanbo Xu, Jayanth Srinivasa, Gaowen Liu, Shubham Tulsiani

TL;DR
This paper introduces Diverse Score Distillation (DSD), a novel method that enhances diversity in 3D and 2D generation tasks guided by diffusion models, addressing mode collapse in traditional score distillation.
Contribution
The paper proposes a new score formulation inspired by diffusion sampling that promotes diversity and an approximation method for complex scenarios, improving upon prior score distillation techniques.
Findings
DSD significantly increases sample diversity.
DSD maintains high fidelity in generated outputs.
Empirical validation shows superiority over previous methods.
Abstract
Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation formulations, however, is that the outputs of the (mode-seeking) optimization are limited in diversity despite the underlying diffusion model being capable of generating diverse samples. In this work, inspired by the sampling process in denoising diffusion, we propose a score formulation that guides the optimization to follow generation paths defined by random initial seeds, thus ensuring diversity. We then present an approximation to adopt this formulation for scenarios where the optimization may not precisely follow the generation paths (\eg a 3D representation whose renderings evolve in a co-dependent manner). We showcase the applications of our `Diverse…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · 3D Shape Modeling and Analysis · Computer Graphics and Visualization Techniques
MethodsADaptive gradient method with the OPTimal convergence rate · Diffusion
