Text-to-3D Generation by 2D Editing
Haoran Li, Yuli Tian, Yonghui Wang, Yong Liao, Lin Wang, Yuyang Wang,, Peng Yuan Zhou

TL;DR
This paper introduces GE3D, a novel 3D generation method that leverages 2D editing and diffusion models to produce photorealistic 3D content, overcoming limitations of previous single-step denoising approaches.
Contribution
The paper proposes a new iterative 3D generation framework that combines 2D editing with diffusion models, enhancing 3D content quality and diversity.
Findings
GE3D produces more realistic 3D models than previous methods.
The approach effectively preserves input information across denoising steps.
Experimental results validate the superiority of GE3D in 3D generation quality.
Abstract
Distilling 3D representations from pretrained 2D diffusion models is essential for 3D creative applications across gaming, film, and interior design. Current SDS-based methods are hindered by inefficient information distillation from diffusion models, which prevents the creation of photorealistic 3D contents. In this paper, we first reevaluate the SDS approach by analyzing its fundamental nature as a basic image editing process that commonly results in over-saturation, over-smoothing, lack of rich content and diversity due to the poor-quality single-step denoising. In light of this, we then propose a novel method called 3D Generation by Editing (GE3D). Each iteration of GE3D utilizes a 2D editing framework that combines a noising trajectory to preserve the information of the input image, alongside a text-guided denoising trajectory. We optimize the process by aligning the latents across…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdditive Manufacturing and 3D Printing Technologies · Modular Robots and Swarm Intelligence · Manufacturing Process and Optimization
MethodsDiffusion
