ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing

TL;DR

ProEdit introduces a simple progressive framework for high-quality 3D scene editing guided by diffusion distillation, effectively reducing multi-view inconsistency and enabling controllable, efficient editing without complex add-ons.

Contribution

It presents a novel progressive diffusion-based 3D scene editing framework with a difficulty-aware scheduler and adaptive training, achieving state-of-the-art results without complex components.

Findings

Achieves state-of-the-art editing quality across various scenes.

Effectively reduces multi-view inconsistency in 3D scene editing.

Enables controllable and previewable editing aggressivity.

Abstract

This paper proposes ProEdit - a simple yet effective framework for high-quality 3D scene editing guided by diffusion distillation in a novel progressive manner. Inspired by the crucial observation that multi-view inconsistency in scene editing is rooted in the diffusion model's large feasible output space (FOS), our framework controls the size of FOS and reduces inconsistency by decomposing the overall editing task into several subtasks, which are then executed progressively on the scene. Within this framework, we design a difficulty-aware subtask decomposition scheduler and an adaptive 3D Gaussian splatting (3DGS) training strategy, ensuring high quality and efficiency in performing each subtask. Extensive evaluation shows that our ProEdit achieves state-of-the-art results in various scenes and challenging editing tasks, all through a simple framework without any expensive or sophisticated add-ons like distillation losses, components, or training procedures. Notably, ProEdit also provides a new way to control, preview, and select the "aggressivity" of editing operation during the editing process.