3DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing

TL;DR

3DGS-Drag introduces an efficient, intuitive point-based 3D editing framework that combines deformation guidance with diffusion techniques to enable diverse geometric and content edits in real 3D scenes.

Contribution

The paper presents a novel 3D editing method that integrates Gaussian Splatting and diffusion guidance for improved geometric and content editing capabilities.

Findings

Achieves state-of-the-art performance in geometry editing.

Enables diverse edits like motion, shape, inpainting, and extension.

Operates efficiently within 10-20 minutes on a single GPU.

Abstract

The transformative potential of 3D content creation has been progressively unlocked through advancements in generative models. Recently, intuitive drag editing with geometric changes has attracted significant attention in 2D editing yet remains challenging for 3D scenes. In this paper, we introduce 3DGS-Drag -- a point-based 3D editing framework that provides efficient, intuitive drag manipulation of real 3D scenes. Our approach bridges the gap between deformation-based and 2D-editing-based 3D editing methods, addressing their limitations to geometry-related content editing. We leverage two key innovations: deformation guidance utilizing 3D Gaussian Splatting for consistent geometric modifications and diffusion guidance for content correction and visual quality enhancement. A progressive editing strategy further supports aggressive 3D drag edits. Our method enables a wide range of edits, including motion change, shape adjustment, inpainting, and content extension. Experimental results demonstrate the effectiveness of 3DGS-Drag in various scenes, achieving state-of-the-art performance in geometry-related 3D content editing. Notably, the editing is efficient, taking 10 to 20 minutes on a single RTX 4090 GPU.