ObjectMorpher: 3D-Aware Image Editing via Deformable 3DGS Models

TL;DR

ObjectMorpher introduces a 3D-aware image editing framework that enables precise, realistic, and controllable object manipulations by integrating 3D Gaussian Splatting with non-rigid deformation and diffusion techniques.

Contribution

It presents a novel unified approach combining 3D Gaussian Splatting, graph-based deformation, and diffusion for efficient, identity-preserving, and photorealistic object editing in images.

Findings

Outperforms 2D drag and 3D-aware baselines on multiple metrics.

Enables fine-grained, photorealistic edits across diverse categories.

Provides fast, controllable, and physically plausible shape and pose changes.

Abstract

Achieving precise, object-level control in image editing remains challenging: 2D methods lack 3D awareness and often yield ambiguous or implausible results, while existing 3D-aware approaches rely on heavy optimization or incomplete monocular reconstructions. We present ObjectMorpher, a unified, interactive framework that converts ambiguous 2D edits into geometry-grounded operations. ObjectMorpher lifts target instances with an image-to-3D generator into editable 3D Gaussian Splatting (3DGS), enabling fast, identity-preserving manipulation. Users drag control points; a graph-based non-rigid deformation with as-rigid-as-possible (ARAP) constraints ensures physically sensible shape and pose changes. A composite diffusion module harmonizes lighting, color, and boundaries for seamless reintegration. Across diverse categories, ObjectMorpher delivers fine-grained, photorealistic edits with superior controllability and efficiency, outperforming 2D drag and 3D-aware baselines on KID, LPIPS, SIFID, and user preference.