EI-Part: Explode for Completion and Implode for Refinement

TL;DR

EI-Part introduces a novel framework for 3D shape generation that uses distinct stages for part completion and refinement, leveraging self-attention to produce structurally coherent and detailed components efficiently.

Contribution

The paper proposes a new two-stage approach with Explode and Implode states, enhancing part-level 3D generation with better structural coherence and geometric detail.

Findings

Achieves state-of-the-art results on multiple benchmarks.

Produces semantically meaningful and structurally coherent parts.

Efficiently generates fine-grained geometric details.

Abstract

Part-level 3D generation is crucial for various downstream applications, including gaming, film production, and industrial design. However, decomposing a 3D shape into geometrically plausible and meaningful components remains a significant challenge. Previous part-based generation methods often struggle to produce well-constructed parts, exhibiting poor structural coherence, geometric implausibility, inaccuracy, or inefficiency. To address these challenges, we introduce EI-Part, a novel framework specifically designed to generate high-quality 3D shapes with components, characterized by strong structural coherence, geometric plausibility, geometric fidelity, and generation efficiency. We propose utilizing distinct representations at different stages: an Explode state for part completion and an Implode state for geometry refinement. This strategy fully leverages spatial resolution, enabling flexible part completion and fine geometric detail generation. To maintain structural coherence between parts, a self-attention mechanism is incorporated in both exploded and imploded states, facilitating effective information perception and feature fusion among components during generation. Extensive experiments on multiple benchmarks demonstrate that EI-Part efficiently produces semantically meaningful and structurally coherent parts with fine-grained geometric details, achieving state-of-the-art performance in part-level 3D generation. Project page: https://cvhadessun.github.io/EI-Part/