PAct: Part-Decomposed Single-View Articulated Object Generation

TL;DR

This paper presents PAct, a fast, part-centric generative model that creates articulated 3D objects from a single image, ensuring accurate part structure, motion, and instance consistency without lengthy optimization.

Contribution

The paper introduces a novel part-aware generative framework for articulated object creation that enables fast, instance-consistent 3D asset synthesis from a single view.

Findings

Outperforms optimization-based methods in accuracy and speed

Produces more consistent and plausible articulated structures

Significantly reduces inference time compared to baselines

Abstract

Articulated objects are central to interactive 3D applications, including embodied AI, robotics, and VR/AR, where functional part decomposition and kinematic motion are essential. Yet producing high-fidelity articulated assets remains difficult to scale because it requires reliable part decomposition and kinematic rigging. Existing approaches largely fall into two paradigms: optimization-based reconstruction or distillation, which can be accurate but often takes tens of minutes to hours per instance, and inference-time methods that rely on template or part retrieval, producing plausible results that may not match the specific structure and appearance in the input observation. We introduce a part-centric generative framework for articulated object creation that synthesizes part geometry, composition, and articulation under explicit part-aware conditioning. Our representation models an object as a set of movable parts, each encoded by latent tokens augmented with part identity and articulation cues. Conditioned on a single image, the model generates articulated 3D assets that preserve instance-level correspondence while maintaining valid part structure and motion. The resulting approach avoids per-instance optimization, enables fast feed-forward inference, and supports controllable assembly and articulation, which are important for embodied interaction. Experiments on common articulated categories (e.g., drawers and doors) show improved input consistency, part accuracy, and articulation plausibility over optimization-based and retrieval-driven baselines, while substantially reducing inference time.