PEGAsus: 3D Personalization of Geometry and Appearance
Jingyu Hu, Bin Hu, Ka-Hei Hui, Haipeng Li, Zhengzhe Liu, Daniel Cohen-Or, Chi-Wing Fu

TL;DR
PEGAsus is a novel framework that enables personalized 3D shape generation by learning and composing geometric and appearance attributes from reference shapes with text prompts, allowing fine-grained control and diversity.
Contribution
It introduces a progressive, decoupled learning strategy for shape concepts and extends to region-wise learning, improving personalization and flexibility in 3D shape synthesis.
Findings
Effective attribute extraction from diverse shapes
Flexible composition with text prompts for diverse shapes
Outperforms state-of-the-art methods in experiments
Abstract
We present PEGAsus, a new framework capable of generating Personalized 3D shapes by learning shape concepts at both Geometry and Appearance levels. First, we formulate 3D shape personalization as extracting reusable, category-agnostic geometric and appearance attributes from reference shapes, and composing these attributes with text to generate novel shapes. Second, we design a progressive optimization strategy to learn shape concepts at both the geometry and appearance levels, decoupling the shape concept learning process. Third, we extend our approach to region-wise concept learning, enabling flexible concept extraction, with context-aware and context-free losses. Extensive experimental results show that PEGAsus is able to effectively extract attributes from a wide range of reference shapes and then flexibly compose these concepts with text to synthesize new shapes. This enables…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
Topics3D Shape Modeling and Analysis · Face recognition and analysis · Computer Graphics and Visualization Techniques
