FlexPainter: Flexible and Multi-View Consistent Texture Generation
Dongyu Yan, Leyi Wu, Jiantao Lin, Luozhou Wang, Tianshuo Xu, Zhifei Chen, Zhen Yang, Lie Xu, Shunsi Zhang, Yingcong Chen

TL;DR
FlexPainter is a novel texture generation pipeline that offers flexible multi-modal guidance and ensures multi-view consistency, significantly improving the quality and control in 3D texture map creation using diffusion models.
Contribution
We introduce FlexPainter, a new method that combines a shared conditional embedding space with multi-view diffusion and adaptive synchronization to produce consistent, high-quality textures.
Findings
Outperforms state-of-the-art methods in flexibility and quality
Achieves highly consistent multi-view texture generation
Enables reference image-based stylization
Abstract
Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt modalities may prevent creators from producing desired results. Furthermore, inconsistencies between generated multi-view images often lead to poor texture generation quality. To address these issues, we introduce \textbf{FlexPainter}, a novel texture generation pipeline that enables flexible multi-modal conditional guidance and achieves highly consistent texture generation. A shared conditional embedding space is constructed to perform flexible aggregation between different input modalities. Utilizing such embedding space, we present an image-based CFG method to decompose structural and style information, achieving reference image-based stylization.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · 3D Shape Modeling and Analysis · Image Retrieval and Classification Techniques
MethodsDiffusion
