DreamPainter: Image Background Inpainting for E-commerce Scenarios
Sijie Zhao, Jing Cheng, Yaoyao Wu, Hao Xu, Shaohui Jiao

TL;DR
DreamPainter is a novel framework for e-commerce background inpainting that combines text prompts and reference images, achieving high product consistency and realistic backgrounds in challenging scenarios.
Contribution
The paper introduces DreamPainter, a new method that effectively integrates text and visual references for improved e-commerce image background inpainting.
Findings
Outperforms state-of-the-art in product-background consistency
Successfully integrates text and reference images for flexible control
Demonstrates high-quality, realistic background generation in experiments
Abstract
Although diffusion-based image genenation has been widely explored and applied, background generation tasks in e-commerce scenarios still face significant challenges. The first challenge is to ensure that the generated products are consistent with the given product inputs while maintaining a reasonable spatial arrangement, harmonious shadows, and reflections between foreground products and backgrounds. Existing inpainting methods fail to address this due to the lack of domain-specific data. The second challenge involves the limitation of relying solely on text prompts for image control, as effective integrating visual information to achieve precise control in inpainting tasks remains underexplored. To address these challenges, we introduce DreamEcom-400K, a high-quality e-commerce dataset containing accurate product instance masks, background reference images, text prompts, and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Multimodal Machine Learning Applications · Face recognition and analysis
