Loomis Painter: Reconstructing the Painting Process
Markus Pobitzer, Chang Liu, Chenyi Zhuang, Teng Long, Bin Ren, Nicu Sebe

TL;DR
This paper introduces a unified diffusion-based framework for generating multi-media painting processes with style control, ensuring consistency and coherence across styles and media, and models artistic progression quantitatively.
Contribution
It presents a novel multi-media painting process generation method with style control, a large dataset, and a perceptual model of artistic progression, advancing artistic process synthesis.
Findings
Achieved strong results on LPIPS, DINO, and CLIP metrics.
Demonstrated cross-media consistency and temporal coherence.
Successfully modeled artistic progression with the PDP curve.
Abstract
Step-by-step painting tutorials are vital for learning artistic techniques, but existing video resources (e.g., YouTube) lack interactivity and personalization. While recent generative models have advanced artistic image synthesis, they struggle to generalize across media and often show temporal or structural inconsistencies, hindering faithful reproduction of human creative workflows. To address this, we propose a unified framework for multi-media painting process generation with a semantics-driven style control mechanism that embeds multiple media into a diffusion models conditional space and uses cross-medium style augmentation. This enables consistent texture evolution and process transfer across styles. A reverse-painting training strategy further ensures smooth, human-aligned generation. We also build a large-scale dataset of real painting processes and evaluate cross-media…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Aesthetic Perception and Analysis · Music Technology and Sound Studies
