RegionRoute: Regional Style Transfer with Diffusion Model
Bowen Chen, Jake Zuena, Alan C. Bovik, Divya Kothandaraman

TL;DR
This paper introduces RegionRoute, a diffusion-based style transfer method that achieves precise, localized style application without masks by using attention supervision and novel loss functions, outperforming existing approaches.
Contribution
The paper proposes an attention-supervised diffusion framework with specialized losses and a modular design for efficient, mask-free localized style transfer.
Findings
Achieves accurate, mask-free localized style transfer.
Outperforms existing diffusion-based editing methods.
Introduces Regional Style Editing Score for evaluation.
Abstract
Precise spatial control in diffusion-based style transfer remains challenging. This challenge arises because diffusion models treat style as a global feature and lack explicit spatial grounding of style representations, making it difficult to restrict style application to specific objects or regions. To our knowledge, existing diffusion models are unable to perform true localized style transfer, typically relying on handcrafted masks or multi-stage post-processing that introduce boundary artifacts and limit generalization. To address this, we propose an attention-supervised diffusion framework that explicitly teaches the model where to apply a given style by aligning the attention scores of style tokens with object masks during training. Two complementary objectives, a Focus loss based on KL divergence and a Cover loss using binary cross-entropy, jointly encourage accurate localization…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Face recognition and analysis · Computer Graphics and Visualization Techniques
