Color and Texture Dual Pipeline Lightweight Style Transfer
ShiQi Jiang

TL;DR
This paper introduces a lightweight dual pipeline style transfer method that separately handles color and texture, reducing artifacts and enabling controllable texture addition, with state-of-the-art results and minimal model size.
Contribution
The proposed CTDP method employs a dual pipeline for simultaneous color and texture transfer, introducing a masked total variation loss and controllable texture addition, with significantly smaller model size.
Findings
Achieves state-of-the-art style transfer quality.
Model size is as low as 20k, much smaller than existing models.
Effectively suppresses artifacts and enables controllable texture enhancement.
Abstract
Style transfer methods typically generate a single stylized output of color and texture coupling for reference styles, and color transfer schemes may introduce distortion or artifacts when processing reference images with duplicate textures. To solve the problem, we propose a Color and Texture Dual Pipeline Lightweight Style Transfer CTDP method, which employs a dual pipeline method to simultaneously output the results of color and texture transfer. Furthermore, we designed a masked total variation loss to suppress artifacts and small texture representations in color transfer results without affecting the semantic part of the content. More importantly, we are able to add texture structures with controllable intensity to color transfer results for the first time. Finally, we conducted feature visualization analysis on the texture generation mechanism of the framework and found that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Image Enhancement Techniques · Computer Graphics and Visualization Techniques
