ILDiff: Generate Transparent Animated Stickers by Implicit Layout Distillation
Ting Zhang, Zhiqiang Yuan, Yeshuang Zhu, Jinchao Zhang

TL;DR
ILDiff is a novel method that generates high-quality, transparent animated stickers by implicitly distilling layout information, effectively addressing semi-open area issues and temporal consistency, supported by a new large-scale dataset.
Contribution
The paper introduces ILDiff, a new approach for animated transparent channel generation using implicit layout distillation, and provides a large-scale dataset TASD for training and evaluation.
Findings
ILDiff produces finer, smoother transparent channels than existing methods.
The TASD dataset contains 0.32 million high-quality samples for research.
Extensive experiments validate ILDiff's superior performance.
Abstract
High-quality animated stickers usually contain transparent channels, which are often ignored by current video generation models. To generate fine-grained animated transparency channels, existing methods can be roughly divided into video matting algorithms and diffusion-based algorithms. The methods based on video matting have poor performance in dealing with semi-open areas in stickers, while diffusion-based methods are often used to model a single image, which will lead to local flicker when modeling animated stickers. In this paper, we firstly propose an ILDiff method to generate animated transparent channels through implicit layout distillation, which solves the problems of semi-open area collapse and no consideration of temporal information in existing methods. Secondly, we create the Transparent Animated Sticker Dataset (TASD), which contains 0.32M high-quality samples with…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsInteractive and Immersive Displays · Innovations in Concrete and Construction Materials · Augmented Reality Applications
MethodsDiffusion
