Fast Sprite Decomposition from Animated Graphics

TL;DR

This paper introduces a fast and efficient method for decomposing animated graphics into sprites by optimizing sprite parameters with a texture prior, pre-trained segmentation, and user input, validated on a new dataset.

Contribution

The paper proposes a novel sprite decomposition approach that combines texture priors, pre-trained segmentation, and user annotations to improve speed and quality.

Findings

Outperforms baseline methods in quality and efficiency

Uses a new Crello Animation dataset for evaluation

Achieves significant speedups in sprite decomposition

Abstract

This paper presents an approach to decomposing animated graphics into sprites, a set of basic elements or layers. Our approach builds on the optimization of sprite parameters to fit the raster video. For efficiency, we assume static textures for sprites to reduce the search space while preventing artifacts using a texture prior model. To further speed up the optimization, we introduce the initialization of the sprite parameters utilizing a pre-trained video object segmentation model and user input of single frame annotations. For our study, we construct the Crello Animation dataset from an online design service and define quantitative metrics to measure the quality of the extracted sprites. Experiments show that our method significantly outperforms baselines for similar decomposition tasks in terms of the quality/efficiency tradeoff.