AnimationBench: Are Video Models Good at Character-Centric Animation?

TL;DR

AnimationBench is a new benchmark designed to evaluate character-centric animation video generation, addressing the limitations of existing benchmarks by incorporating animation principles and flexible evaluation methods.

Contribution

It introduces the first systematic benchmark for animation I2V generation, operationalizing animation principles and supporting both standardized and open-set evaluations.

Findings

AnimationBench aligns well with human judgment.

It reveals animation-specific quality differences.

It provides more informative evaluation of I2V models.

Abstract

Video generation has advanced rapidly, with recent methods producing increasingly convincing animated results. However, existing benchmarks-largely designed for realistic videos-struggle to evaluate animation-style generation with its stylized appearance, exaggerated motion, and character-centric consistency. Moreover, they also rely on fixed prompt sets and rigid pipelines, offering limited flexibility for open-domain content and custom evaluation needs. To address this gap, we introduce AnimationBench, the first systematic benchmark for evaluating animation image-to-video generation. AnimationBench operationalizes the Twelve Basic Principles of Animation and IP Preservation into measurable evaluation dimensions, together with Broader Quality Dimensions including semantic consistency, motion rationality, and camera motion consistency. The benchmark supports both a standardized close-set evaluation for reproducible comparison and a flexible open-set evaluation for diagnostic analysis, and leverages visual-language models for scalable assessment. Extensive experiments show that AnimationBench aligns well with human judgment and exposes animation-specific quality differences overlooked by realism-oriented benchmarks, leading to more informative and discriminative evaluation of state-of-the-art I2V models.