Eulerian Motion Guidance: Robust Image Animation via Bidirectional Geometric Consistency
Thong Nguyen, Khoi M. Le, Cong-Duy Nguyen, Luu Anh Tuan, See-Kiong Ng, Chunyan Miao

TL;DR
This paper introduces a novel Eulerian motion guidance method for image animation using local supervision with adjacent-frame motion fields, enhancing training efficiency and temporal coherence.
Contribution
It proposes a bidirectional geometric consistency mechanism to improve motion supervision and reduce artifacts in diffusion-based image animation.
Findings
Accelerates training process.
Preserves temporal coherence in animations.
Reduces dynamic artifacts compared to baselines.
Abstract
Recent advancements in image animation have utilized diffusion models to breathe life into static images. However, existing controllable frameworks typically rely on Lagrangian motion guidance, where optical flow is estimated relative to the initial frame. This paper revisits the same optical-flow primitive through a more local supervision design: we use adjacent-frame Eulerian motion fields to guide generation, where the motion signal always describes a short temporal hop. This shift enables parallelized training and provides bounded-error supervision throughout the generation process. To mitigate the drift artifacts common in adjacent frame generation, we introduce a Bidirectional Geometric Consistency mechanism, which computes a forward-backward cycle check to mathematically identify and mask occluded regions, preventing the model from learning incorrect warping objectives. Extensive…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
