Copy Motion From One to Another: Fake Motion Video Generation
Zhenguang Liu, Sifan Wu, Chejian Xu, Xiang Wang, Lei Zhu, Shuang Wu,, Fuli Feng

TL;DR
This paper presents a novel approach for generating realistic fake videos of a target person performing arbitrary motions by disentangling video components, using a Gromov-Wasserstein loss, and employing local GANs for detailed textures.
Contribution
It introduces a disentanglement strategy, a Gromov-Wasserstein loss, and local GANs for texture refinement to improve fake motion video generation.
Findings
Generated videos are realistic and faithfully replicate complex motions.
The method reduces texture distortion in face, hands, and feet.
Extensive experiments validate the effectiveness of the proposed approach.
Abstract
One compelling application of artificial intelligence is to generate a video of a target person performing arbitrary desired motion (from a source person). While the state-of-the-art methods are able to synthesize a video demonstrating similar broad stroke motion details, they are generally lacking in texture details. A pertinent manifestation appears as distorted face, feet, and hands, and such flaws are very sensitively perceived by human observers. Furthermore, current methods typically employ GANs with a L2 loss to assess the authenticity of the generated videos, inherently requiring a large amount of training samples to learn the texture details for adequate video generation. In this work, we tackle these challenges from three aspects: 1) We disentangle each video frame into foreground (the person) and background, focusing on generating the foreground to reduce the underlying…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Face recognition and analysis · Advanced Image Processing Techniques
