Real Face Video Animation Platform

TL;DR

This paper introduces a real-time facial animation platform that converts real human faces into expressive anime-style faces, supporting multiple models and ensuring high interactivity for users.

Contribution

It presents a novel platform built on Gradio that enables real-time conversion of real faces to anime styles, addressing the lack of high-quality training data for exaggerated anime faces.

Findings

Supports multiple cartoon styles and models

Processes HDTF dataset to create animated facial videos

Ensures high interactivity and user-friendliness

Abstract

In recent years, facial video generation models have gained popularity. However, these models often lack expressive power when dealing with exaggerated anime-style faces due to the absence of high-quality anime-style face training sets. We propose a facial animation platform that enables real-time conversion from real human faces to cartoon-style faces, supporting multiple models. Built on the Gradio framework, our platform ensures excellent interactivity and user-friendliness. Users can input a real face video or image and select their desired cartoon style. The system will then automatically analyze facial features, execute necessary preprocessing, and invoke appropriate models to generate expressive anime-style faces. We employ a variety of models within our system to process the HDTF dataset, thereby creating an animated facial video dataset.