Image Registration Based Flicker Solving in Video Face Replacement and Analysis Based Sub-pixel Image Registration

TL;DR

This paper introduces a novel video face replacement framework that effectively reduces flicker by employing advanced image registration techniques, including a fast subpixel registration method that enhances accuracy and efficiency.

Contribution

It presents a new framework combining image registration with a fast subpixel method to eliminate flicker in video face replacement, improving accuracy and computational speed.

Findings

Reduces flicker in video face replacement

Achieves high registration accuracy

Speeds up the registration process

Abstract

In this paper, a framework of video face replacement is proposed and it deals with the flicker of swapped face in video sequence. This framework contains two main innovations: 1) the technique of image registration is exploited to align the source and target video faces for eliminating the flicker or jitter of the segmented video face sequence; 2) a fast subpixel image registration method is proposed for farther accuracy and efficiency. Unlike the priori works, it minimizes the overlapping region and takes spatiotemporal coherence into account. Flicker in resulted videos is usually caused by the frequently changed bound of the blending target face and unregistered faces between and along video sequences. The subpixel image registration method is proposed to solve the flicker problem. During the alignment process, integer pixel registration is formulated by maximizing the similarity of images with down sampling strategy speeding up the process and sub-pixel image registration is a single-step image match via analytic method. Experimental results show the proposed algorithm reduces the computation time and gets a high accuracy when conducting experiments on different data sets.