Triple Motion Estimation and Frame Interpolation based on Adaptive Threshold for Frame Rate Up-Conversion

TL;DR

This paper introduces a novel motion-compensated frame rate up-conversion algorithm that uses adaptive thresholding for motion vector combination, significantly improving interpolation quality and reducing artifacts.

Contribution

It presents a new MC-FRUC method with adaptive threshold-based motion vector fusion and a hole-filling algorithm, enhancing frame interpolation quality.

Findings

Higher quality interpolated frames compared to existing algorithms

Effective reduction of block artifacts and holes

Improved visual smoothness in frame rate up-conversion

Abstract

In this paper, we propose a novel motion-compensated frame rate up-conversion (MC-FRUC) algorithm. The proposed algorithm creates interpolated frames by first estimating motion vectors using unilateral (jointing forward and backward) and bilateral motion estimation. Then motion vectors are combined based on adaptive threshold, in order to creates high-quality interpolated frames and reduce block artifacts. Since motion-compensated frame interpolation along unilateral motion trajectories yields holes, a new algorithm is introduced to resolve this problem. The experimental results show that the quality of the interpolated frames using the proposed algorithm is much higher than the existing algorithms.