Motion Compensated Three-Dimensional Frequency Selective Extrapolation for Improved Error Concealment in Video Communication

TL;DR

This paper introduces a novel error concealment algorithm for video transmission that combines motion compensation with an enhanced frequency selective extrapolation, significantly improving visual quality in error-prone channels.

Contribution

It proposes a new spatio-temporal error concealment method that integrates fractional-pel motion estimation with an improved extrapolation model, outperforming existing algorithms.

Findings

Up to 1.64 dB PSNR improvement over existing methods.

More than 3 dB gain compared to other error concealment algorithms.

Enhanced model generation leads to higher concealment quality.

Abstract

During transmission of video data over error-prone channels the risk of getting severe image distortions due to transmission errors is ubiquitous. To deal with image distortions at decoder side, error concealment is applied. This article presents Motion Compensated Three-Dimensional Frequency Selective Extrapolation, a novel spatio-temporal error concealment algorithm. The algorithm uses fractional-pel motion estimation and compensation as initial step, being followed by the generation of a model of the distorted signal. The model generation is conducted by an enhanced version of Three-Dimensional Frequency Selective Extrapolation, an existing error concealment algorithm. Compared to this existent algorithm, the proposed one yields an improvement in concealment quality of up to 1.64 dB PSNR. Altogether, the incorporation of motion compensation and the improved model generation extends the already high extrapolation quality of the underlying Frequency Selective Extrapolation, resulting in a gain of more than 3 dB compared to other well-known error concealment algorithms.