Spatio-temporal error concealment in video by denoised temporal extrapolation refinement

TL;DR

This paper introduces a novel spatio-temporal error concealment algorithm for video communication that combines temporal extrapolation with spatial denoising, achieving significant visual quality improvements over existing methods.

Contribution

The paper presents a new denoised temporal extrapolation refinement algorithm that enhances error concealment by integrating spatial denoising with temporal estimates.

Findings

Average 1 dB gain over pure temporal concealment

Outperforms existing spatio-temporal concealment algorithms

Effective in reducing visual distortions caused by transmission errors

Abstract

In video communication, the concealment of distortions caused by transmission errors is important for allowing for a pleasant visual quality and for reducing error propagation. In this article, Denoised Temporal Extrapolation Refinement is introduced as a novel spatiotemporal error concealment algorithm. The algorithm operates in two steps. First, temporal error concealment is used for obtaining an initial estimate. Afterwards, a spatial denoising algorithm is used for reducing the imperfectness of the temporal extrapolation. For this, Non-Local Means denoising is used which is extended by a spiral scan processing order and is improved by an adaptation step for taking the preliminary temporal extrapolation into account. In doing so, a spatio-temporal error concealment results. By making use of the refinement, a visually noticeable average gain of 1 dB over pure temporal error concealment is possible. With this, the algorithm also is able to clearly outperform other spatio-temporal error concealment algorithms.