Enhanced Spatially Interleaved Techniques for Multi-View Distributed Video Coding

TL;DR

This paper introduces advanced multi-view distributed video coding techniques that leverage interleaved hybrid frames and correlation exploitation to significantly improve rate-distortion performance over traditional intra coding methods.

Contribution

The paper develops novel spatio-temporal-view concealment methods and system enhancements that exploit interleaved hybrid frames for improved distributed video coding.

Findings

Up to 25% bitrate reduction compared to H.264 intra coding

Achieved 2.5 dB PSNR improvement

Enhanced reliability through multiple prediction fusion

Abstract

This paper presents a multi-view distributed video coding framework for independent camera encoding and centralized decoding. Spatio-temporal-view concealment methods are developed that exploit the interleaved nature of the employed hybrid KEY/Wyner-Ziv frames for block-wise generation of the side information (SI). We study a number of view concealment methods and develop a joint approach that exploits all available correlation for forming the side information. We apply a diversity technique for fusing multiple such predictions thereby achieving more reliable results. We additionally introduce systems enhancements for further improving the rate distortion performance through selective feedback, inter-view bitplane projection and frame subtraction. Results show a significant improvement in performance relative to H.264 intra coding of up to 25% reduction in bitrate or equivalently 2.5 dB increase in PSNR.