Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

TL;DR

This paper introduces a novel ray-space domain motion compensation method for lenslet plenoptic video coding, significantly improving compression efficiency by integrating with existing video codecs like HEVC.

Contribution

It proposes a new ray-space motion compensation scheme for plenoptic videos, addressing a gap in existing pixel-domain approaches and enabling better integration with standard codecs.

Findings

Achieved an average of 19.63% bitrate reduction.

Maximum gain of 29.1% in compression efficiency.

Demonstrated compatibility with HEVC.

Abstract

Plenoptic images and videos bearing rich information demand a tremendous amount of data storage and high transmission cost. While there has been much study on plenoptic image coding, investigations into plenoptic video coding have been very limited. We investigate the motion compensation for plenoptic video coding from a slightly different perspective by looking at the problem in the ray-space domain instead of in the conventional pixel domain. Here, we develop a novel motion compensation scheme for lenslet video under two sub-cases of ray-space motion, that is, integer ray-space motion and fractional ray-space motion. The proposed new scheme of light field motion-compensated prediction is designed such that it can be easily integrated into well-known video coding techniques such as HEVC. Experimental results compared to relevant existing methods have shown remarkable compression efficiency with an average gain of 19.63% and a peak gain of 29.1%.