Improving HEVC Encoding of Rendered Video Data Using True Motion Information

TL;DR

This paper demonstrates that utilizing true motion vectors from rendered computer-generated videos can improve HEVC encoding efficiency, achieving around 3.78% rate savings by integrating per-pixel motion data into the encoding process.

Contribution

It introduces a novel approach that exploits true motion vectors from rendering to enhance HEVC encoding, including a motion vector mapping method with disocclusion handling.

Findings

Achieved 3.78% average rate savings.

Proposed a motion vector mapping with disocclusion handling.

Enhanced rate-distortion performance using true motion data.

Abstract

This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences. Therefore, a set of sequences is presented for which the true motion vectors of the corresponding objects were generated on a per-pixel basis during the rendering process. In addition to conventional motion estimation methods, it is proposed to exploit the computer generated motion vectors to enhance the ratedistortion performance. To this end, a motion vector mapping method including disocclusion handling is presented. It is shown that mean rate savings of 3.78% can be achieved.