KeyNode-Driven Geometry Coding for Real-World Scanned Human Dynamic Mesh Compression

TL;DR

This paper introduces a novel compression method for real-world scanned 3D human dynamic meshes that uses embedded key nodes and advanced coding schemes to significantly reduce bitrate while maintaining quality.

Contribution

It proposes a key node-driven prediction framework with octree residual coding and dual-direction prediction, addressing challenges of topology variation and scan defects in scanned human meshes.

Findings

Achieves 58.43% average bitrate savings over state-of-the-art methods.

Effectively handles topology changes and scan defects in dynamic meshes.

Performs well at low bitrates, ensuring efficient compression.

Abstract

The compression of real-world scanned 3D human dynamic meshes is an emerging research area, driven by applications such as telepresence, virtual reality, and 3D digital streaming. Unlike synthesized dynamic meshes with fixed topology, scanned dynamic meshes often not only have varying topology across frames but also scan defects such as holes and outliers, increasing the complexity of prediction and compression. Additionally, human meshes often combine rigid and non-rigid motions, making accurate prediction and encoding significantly more difficult compared to objects that exhibit purely rigid motion. To address these challenges, we propose a compression method designed for real-world scanned human dynamic meshes, leveraging embedded key nodes. The temporal motion of each vertex is formulated as a distance-weighted combination of transformations from neighboring key nodes, requiring the transmission of solely the key nodes' transformations. To enhance the quality of the KeyNode-driven prediction, we introduce an octree-based residual coding scheme and a Dual-direction prediction mode, which uses I-frames from both directions. Extensive experiments demonstrate that our method achieves significant improvements over the state-of-the-art, with an average bitrate savings of 58.43% across the evaluated sequences, particularly excelling at low bitrates.