CoE: Deep Coupled Embedding for Non-Rigid Point Cloud Correspondences

TL;DR

This paper introduces a novel high-dimensional embedding for non-rigid point cloud shapes that captures geometric and deformation-invariant features, enabling accurate correspondence matching and shape analysis.

Contribution

It proposes a new shape representation via per-point embeddings that are robust to deformations, noise, and partial data, improving non-rigid shape matching.

Findings

Achieves state-of-the-art results on non-rigid shape matching benchmarks.

Demonstrates robustness to noise, partiality, and shape artefacts.

Shows potential for other shape analysis tasks like segmentation.

Abstract

The interest in matching non-rigidly deformed shapes represented as raw point clouds is rising due to the proliferation of low-cost 3D sensors. Yet, the task is challenging since point clouds are irregular and there is a lack of intrinsic shape information. We propose to tackle these challenges by learning a new shape representation -- a per-point high dimensional embedding, in an embedding space where semantically similar points share similar embeddings. The learned embedding has multiple beneficial properties: it is aware of the underlying shape geometry and is robust to shape deformations and various shape artefacts, such as noise and partiality. Consequently, this embedding can be directly employed to retrieve high-quality dense correspondences through a simple nearest neighbor search in the embedding space. Extensive experiments demonstrate new state-of-the-art results and robustness in numerous challenging non-rigid shape matching benchmarks and show its great potential in other shape analysis tasks, such as segmentation.