View-Guided Point Cloud Completion

TL;DR

This paper introduces ViPC, a view-guided point cloud completion method that utilizes a single-view image to improve the reconstruction of missing 3D point cloud data, outperforming existing methods.

Contribution

The paper proposes a novel view-guided framework that integrates single-view images with point cloud data for enhanced completion accuracy.

Findings

Significantly better results than existing methods on a new large-scale dataset.

Effective cross-modality and cross-level fusion strategies.

Demonstrated the importance of global structure information from images.

Abstract

This paper presents a view-guided solution for the task of point cloud completion. Unlike most existing methods directly inferring the missing points using shape priors, we address this task by introducing ViPC (view-guided point cloud completion) that takes the missing crucial global structure information from an extra single-view image. By leveraging a framework that sequentially performs effective cross-modality and cross-level fusions, our method achieves significantly superior results over typical existing solutions on a new large-scale dataset we collect for the view-guided point cloud completion task.