MaFreeI2P: A Matching-Free Image-to-Point Cloud Registration Paradigm with Active Camera Pose Retrieval
Gongxin Yao, Xinyang Li, Yixin Xuan, Yu Pan

TL;DR
MaFreeI2P introduces a novel matching-free approach for image-to-point cloud registration by actively retrieving camera pose through geometric feature contrast, avoiding information loss from traditional correspondence methods.
Contribution
The paper proposes a matching-free paradigm that uses cost volume and active pose retrieval, significantly improving registration accuracy and robustness over existing matching-based methods.
Findings
Achieves competitive accuracy on KITTI-Odometry and Apollo-DaoxiangLake datasets.
Effectively preserves information by using cost volume instead of correspondences.
Iterative pose sampling and filtering enhance convergence and precision.
Abstract
Image-to-point cloud registration seeks to estimate their relative camera pose, which remains an open question due to the data modality gaps. The recent matching-based methods tend to tackle this by building 2D-3D correspondences. In this paper, we reveal the information loss inherent in these methods and propose a matching-free paradigm, named MaFreeI2P. Our key insight is to actively retrieve the camera pose in SE(3) space by contrasting the geometric features between the point cloud and the query image. To achieve this, we first sample a set of candidate camera poses and construct their cost volume using the cross-modal features. Superior to matching, cost volume can preserve more information and its feature similarity implicitly reflects the confidence level of the sampled poses. Afterwards, we employ a convolutional network to adaptively formulate a similarity assessment function,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRobotics and Sensor-Based Localization · Medical Image Segmentation Techniques · Image and Object Detection Techniques
MethodsSparse Evolutionary Training
