Boundary Exploration of Next Best View Policy in 3D Robotic Scanning

TL;DR

This paper introduces a boundary exploration approach for the Next Best View problem in 3D robotic scanning, improving efficiency and coverage by considering view overlap and flexible camera distance, with both model-based and learning-based methods.

Contribution

It proposes a novel boundary exploration NBV policy that intrinsically considers view overlap and introduces BENBV-Net, a learning-based method for direct NBV prediction without a reference model.

Findings

The boundary exploration approach outperforms existing methods in efficiency and coverage.

BENBV-Net significantly speeds up NBV generation while maintaining accuracy.

Experimental results on multiple datasets validate the effectiveness of both methods.

Abstract

The Next Best View (NBV) problem is a pivotal challenge in 3D robotic scanning, with the potential to significantly improve the efficiency of object capture and reconstruction. Existing methods for determining the NBV often overlook view overlap, assume a fixed virtual origin for the camera, and rely on voxel-based representations of 3D data. To address these limitations and enhance the practicality of scanning unknown objects, we propose an NBV policy in which the next view explores the boundary of the scanned point cloud, with overlap intrinsically considered. The scanning or working distance of the camera is user-defined and remains flexible throughout the process. To this end, we first introduce a model-based approach in which candidate views are iteratively proposed based on a reference model. Scores are computed using a carefully designed strategy that accounts for both view overlap and convergence. In addition, we propose a learning-based method, the Boundary Exploration NBV Network (BENBV-Net), which predicts the NBV directly from the scanned data without requiring a reference model. BENBV-Net estimates scores for candidate boundaries, selecting the one with the highest score as the target for the next best view. It offers a significant improvement in NBV generation speed while maintaining the performance level of the model-based approach. We evaluate both methods on the ShapeNet, ModelNet, and 3D Repository datasets. Experimental results demonstrate that our approach outperforms existing methods in terms of scanning efficiency, final coverage, and overlap stability, all of which are critical for practical 3D scanning applications. The related code is available at github.com/leihui6/BENBV.