Online Diffusion-Based 3D Occupancy Prediction at the Frontier with Probabilistic Map Reconciliation

TL;DR

This paper presents a real-time, online diffusion-based method for 3D occupancy prediction in robotics, significantly improving map coverage and frontier prediction through model modifications and probabilistic map reconciliation.

Contribution

It introduces a modified diffusion model for real-time occupancy prediction without attention mechanisms, enabling full-map inference and improved frontier prediction via probabilistic map merging.

Findings

73% reduction in runtime with minimal accuracy loss

Occupancy prediction across entire map area

71% improvement in frontier occupancy prediction

Abstract

Autonomous navigation and exploration in unmapped environments remains a significant challenge in robotics due to the difficulty robots face in making commonsense inference of unobserved geometries. Recent advancements have demonstrated that generative modeling techniques, particularly diffusion models, can enable systems to infer these geometries from partial observation. In this work, we present implementation details and results for real-time, online occupancy prediction using a modified diffusion model. By removing attention-based visual conditioning and visual feature extraction components, we achieve a 73$\%$ reduction in runtime with minimal accuracy reduction. These modifications enable occupancy prediction across the entire map, rather than being limited to the area around the robot where camera data can be collected. We introduce a probabilistic update method for merging predicted occupancy data into running occupancy maps, resulting in a 71$\%$ improvement in predicting occupancy at map frontiers compared to previous methods. Finally, we release our code and a ROS node for on-robot operation <upon publication> at github.com/arpg/sceneSense_ws.