UniOcc: Unifying Vision-Centric 3D Occupancy Prediction with Geometric and Semantic Rendering

TL;DR

UniOcc introduces a unified approach for vision-centric 3D occupancy prediction that combines geometric and semantic rendering, improving accuracy and reducing annotation costs.

Contribution

It proposes a novel unifying occupancy prediction method with volume ray rendering and a depth-aware teacher-student framework for unlabeled data.

Findings

Achieved 51.27% mIoU on nuScenes leaderboard

Placed 3rd in CVPR 2023 challenge

Enhanced prediction accuracy with less annotation effort

Abstract

In this technical report, we present our solution, named UniOCC, for the Vision-Centric 3D occupancy prediction track in the nuScenes Open Dataset Challenge at CVPR 2023. Existing methods for occupancy prediction primarily focus on optimizing projected features on 3D volume space using 3D occupancy labels. However, the generation process of these labels is complex and expensive (relying on 3D semantic annotations), and limited by voxel resolution, they cannot provide fine-grained spatial semantics. To address this limitation, we propose a novel Unifying Occupancy (UniOcc) prediction method, explicitly imposing spatial geometry constraint and complementing fine-grained semantic supervision through volume ray rendering. Our method significantly enhances model performance and demonstrates promising potential in reducing human annotation costs. Given the laborious nature of annotating 3D occupancy, we further introduce a Depth-aware Teacher Student (DTS) framework to enhance prediction accuracy using unlabeled data. Our solution achieves 51.27\% mIoU on the official leaderboard with single model, placing 3rd in this challenge.