QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction

TL;DR

QuadricFormer introduces a novel superquadric-based approach for 3D occupancy prediction, efficiently modeling complex scene structures with fewer primitives, outperforming existing methods in accuracy and efficiency.

Contribution

The paper proposes using superquadrics as scene primitives and develops a probabilistic mixture model, significantly improving efficiency and modeling capability over prior voxel and Gaussian-based methods.

Findings

Achieves state-of-the-art accuracy on nuScenes dataset.

Demonstrates superior efficiency with fewer primitives.

Outperforms voxel-based and Gaussian-based methods.

Abstract

3D occupancy prediction is crucial for robust autonomous driving systems as it enables comprehensive perception of environmental structures and semantics. Most existing methods employ dense voxel-based scene representations, ignoring the sparsity of driving scenes and resulting in inefficiency. Recent works explore object-centric representations based on sparse Gaussians, but their ellipsoidal shape prior limits the modeling of diverse structures. In real-world driving scenes, objects exhibit rich geometries (e.g., cuboids, cylinders, and irregular shapes), necessitating excessive ellipsoidal Gaussians densely packed for accurate modeling, which leads to inefficient representations. To address this, we propose to use geometrically expressive superquadrics as scene primitives, enabling efficient representation of complex structures with fewer primitives through their inherent shape diversity. We develop a probabilistic superquadric mixture model, which interprets each superquadric as an occupancy probability distribution with a corresponding geometry prior, and calculates semantics through probabilistic mixture. Building on this, we present QuadricFormer, a superquadric-based model for efficient 3D occupancy prediction, and introduce a pruning-and-splitting module to further enhance modeling efficiency by concentrating superquadrics in occupied regions. Extensive experiments on the nuScenes dataset demonstrate that QuadricFormer achieves state-of-the-art performance while maintaining superior efficiency.