OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Data

TL;DR

This paper introduces a black-box, perturbation-based method for generating interpretable attribution maps for 3D LiDAR object detectors, enhancing understanding of model behavior without requiring internal access.

Contribution

It proposes OccAM's Laser, a novel approach for explainability in 3D object detection that works on any model without internal details, tailored for LiDAR data characteristics.

Findings

Attribution maps are interpretable and informative.

The method works efficiently with various 3D detection architectures.

Insights into model decision processes are gained through attribution analysis.

Abstract

While 3D object detection in LiDAR point clouds is well-established in academia and industry, the explainability of these models is a largely unexplored field. In this paper, we propose a method to generate attribution maps for the detected objects in order to better understand the behavior of such models. These maps indicate the importance of each 3D point in predicting the specific objects. Our method works with black-box models: We do not require any prior knowledge of the architecture nor access to the model's internals, like parameters, activations or gradients. Our efficient perturbation-based approach empirically estimates the importance of each point by testing the model with randomly generated subsets of the input point cloud. Our sub-sampling strategy takes into account the special characteristics of LiDAR data, such as the depth-dependent point density. We show a detailed evaluation of the attribution maps and demonstrate that they are interpretable and highly informative. Furthermore, we compare the attribution maps of recent 3D object detection architectures to provide insights into their decision-making processes.