Real-Time 3D Object Detection Using InnovizOne LiDAR and Low-Power Hailo-8 AI Accelerator

TL;DR

This paper demonstrates real-time 3D object detection for autonomous driving using InnovizOne LiDAR and a low-power Hailo-8 AI accelerator, achieving high accuracy and efficiency suitable for cost-effective systems.

Contribution

It introduces a method for deploying high-quality 3D object detection on low-power hardware using InnovizOne LiDAR and Hailo-8 AI accelerator, with minimal accuracy loss.

Findings

Real-time inference at ~5Hz achieved.

High detection accuracy with 0.91% F1 score.

Negligible -0.2% accuracy degradation compared to high-end GPU.

Abstract

Object detection is a significant field in autonomous driving. Popular sensors for this task include cameras and LiDAR sensors. LiDAR sensors offer several advantages, such as insensitivity to light changes, like in a dark setting and the ability to provide 3D information in the form of point clouds, which include the ranges of objects. However, 3D detection methods, such as PointPillars, typically require high-power hardware. Additionally, most common spinning LiDARs are sparse and may not achieve the desired quality of object detection in front of the car. In this paper, we present the feasibility of performing real-time 3D object detection of cars using 3D point clouds from a LiDAR sensor, processed and deployed on a low-power Hailo-8 AI accelerator. The LiDAR sensor used in this study is the InnovizOne sensor, which captures objects in higher quality compared to spinning LiDAR techniques, especially for distant objects. We successfully achieved real-time inference at a rate of approximately 5Hz with a high accuracy of 0.91% F1 score, with only -0.2% degradation compared to running the same model on an NVIDIA GeForce RTX 2080 Ti. This work demonstrates that effective real-time 3D object detection can be achieved on low-cost, low-power hardware, representing a significant step towards more accessible autonomous driving technologies. The source code and the pre-trained models are available at https://github.com/AIROTAU/ PointPillarsHailoInnoviz/tree/main