LEROjD: Lidar Extended Radar-Only Object Detection
Patrick Palmer, Martin Kr\"uger, Stefan Sch\"utte, Richard, Altendorfer, Ganesh Adam, Torsten Bertram

TL;DR
This paper introduces methods to improve radar-only 3D object detection for autonomous driving by transferring knowledge from lidar data through multi-stage training and cross-modal distillation, achieving significant accuracy gains.
Contribution
It proposes two novel strategies for training radar-only detectors using lidar data without changing detector architectures, enhancing detection performance.
Findings
Up to 4.2% improvement in mean Average Precision
Effective knowledge transfer via multi-stage training and distillation
Applicable to multiple 3D detection networks
Abstract
Accurate 3D object detection is vital for automated driving. While lidar sensors are well suited for this task, they are expensive and have limitations in adverse weather conditions. 3+1D imaging radar sensors offer a cost-effective, robust alternative but face challenges due to their low resolution and high measurement noise. Existing 3+1D imaging radar datasets include radar and lidar data, enabling cross-modal model improvements. Although lidar should not be used during inference, it can aid the training of radar-only object detectors. We explore two strategies to transfer knowledge from the lidar to the radar domain and radar-only object detectors: 1. multi-stage training with sequential lidar point cloud thin-out, and 2. cross-modal knowledge distillation. In the multi-stage process, three thin-out methods are examined. Our results show significant performance gains of up to 4.2…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Optical Sensing Technologies · Remote Sensing and LiDAR Applications · Radar Systems and Signal Processing
MethodsKnowledge Distillation
