Structure-Aware Radar-Camera Depth Estimation
Fuyi Zhang, Zhu Yu, Chunhao Li, Runmin Zhang, Xiaokai Bai, Zili Zhou, Si-Yuan Cao, Fang Wang, Hui-Liang Shen

TL;DR
This paper introduces a structure-aware radar-camera depth estimation framework that leverages RGB image priors and multi-scale guidance to produce dense, accurate depth maps, outperforming existing methods on the nuScenes dataset.
Contribution
It proposes a novel structure-aware strategy and a multi-scale network to enhance radar data processing for improved depth estimation.
Findings
Achieves state-of-the-art results on nuScenes dataset.
Effectively preserves detailed structures in depth maps.
Outperforms previous radar-camera depth estimation methods.
Abstract
Radar has gained much attention in autonomous driving due to its accessibility and robustness. However, its standalone application for depth perception is constrained by issues of sparsity and noise. Radar-camera depth estimation offers a more promising complementary solution. Despite significant progress, current approaches fail to produce satisfactory dense depth maps, due to the unsatisfactory processing of the sparse and noisy radar data. They constrain the regions of interest for radar points in rigid rectangular regions, which may introduce unexpected errors and confusions. To address these issues, we develop a structure-aware strategy for radar depth enhancement, which provides more targeted regions of interest by leveraging the structural priors of RGB images. Furthermore, we design a Multi-Scale Structure Guided Network to enhance radar features and preserve detailed…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Vision and Imaging · Advanced SAR Imaging Techniques · Robotics and Sensor-Based Localization
