Visual Perception System for Autonomous Driving

TL;DR

This paper presents a visual perception system for autonomous driving that integrates trajectory prediction and environment mapping to enhance safety and navigation, validated through extensive tests on simulated and real data.

Contribution

It introduces an integrated visual perception system combining motion-based object tracking, trajectory prediction, and environment mapping for autonomous vehicles, addressing localization and collision avoidance.

Findings

System effectively predicts pedestrian movements.

Achieves accurate environment mapping in real-world scenarios.

Demonstrates robustness and efficiency in diverse conditions.

Abstract

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms have yielded more precise algorithms applicable to autonomous driving, including vision-based Simultaneous Localization and Mapping (SLAMs), object detection, and tracking algorithms. This work introduces a visual-based perception system for autonomous driving that integrates trajectory tracking and prediction of moving objects to prevent collisions, while addressing autonomous driving's localization and mapping requirements. The system leverages motion cues from pedestrians to monitor and forecast their movements and simultaneously maps the environment. This integrated approach resolves camera localization and the tracking of other moving objects in the scene, subsequently generating a sparse map to facilitate vehicle navigation. The performance, efficiency, and resilience of this approach are substantiated through comprehensive evaluations of both simulated and real-world datasets.