What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies
Yaoqi Huang, Julie Stephany Berrio, Mao Shan, and Stewart Worrall

TL;DR
This survey reviews vision-driven datasets and studies in urban traffic scenes, categorizing critical entities and analyzing 73 datasets to guide future research and improve road safety.
Contribution
It introduces a unified taxonomy of traffic entities, analyzes 35 vision tasks, and provides a comprehensive overview of 73 datasets for traffic scene understanding.
Findings
Categorizes traffic entities into anomalies and critical normal entities.
Analyzes 35 vision-driven tasks relevant to traffic safety.
Provides visualizations and evaluations of 73 datasets.
Abstract
Advances in vision-based sensors and computer vision algorithms have significantly improved the analysis and understanding of traffic scenarios. To facilitate the use of these improvements for road safety, this survey systematically categorizes the critical elements that demand attention in traffic scenarios and comprehensively analyzes available vision-driven tasks and datasets. Compared to existing surveys that focus on isolated domains, our taxonomy categorizes attention-worthy traffic entities into two main groups that are anomalies and normal but critical entities, integrating ten categories and twenty subclasses. It establishes connections between inherently related fields and provides a unified analytical framework. Our survey highlights the analysis of 35 vision-driven tasks and comprehensive examinations and visualizations of 73 available datasets based on the proposed…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Surveillance and Tracking Methods
MethodsFocus
