I see you: A Vehicle-Pedestrian Interaction Dataset from Traffic Surveillance Cameras

TL;DR

This paper introduces 'I see you', a novel dataset capturing vehicle-pedestrian near-accident interactions from traffic cameras, addressing a gap in existing datasets for autonomous vehicle safety research.

Contribution

The paper presents a new dataset with near-accident scenarios and a processing pipeline using YOLOv5 and camera calibration, enhancing urban traffic interaction modeling.

Findings

Contains 170 near-accident interaction instances

Provides trajectory data for vehicle-pedestrian interactions

Available publicly on Github

Abstract

The development of autonomous vehicles arises new challenges in urban traffic scenarios where vehicle-pedestrian interactions are frequent e.g. vehicle yields to pedestrians, pedestrian slows down due approaching to the vehicle. Over the last years, several datasets have been developed to model these interactions. However, available datasets do not cover near-accident scenarios that our dataset covers. We introduce I see you, a new vehicle-pedestrian interaction dataset that tackles the lack of trajectory data in near-accident scenarios using YOLOv5 and camera calibration methods. I see you consist of 170 near-accident occurrences in seven intersections in Cusco-Peru. This new dataset and pipeline code are available on Github.