A Dataset and Model for Crossing Indian Roads

TL;DR

This paper introduces INDRA, a new dataset of Indian road videos from the pedestrian perspective, and develops a CNN-based model, DilatedRoadCrossNet, to predict crossing safety, enabling real-time assistance for the blind.

Contribution

The paper provides the first Indian-specific road crossing dataset and a novel CNN architecture optimized for low-power devices, improving safety predictions for blind pedestrians.

Findings

DilatedRoadCrossNet achieves 79% recall at 90% precision.

The dataset contains 26,000 annotated frames from Indian roads.

The wearable assistant demonstrates real-time crossing safety predictions.

Abstract

Roads in medium-sized Indian towns often have lots of traffic but no (or disregarded) traffic stops. This makes it hard for the blind to cross roads safely, because vision is crucial to determine when crossing is safe. Automatic and reliable image-based safety classifiers thus have the potential to help the blind to cross Indian roads. Yet, we currently lack datasets collected on Indian roads from the pedestrian point-of-view, labelled with road crossing safety information. Existing classifiers from other countries are often intended for crossroads, and hence rely on the detection and presence of traffic lights, which is not applicable in Indian conditions. We introduce INDRA (INdian Dataset for RoAd crossing), the first dataset capturing videos of Indian roads from the pedestrian point-of-view. INDRA contains 104 videos comprising of 26k 1080p frames, each annotated with a binary road crossing safety label and vehicle bounding boxes. We train various classifiers to predict road crossing safety on this data, ranging from SVMs to convolutional neural networks (CNNs). The best performing model DilatedRoadCrossNet is a novel single-image architecture tailored for deployment on the Nvidia Jetson Nano. It achieves 79% recall at 90% precision on unseen images. Lastly, we present a wearable road crossing assistant running DilatedRoadCrossNet, which can help the blind cross Indian roads in real-time. The project webpage is http://roadcross-assistant.github.io/Website/.