Windshield Integration of Thermal and Color Fusion for Automatic Emergency Braking in Low Visibility Conditions

TL;DR

This paper introduces a thermal imaging sensor integrated into vehicle windshields to enhance automatic emergency braking systems in low visibility conditions, demonstrating improved pedestrian detection through sensor fusion.

Contribution

It proposes a novel windshield-integrated thermal and color fusion system for AEB, and evaluates thermal camera performance against NHSTA standards based on real-world testing.

Findings

Thermal imaging improves pedestrian detection range in low visibility.

Sensor fusion enhances AEB system reliability.

Windshield integration is feasible for real-world deployment.

Abstract

The new NHSTA regulations require Automatic Emergency Braking (AEB) systems to operate at night, to protect pedestrians in the deadliest conditions. We propose thermal imaging as a new sensor to complement the AEB sensor suite, alongside the visible front camera and RADAR. This paper explores the benefits of visible-thermal fusion, proposes a windshield integration for such a system, and evaluates the minimum performance requirements for a thermal camera compliant with the NHSTA standards, based on a field study of pedestrian detection range.