# The Right (Angled) Perspective: Improving the Understanding of Road Scenes Using Boosted Inverse Perspective Mapping

## TL;DR

This paper introduces an adversarial learning method to generate enhanced bird's-eye view images from a single camera, improving clarity and scene understanding for autonomous vehicle tasks.

## Contribution

It presents a novel real-time adversarial approach to produce sharper, more homogeneous IPM images that automatically remove dynamic objects, surpassing traditional methods.

## Key findings

- Sharper features and homogeneous illumination in generated IPM images
- Automatic removal of dynamic objects from scenes
- Improved scene understanding in autonomous driving tasks

## Abstract

Many tasks performed by autonomous vehicles such as road marking detection, object tracking, and path planning are simpler in bird's-eye view. Hence, Inverse Perspective Mapping (IPM) is often applied to remove the perspective effect from a vehicle's front-facing camera and to remap its images into a 2D domain, resulting in a top-down view. Unfortunately, however, this leads to unnatural blurring and stretching of objects at further distance, due to the resolution of the camera, limiting applicability. In this paper, we present an adversarial learning approach for generating a significantly improved IPM from a single camera image in real time. The generated bird's-eye-view images contain sharper features (e.g. road markings) and a more homogeneous illumination, while (dynamic) objects are automatically removed from the scene, thus revealing the underlying road layout in an improved fashion. We demonstrate our framework using real-world data from the Oxford RobotCar Dataset and show that scene understanding tasks directly benefit from our boosted IPM approach.