Multi-modal Transformer Path Prediction for Autonomous Vehicle

TL;DR

This paper introduces a multi-modal Transformer-based system for vehicle path prediction that effectively incorporates lane information and sensor data to improve long-term trajectory forecasting in autonomous driving.

Contribution

The paper presents a novel Transformer architecture for path prediction that utilizes multi-modal sensor data and refined lane filtering to enhance accuracy.

Findings

Transformer architecture improves trajectory prediction accuracy.

Lane filtering reduces unlikely path options.

System performs well on nuScene dataset.

Abstract

Reasoning about vehicle path prediction is an essential and challenging problem for the safe operation of autonomous driving systems. There exist many research works for path prediction. However, most of them do not use lane information and are not based on the Transformer architecture. By utilizing different types of data collected from sensors equipped on the self-driving vehicles, we propose a path prediction system named Multi-modal Transformer Path Prediction (MTPP) that aims to predict long-term future trajectory of target agents. To achieve more accurate path prediction, the Transformer architecture is adopted in our model. To better utilize the lane information, the lanes which are in opposite direction to target agent are not likely to be taken by the target agent and are consequently filtered out. In addition, consecutive lane chunks are combined to ensure the lane input to be long enough for path prediction. An extensive evaluation is conducted to show the efficacy of the proposed system using nuScene, a real-world trajectory forecasting dataset.