R3ST: A Synthetic 3D Dataset With Realistic Trajectories

TL;DR

R3ST is a synthetic 3D dataset that combines realistic vehicle trajectories from real-world drone footage with synthetic environments, improving the training and evaluation of traffic analysis models.

Contribution

The paper introduces R3ST, a synthetic dataset with authentic vehicle trajectories derived from real-world data, bridging the gap between synthetic environments and realistic motion patterns.

Findings

Provides realistic vehicle trajectories in synthetic data

Enables accurate multimodal ground-truth annotations

Enhances trajectory forecasting research

Abstract

Datasets are essential to train and evaluate computer vision models used for traffic analysis and to enhance road safety. Existing real datasets fit real-world scenarios, capturing authentic road object behaviors, however, they typically lack precise ground-truth annotations. In contrast, synthetic datasets play a crucial role, allowing for the annotation of a large number of frames without additional costs or extra time. However, a general drawback of synthetic datasets is the lack of realistic vehicle motion, since trajectories are generated using AI models or rule-based systems. In this work, we introduce R3ST (Realistic 3D Synthetic Trajectories), a synthetic dataset that overcomes this limitation by generating a synthetic 3D environment and integrating real-world trajectories derived from SinD, a bird's-eye-view dataset recorded from drone footage. The proposed dataset closes the gap between synthetic data and realistic trajectories, advancing the research in trajectory forecasting of road vehicles, offering both accurate multimodal ground-truth annotations and authentic human-driven vehicle trajectories.