BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning

TL;DR

The paper introduces BDD100K, a large and diverse driving video dataset with 100K videos and 10 tasks, designed to advance heterogeneous multitask learning for autonomous driving in varied conditions.

Contribution

It provides the largest diverse driving dataset with multiple tasks and establishes a benchmark for heterogeneous multitask learning in autonomous driving.

Findings

Existing models require special training strategies for heterogeneous tasks.

The dataset's diversity improves model robustness across conditions.

Benchmark facilitates future research in multitask autonomous driving.

Abstract

Datasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving. Researchers are usually constrained to study a small set of problems on one dataset, while real-world computer vision applications require performing tasks of various complexities. We construct BDD100K, the largest driving video dataset with 100K videos and 10 tasks to evaluate the exciting progress of image recognition algorithms on autonomous driving. The dataset possesses geographic, environmental, and weather diversity, which is useful for training models that are less likely to be surprised by new conditions. Based on this diverse dataset, we build a benchmark for heterogeneous multitask learning and study how to solve the tasks together. Our experiments show that special training strategies are needed for existing models to perform such heterogeneous tasks. BDD100K opens the door for future studies in this important venue.