Adapt, But Don't Forget: Fine-Tuning and Contrastive Routing for Lane Detection under Distribution Shift

TL;DR

This paper introduces a parameter-efficient method for lane detection under distribution shifts by combining selective fine-tuning with contrastive routing to adapt to new data distributions without catastrophic forgetting.

Contribution

It proposes a novel framework that uses separate branches and contrastive learning for dynamic routing, enabling effective adaptation with fewer parameters.

Findings

Achieves near-optimal F1-scores across distributions

Uses significantly fewer parameters than training separate models

Effective fine-tuning strategies identified for distribution adaptation

Abstract

Lane detection models are often evaluated in a closed-world setting, where training and testing occur on the same dataset. We observe that, even within the same domain, cross-dataset distribution shifts can cause severe catastrophic forgetting during fine-tuning. To address this, we first train a base model on a source distribution and then adapt it to each new target distribution by creating separate branches, fine-tuning only selected components while keeping the original source branch fixed. Based on a component-wise analysis, we identify effective fine-tuning strategies for target distributions that enable parameter-efficient adaptation. At inference time, we propose using a supervised contrastive learning model to identify the input distribution and dynamically route it to the corresponding branch. Our framework achieves near-optimal F1-scores while using significantly fewer parameters than training separate models for each distribution.