A Training-Free Framework for Video License Plate Tracking and Recognition with Only One-Shot

TL;DR

OneShotLP is a training-free, video-based license plate detection and recognition framework that leverages pre-trained models for adaptable and accurate license plate tracking and recognition without extensive training.

Contribution

It introduces a novel training-free approach using large pre-trained models for license plate detection and recognition in videos, enabling adaptability across diverse styles.

Findings

Outperforms traditional methods on UFPR-ALPR and SSIG-SegPlate datasets.

Effective without extensive training data.

Demonstrates high accuracy and adaptability in real-world scenarios.

Abstract

Traditional license plate detection and recognition models are often trained on closed datasets, limiting their ability to handle the diverse license plate formats across different regions. The emergence of large-scale pre-trained models has shown exceptional generalization capabilities, enabling few-shot and zero-shot learning. We propose OneShotLP, a training-free framework for video-based license plate detection and recognition, leveraging these advanced models. Starting with the license plate position in the first video frame, our method tracks this position across subsequent frames using a point tracking module, creating a trajectory of prompts. These prompts are input into a segmentation module that uses a promptable large segmentation model to generate local masks of the license plate regions. The segmented areas are then processed by multimodal large language models (MLLMs) for accurate license plate recognition. OneShotLP offers significant advantages, including the ability to function effectively without extensive training data and adaptability to various license plate styles. Experimental results on UFPR-ALPR and SSIG-SegPlate datasets demonstrate the superior accuracy of our approach compared to traditional methods. This highlights the potential of leveraging pre-trained models for diverse real-world applications in intelligent transportation systems. The code is available at https://github.com/Dinghaoxuan/OneShotLP.