Retrieval-Augmented Prompt for OOD Detection
Ruisong Han, Zongbo Han, Jiahao Zhang, Mingyue Cheng, Changqing Zhang

TL;DR
This paper introduces Retrieval-Augmented Prompt (RAP), a novel method that enhances out-of-distribution detection by retrieving external knowledge to improve semantic supervision and adapt prompts in real-time, achieving state-of-the-art results.
Contribution
RAP leverages external knowledge retrieval to dynamically augment prompts for improved OOD detection, addressing limitations of existing methods that rely on limited or mismatched outlier data.
Findings
RAP achieves state-of-the-art performance on large-scale OOD benchmarks.
In 1-shot OOD detection on ImageNet-1k, RAP reduces FPR95 by 7.05%.
RAP improves AUROC by 1.71% over previous methods.
Abstract
Out-of-Distribution (OOD) detection is crucial for the reliable deployment of machine learning models in-the-wild, enabling accurate identification of test samples that differ from the training data distribution. Existing methods rely on auxiliary outlier samples or in-distribution (ID) data to generate outlier information for training, but due to limited outliers and their mismatch with real test OOD samples, they often fail to provide sufficient semantic supervision, leading to suboptimal performance. To address this, we propose a novel OOD detection method called Retrieval-Augmented Prompt (RAP). RAP augments a pre-trained vision-language model's prompts by retrieving external knowledge, offering enhanced semantic supervision for OOD detection. During training, RAP retrieves descriptive words for outliers based on joint similarity with external textual knowledge and uses them to…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
