RAR: Setting Knowledge Tripwires for Retrieval Augmented Rejection

TL;DR

This paper presents Retrieval Augmented Rejection (RAR), a flexible method for content moderation in large language models that detects and rejects unsafe queries by leveraging retrieval-augmented generation without retraining the model.

Contribution

RAR introduces a novel retrieval-based approach for dynamic content moderation that requires no architectural changes and allows real-time customization.

Findings

RAR achieves performance comparable to embedded moderation.

It offers superior flexibility and real-time customization.

The method requires only adding malicious documents to the database.

Abstract

Content moderation for large language models (LLMs) remains a significant challenge, requiring flexible and adaptable solutions that can quickly respond to emerging threats. This paper introduces Retrieval Augmented Rejection (RAR), a novel approach that leverages a retrieval-augmented generation (RAG) architecture to dynamically reject unsafe user queries without model retraining. By strategically inserting and marking malicious documents into the vector database, the system can identify and reject harmful requests when these documents are retrieved. Our preliminary results show that RAR achieves comparable performance to embedded moderation in LLMs like Claude 3.5 Sonnet, while offering superior flexibility and real-time customization capabilities, a fundamental feature to timely address critical vulnerabilities. This approach introduces no architectural changes to existing RAG systems, requiring only the addition of specially crafted documents and a simple rejection mechanism based on retrieval results.