Retrieving, Rethinking and Revising: The Chain-of-Verification Can Improve Retrieval Augmented Generation
Bolei He, Nuo Chen, Xinran He, Lingyong Yan, Zhenkai Wei, Jinchang, Luo, Zhen-Hua Ling

TL;DR
This paper introduces CoV-RAG, a chain-of-verification method that improves retrieval accuracy and answer consistency in retrieval-augmented generation by integrating verification, rewriting, and reasoning modules, significantly outperforming existing baselines.
Contribution
The paper proposes a novel chain-of-verification framework for RAG that enhances retrieval correctness and generation consistency through integrated verification and reasoning modules.
Findings
CoV-RAG significantly outperforms state-of-the-art baselines.
The verification module improves retrieval accuracy.
Unified QA and verification with Chain-of-Thought enhances consistency.
Abstract
Recent Retrieval Augmented Generation (RAG) aims to enhance Large Language Models (LLMs) by incorporating extensive knowledge retrieved from external sources. However, such approach encounters some challenges: Firstly, the original queries may not be suitable for precise retrieval, resulting in erroneous contextual knowledge; Secondly, the language model can easily generate inconsistent answer with external references due to their knowledge boundary limitation. To address these issues, we propose the chain-of-verification (CoV-RAG) to enhance the external retrieval correctness and internal generation consistency. Specifically, we integrate the verification module into the RAG, engaging in scoring, judgment, and rewriting. To correct external retrieval errors, CoV-RAG retrieves new knowledge using a revised query. To correct internal generation errors, we unify QA and verification tasks…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques
MethodsRefunds@Expedia|||How do I get a full refund from Expedia? · WordPiece · Attention Dropout · Linear Layer · Weight Decay · Attention Is All You Need · Linear Warmup With Linear Decay · Dropout · Byte Pair Encoding · BERT
