Knowledge-Augmented Question Error Correction for Chinese Question Answer System with QuestionRAG
Longpeng Qiu, Ting Li, Shuai Mao, Nan Yang, Xiaohui Yan

TL;DR
This paper introduces QuestionRAG, a framework that enhances Chinese question error correction in QA systems by combining external knowledge augmentation with reinforcement learning to improve understanding and reduce over-correction.
Contribution
It proposes a novel knowledge-augmented, RL-based approach for question error correction, outperforming traditional fine-tuning methods.
Findings
Knowledge augmentation improves question understanding.
RL-based alignment outperforms supervised fine-tuning.
Significant boost in correction accuracy and instruction-following ability.
Abstract
Input errors in question-answering (QA) systems often lead to incorrect responses. Large language models (LLMs) struggle with this task, frequently failing to interpret user intent (misinterpretation) or unnecessarily altering the original question's structure (over-correction). We propose QuestionRAG, a framework that tackles these problems. To address misinterpretation, it enriches the input with external knowledge (e.g., search results, related entities). To prevent over-correction, it uses reinforcement learning (RL) to align the model's objective with precise correction, not just paraphrasing. Our results demonstrate that knowledge augmentation is critical for understanding faulty questions. Furthermore, RL-based alignment proves significantly more effective than traditional supervised fine-tuning (SFT), boosting the model's ability to follow instructions and generalize. By…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
Taxonomy
TopicsTopic Modeling · Expert finding and Q&A systems · Multimodal Machine Learning Applications
