RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning

TL;DR

RAG+ enhances retrieval-augmented generation by explicitly incorporating application-aware reasoning, enabling models to better apply retrieved knowledge in goal-oriented tasks across various domains.

Contribution

Introduces RAG+, a modular extension that integrates structured reasoning with retrieval, improving LLM performance in knowledge-intensive, application-specific tasks.

Findings

RAG+ outperforms standard RAG by 3-5% on average.

Achieves up to 13.5% improvement in complex scenarios.

Effective across mathematical, legal, and medical domains.

Abstract

The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning. In this work, we introduce RAG+, a principled and modular extension that explicitly incorporates application-aware reasoning into the RAG pipeline. RAG+ constructs a dual corpus consisting of knowledge and aligned application examples, created either manually or automatically, and retrieves both jointly during inference. This design enables LLMs not only to access relevant information but also to apply it within structured, goal-oriented reasoning processes. Experiments across mathematical, legal, and medical domains, conducted on multiple models, demonstrate that RAG+ consistently outperforms standard RAG variants, achieving average improvements of 3-5%, and peak gains up to 13.5% in complex scenarios. By bridging retrieval with actionable application, RAG+ advances a more cognitively grounded framework for knowledge integration, representing a step toward more interpretable and capable LLMs.