QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism
Bo Wang, Heyan Huang, Yixin Cao, Jiahao Ying, Wei Tang, Chong Feng

TL;DR
QRMeM introduces a dual-structured memory mechanism for large language models, enabling better handling of extensive texts through dynamic reorganization and reflection, significantly improving performance on question answering tasks.
Contribution
The paper presents QRMeM, a novel memory mechanism combining static content with structured guidance, addressing limitations of existing methods in dynamic text processing.
Findings
Enhanced performance on MCQ benchmarks
Improved multi-document question answering accuracy
Effective dynamic reorganization of relevant segments
Abstract
While large language models (LLMs) have made notable advancements in natural language processing, they continue to struggle with processing extensive text. Memory mechanism offers a flexible solution for managing long contexts, utilizing techniques such as compression, summarization, and structuring to facilitate nuanced and efficient handling of large volumes of text. However, existing techniques face challenges with static knowledge integration, leading to insufficient adaptation to task-specific needs and missing multi-segmentation relationships, which hinders the dynamic reorganization and logical combination of relevant segments during the response process. To address these issues, we introduce a novel strategy, Question then Reflection Memory Mechanism (QRMeM), incorporating a dual-structured memory pool. This pool synergizes static textual content with structured graph guidance,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Memory and Neural Computing · Neural Networks and Reservoir Computing · Neural Networks and Applications
