RATT: A Thought Structure for Coherent and Correct LLM Reasoning
Jinghan Zhang, Xiting Wang, Weijieying Ren, Lu Jiang, Dongjie Wang,, Kunpeng Liu

TL;DR
RATT introduces a novel thought structure for LLMs that enhances reasoning coherence and factual accuracy by integrating local fact-checking with global strategic evaluation, improving decision-making in complex tasks.
Contribution
The paper proposes RATT, a new thought structure that combines local fact verification with global strategy assessment to improve LLM reasoning and decision-making.
Findings
RATT outperforms existing methods in factual correctness.
RATT enhances logical coherence in LLM reasoning.
RATT improves decision-making efficiency in complex tasks.
Abstract
Large Language Models (LLMs) gain substantial reasoning and decision-making capabilities from thought structures. However, existing methods such as Tree of Thought and Retrieval Augmented Thoughts often fall short in complex tasks due to the limitations of insufficient local retrieval of factual knowledge and inadequate global selection of strategies. These limitations make it challenging for these methods to balance factual accuracy and comprehensive logical optimization effectively. To address these limitations, we introduce the Retrieval Augmented Thought Tree (RATT), a novel thought structure that considers both overall logical soundness and factual correctness at each step of the thinking process. Specifically, at every point of a thought branch, RATT performs planning and lookahead to explore and evaluate multiple potential reasoning steps, and integrate the fact-checking ability…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsParticle accelerators and beam dynamics · Nuclear Physics and Applications · Superconducting Materials and Applications
