Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation
Ruomeng Ding, Chaoyun Zhang, Lu Wang, Yong Xu, Minghua Ma, Wei Zhang,, Si Qin, Saravan Rajmohan, Qingwei Lin, Dongmei Zhang

TL;DR
This paper introduces 'Everything of Thoughts' (XoT), a novel prompting method for LLMs that integrates reinforcement learning and MCTS to improve performance, efficiency, and flexibility in complex problem-solving.
Contribution
XoT defies existing thought paradigms by combining external domain knowledge with LLMs, enabling autonomous, high-quality, and flexible problem-solving with minimal interactions.
Findings
XoT outperforms existing methods on multi-solution tasks.
XoT generates multiple solutions with only one LLM call.
XoT demonstrates strong generalization to unseen problems.
Abstract
Recent advancements in Large Language Models (LLMs) have revolutionized decision-making by breaking down complex problems into more manageable language sequences referred to as "thoughts". An effective thought design should consider three key perspectives: performance, efficiency, and flexibility. However, existing thought can at most exhibit two of these attributes. To address these limitations, we introduce a novel thought prompting approach called "Everything of Thoughts" (XoT) to defy the law of "Penrose triangle of existing thought paradigms. XoT leverages pretrained reinforcement learning and Monte Carlo Tree Search (MCTS) to incorporate external domain knowledge into thoughts, thereby enhancing LLMs' capabilities and enabling them to generalize to unseen problems efficiently. Through the utilization of the MCTS-LLM collaborative thought revision framework, this approach…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Software Engineering Research
