PreAct: Prediction Enhances Agent's Planning Ability

TL;DR

PreAct is a novel agent framework that integrates prediction, reasoning, and action to improve planning and task completion in large language models, outperforming previous methods like ReAct.

Contribution

The paper introduces PreAct, a new framework that leverages predictions to enhance reasoning and planning in LLM agents, demonstrating superior performance over existing approaches.

Findings

PreAct outperforms ReAct in complex task completion.

Predictions improve LLM planning across various historical data quantities.

PreAct shows increased diversity and strategic reasoning in single-step processes.

Abstract

Addressing the disparity between forecasts and actual results can enable individuals to expand their thought processes and stimulate self-reflection, thus promoting accurate planning. In this research, we present **PreAct**, an agent framework that integrates **pre**diction, **rea**soning, and **act**ion. By utilizing the information derived from predictions, the large language model (LLM) agent can provide a wider range and more strategically focused reasoning. This leads to more efficient actions that aid the agent in accomplishing intricate tasks. Our experimental results show that PreAct surpasses the ReAct method in completing complex tasks and that PreAct's performance can be further improved when paired with other memory or selection strategy techniques. We presented the model with varying quantities of historical predictions and discovered that these predictions consistently enhance LLM planning.The variances in single-step reasoning between PreAct and ReAct indicate that PreAct indeed has benefits in terms of diversity and strategic orientation over ReAct.