# Augmenting large language models with psychologically grounded models of causal reasoning for planning under uncertainty

## TL;DR

This paper explores integrating human causal reasoning with large language models to improve decision-making under uncertainty in tasks like object assembly and troubleshooting.

## Contribution

The paper introduces a hybrid-reasoning framework combining LLMs with human causal models to enhance planning in uncertain scenarios.

## Key findings

- A hybrid framework using LLMs and human causal models significantly improves task planning rewards.
- The approach was tested across three state-of-the-art LLMs in POMDP-based simulations.
- Integrating causal models enhances decision-making in object assembly and troubleshooting tasks.

## Abstract

Large Language Models (LLMs) have come a long way in their ability to solve a wide range of problems. Yet, LLM decision-making still relies primarily on pattern recognition, which may limit its ability to make sound decisions under uncertainty. In contrast, human reasoning often makes use of explicit causal models, allowing humans to explain, hypothesize, and extrapolate to different domains in uncertain scenarios. In this article, we explore whether human causal models can be strategically integrated with Large Language Models to improve planning outcomes under uncertainty for object assembly and troubleshooting tasks modeled as Partially Observable Markov Decision Processes (POMDPs). Our contributions consist of two parts: (1) an interactive LLM agent that plans an action at each time step by solving a POMDP targeted at an object assembly or troubleshooting task, and (2) a novel hybrid-reasoning framework that uses confidence scores in both the LLM agent's output and a human causal model to make a final decision on the most appropriate action for the current time step to achieve the task. We demonstrate the efficacy of our approach through detailed simulations and show a significant improvement in task planning reward across three different state-of-the-art LLMs when augmenting the baseline LLM planner with a human causal model.