STRUX: An LLM for Decision-Making with Structured Explanations

TL;DR

STRUX is a novel LLM framework that improves decision-making transparency by generating structured explanations, including key favorable and adverse facts, to better understand and predict decisions like stock investments.

Contribution

Introduces STRUX, a new LLM decision-making framework that provides structured, prioritized explanations to enhance transparency and accuracy in complex decision tasks.

Findings

Outperforms baseline models in stock investment decision forecasting

Provides transparent explanations with key factors influencing decisions

Enhances understanding of decision rationale through structured facts

Abstract

Countless decisions shape our daily lives, and it is paramount to understand the how and why behind these choices. In this paper, we introduce a new LLM decision-making framework called STRUX, which enhances LLM decision-making by providing structured explanations. These include favorable and adverse facts related to the decision, along with their respective strengths. STRUX begins by distilling lengthy information into a concise table of key facts. It then employs a series of self-reflection steps to determine which of these facts are pivotal, categorizing them as either favorable or adverse in relation to a specific decision. Lastly, we fine-tune an LLM to identify and prioritize these key facts to optimize decision-making. STRUX has been evaluated on the challenging task of forecasting stock investment decisions based on earnings call transcripts and demonstrated superior performance against strong baselines. It enhances decision transparency by allowing users to understand the impact of different factors, representing a meaningful step towards practical decision-making with LLMs.