Sequential Language-based Decisions

TL;DR

This paper extends language-based decision models to include sequential actions, providing a representation theorem that characterizes agents as expected utility maximizers with complex, multi-step decision processes.

Contribution

It introduces a framework for sequential language-based decisions and proves a representation theorem for agents with preferences over such actions.

Findings

Agents' preferences can be represented as expected utility maximizers.

The framework accommodates multi-step, sequential decision actions.

A novel construction captures how agents interpret coarse descriptions.

Abstract

In earlier work, we introduced the framework of language-based decisions, the core idea of which was to modify Savage's classical decision-theoretic framework by taking actions to be descriptions in some language, rather than functions from states to outcomes, as they are defined classically. Actions had the form "if psi then do(phi)", where psi and phi were formulas in some underlying language, specifying what effects would be brought about under what circumstances. The earlier work allowed only one-step actions. But, in practice, plans are typically composed of a sequence of steps. Here, we extend the earlier framework to sequential actions, making it much more broadly applicable. Our technical contribution is a representation theorem in the classical spirit: agents whose preferences over actions satisfy certain constraints can be modeled as if they are expected utility maximizers. As in the earlier work, due to the language-based specification of the actions, the representation theorem requires a construction not only of the probability and utility functions representing the agent's beliefs and preferences, but also the state and outcomes spaces over which these are defined, as well as a "selection function" which intuitively captures how agents disambiguate coarse descriptions. The (unbounded) depth of action sequencing adds substantial interest (and complexity!) to the proof.