Algorithmic Feature Highlighting for Human-AI Decision-Making

TL;DR

This paper explores algorithms that highlight a small, context-specific set of features for human decision-makers, analyzing their computational properties and implications for human-AI collaboration.

Contribution

It introduces a formal model of feature highlighting as an information policy, analyzes its computational complexity, and proposes robust strategies for human-AI decision-making.

Findings

Optimizing highlighting for sophisticated agents is computationally intractable.

Optimizing for naive agents is tractable with fixed bandwidth.

Highlighting policies for sophisticated agents can perform poorly for naive agents.

Abstract

Human decision-makers often face choices about complex cases with many potentially relevant features, but limited bandwidth to inspect and integrate all available information. In such settings, we study algorithms that highlight a small subset of case-specific features for human consideration, rather than producing a single prediction or recommendation. We model highlighting as a constrained information policy that selects a small number of features to reveal. A central issue is how humans interpret the algorithm's choice of features: a sophisticated agent correctly conditions on the selection rule, while a naive agent updates only on revealed feature values and treats the selection event as exogenous. We show that optimizing highlighting for sophisticated agents can be computationally intractable, even in simple discrete and binary settings, whereas optimizing for naive agents is tractable as long as the maximal bandwidth is fixed. We also show that a highlighting policy that is optimal for sophisticated agents can perform arbitrarily poorly when deployed to naive agents, motivating robust, implementable alternatives. We illustrate our framework in a calibrated empirical exercise based on the American Housing Survey. Overall, our results establish the value of highlighting a context-specific set of features rather than a fixed one as a practically appealing and computationally feasible tool for achieving human-algorithm complementarity.