Exploratory Models of Human-AI Teams: Leveraging Human Digital Twins to Investigate Trust Development

TL;DR

This paper explores how human digital twins can model trust in human-AI teams by analyzing communication data, validating trust measures, and designing experiments to understand trust development and dynamics.

Contribution

It introduces a framework for using digital twins to model trust, evaluates trust measurement methods, and proposes experimental designs for trust development studies in HATs.

Findings

Causal analysis links empathy and socio-cognitive factors to trust formation.

Preliminary simulations compare LLM models for HDT communication fidelity.

Experimental design outlines trust manipulation strategies for HDTs and AI agents.

Abstract

As human-agent teaming (HAT) research continues to grow, computational methods for modeling HAT behaviors and measuring HAT effectiveness also continue to develop. One rising method involves the use of human digital twins (HDT) to approximate human behaviors and socio-emotional-cognitive reactions to AI-driven agent team members. In this paper, we address three research questions relating to the use of digital twins for modeling trust in HATs. First, to address the question of how we can appropriately model and operationalize HAT trust through HDT HAT experiments, we conducted causal analytics of team communication data to understand the impact of empathy, socio-cognitive, and emotional constructs on trust formation. Additionally, we reflect on the current state of the HAT trust science to discuss characteristics of HAT trust that must be replicable by a HDT such as individual differences in trust tendencies, emergent trust patterns, and appropriate measurement of these characteristics over time. Second, to address the question of how valid measures of HDT trust are for approximating human trust in HATs, we discuss the properties of HDT trust: self-report measures, interaction-based measures, and compliance type behavioral measures. Additionally, we share results of preliminary simulations comparing different LLM models for generating HDT communications and analyze their ability to replicate human-like trust dynamics. Third, to address how HAT experimental manipulations will extend to human digital twin studies, we share experimental design focusing on propensity to trust for HDTs vs. transparency and competency-based trust for AI agents.