We Need Accountability in Human-AI Agent Relationships

TL;DR

This paper emphasizes the importance of accountability in human-AI interactions and proposes a framework that conditions AI engagement on user behavior to promote alignment with societal interests.

Contribution

It introduces a novel framework that integrates accountability mechanisms and design strategies like distancing and disengaging to improve human-AI relationship management.

Findings

Framework effectively links AI engagement to user behavior

Design strategies can enhance accountability in AI systems

Promotes alignment with societal interests

Abstract

We argue that accountability mechanisms are needed in human-AI agent relationships to ensure alignment with user and societal interests. We propose a framework according to which AI agents' engagement is conditional on appropriate user behaviour. The framework incorporates design-strategies such as distancing, disengaging, and discouraging.