Architecture for Simulating Behavior Mode Changes in Norm-Aware Autonomous Agents

TL;DR

This paper introduces an architecture and prototype for simulating norm-aware autonomous agents whose behavior modes can be dynamically changed by human controllers, aiding policy development and understanding of agent actions.

Contribution

The work presents a novel architecture and prototype system for simulating behavior mode changes in norm-aware agents using the AOPL language, facilitating policy analysis.

Findings

Prototype successfully simulates behavior mode changes

Enables policy makers to analyze agent actions under different norms

Supports refinement of policies based on simulation outcomes

Abstract

This paper presents an architecture for simulating the actions of a norm-aware intelligent agent whose behavior with respect to norm compliance is set, and can later be changed, by a human controller. Updating an agent's behavior mode from a norm-abiding to a riskier one may be relevant when the agent is involved in time-sensitive rescue operations, for example. We base our work on the Authorization and Obligation Policy Language AOPL designed by Gelfond and Lobo for the specification of norms. We introduce an architecture and a prototype software system that can be used to simulate an agent's plans under different behavior modes that can later be changed by the controller. We envision such software to be useful to policy makers, as they can more readily understand how agents may act in certain situations based on the agents' attitudes towards norm-compliance. Policy makers may then refine their policies if simulations show unwanted consequences.