Robust Artificial Intelligence and Robust Human Organizations

TL;DR

This paper discusses how integrating principles of high-reliability organizations into AI development and deployment can enhance safety and reduce catastrophic failures in high-risk applications.

Contribution

It highlights the importance of applying high-reliability organization principles to AI systems and human organizations for safer AI deployment.

Findings

High-reliability principles can improve AI safety.

Human-AI systems require organizational safeguards.

Implications for AI development and policy.

Abstract

Every AI system is deployed by a human organization. In high risk applications, the combined human plus AI system must function as a high-reliability organization in order to avoid catastrophic errors. This short note reviews the properties of high-reliability organizations and draws implications for the development of AI technology and the safe application of that technology.