Open Problems in Technical AI Governance

TL;DR

This paper discusses the importance of technical AI governance, providing a taxonomy and catalog of open problems to guide researchers in addressing AI risks and governance challenges.

Contribution

It introduces a taxonomy and an incomplete catalog of open problems in technical AI governance, serving as a resource for researchers and funders.

Findings

Identifies key areas where technical intervention is needed.

Provides a framework for assessing governance mechanisms.

Highlights open problems to guide future research.

Abstract

AI progress is creating a growing range of risks and opportunities, but it is often unclear how they should be navigated. In many cases, the barriers and uncertainties faced are at least partly technical. Technical AI governance, referring to technical analysis and tools for supporting the effective governance of AI, seeks to address such challenges. It can help to (a) identify areas where intervention is needed, (b) identify and assess the efficacy of potential governance actions, and (c) enhance governance options by designing mechanisms for enforcement, incentivization, or compliance. In this paper, we explain what technical AI governance is, why it is important, and present a taxonomy and incomplete catalog of its open problems. This paper is intended as a resource for technical researchers or research funders looking to contribute to AI governance.