US-China perspectives on extreme AI risks and global governance

TL;DR

This study analyzes US and China expert statements on advanced AI risks, highlighting shared concerns and early efforts for international cooperation to address global security challenges posed by AI.

Contribution

It provides a comparative analysis of US and China expert perspectives on AI risks and international cooperation efforts based on publicly available statements.

Findings

Both countries express concern about AGI and AI systems escaping control.

Early international cooperation efforts are underway in both nations.

Public discourse reflects shared security concerns about advanced AI.

Abstract

The United States and China will play an important role in navigating safety and security challenges relating to advanced artificial intelligence. We sought to better understand how experts in each country describe safety and security threats from advanced artificial intelligence, extreme risks from AI, and the potential for international cooperation. Specifically, we compiled publicly-available statements from major technical and policy leaders in both the United States and China. We focused our analysis on advanced forms of artificial intelligence, such as artificial general intelligence (AGI), that may have the most significant impacts on national and global security. Experts in both countries expressed concern about risks from AGI, risks from intelligence explosions, and risks from AI systems that escape human control. Both countries have also launched early efforts designed to promote international cooperation around safety standards and risk management practices. Notably, our findings only reflect information from publicly available sources. Nonetheless, our findings can inform policymakers and researchers about the state of AI discourse in the US and China. We hope such work can contribute to policy discussions around advanced AI, its global security threats, and potential international dialogues or agreements to mitigate such threats.