AGI Safety Literature Review

TL;DR

This paper provides a comprehensive overview of AGI safety, summarizing key safety challenges, recent research efforts, theoretical perspectives, predictions, and policy considerations in the emerging field.

Contribution

It offers an accessible, up-to-date survey of AGI safety literature, highlighting safety problems, recent solutions, and policy discussions.

Findings

Identified major safety problems for AGI

Surveyed recent research on safety solutions

Reviewed predictions and policy discussions

Abstract

The development of Artificial General Intelligence (AGI) promises to be a major event. Along with its many potential benefits, it also raises serious safety concerns (Bostrom, 2014). The intention of this paper is to provide an easily accessible and up-to-date collection of references for the emerging field of AGI safety. A significant number of safety problems for AGI have been identified. We list these, and survey recent research on solving them. We also cover works on how best to think of AGI from the limited knowledge we have today, predictions for when AGI will first be created, and what will happen after its creation. Finally, we review the current public policy on AGI.