The Suicide Region: Option Games and the Race to Artificial General Intelligence
David Tan

TL;DR
This paper models the competitive race to develop AGI as a preemption game with systemic existential risk, explaining why actors accelerate despite catastrophic potential and proposing safety measures to mitigate this.
Contribution
It formalizes the AGI race as a continuous-time preemption game with endogenous risk, revealing the 'suicide region' where early deployment is rational and suggesting mechanisms for safer development.
Findings
Accelerating AGI development occurs despite catastrophic risk due to a 'suicide region' in the investment space.
Warning shots are ineffective in deterring AGI race acceleration.
Safety research becomes essential for economic viability and risk mitigation in AGI development.
Abstract
Standard real options theory predicts delay in exercising the option to invest or deploy when extreme asset volatility or technological uncertainty are present. However, in the current race to develop artificial general intelligence (AGI), sovereign actors are exhibiting behaviors contrary to theoretical predictions: the US and China are accelerating AI investment despite acknowledging the potential for catastrophic failure from AGI misalignment. We resolve this puzzle by formalizing the AGI race as a continuous-time preemption game with endogenous existential risk. In our model, the cost of failure is no longer bounded only by the sunk cost of investment (I), but rather a systemic ruin parameter (D) that is correlated with development velocity and shared globally. As the disutility of catastrophe is embedded in both players' payoffs, the risk term mathematically cancels out of the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCapital Investment and Risk Analysis · Space Science and Extraterrestrial Life · Innovation, Sustainability, Human-Machine Systems
