Transformative AGI by 2043 is <1% likely

TL;DR

This paper estimates the probability of achieving transformative AGI by 2043 to be less than 1%, considering multiple necessary steps across software, hardware, and sociopolitical factors, and finds the likelihood to be quite low.

Contribution

It introduces a probabilistic framework decomposing the likelihood of transformative AGI into cascading conditional probabilities, providing a nuanced estimate of under 1%.

Findings

Transformative AGI by 2043 is estimated at 0.4% likelihood.

Many necessary steps have success probabilities ranging from 16% to 95%.

The framework highlights the low probability of reaching >10% chance by 2043.

Abstract

This paper is a submission to the Open Philanthropy AI Worldviews Contest. In it, we estimate the likelihood of transformative artificial general intelligence (AGI) by 2043 and find it to be <1%. Specifically, we argue: The bar is high: AGI as defined by the contest - something like AI that can perform nearly all valuable tasks at human cost or less - which we will call transformative AGI is a much higher bar than merely massive progress in AI, or even the unambiguous attainment of expensive superhuman AGI or cheap but uneven AGI. Many steps are needed: The probability of transformative AGI by 2043 can be decomposed as the joint probability of a number of necessary steps, which we group into categories of software, hardware, and sociopolitical factors. No step is guaranteed: For each step, we estimate a probability of success by 2043, conditional on prior steps being achieved. Many steps are quite constrained by the short timeline, and our estimates range from 16% to 95%. Therefore, the odds are low: Multiplying the cascading conditional probabilities together, we estimate that transformative AGI by 2043 is 0.4% likely. Reaching >10% seems to require probabilities that feel unreasonably high, and even 3% seems unlikely. Thoughtfully applying the cascading conditional probability approach to this question yields lower probability values than is often supposed. This framework helps enumerate the many future scenarios where humanity makes partial but incomplete progress toward transformative AGI.