The Einstein Test: Towards a Practical Test of a Machine's Ability to Exhibit Superintelligence

TL;DR

The paper introduces the Einstein test, a practical evaluation to determine if AI can independently generate creative disruptive insights, marking a step towards identifying machine superintelligence.

Contribution

It proposes a novel, practical test for AI to demonstrate the ability to produce creative insights comparable to human breakthroughs, advancing superintelligence assessment.

Findings

The Einstein test can evaluate AI's capacity for creative insights.

It provides a benchmark for assessing machine superintelligence.

Potential to identify AI surpassing human intellectual achievements.

Abstract

Creative and disruptive insights (CDIs), such as the development of the theory of relativity, have punctuated human history, marking pivotal shifts in our intellectual trajectory. Recent advancements in artificial intelligence (AI) have sparked debates over whether state of the art models possess the capacity to generate CDIs. We argue that the ability to create CDIs should be regarded as a significant feature of machine superintelligence (SI).To this end, we propose a practical test to evaluate whether an approach to AI targeting SI can yield novel insights of this kind. We propose the Einstein test: given the data available prior to the emergence of a known CDI, can an AI independently reproduce that insight (or one that is formally equivalent)? By achieving such a milestone, a machine can be considered to at least match humanity's past top intellectual achievements, and therefore to have the potential to surpass them.