Turing Test 2.0: The General Intelligence Threshold

TL;DR

This paper proposes a new framework called Turing Test 2.0 to detect artificial general intelligence by defining a G.I. threshold and providing practical testing methods beyond traditional Turing tests.

Contribution

It introduces a clear definition of general intelligence, establishes a G.I. threshold, and develops a comprehensive framework for testing A.I. systems for G.I. detection.

Findings

Demonstrated application of Turing Test 2.0 on modern A.I. models

Provided a practical method for distinguishing A.G.I. from narrow A.I.

Highlighted limitations of traditional Turing tests for G.I. detection

Abstract

With the rise of artificial intelligence (A.I.) and large language models like ChatGPT, a new race for achieving artificial general intelligence (A.G.I) has started. While many speculate how and when A.I. will achieve A.G.I., there is no clear agreement on how A.G.I. can be detected in A.I. models, even when popular tools like the Turing test (and its modern variations) are used to measure their intelligence. In this work, we discuss why traditional methods like the Turing test do not suffice for measuring or detecting A.G.I. and provide a new, practical method that can be used to decide if a system (computer or any other) has reached or surpassed A.G.I. To achieve this, we make two new contributions. First, we present a clear definition for general intelligence (G.I.) and set a G.I. Threshold (G.I.T.) that can be used to distinguish between systems that achieve A.G.I. and systems that do not. Second, we present a new framework on how to construct tests that can detect if a system has achieved G.I. in a simple, comprehensive, and clear-cut fail/pass way. We call this novel framework the Turing test 2.0. We then demonstrate real-life examples of applying tests that follow our Turing test 2.0 framework on modern A.I. models.