React to This (RTT): A Nonverbal Turing Test for Embodied AI

TL;DR

This paper introduces the React to This (RTT) test, a new nonverbal Turing test for embodied AI that assesses interaction awareness and believability through physical and perceptual reactions.

Contribution

It proposes the RTT test as a novel evaluation method for embodied AI, extending the Turing concept to nonverbal, physical interactions.

Findings

Initial experiment demonstrates feasibility of RTT test

RTT effectively distinguishes levels of interaction believability

Provides a new benchmark for embodied AI evaluation

Abstract

We propose an approach to test embodied AI agents for interaction awareness and believability, particularly in scenarios where humans push them to their limits. Turing introduced the Imitation Game as a way to explore the question: "Can machines think?" The Total Turing Test later expanded this concept beyond purely verbal communication, incorporating perceptual and physical interaction. Building on this, we propose a new guiding question: "Can machines react?" and introduce the React to This (RTT) test for nonverbal behaviors, presenting results from an initial experiment.