The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity

TL;DR

This paper presents Aria-Duet, an interactive system that enables real-time, embodied musical collaboration between a human pianist and an AI model using a Disklavier, fostering musically coherent and stylistically meaningful co-creation.

Contribution

It introduces a novel real-time, physical interface for human-AI musical duet using a Disklavier, advancing embodied, responsive AI-assisted music performance.

Findings

The system maintains stylistic semantics in generated music.

It enables coherent musical phrasal development during duet performance.

The approach demonstrates potential for musically sophisticated human-AI interaction.

Abstract

While generative models for music composition are increasingly capable, their adoption by musicians is hindered by text-prompting, an asynchronous workflow disconnected from the embodied, responsive nature of instrumental performance. To address this, we introduce Aria-Duet, an interactive system facilitating a real-time musical duet between a human pianist and Aria, a state-of-the-art generative model, using a Yamaha Disklavier as a shared physical interface. The framework enables a turn-taking collaboration: the user performs, signals a handover, and the model generates a coherent continuation performed acoustically on the piano. Beyond describing the technical architecture enabling this low-latency interaction, we analyze the system's output from a musicological perspective, finding the model can maintain stylistic semantics and develop coherent phrasal ideas, demonstrating that such embodied systems can engage in musically sophisticated dialogue and open a promising new path for human-AI co-creation.