The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity
Louis Bradshaw, Alexander Spangher, Stella Biderman, Simon Colton

TL;DR
This paper presents Aria-Duet, an interactive system that enables real-time, embodied musical collaboration between a human pianist and an AI model using a Disklavier, fostering musically coherent and stylistically meaningful co-creation.
Contribution
It introduces a novel real-time, physical interface for human-AI musical duet using a Disklavier, advancing embodied, responsive AI-assisted music performance.
Findings
The system maintains stylistic semantics in generated music.
It enables coherent musical phrasal development during duet performance.
The approach demonstrates potential for musically sophisticated human-AI interaction.
Abstract
While generative models for music composition are increasingly capable, their adoption by musicians is hindered by text-prompting, an asynchronous workflow disconnected from the embodied, responsive nature of instrumental performance. To address this, we introduce Aria-Duet, an interactive system facilitating a real-time musical duet between a human pianist and Aria, a state-of-the-art generative model, using a Yamaha Disklavier as a shared physical interface. The framework enables a turn-taking collaboration: the user performs, signals a handover, and the model generates a coherent continuation performed acoustically on the piano. Beyond describing the technical architecture enabling this low-latency interaction, we analyze the system's output from a musicological perspective, finding the model can maintain stylistic semantics and develop coherent phrasal ideas, demonstrating that such…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMusic Technology and Sound Studies · Social Robot Interaction and HRI · AI in Service Interactions
