DAWZY: A New Addition to AI powered "Human in the Loop" Music Co-creation

TL;DR

DAWZY is an open-source AI assistant integrated into digital audio workstations that simplifies music production by translating natural language requests into reversible, controllable actions, enhancing user experience and creative flow.

Contribution

It introduces a novel LLM-based code generation approach for DAW control, enabling natural language interaction and reversible actions within music production software.

Findings

Performed reliably on common production tasks

Rated positively by users in usability and control

Reduces learning curve for complex DAW interfaces

Abstract

Digital Audio Workstations (DAWs) offer fine control, but mapping high-level intent (e.g., "warm the vocals") to low-level edits breaks creative flow. Existing artificial intelligence (AI) music generators are typically one-shot, limiting opportunities for iterative development and human contribution. We present DAWZY, an open-source assistant that turns natural-language (text/voice/hum) requests into reversible actions in REAPER. DAWZY keeps the DAW as the creative hub with a minimal GUI and voice-first interface. DAWZY uses LLM-based code generation as a novel way to significantly reduce the time users spend familiarizing themselves with large interfaces, replacing hundreds of buttons and drop-downs with a chat box. DAWZY also uses three Model Context Protocol tools for live state queries, parameter adjustment, and AI beat generation. It maintains grounding by refreshing state before mutation and ensures safety and reversibility with atomic scripts and undo. In evaluations, DAWZY performed reliably on common production tasks and was rated positively by users across Usability, Control, Learning, Collaboration, and Enjoyment.