Collaboration Between Robots, Interfaces and Humans: Practice-Based and Audience Perspectives

TL;DR

This paper analyzes a mixed-media musical performance integrating human musicians, robotics, AI, and interactive visuals, providing technical insights, artistic reflections, and audience perspectives on the innovative collaboration.

Contribution

It offers a detailed technical and artistic analysis of a novel interdisciplinary musical work combining robotics, AI, and human performance, along with audience reception insights.

Findings

Insights into human-robot musical collaboration

Audience perceptions of technological integration

Challenges and breakthroughs in system design

Abstract

This paper provides an analysis of a mixed-media experimental musical work that explores the integration of human musical interaction with a newly developed interface for the violin, manipulated by an improvising violinist, interactive visuals, a robotic drummer and an improvised synthesised orchestra. We first present a detailed technical overview of the systems involved including the design and functionality of each component. We then conduct a practice-based review examining the creative processes and artistic decisions underpinning the work, focusing on the challenges and breakthroughs encountered during its development. Through this introspective analysis, we uncover insights into the collaborative dynamics between the human performer and technological agents, revealing the complexities of blending traditional musical expressiveness with artificial intelligence and robotics. To gauge public reception and interpretive perspectives, we conducted an online survey, sharing a video of the performance with a diverse audience. The feedback collected from this survey offers valuable viewpoints on the accessibility, emotional impact, and perceived artistic value of the work. Respondents' reactions underscore the transformative potential of integrating advanced technologies in musical performance, while also highlighting areas for further exploration and refinement.