Two Sonification Methods for the MindCube

TL;DR

This paper investigates two musical interface methods for the MindCube, an emotion-focused interactive device, including a novel AI-based mapping to enhance emotional expression and control.

Contribution

It introduces two distinct sonification mappings for the MindCube, notably incorporating generative AI to create meaningful latent space navigation for emotional music interaction.

Findings

AI mapping enables meaningful emotional control

User engagement with the AI-enhanced interface improves

The methods facilitate expressive musical interactions

Abstract

In this work, we explore the musical interface potential of the MindCube, an interactive device designed to study emotions. Embedding diverse sensors and input devices, this interface resembles a fidget cube toy commonly used to help users relieve their stress and anxiety. As such, it is a particularly well-suited controller for musical systems that aim to help with emotion regulation. In this regard, we present two different mappings for the MindCube, with and without AI. With our generative AI mapping, we propose a way to infuse meaning within a latent space and techniques to navigate through it with an external controller. We discuss our results and propose directions for future work.