SoundSignaling: Realtime, Stylistic Modification of a Personal Music Corpus for Information Delivery

TL;DR

SoundSignaling is a real-time system that subtly modifies personal music to deliver notifications, aiming to reduce cognitive load and improve user experience compared to traditional binary alerts.

Contribution

The paper introduces a novel system for stylistic, real-time music modification for information delivery, validated through experiments and qualitative analysis.

Findings

Effective real-time music modifications demonstrated

Participants could identify signals with high accuracy

Potential for reduced cognitive load and improved listening experience

Abstract

Drawing inspiration from the notion of cognitive incongruence associated with Stroop's famous experiment, from musical principles, and from the observation that music consumption on an individual basis is becoming increasingly ubiquitous, we present the SoundSignaling system -- a software platform designed to make real-time, stylistically relevant modifications to a personal corpus of music as a means of conveying information or notifications. In this work, we discuss in detail the system's technical implementation and its motivation from a musical perspective, and validate these design choices through a crowd-sourced signal identification experiment consisting of 200 independent tasks performed by 50 online participants. We then qualitatively discuss the potential implications of such a system from the standpoint of switch cost, cognitive load, and listening behavior by considering the anecdotal outcomes of a small-scale, in-the-wild experiment consisting of over 180 hours of usage from 6 participants. Through this work, we suggest a re-evaluation of the age-old paradigm of binary audio notifications in favor of a system designed to operate upon the relatively unexplored medium of a user's musical preferences.