Seeing Beyond Sound: Visualization and Abstraction in Audio Data Representation

TL;DR

This paper discusses enhancing audio data analysis by integrating visualization and abstraction techniques to improve pattern recognition and workflow alignment, exemplified through the Jellyfish Dynamite software.

Contribution

It introduces the concept of adding dimensionality and interactivity to audio visualization tools to better support complex research workflows.

Findings

Enhanced pattern recognition through visualization.

Improved workflow alignment with modern needs.

Potential for more effective audio analysis tools.

Abstract

In audio signal processing, the interpretation of complex information using visual representation enhances pattern recognition through its alignment with human perceptual systems. Software tools that carry hidden assumptions inherited from their historical contexts risk misalignment with modern workflows as design origins become obscured. We argue that creating tools that align with emergent needs improves analytical and creative outputs due to an increased affinity for using them. This paper explores the potentials associated with adding dimensionality and interactivity into visualization tools to facilitate complex workflows in audio information research using the Jellyfish Dynamite software.