AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

TL;DR

AIive is an innovative VR tool that visually and sonically represents neural networks, allowing users to interactively manipulate parameters and gain intuitive insights into AI models.

Contribution

It introduces a novel immersive VR environment combining visualization, sonification, and interaction to represent neural networks in an accessible and artistic way.

Findings

Enables real-time manipulation of neural network parameters in VR

Provides auditory feedback for neural network metrics

Creates an intuitive and artistic AI visualization experience

Abstract

Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present AIive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". AIive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, AIive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.