VINE: An Open Source Interactive Data Visualization Tool for Neuroevolution

TL;DR

VINE is an interactive visualization tool designed to help researchers and users understand the complex dynamics of neuroevolution algorithms like ES and GA in high-dimensional neural network training.

Contribution

The paper introduces VINE, a novel open-source visualization tool that enables exploration of neuroevolution processes across various algorithms and scales.

Findings

VINE effectively visualizes neuroevolution dynamics.

Supports multiple neuroevolution algorithms.

Enhances understanding of high-dimensional neural network training.

Abstract

Recent advances in deep neuroevolution have demonstrated that evolutionary algorithms, such as evolution strategies (ES) and genetic algorithms (GA), can scale to train deep neural networks to solve difficult reinforcement learning (RL) problems. However, it remains a challenge to analyze and interpret the underlying process of neuroevolution in such high dimensions. To begin to address this challenge, this paper presents an interactive data visualization tool called VINE (Visual Inspector for NeuroEvolution) aimed at helping neuroevolution researchers and end-users better understand and explore this family of algorithms. VINE works seamlessly with a breadth of neuroevolution algorithms, including ES and GA, and addresses the difficulty of observing the underlying dynamics of the learning process through an interactive visualization of the evolving agent's behavior characterizations over generations. As neuroevolution scales to neural networks with millions or more connections, visualization tools like VINE that offer fresh insight into the underlying dynamics of evolution become increasingly valuable and important for inspiring new innovations and applications.