Visualizing Deep Neural Networks with Topographic Activation Maps

TL;DR

This paper introduces a novel visualization technique inspired by neuroscience to create topographic maps of neural network activations, enhancing interpretability and transparency of deep learning models.

Contribution

It proposes and compares methods for generating topographic layouts of neurons in DNN layers, improving understanding of model decisions without requiring ML expertise.

Findings

Effective visualization of neuron activations as topographic maps

Identification of errors and biases through visual analysis

Visualization of training processes enhances model transparency

Abstract

Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity of DNNs makes it difficult to understand how they solve their learned task. To improve the explainability of DNNs, we adapt methods from neuroscience that analyze complex and opaque systems. Here, we draw inspiration from how neuroscience uses topographic maps to visualize brain activity. To also visualize activations of neurons in DNNs as topographic maps, we research techniques to layout the neurons in a two-dimensional space such that neurons of similar activity are in the vicinity of each other. In this work, we introduce and compare methods to obtain a topographic layout of neurons in a DNN layer. Moreover, we demonstrate how to use topographic activation maps to identify errors or encoded biases and to visualize training processes. Our novel visualization technique improves the transparency of DNN-based decision-making systems and is interpretable without expert knowledge in Machine Learning.