AMSOM: Adaptive Moving Self-organizing Map for Clustering and Visualization

TL;DR

The paper introduces AMSOM, an adaptive self-organizing map that dynamically adjusts neuron positions and structure during training, improving visualization and training efficiency for high-dimensional data.

Contribution

It proposes a novel SOM variant that allows dynamic neuron movement and structural changes, addressing limitations of fixed-grid and growing SOM models.

Findings

Enhanced training performance compared to traditional SOM

Improved visualization of high-dimensional data

Framework for optimal neuron structure determination

Abstract

Self-Organizing Map (SOM) is a neural network model which is used to obtain a topology-preserving mapping from the (usually high dimensional) input/feature space to an output/map space of fewer dimensions (usually two or three in order to facilitate visualization). Neurons in the output space are connected with each other but this structure remains fixed throughout training and learning is achieved through the updating of neuron reference vectors in feature space. Despite the fact that growing variants of SOM overcome the fixed structure limitation they increase computational cost and also do not allow the removal of a neuron after its introduction. In this paper, a variant of SOM is proposed called AMSOM (Adaptive Moving Self-Organizing Map) that on the one hand creates a more flexible structure where neuron positions are dynamically altered during training and on the other hand tackles the drawback of having a predefined grid by allowing neuron addition and/or removal during training. Experiments using multiple literature datasets show that the proposed method improves training performance of SOM, leads to a better visualization of the input dataset and provides a framework for determining the optimal number and structure of neurons.