Magnification Laws of Winner-Relaxing and Winner-Enhancing Kohonen Feature Maps
Jens Christian Claussen (University Kiel)

TL;DR
This paper explores modifications to the Kohonen Self-Organizing Map that achieve maximal mutual information mapping, providing insights into neural optimization principles through magnification laws.
Contribution
It introduces a winner-enhancing modification that results in an infomax map with a magnification exponent of one, advancing understanding of neural map optimization.
Findings
Winner-enhancing updates produce infomax maps.
Magnification exponent of one achieved.
Magnification law is experimentally accessible.
Abstract
Self-Organizing Maps are models for unsupervised representation formation of cortical receptor fields by stimuli-driven self-organization in laterally coupled winner-take-all feedforward structures. This paper discusses modifications of the original Kohonen model that were motivated by a potential function, in their ability to set up a neural mapping of maximal mutual information. Enhancing the winner update, instead of relaxing it, results in an algorithm that generates an infomax map corresponding to magnification exponent of one. Despite there may be more than one algorithm showing the same magnification exponent, the magnification law is an experimentally accessible quantity and therefore suitable for quantitative description of neural optimization principles.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural dynamics and brain function · Neural Networks and Applications · Neural Networks and Reservoir Computing
