Adaptive rewiring of random neural networks generates convergent-divergent units
Ilias Rentzeperis, Steeve Laquitaine, Cees van Leeuwen

TL;DR
This paper demonstrates that adaptive rewiring in directed neural network models, based on advection and consensus algorithms, leads to the spontaneous emergence of convergent-divergent units that resemble brain connectivity structures.
Contribution
It introduces a biologically plausible adaptive rewiring model combining advection and consensus algorithms to explain the emergence of complex directed connectivity structures.
Findings
Adaptive rewiring shortens path length and improves connectivity.
Convergent-divergent units emerge with balanced advection and consensus.
These units resemble core brain connectivity patterns.
Abstract
Brain networks are adaptively rewired continually, adjusting their topology to bring about functionality and efficiency in sensory, motor and cognitive tasks. In model neural network architectures, adaptive rewiring generates complex, brain-like topologies. Present models, however, cannot account for the emergence of complex directed connectivity structures. We tested a biologically plausible model of adaptive rewiring in directed networks, based on two algorithms widely used in distributed computing: advection and consensus. When both are used in combination as rewiring criteria, adaptive rewiring shortens path length and enhances connectivity. When keeping a balance between advection and consensus, adaptive rewiring produces convergent-divergent units consisting of convergent hub nodes, which collect inputs from pools of sparsely connected, or local, nodes and project them via densely…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
