Neuro-Vesicles: Neuromodulation Should Be a Dynamical System, Not a Tensor Decoration

TL;DR

Neuro-Vesicles introduces a novel neuromodulation framework where mobile, discrete vesicles dynamically interact with neural networks, enabling more flexible and structured modulation compared to traditional tensor-based methods.

Contribution

The paper presents a comprehensive mathematical framework for vesicle-based neuromodulation, including emission, migration, docking, and learning, extending to spiking networks and neuromorphic hardware.

Findings

Vesicle dynamics can approximate tensor mechanisms like FiLM and attention.

Sparse vesicles act as mobile agents influencing network behavior at critical moments.

The framework supports differentiable reaction diffusion dynamics and reinforcement learning integration.

Abstract

We introduce Neuro-Vesicles, a framework that augments conventional neural networks with a missing computational layer: a dynamical population of mobile, discrete vesicles that live alongside the network rather than inside its tensors. Each vesicle is a self contained object v = (c, kappa, l, tau, s) carrying a vector payload, type label, location on the graph G = (V, E), remaining lifetime, and optional internal state. Vesicles are emitted in response to activity, errors, or meta signals; migrate along learned transition kernels; probabilistically dock at nodes; locally modify activations, parameters, learning rules, or external memory through content dependent release operators; and finally decay or are absorbed. This event based interaction layer reshapes neuromodulation. Instead of applying the same conditioning tensors on every forward pass, modulation emerges from the stochastic evolution of a vesicle population that can accumulate, disperse, trigger cascades, carve transient pathways, and write structured traces into topological memory. Dense, short lived vesicles approximate familiar tensor mechanisms such as FiLM, hypernetworks, or attention. Sparse, long lived vesicles resemble a small set of mobile agents that intervene only at rare but decisive moments. We give a complete mathematical specification of the framework, including emission, migration, docking, release, decay, and their coupling to learning; a continuous density relaxation that yields differentiable reaction diffusion dynamics on the graph; and a reinforcement learning view where vesicle control is treated as a policy optimized for downstream performance. We also outline how the same formalism extends to spiking networks and neuromorphic hardware such as the Darwin3 chip, enabling programmable neuromodulation on large scale brain inspired computers.