Efficient Coding Predicts Synaptic Conductance
James V Stone

TL;DR
This paper demonstrates that synapses operate at an optimal signal-to-noise ratio to maximize information efficiency, aligning with biophysical principles and observed conductance data.
Contribution
It introduces a parameter-free model based on Shannon's information theory that predicts synaptic efficiency decline with conductance deviations.
Findings
Synaptic efficiency peaks at a specific signal-to-noise ratio.
The model accurately predicts efficiency decreases across conductance ranges.
Synapses operate near an energy-efficient information transmission limit.
Abstract
Synapses are information efficient in the sense that their natural conductance values convey as many bits per Joule as possible, but efficiency falls rapidly if the conductance is forced to deviate from its natural value (Harris et al, 2015. However, the exact manner in which efficiency falls as conductance deviates from its natural value remains unexplained. Recently, Malkin et al (2026) showed that synaptic noise is minimised given the available energy, consistent with a minimal energy boundary. This minimal energy boundary is a necessary, but not sufficient, condition for maximising information efficiency. By expressing the minimal energy boundary in terms of Shannon's information theory (Shannon, 1949), we show that synapses operate at signal-to-noise ratios which maximise information efficiency, and that this accurately predicts the decrease in efficiency values observed in Harris…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Memory and Neural Computing · Neural dynamics and brain function · Neural Networks and Reservoir Computing
