Energy-information trade-off makes the cortical critical power law the optimal coding
Tsuyoshi Tatsukawa, Jun-nosuke Teramae

TL;DR
This paper demonstrates that the cortical neurons' critical power law response is an optimal neural coding strategy driven by energy-information trade-offs, even on non-differentiable fractal manifolds, challenging previous assumptions about neural criticality.
Contribution
It provides a theoretical proof that the critical power law in neural responses is optimal for coding, due to energy and information trade-offs, regardless of manifold differentiability.
Findings
Critical power law response is optimal for neural coding.
Neural coding remains reliable on non-differentiable fractal manifolds.
Energy-information trade-offs underpin the criticality in neural responses.
Abstract
Stimulus responses of cortical neurons exhibit the critical power law, where the covariance eigenspectrum follows the power law with the exponent just at the edge of differentiability of the neural manifold. This criticality is conjectured to balance the expressivity and robustness of neural codes, because a non-differential fractal manifold spoils coding reliability. However, contrary to the conjecture, here we prove that the neural coding is not degraded even on the non-differentiable fractal manifold, where the coding is extremely sensitive to perturbations. Rather, we show that the trade-off between energetic cost and information always makes this critical power-law response the optimal neural coding. Direct construction of a maximum likelihood decoder of the power-law coding validates the theoretical prediction. By revealing the non-trivial nature of high-dimensional coding, the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural dynamics and brain function · Advanced Memory and Neural Computing
