Concurrence of form and function in developing networks and its role in synaptic pruning

TL;DR

This paper explores how neural network structure and function co-develop through a feedback mechanism, leading to optimized memory performance and potential insights into synaptic pruning during brain development.

Contribution

It introduces a model combining auto-associative networks with synaptic birth and death, revealing how structure-function interplay influences network behavior and development.

Findings

Heterogeneous, dissasortative networks enhance memory performance

Homogeneous networks fail at pattern retrieval

Model aligns with experimental observations of early brain development

Abstract

A fundamental question in neuroscience is how structure and function of neural systems are related. We study this interplay by combining a familiar auto-associative neural network with an evolving mechanism for the birth and death of synapses. A feedback loop then arises leading to two qualitatively different types of behaviour. In one, the network structure becomes heterogeneous and dissasortative, and the system displays good memory performance; furthermore, the structure is optimised for the particular memory patterns stored during the process. In the other, the structure remains homogeneous and incapable of pattern retrieval. These findings provide an inspiring picture of brain structure and dynamics, are compatible with experimental results on early brain development, and may help to explain synaptic pruning. Other evolving networks -- such as those of protein interaction -- might share the basic ingredients for this feedback loop and other questions, and indeed many of their structural features are as predicted by our model.

Equations

$$P_i^g=u\left(\kappa \right)\pi \left(I_i\right),P_i^l=d\left(\kappa \right)\eta \left(I_i\right),$$

$$u\left(\kappa \right)=\frac{n}{N}\left(1-\frac{\kappa }{2{\kappa }_{\infty }}\right),d\left(\kappa \right)=\frac{n}{N}\frac{\kappa }{2{\kappa }_{\infty }},$$

$$\pi \left(I_i\right)=2\frac{I_i^{\alpha }}{⟨I^{\alpha }⟩N}-\frac{1}{N},\eta \left(I_i,k_i\right)=2\frac{I_i^{\gamma }}{⟨I^{\gamma }⟩N}-\frac{k_i}{\kappa N},$$

$$\begin{array}{rl}\frac{dp(k,t)}{dt}=& u\left(\kappa \right)\tilde{\pi }\left(k-1\right)p\left(k-1,t\right)\\ & +d\left(\kappa \right)\tilde{\eta }\left(k+1\right)p\left(k+1,t\right)\\ & -\left[u\left(\kappa \right)\tilde{\pi }\left(k\right)+d\left(\kappa \right)\tilde{\eta }\left(k\right)\right]p\left(k,t\right),\end{array}$$

Full text

Introduction

The fundamental question in neuroscience of how structural and functional properties of neural networks are related has recently been considered in terms of large-scale connectomes and functional networks obtained with various imaging techniques [1]. But at the lower level of individual neurons and synapses there is still much to learn. The brain can be regarded as a complex network in which nodes represent neurons, and edges stand for synapses. It is then possible to use mathematical models which capture the essence of neural and synaptic activity to study how a great many of such elements can give rise to collective behavior with at least some of the characteristics of cognition [2, 3, 4]. In this context, the structural properties of the underlying network supporting brain dynamics has been found to affect the behavior of the system in various ways [5, 6, 7, 8]. For instance, experimental set-ups have confirmed that actual neural networks exhibit degree heterogeneity that roughly accords with scale-free distributions, and negative degree-degree correlations (dissasortativity), which strongly influence the dynamics of the system [1, 10].

These networks are also not static: new synapses grow and others disappear in response to neural activity [11, 12, 13, 14]. In many species, early brain development seems to be dominated by a remarkable process known as synaptic pruning. The brain starts out with a relatively high density of synapses, which is gradually reduced as the individual matures. In humans, for example, synaptic density at birth is about twice what it will be at puberty, and certain disorders, such as autism and schizophrenia, have been related to details of this process [15, 16, 17, 18, 19]. It has been suggested that such synaptic pruning may represent some kind of optimization, perhaps minimizing energy consumption and/or the genetic information needed to build an efficient and robust network, and/or to optimize network structure [20, 21].

Some progress has been made in understanding how new synapses are grown. It has been shown that presynaptic activity and glutamate could act as trophic factors to guide new synaptic spines growth [22], and other mechanisms of cooperation among neurons have also been proposed, such as spike-timing dependence plasticity [23, 24]. Imaging experiments also reveal that brain architecture is sculpted by spontaneous and sensory-evoked activity, in a process that goes on into adulthood, as synaptic circuits continue to stabilize in the mature brain [22, 25]. Even though synapses are highly dynamic in time, their overall statistics are preserved over time in the adult brain, indicating that synapse creation and pruning balance each other [23].

In this context, models in which networks are gradually formed, for instance by addition of nodes and edges or by rewiring of the latter, have long been studied in different contexts. Typically, the probabilistic addition or deletion of elements is a function of the existing structure. For example, in the familiar Barabási-Albert model, a node’s probability of receiving a new edge is proportional to its degree [26]. These rules often give rise to phase transitions (almost invariably of a continuous nature), such that different kinds of network topology can ensue, depending on parameters [27], and have been used in the past to reproduce some connectivity data on human brain development [28]. More recently, models in which the evolution of network structure is intrinsically coupled with an activity model that runs on the nodes of the network – the so-called co-evolving network models – have gained attention as a way to approximate the evolution of real systems [29, 30, 31]. Previous studies of co-evolving brain networks have studied the temporal evolution of mean degree [32], particular microscopic mechanisms [20], the development of certain computational capabilities [33], or the effects of specific growth rules [34], and have suggested evidence for the role of bistability and discontinuous transitions in the brain, for instance in synaptic plasticity mechanisms involved in learning [35, 36].

Here we define a co-evolving model for brain network development by combining the Amari-Hopfield neural network [2, 3] with a plausible model of network evolution [28], by setting the probabilities of synaptic growth and death to depend on neural activity, as it has been empirically observed [22]. We find that, for certain parameter ranges, the phase transition between memory and randomness becomes discontinuous (i.e. resembling a first order thermodynamic transition). Depending on initial conditions, the system can either evolve towards heterogeneous networks with good memory performance, or homogeneous ones incapable of memory, as a consequence of the a feedback loop between structure and function. To the best of our knowledge, this is the first time that this feedback loop, and the ensuing discontinuous transition, have been identified. Also, in our model networks are generated which have optimal memory performance for the specific memory patterns they encode, thus allowing for a greater memory capacity than would be possible in the absence of such a mechanism. Our results thus suggest a more complete explanation of synaptic pruning. Finally, we discuss the possibility that other biological systems – in particular, protein interaction networks – also owe their topologies to a version of the feedback loop between form and function that we identify here.

Results

Model construction

We define a co-evolving model of synaptic pruning that couples a traditional associative memory model, the Hopfield model [37], with a preferential attachment model for network evolution [28]. Memory is measured via the overlap, $m^{\mu}(t)$, of the network with the $P$ memorized patterns of activity, $\left\{\xi^{\mu}\right\}$, which are stored by an appropriate definition of the synaptic weights $w_{ij}$. In a stationary regime, it undergoes a continuous transition from a phase of memory recovery ($m\rightarrow 1$) to one dominated by noise ($m\approx 0$) as a function of the noise level or temperature $T$.

Network structure dynamics is defined by the probability each node $i$ has to gain or to lose an edge:

[TABLE]

respectively, where $\kappa$ is the mean degree of the network and $I_{i}$ a physiological variable that measures the incoming current at node $i$. A second node $j$ is then randomly chosen to be connected to (or disconnected from) node $i$, so that there are two processes that can lead to an increase (decrease) in node degree, and we shall define the effective local probabilities $\widetilde{\pi}$ and $\widetilde{\eta}$ to account for both of them. We choose these to be power-law distributed, $\widetilde{\pi}\propto I_{i}^{\alpha}$ and $\widetilde{\eta}\propto I_{i}^{\gamma}$, to allow for a smooth transition from a sub-linear to a super-linear dependence with a single parameter. Network structure is characterized by the homogeneity parameter $g(t)$, which equals $1$ if $p(k)=\delta_{k_{0},k}$ and tends to [math] for highly heterogeneous (bimodal) networks. Depending on $\alpha$ and $\gamma$, networks are homogeneous (every node having similar degree, $g\rightarrow 1$) or heterogeneous (with the appearance of hubs, $g\rightarrow 0$). Probabilities $u$ and $d$ are chosen to be consistent with empirical data on synaptic pruning, as we discuss in subsection Synaptic pruning. A full and comprehensive description of the model is detailed in the Methods.

Topological limit

Consider first the topological limit of the model as defined by eq. 4, in which network structure is de-coupled from neural activity. Given the biologically inspired probabilities of eq. 2 and 3, three qualitatively different behaviours, leading in practice to different phases, are possible for $k_{i}\gg 1$ (figure 1a). If $\gamma>\alpha$, then $\widetilde{\eta}(k_{i})>\widetilde{\pi}(k_{i})$, and high degree nodes are more likely to lose than to gain edges, so that $p_{\infty}(k)=p(k,t\rightarrow\infty)$ is homogeneous, $g\rightarrow 1$, and the probability of having high degree nodes vanishes rapidly from a maximum. On the other hand, if $\gamma<\alpha$, then $\widetilde{\eta}(k_{i})<\widetilde{\pi}(k_{i})$, and high degree nodes are more likely to continue to gain than to lose edges. Since the stationary number of edges $N\kappa_{t}$ is fixed, this leads to a bimodal $p_{\infty}(k)$, with $g\rightarrow 0$. Finally, in the case $\gamma=\alpha$, $\widetilde{\eta}(k_{i})=\widetilde{\pi}(k_{i})$ and very connected nodes are as likely to gain as to lose edges. Excluding low degrees, $p_{\infty}(k)$ then decays as a power-law with exponent $\mu\approx 2.5$, in accordance with long-range connections observed in the human brain [8] and measures in protein interaction networks [38]. We have found that this condition is mandatory to obtain critical behaviour, despite previous preliminary studies assuming the contrary [28], as shown in figure 1b.

Synaptic pruning

The time evolution of $\kappa(t)$ is controlled in our model by the global probabilities $u(\kappa)$ and $d(\kappa)$, which can be chosen to model experimental data on synaptic density during brain development [28]. In particular, here we analyze and fit two experimental data-sets (figure 2): the first one (panel a) corresponds to post-morten measures on layers $1$ and $2$ of the human auditory cortex, obtained by directly counting synapses in the tissue [32]; whereas the second set (pannel b) corresponds to an electron microscopy imaging study on the mouse somatosensory cortex [21]. Even though they correspond to different animals and have been obtained through different technique, both data-sets show the same overall behaviour: an extreme initial growth of synapses, followed by a maximum when pruning begins and connectivity starts decreasing, until a plateau is reached. Synaptic density decays roughly exponentially during pruning, and can be fitted by $u(\kappa)$ and $d(\kappa)$ as given by eq. 2, which describe a situation in which synapses are less likely to grow, and more likely to atrophy, when the connectivity is high, and vice-versa, a situation that could easily arise in the presence of a finite quantity of nutrients. These lead to $\kappa(t)=(\kappa_{0}-\kappa_{\infty})\exp\left(-t/\tau_{p}\right)+\kappa_{\infty}$, where $\tau_{p}=N\kappa_{\infty}/(2n)$, so that $\kappa(t)$ decays exponentially from $\kappa_{0}$ to $\kappa_{\infty}$, assuming that $\kappa_{0}>\kappa_{\infty}$ as in the case of interest.

On the other hand, the initial overgrowth of synapses can be related to the transient existence of some growth factors, and it can be accounted for in our model by including a non-linear, time dependent term, $c(t)=a\exp(-t/\tau_{g})$, in the growth probability $u(\kappa)$. The solution is now $\kappa(t)=\kappa_{\infty}\left[1+b\exp(-t/\tau_{g})-a\exp(-t/\tau_{p})\right]$, with $b=a\tau_{g}/(\tau_{g}-\tau_{p})$, $a=1-\kappa_{0}/\kappa_{\infty}+b$, and $\tau_{p}$ as before. With the inclusion of this term, the evolution of $\kappa(t)$ on both data-sets can be fully reproduced.

Therefore, our model can approximate the evolution of the mean density of synapses in the mammal brain during infancy, and with the inclusion of an initial growth factor it also reproduces the fast growth and early maximum of the connectivity. Notice that this framework also goes in line with previous studies that have highlighted the computational benefits of a pruning process in which the pruning rate decreases with time, as in our model, which can optimize both efficiency and robustness when growth takes place locally throughout the network [21]. In our model the decreasing rate is naturally obtained via a simple, physiologically-inspired master equation for $p(k,t)$. Even when an extra growth factor is included, once pruning begins its rate decreases over time, in accordance with [21]. Giving that our goal here is to understand the effect of neuronal physiological activity on network development, in the framework of co-evolving growing models, we shall focus on the simplest version of the model, with linear dependence on $u(\kappa)$ and $d(\kappa)$, to illustrate the effect of coupling structure and physiology. Non-linear global probabilities could also be considered, but would add an extra level of complexity which we will not explore here.

Phase diagram

In the coupled model, where pruning depends on $I_{i}$ (see Methods), computer simulations depict a rich emergent phenomenology depending on stochasticity ($T$) and emerging degree heterogeneity ($\alpha$). The effect of the number of memorized patterns $P$ is analyzed in subsection Capacity analysis, and we discuss the effect of $\gamma$ in Supplementary Figure 7. Other parameters, such as $\kappa_{\infty}$ or $a_{0}$, were found to have only a quantitative effect on the resulting phase diagram, and they are set as in a previous study [28]. Preliminary simulations suggested dependence on the heterogeneity of the initial condition (IC), so we consider two different types of IC, namely, homogeneous, $p\left(k,t=0\right)=\delta(k-\kappa_{0})$, and heterogeneous, $p\left(k,t\right)\propto k^{-2.5}$, networks, with fixed $\kappa_{0}$.

Our coupling dynamics lead to a rich phenomenology, including discontinuous transitions and multistability. Three different phases can be identified by monitoring the order parameters $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu(\alpha,T),\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu(\alpha,T)$ and the Pearson correlation coefficient, $\mkern 1.5mu\overline{\mkern-1.5mur\mkern-1.5mu}\mkern 1.5mu(\alpha,T)$, as illustrated in figure 3 (data for $\mkern 1.5mu\overline{\mkern-1.5mur\mkern-1.5mu}\mkern 1.5mu(\alpha,T)$ is not shown here since it provides similar information as $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu(\alpha,T)$). Analysis of these and similar curves for different parameter values leads to the phase diagram in figure 4. That is, there is a homogeneous memory phase for low $\alpha$ and $T$ which is characterized by high $\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu$, high $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu$ and low (negative, almost zero) $\mkern 1.5mu\overline{\mkern-1.5mur\mkern-1.5mu}\mkern 1.5mu$ (fig. 3a,c for $\alpha=0.5$ and low $T$, and in fig. 3b,d for $T<1.2$ and low $\alpha$). The system is then able to reach and maintain memory, while the topological processes lead to a homogeneous network configuration. Due to the existence of memory, there is a strong correlation between the physiological state of the network, as measured by the currents $I_{i}$, and its topology, as reflected by the degrees $k_{i}$ (see figure 1c).

A continuous increase in $\alpha$ leads through a topological phase transition from homogeneous final networks (with roughly Poisson degree distributions) to heterogeneous ones (with bimodal degree distributions). At the critical point $\alpha=\alpha^{t}_{c}(T)$ the emergent networks are scale-free (i.e. with power-law-like degree distributions). The phase transition is revealed in $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu(\alpha)$ (fig. 3b for $T=0.9,1.0$ and $1.1$) as a fast (and continuous) decay to zero, and it also appears in $\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu(\alpha)$ (fig. 3d) where, after an initial growth with $\alpha$, $\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu$ then decreases at the transition, and finally approaches a constant value for $\alpha>\alpha^{t}_{c}(T)$. This is a consequence of the strong coupling between structure and memory, and it shows that scale-free networks optimize memory recovery for a given set of control parameters. We call this the heterogeneous memory phase, characterized by high $\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu$, very low (almost zero) $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu$ and high negative $\mkern 1.5mu\overline{\mkern-1.5mur\mkern-1.5mu}\mkern 1.5mu$, indicating a memory state with heterogeneous (bimodal) dissasortative structure. Interestingly, this phase expands up to high noise levels as a consequence of network heterogeneity, which increases memory performance [1, 10]. Moreover, memory recovery in turn favors network heterogenization in a feed-back manner due to the microscopic dynamics, enhancing the stability of the state. This is because $I_{i}$ becomes proportional to $k_{i}$ in the memory regime, whereas this correlation is reduced in disordered neural states (see figure 1c).

As $T$ is further increased, dynamics is finally governed by noise, and the stationary network is then homogeneous, resulting in the homogeneous noisy phase, characterized by low (almost zero) $\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu$, high $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu$ and low (almost zero) $\mkern 1.5mu\overline{\mkern-1.5mur\mkern-1.5mu}\mkern 1.5mu$ (fig. 3a,c for $\alpha=0.5$ and $1.0$ and high $T$, and fig. 3b,d for $T>0.9$ and low $\alpha$).

A particularly interesting aspect of this phenomenology is that the nature of the phase transition with $T$ depends on $\alpha$. For low $\alpha$ ($\alpha<\alpha_{c}^{t}(T)$) there is a continuous (second order) transition with increasing $T$ from a homogeneous memory phase to a homogeneous noisy one through $\alpha=\alpha^{m}_{c}(T)$ (fig. 3a,c for $\alpha=0.5$). On the other hand, at higher $\alpha$ ($\alpha>\alpha_{c}^{t}(T)$) the transition from the heterogeneous memory phase to the heterogeneous noisy one is discontinuous (first order), and includes a bi-stability region (striped area in figure 4) in which simulations starting from heterogeneous IC reach the heterogeneous memory state, whereas those starting from homogeneous ones fall into the homogeneous noisy one (fig. 3b,d for $T=1.2$, and fig. 3a,c for $\alpha=1.5$).

The existence of multistability illustrates how memory promotes itself in a heterogeneous network, which is a direct consequence of the coupled dynamics in our model, and it is lost in the topological limit (see Supplementary Figure 8). This is because heterogeneous networks present higher memory recovery than homogeneous ones for high noise levels, particularly for $T>1$ [1, 10]. At the same time, given that in our model growth and death of links depend on the activity of the nodes, the evolution of the structure of the network is driven by its activity state. In this way, an ordered state of the activity of the system - that is, a memory state - is needed in order to allow for the formation of heterogeneous (ordered) structures. Hence, if the network is in a noisy state, edge birth and death is a random process, and thus lead to a homogeneous network configuration, whereas in a memory state there is a direct correlation between $I_{i}$ and $k_{i}$ (fig. 1b) that allows for the emergence of structure – as given by the local probabilities. Correspondingly, the physiological state directly depends on the network structure through the currents $I_{i}$, thus closing a memory-heterogeneity feed-back loop. As a consequence, homogeneous and heterogeneous IC evolve differently, which translates into a multistability region for high $\alpha$ and $T$, and the presence of memory for $T>1$.

Therefore, a main observation here is that the model shows an intriguing relation between memory and topology which induces complex transitions that might be relevant for understanding actual systems. In particular, the inclusion of a topological process allows for memory recovery when $T>1$, whereas the presence of thermal noise shifts the topological transition, which in the topological limit occurs at $\alpha=1$, to $\alpha>1$. These findings can also have implications for network design – for instance, to help memory recovery optimization in noisy environments. It is worth noting also that one does not need to know the specific patterns that induce the synaptic weights in order to have a memory state, so that the definition of memories is not essential – only an ordered state of neural activity. Therefore, our results could be extended to other models of microscopic activity, not necessarily based on a Hebbian learning, or to other systems such as protein interaction networks (see subsection Protein interaction networks), as long as they present a transition between an ordered and a disordered activity state.

Capacity analysis

We have so far considered $P=1$ for the sake of simplicity. However, for neural networks – whether natural or artificial – to be useful, they must generally store many different memory patterns. Something analogous seems also to be true for other complex systems, such as gene regulatory networks, which switch between different configurations. We therefore go on to study the capacity of the network - that is, how its memory capability depends on the number of memorized patterns $P$. For random uncorrelated memory patterns ($a_{0}=0.5$) the performance (as measured by the overlap $\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu$ of the recovered pattern) drops fast with $P$ [39] (see figure 5a). However, there is experimental evidence that the configurations of neural activity related to particular memories in the animal brain involve many more silent neurons, $\xi_{i}=0$, than active ones, $\xi_{i}=1$ [40] (notice that in this case there will be a positive correlation between different patterns); we therefore consider this kind of activity pattern in figure 5b, and find that good memory performance can be maintained at higher $P$ depending on $\alpha$. These curves are combined with analogous ones for $\mkern 1.5mu\overline{\mkern-1.5mug\mkern-1.5mu}\mkern 1.5mu(P,\alpha)$ to define the phase diagram of panel c. This shows that for $\alpha<1$ memory is preserved only for small $P$ and the structural noise (or quenched disorder) introduced by the patterns has a similar effect to that of the thermal noise in figure 4, and a continuous (second order) transition from homogeneous-memory to homogeneous-noisy networks is observed. On the other hand, for $\alpha>1$ the competition between different patterns boosts network heterogeneity, and the capacity of the network increases greatly. There is a transition from a pure memory state to a spin-glass-like state (SG), in which several patterns are partially retrieved at the same time. However, due to the presence of hubs and the correlation among patterns, this corresponds to high overlap ($\mkern 1.5mu\overline{\mkern-1.5mum\mkern-1.5mu}\mkern 1.5mu\approx 1$), instead of a moderate value as one would expect in a typical spin-glass phase [37].

Finally, figure 5d shows the same diagram but for the topological limit of the model, where now the memory phases are much more narrow and SG states correspond to moderate overlap values ($\mkern 1.5mu\overline{\mkern-1.5mum^{\mu}\mkern-1.5mu}\mkern 1.5mu\approx 0.6$), thus indicating a pure SG state. Therefore, the capacity analysis reveals another significant difference between the topological and coupled versions of the model, since the coupled one allows for good memory retrieval even at much larger numbers of patterns ($P>50$) for $\alpha\simeq 1$ – that is, for the limiting case in which the emerging networks are approximately scale-free. It follows that the emerging network topologies in the coupled version do not owe their good memory performance solely to their power-law degree distributions. Rather, the network is tuned for good memory performance on the specific patterns encoded in the edge weights.

Protein interaction networks

Many complex systems can be described as networks which evolve under the influence of node activity, and it is likely that the described structure-function feedback loop plays a role in these settings too. In particular, it could be compatible with experimental and theoretical studies concerning protein interaction networks, which gather different types of metabolic interactions amongst proteins. These can be either inhibitory or excitatory and also have different strengths, as the edges in our model. Moreover, network structure changes on an evolutionary time scale, during the evolution of the species, and these changes combine a random origin, typically due to mutations, with a “force” driven by natural selection, which is likely to be activity dependent [38]. The similarities between this picture and our model suggest a parallelism concerning the resulting network topologies as well.

Measurements on protein interaction networks show power-law distributions of some important topological magnitudes: degree distribution $p(k)\propto k^{-\mu}$, with $\mu\approx 2.5$ [38]; clustering coefficient $C(k)\propto k^{-\theta}$, with $\theta\approx 1$ (metabolic networks) or $2$ (protein interaction networks) [38, 41]; and neighbours mean degree $k_{nn}(k)\propto k^{-\nu}$, with $\nu\approx 0.6$ [42]. We find that these magnitudes are also power-law distributed for networks in our model near the transition $\alpha_{c}^{t}(T)$ (figure 6), with exponents $\mu_{M}=2.55\pm 0.01$, $\theta_{M}=0.98\pm 0.01$ and $\nu_{M}=0.95\pm 0.02$, so there is a good agreement with $\mu$ and $\theta$. Moreover, $k_{nn}(k)$ decays in our model as a power-law for almost every value of the parameters, which is related to the intrinsic topological dynamics of the model, that creates an asymmetry between the nodes that gain and loose edges [42]. We find $\nu\approx 0.5$ for homogeneous networks and $\nu\approx 1.5$ for bimodal ones, whereas scale-free networks lie in between, with $\nu\approx 1.0$. It is likely that this parameter could be better reproduced with further adjustments in the local probabilities, so as to reflect degree-degree correlations among different proteins.

In conclusion, there are definite indications that some of the main topological properties of protein interaction networks could be qualitatively reproduced with simple adjustments or extensions of our model. This suggests a general mechanism underlying the dynamics of different biological systems, which is likely to extend as well to other contexts. Moreover, several studies have recently shown that there are specific patterns in protein interaction networks that can be determined experimentally [50, 51], and which could allow us to identify important biological substructures in the network [52, 53]. This information could be used, together with the model proposed here, to determine the relevance of such patterns and of the complex interplay between the underlying structure of the network and its functional role, as in the present study.

Discussion

It is well known that the brain stores information in synaptic conductances, which mediate neural activity; and that this in turn affects the birth and death of synapses. To explore what this feedback might entail, we have coupled an auto–associative or attractor neural network model with a model for the evolution of the underlying network topology, which has been used to describe synaptic pruning. Neural network models have long provided a means of relating cognitive processes, such as memory, with biophysical dynamics at the cellular level. This coupled model includes the further ingredient of a changing underlying network structure, in such a way that it can be used as a more general and complete study of synaptic pruning. The intention behind our theoretical framework is to identify a minimal set of ingredients which can give rise to observed phenomena. Specif details of a given system could be added to the model, such as more realistic neuron and synaptic dynamics.

Taken separately, each of the two models involved exhibit continuous phase transitions: between a phase of memory and one of noise in the neural network, and between homogeneous and heterogeneous network topologies in the pruning model. Our coupled model continues to display both of these transitions for certain parameter regimes, but a new discontinuous transition emerges, giving rise to a region of coexistence of phases (also known as hysteresis). In other words, situations with the same parameters but slightly different initial conditions can lead to markedly different outcomes. In this case, whether the attractor neural network is initially capable of memory retrieval influences the emerging network structure, which feeds back into memory performance. There is therefore a crucial feedback loop between structure and function, which determines the capabilities of the eventual system which the process yields. Our picture thus addresses how neural activity can impact on early brain development, and relates specific dynamic processes in the brain to well-defined mathematical properties, such as bistability and critical-like regions, or the emergence of a feedback loop.

The models we have coupled in this work are the simplest ones able to reproduce the behavior of interest - namely, associative memory and network topologies with realistic features. However, there are no indications to believe that this feedback will disappear when using more complex models, including the consideration of asymmetric networks, or more realistic choices of the synaptic weights. Hebbian synapses have been considered here as a standard way to define memory attractors, and therefore a useful tool to understand the effect of heterogeneity, and its coupling with memory, on network dynamics. More realistic scenarios could include time dependent synapses, considering for instance learning [43] or fast noise [44], which would indubitably add more complexity to the model. Similarly, particular definitions of the memories could boost the capacity of the network, and even create topologically induced oscillations.

On the other hand, neural systems may not be the only ones to display the properties we found to be sufficient for the existence of this feedback loop between structure and function. Networks of proteins, metabolites or genes also adopt specific configurations (often associated to attractors of some dynamics), and the existence of interactions between nodes might depend on their activity. One may expect that the interplay between form and function we have described in this work could play a role in many natural, complex systems. We have shown some evidence that protein networks seem to have topological features which emerge naturally from the coupled models we have considered here.

Finally, an unresolved question in neuroscience is why brain development proceeds via a severe synaptic pruning – that is, with an initial overgrowth of sypapses, followed by the subsequent atrophy of approximately half of them throughout infancy. Fewer synapses require less metabolic energy, but why not begin with the optimal synaptic density? Navlakha and co-authors have shown that network properties such as efficiency and robustness can be optimised by a pruning rule which favours short paths [21]. However, in order for synapses to “know” whether they belong to short paths, some kind of back-propagating signal must be postulated. Our coupled model provides a simple demonstration of how network structure can be optimised by pruning, as in Navlakha’s model, with a rule that only depends on local information at each synapse – namely, the intensity of electrical current. Moreover, this rule is consistent with empirical results on synaptic growth and death [11, 12, 13, 14]. In this view, a neural network would begin life as a more or less random structure with a sufficiently high synaptic density that it is capable of memory performance. This is in keeping with the description given by neuroscientists such as Kolb and Gibb, who say of the initial $10^{14}$ synapses in the human brain: “This enormous number could not possibly be determined by a genetic program, but rather only the general outlines of neural connections in the brain will be genetically predetermined” [54]. Throughout infancy, certain memory patterns are stored, and pruning gradually eliminates synapses experiencing less electrical activity. Eventually, a network architecture emerges which has lower mean synaptic density but is still capable, by virtue of a more optimal structure, of retrieving memories. Moreover, the network structure will be optimised for the specific patterns it stored and, when the emerging networks are scale free, it becomes possible to store orders of magnitude more memory patterns via this mechanism as compared to the networks generated with the uncoupled (topological) version of the model. This seems consistent with the fact that young children can acquire memory patterns (such as languages or artistic skills) which remain with them indefinitely, yet as adults they struggle to learn new ones [54, 55].

Methods

The neural network model

Consider an undirected network with $N$ nodes, and edges which can change in discrete time. At time $t$, the adjacency matrix is $\{e_{ij}(t)\}$, for $i,j=1,\ldots,N$, with elements $1$ or [math] according to whether there exists or not an edge between the pair of nodes $(i,j)$, respectively. The degree of node $i$ at time $t$ is $k_{i}(t)=\sum_{j}^{N}e_{ij}(t)$, and the mean degree of the network is $\kappa(t)=N^{-1}\sum_{i}^{N}k_{i}(t)$.

Each node represents a neuron, and each edge a synapse. We shall follow the Amari-Hopfield model, according to which each neuron has two possible states at each time $t$, either firing or silent, given by $s_{i}(t)=\{0,1\}$ [37]. Each edge $(i,j)$ is characterized by its synaptic weight $w_{ij}$, and the local field at neuron $i$ is $h_{i}(t)=\sum_{j=1}^{N}w_{ij}e_{ij}(t)s_{j}(t).$ The states of all neurons are updated in parallel at every time step according to the transition probability $P\left\{s_{i}(t+1)=1\right\}=\frac{1}{2}\left[1+\tanh\left(\beta\left[h_{i}(t)-\theta_{i}(t)\right]\right)\right],$ where $\theta_{i}(t)=\frac{1}{2}\sum_{j=1}^{N}w_{ij}e_{ij}(t)$ is a neuron’s threshold for firing, and $\beta=T^{-1}$ is a noise parameter controlling stochasticity (analogous to the inverse temperature in statistical physics) [45]. The synaptic weights can be used to encode information in the form of a set of $P$ patterns $\left\{\xi_{i}^{\mu};\ \mu=1,\ldots,P\right\}$, with mean $a_{0}=\left\langle\xi^{\mu}\right\rangle$, specific configurations of neural states which can be regarded as memories via the Hebbian learning rule, $w_{ij}=\left[\kappa_{\infty}a_{0}(1-a_{0})\right]^{-1}\sum_{\mu=1}^{P}(\xi_{i}^{\mu}-a_{0})(\xi_{j}^{\mu}-a_{0}),$ where $\kappa_{0}=\kappa(t=0)$. The order parameter of the model is the overlap of the state of the neurons with each of the memorized patterns of activity, $m^{\mu}=\left(Na(1-a)\right)^{-1}\sum_{j=1}^{N}(\xi_{i}^{\mu}-a_{0})s_{i}(t)$. The canonical Amari-Hopfield model, which is here a reference, is defined on a fully connected network ($e_{ij}=1,\ \forall i\!=j$), and it exhibits a continuous phase transition at the critical value $T=1$ [37].

Notice that, even tough synapses are generally assymetic, we have defined an undirected, symmetric network, in the spirit of previous studies on synaptic pruning [21]. Earlier studies suggest that the inclusion of asymmetry could lead to the induction of chaos, affecting learning, for instance causing the system to oscillate among different states [46]. Here we have decided to simplify the picture and consider symmetric networks, and we expect that, given a reasonable definition of asymmetry, the main results of our work would hold.

The pruning model

Edge dynamics are modelled as follows. At each time $t$, each node has a probability $P_{i}^{g}(t)$ of being assigned a new edge to another node, randomly chosen. Likewise, each node has a probability $P_{i}^{l}(t)$ of losing one of its edges. These probabilities are given by $P_{i}^{g}=u\left(\kappa\right)\pi\left(I_{i}\right)$ and $P_{i}^{l}=d\left(\kappa\right)\eta\left(I_{i}\right),$ where we have dropped the time dependence of all variables for clarity, and $I_{i}$ is a physiological variable that characterizes the local dependence of the probabilities: $I_{i}=|h_{i}-\theta_{i}|$. The first terms on the right-hand side of each equation represent a global dependence to account for the fact that such processes rely in some way on diffusion of different molecules through large areas of tissue, and we take the mean degree $\kappa$ at each time as a proxy. In order to describe synaptic pruning, we choose these probabilities to be consistent with empirical data describing synaptic density in mammals during infancy. The simplest choice is [28, 32]

[TABLE]

where $n$ is the number of edges to be added or removed at each step, which sets the speed of the process, and $\kappa_{\infty}=\kappa(t\rightarrow\infty)$ is the stationary mean degree. It should also be noticed that experimental studies [32] have revealed a fast initial overgrowth of synapses associated with the transient existence of different growth factors. This and other particular mechanisms could be accounted for by adding extra factors in eqs. (2). For example, initial overgrowth has been reproduced by adding the term $a\exp(-t/\tau_{g})$ in the growth probability [28].

The second terms of the right hand of eqs. (1) were previously considered [28] to be functions of $k_{i}$. This was meant as a proxy for the empirical observations that synaptic growth and death are determined by neural activity [11, 12, 13, 14]. We now make this dependence explicit, and couple the evolving network with the neural dynamics by considering a dependence on the local current at each neuron, $I_{i}=|h_{i}-\theta_{i}|$, as stated before.

Monte Carlo simulations

The initial conditions for the neural states are random. For the network topology we can draw an initial degree sequence from some distribution $p(k,t=0)$, and then place edges between nodes $i$ and $j$ with a probability proportional to $k_{i}(0)k_{j}(0)$, as in the configuration model. Time evolution is then accomplished in practice via computer simulations as follows. First, the number of links to be created and destroyed is chosen according to two Poisson distributions with means $Nu\left(\kappa\right)$ and $Nd\left(\kappa\right)$, respectively. Then, as many times as needed according to this draw, we choose a node $i$ with probability $\pi\left(I_{i}\right)$ to be assigned a new edge, to another node randomly chosen; and similarly we choose a new node $j$ according to $\eta\left(I_{j}\right)$ to lose an edge from one of its neighbors, randomly chosen. This procedure uses the BKL algorithm to assure proper evolution towards stationarity [45]. This way, each node can then gain (or lose) an edge via two paths: either through the process with probability $\pi\left(I_{i}\right)$ for a gain (or $\eta\left(I_{i}\right)$ for a loss), or when it is randomly connected to (or disconnected from) an already chosen node. Therefore, the effective values of the second factors in eq. 1 are $\widetilde{\pi}=1/2\left(\pi\left(I_{i}\right)+1/N\right)$ and $\widetilde{\eta}=1/2\left(\eta\left(I_{i}\right)+k_{i}/(\kappa N)\right)$, where the $1/2$ factor is included to assure normalization.

For the sake of simplicity, we shall consider $\widetilde{\pi}$ and $\widetilde{\eta}$ to be power-law distributed [28], which allows one to move smoothly from a sub-linear to a super-linear dependence with a single parameter, $\widetilde{\pi}=I_{i}^{\alpha}/(\left\langle I^{\alpha}\right\rangle N)$ and $\widetilde{\eta}=I_{i}^{\gamma}/(\left\langle I^{\gamma}\right\rangle N)$. This leads to:

[TABLE]

where normalization of $\pi$, $\eta$, $\widetilde{\pi}$ and $\widetilde{\eta}$ has been imposed. Notice that by construction the death probability not only depends on $I_{i}$, but also on the degree $k_{i}$. Given that, in the memory regime of the Hopfield model, $I_{i}\propto k_{i}$, as shown in the Results section, here we consider the approximation $\eta\rightarrow\eta(I_{i})$. Notice also that with this definition the local probabilities could become negative, so we define $\pi(I_{i})\rightarrow\max(\pi(I_{i}),0)$ and $\eta(I_{i})\rightarrow\max(\eta(I_{i}),0)$. These definitions are most important, as they characterize the coupling between neural activity and structure. However, the particular functions are an arbitrary choice and other ones could be considered. In our scenario, the parameters $\alpha$ and $\gamma$ characterize the dependence of the local probabilities on the local currents and account for the different proteins and factors that control synaptic growth. These could be obtained experimentally, although to the best of our knowledge this has not yet been done.

The time scale for structure changes is set by the parameter $n$ in eq. 2, whereas the time unit for activity changes, $h_{s}$, is the number of Monte Carlo Steps (MCS) that the states of all neurons are updated according to the Hopfield dynamics between each structural network update. Our studies show a low dependence on these parameters in the cases of interest, so we only report results here for $h_{s}=10$ MCS and $n=10$.

The macroscopic state

The macroscopic state is characterized by the overlap, as defined before, and by the mean neural activity, $M(t)=N^{-1}\sum_{i=1}^{N}s_{i}(t)$. Results in the main section are for $P=1$, so we simplify the notation and use $m=m^{1}$. A discussion on the effect of learning more patterns is included in subsection Capacity analysis. Also of interest is the degree distribution at each time, $p\left(k,t\right)$, whose homogeneity may be measured via $g(t)=\exp\left({-\sigma^{2}(t)/\kappa^{2}(t)}\right)$, where $\sigma^{2}(t)$ is the variance of the distribution and $\kappa$ its mean, as defined before. $g(t)=1$ for highly homogeneous networks, $p\left(k\right)=\delta\left(k-\kappa\right)$, and tends to zero for highly heterogeneous ones. Network structure is also characterized by the clustering coefficient for each node, $C_{i}$, is defined as $C_{i}=\left(2t_{i}\right)/\left(k_{i}(k_{i}-1)\right)$, where $t_{i}$ is the number of triangles incident to node $i$, that is, $t_{i}=1/2\sum_{j,h}a_{ij}a_{ih}a_{jh}$. We also monitored the Pearson correlation coefficient applied to the edges, $r=\left([k_{l}k_{l}^{\prime}]-[k_{l}]^{2}\right)/\left([k_{l}^{2}]-[k_{l}]^{2}\right)$, where $[\cdot]=\frac{1}{<k>N}\sum_{l}(\cdot)$ stands for the average over edges [47], and the time dependence has been dropped for clarity. In this context it can be estimated as $r=\left\langle k\right\rangle\left\langle k^{2}k_{nn}\left(k\right)-\left\langle k^{2}\right\rangle^{2}\right\rangle/\left(\left\langle k\right\rangle\left\langle k^{3}\right\rangle-\left\langle k^{2}\right\rangle^{2}\right),$ where $k_{nn}\left(k\right)$ is the mean nearest-neighbor-degree function: $k_{nn,i}=k_{i}^{-1}\sum_{j}a_{ij}k_{j}$ [28]. This characterizes the degree-degree correlations, which have important implications for network connectedness and robustness. That is, whereas most social networks are assortative ($r>0$), almost all other networks, whether biological, technological or information-related, seem to be generically dissasortative ($r<0$), meaning that high degree nodes tend to have low degree neighbors, and vice-versa. Previous studies showed that heterogeneous networks favor the emergence of dissasortative correlations [47, 48, 49]. Measures of the global variables on the stationary state are obtained by averaging during a long window of time: $\mkern 1.5mu\overline{\mkern-1.5muf\mkern-1.5mu}\mkern 1.5mu=\Delta t^{-1}\sum_{t=t_{0}}^{t_{0}+\Delta t}f(t)$.

Topological limit

In the topological limit of the model the topology of the network is independent from its neural state, and one substitutes $I_{i}\rightarrow k_{i}$, so that $\widetilde{\eta}_{i}=\widetilde{\eta}\left(k_{i}\right)$ and $\widetilde{\pi}_{i}=\widetilde{\pi}\left(k_{i}\right)$. In this way we can construct a master equation for the evolution of the degree distribution by considering network evolution as a one step process with transition rates $u(\kappa)\widetilde{\pi}(k)$ for degree increment and $d(\kappa)\widetilde{\sigma}(k)$ for the decrement. Approximating the temporal derivative for the expected value of the difference in a given $p(k,t)$ at each time step we get:

[TABLE]

which is exact in the limit of no degree-degree correlations between nodes.

Finally, results of the manuscript are for $\gamma=1$ since, in this topological limit, it corresponds to choosing links at random for removal, given that the probability of choosing an edge $(i,j)$ is then $p_{ij}=\frac{1}{k_{i}}\widetilde{\eta}\left(k_{i}\right)+\frac{1}{k_{j}}\widetilde{\eta}\left(k_{j}\right)=\frac{1}{\left\langle k\right\rangle N}$. This can be seen as a first order approximation to the pruning dynamics, and it also induces powerful simplifications during computations. Furthermore, the relevant parameter determining the behavior of the system is the ratio between $\alpha$ and $\gamma$, whereas their absolute values only affect quantitatively (see Supplementary Figure 7).

Statistics and general methods

In this work, we used systems sizes $N=800$, $1600$ and $3200$, as indicated in each section. Results for $N<800$ presented strong finite size effects, so they were discarded (data not shown). The sample size for each result was chosen by convergence of the mean value.

Code availability

Generated codes are available from the corresponding author upon reasonable request.

Data availability

All data that support this study are available from the corresponding author upon reasonable request.

Acknowledgements

We are grateful for financial support from Spanish MINECO (project of Excellence: FIS2017-84256-P) and from “Obra Social La Caixa”.

Author contributions

A.P.M., J.J.T, J.M. and S.J. designed the analyses, discussed the results and wrote the manuscript. A.P.M. also wrote the codes and performed the simulations.

Conflict of interest

The authors declare no competing interests.

Supplementary Information for "Concurrence of form and function in developing networks and its role in synaptic pruning"