Topological dimension tunes activity patterns in hierarchical modular network models
Ali Safari, Paolo Moretti, Miguel A. Mu\~noz

TL;DR
This paper investigates how the topological dimension of hierarchical modular networks influences neural activity patterns and the critical spreading threshold, combining analytical and numerical methods to deepen understanding of brain-like network dynamics.
Contribution
It introduces the network topological dimension as a key structural parameter controlling epidemic thresholds in hierarchical modular networks, advancing the analysis of activity spreading.
Findings
Topological dimension predicts epidemic threshold in HMNs.
Analytical and computational methods reveal threshold dependence on network structure.
Spectral methods have limitations in predicting spreading in HMNs.
Abstract
Connectivity patterns of relevance in neuroscience and systems biology can be encoded in hierarchical modular networks (HMNs). Moreover, recent studies highlight the role of hierarchical modular organization in shaping brain activity patterns, providing an excellent substrate to promote both the segregation and integration of neural information. Here we propose an extensive numerical analysis of the critical spreading rate (or "epidemic" threshold) --separating a phase with endemic persistent activity from one in which activity ceases-- on diverse HMNs. By employing analytical and computational techniques we determine the nature of such a threshold and scrutinize how it depends on general structural features of the underlying HMN. We critically discuss the extent to which current graph-spectral methods can be applied to predict the onset of spreading in HMNs, and we propose the network…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Topological dimension tunes activity patterns in hierarchical modular network models
Ali Safari
Paolo Moretti
Institute for Materials Simulation, Friedrich-Alexander-Universität Erlangen-Nürnberg, Dr.-Mack-Str. 77 90762 Fürth, Germany
Miguel A. Muñoz
Departamento de Electromagnetismo y Física de la Materia e Instituto Carlos I de Física Teórica y Computacional, Universidad de Granada, Granada E-18071, Spain
Abstract
Connectivity patterns of relevance in neuroscience and systems biology can be encoded in hierarchical modular networks (HMNs). Moreover, recent studies highlight the role of hierarchical modular organization in shaping brain activity patterns, providing an excellent substrate to promote both the segregation and integration of neural information. Here we propose an extensive numerical analysis of the critical spreading rate (or “epidemic” threshold) –separating a phase with endemic persistent activity from one in which activity ceases– on diverse HMNs. By employing analytical and computational techniques we determine the nature of such a threshold and scrutinize how it depends on general structural features of the underlying HMN. We critically discuss the extent to which current graph-spectral methods can be applied to predict the onset of spreading in HMNs, and we propose the network topological dimension as a relevant and unifying structural parameter, controlling the epidemic threshold.
I Introduction
A surprising variety of biosystems display hierarchical modular architectures, an incomplete list of which includes the human brain structural network, or connectome Sporns2005 ; Hagmann2008 , metabolic and regulatory networks Jeong2000 ; Ravasz2002 and fiber networks in connective tissue Gautieri2011 . All such examples point to a common conjecture: hierarchical modular organization is capable of steering function and activity into localized patterns that provide an excellent tradeoff between segregation of functions (located at diverse moduli) and their integration across very diverse scales, constituting an elegant solution of the so-called segregation-integration dilemma Tononi1994 ; Arenas2006 ; Zhou2006 ; MuellerLinow2008 ; Bullmore2012 ; Sporns2013segreinte ; Diez2015 . Further examples of such remarkable dynamic signatures in fields beyond the biological realm have been recently pointed out for parallel processing Sollich2014 , information retrieval Agliari2015_PRL , as well as random and quantum walks Agliari2016 .
From the perspective of modeling techniques, hierarchical modular organization is often encoded in simple mathematical models of synthetic hierarchical modular networks (HMNs) Kaiser2007 . Song et al. first noted that in HMNs the mutual distance between highly connected hubs is higher than in scale-free (SF) networks Song2006 . As a consequence, hubs and their neighborhoods are not easily exposed to functional overloads; even if load increases in some location, it mostly remains localized in a subnetwork and does not greatly affect activity at other hubs. Song et al. Song2006 proposed that the hierarchical (or fractal) organization of functional modules (e.g. metabolic networks) is an evolutionary constraint imposed by the need for network robustness. The concept of increased distances and path lengths in HMNs –as opposed to standard scale-free and small-world models– was later formalized through the observation that HMNs are endowed with a finite topological dimension, , by Gallos et al. Gallos2012 . Let us recall that quantifies how the number of nodes in the local neighborhood of an arbitrary node grows with the distance, from it, ): lower values of amount to higher distances between network hotspots, while, formally, networks with the small-world property have .
The use of simple dynamical models have proven effective as a probing tool to understand the propagation of information or “activity” in biological networks. For instance, paramount features of brain activity have been first highlighted borrowing models from quantitative epidemiology Kaiser2007 ; Moretti2013 ; in the context of activity spreading in cortical networks or connectomes –which are well represented by HMN architectures– it has been recently shown that simple “epidemic” processes of activity propagation such as susceptible-infected-susceptible (SIS) model are very convenient Haimovici ; Moretti2013 . In SIS dynamics, nodes can be either active (infected I) or inactive (susceptible S); in terms of neural dynamics an active node corresponds to an active region in the brain, which can activate an inactive neighboring region with a given probability per unit time , and which are deactivated at rate (which we set to without loss of generality) due to exhaustion of synaptic resources. In the standard critical point scenario, the steady-state average fraction of active nodes (or prevalence) is zero for low and non-zero for high , these two regimes being separated by a critical value , at which scale invariant dynamic patterns are recorded. In HMNs instead, there is a whole range of values where scale-invariance is observed, i.e. a Griffiths phase Moretti2013 ; Villa2015 . The origin of such generic (i.e. occurring in an extended region in parameter space) scale-invariant behavior is believed to be mostly structural: hierarchical modular organization promotes the emergence of rare regions where activity tends to remain localized for large times even if finally it becomes extinct owing to fluctuations.
This is just an example of a general mechanism by which structural disorder can induce Griffiths phases, with generic critical-like scale-invariant features in complex networks Vojta2006 ; Munoz2010 . The structural origin of critical-like behavior is in agreement with renormalization arguments, which show how in hierarchical networks even standard percolation produces generic power-law distributions of connected component sizes, a feature otherwise normally ascribed to the critical point (or percolation threshold) Boettcher2009 ; Friedman2013 .
Here, we propose the numerical study of the onset of spreading –the epidemic threshold– for the SIS in synthetic HMNs, and its relationship –employing spectral graph analyses– with structural parameters controlling the HMN architecture. We will highlight the topological dimension, , as the relevant feature that can tune and control the value of the epidemic threshold .
II Hierarchical modular networks (HMNs)
We recall the general definition of a HMN, as a network in which smaller, more densely connected modules are clustered into larger and less densely connected super-modules, in an iterative fashion that spans several scales, or hierarchical levels. Diverse algorithms to generate synthetic HMNs have been proposed in the literature Kaiser2007 ; Wang2011 ; Moretti2013 ; Odor2015 . Here, we consider the model proposed in Moretti2013 motivated by previous works on optimal HMN architectures Kaiser2010 . Networks of this type will be undirected and unweighted, although generalizations to the weighted and directed cases can be introduced straightforwardly.
A schematic description of this method is shown in Fig. 1. We call the connectivity strength of a HMN, as it will appear as a chief parameter controlling the emerging topology. The network is organized in densely connected modules of size , which represent the level [math] of a hierarchy of links. At each hierarchical level , super-modules of size are formed, joining sub-modules of size by wiring their respective nodes with probability : the average number of links between two modules at level will thus be , i.e. proportional to , regardless of the value of .
It was shown that this construction method ensures the scalability of the network structure, so that the average degree and the topological dimension reach asymptotic values for large Moretti2013 . In the limit, the effect of lowest-level modules becomes negligible (relegated to transient time scales) and the time asymptotics are dominated by the hierarchical organization: in this regime becomes the only relevant construction parameter. We remark that, being the number of links between any two modules of size , the maximum value of is given by , so that can take values in the interval . Fig. 2 shows numerical measurements of the topological dimension , which is found to increase linearly with , in the limit of large system sizes . While this result is only approximate for smaller values of , where higher dimensions are complex to measure due to the size constraint, the linear behavior seems to take over for sizes around and above. This finding helps contextualize previous results, which pointed to a quasi-linear growth of with Moretti2013 . While that result was initially dismissed as a possible effect of a too-limited window and a non-exhaustive size-scaling analysis, our current results, extending up to , seem to robustly confirm the conjecture of a dependence. While we have not been able to prove this result analytically so far, we will show in the rest of the paper its remarkable implications for activity spreading.
III Spectral analysis of HMNs
The study of the epidemic threshold often relies on spectral arguments. In the case of SIS dynamics, network spectra refer to the adjacency matrix , whose generic element is if nodes and are linked, and [math] otherwise. In particular, if one considers undirected networks as we do here, is symmetric and thus diagonalizable. In most cases one is interested in the higher spectral edge of , including the largest eigenvalues , where the uniqueness of the largest is ensured by the Perron-Frobenius theorem whenever the network is connected. Provided that the spectral gap is large, one can prove that , within the framework of the quenched mean-field (QMF) approximation, as we recall in the following.
The activity state for a SIS dynamic process is given by the column vector , whose generic element is the probability that node is in the active state at a generic time , and its steady state limit , obtained for . Our starting point is the well-known exact result for the time evolution: , which originates from the full SIS problem by neglecting (negative) quadratic terms as well as dynamic correlation contributions PastorSatorras2015 . In the limit (when the time derivative of vanishes), using the eigendecomposition , where is the eigenvector, we obtain
[TABLE]
which expresses the steady state of a SIS process of spreading rate in terms of its projections on the eigenspaces of , with the scalar product . The prevalence or steady-state density of active nodes is then defined as . If , the sum is dominated by the leading term, the scalar product is approximately equal to unity, and a non-trivial steady state may exist only if . In particular, the QMF result is recovered when the equal sign is taken in Eq. (1).
The generality of this result in SF networks has been the focus of a recent debate Goltsev2012 ; Lee2013 ; Boguna2013 . A crucial aspect here is introduced by the localization property. An eigenvector of is called localized if it has all vanishing components, except for a small subset of them. A measure of eigenvector localization is provided by the inverse participation ratio of eigenvector Farkas2001 ; Goltsev2012 ; PastorSatorras2016 . It was initially proposed Goltsev2012 ; Lee2013 that in networks displaying a localized the epidemic threshold should be replaced by an interval of the spreading rate , in which active states are short-lived, ideally a Griffiths phase Lee2013 , as unique unstable but localized modes do not suffice to create a global state of endemic network activity. While this view has been more recently challenged in the case of SF networks Boguna2013 , we mentioned above that HMNs are now well-known to exhibit such a Griffiths phase, whose upper bound is given by the actual critical point Moretti2013 . Such epidemic threshold does not comply with the QMF prediction, leading to Moretti2013 . It was argued Moretti2013 that this result is related to the fact that in HMNs: (i) spectral gaps are small; and (ii) localization extends to all eigenvectors in the higher spectral edge of , that is, it is not limited to the principal eigenvector . We show here the extent to which the basic assumptions of QMF are altered in HMNs, thus making the estimate of a formidable task.
The existence of a large spectral gap is equivalent to saying that the steady state is approximately given by the principal eigenvector : as argued above, the sum in Eq. (1) would be dominated by the term and, taking the equal sign (QMF approximation), would be simply given by . Such a strong statement works remarkably well in networks with strong small world properties Farkas2001 or entangled connectivity patterns Donetti2005 ; Donetti2006 , but fails to describe systems like ours in which spectral gaps are small Moretti2013 ; Villegas2014 . We propose a way to relax the above assumption, by considering a candidate steady state as a linear combination of the first eigenvectors, that is . In particular, we can always choose our eigenvector basis in such a way that for all . We note that in the worst case scenario , meaning that all eigenvalues are needed. Under what conditions is the network able to sustain the candidate steady state, so that ? By inserting our expansion for the steady state in Eq. (1), and using the linear independence of eigenvectors, we obtain the condition
[TABLE]
Eq. (2) shows that in a spectral theory of SIS in which the first eigenvalues are necessary, also the corresponding eigenvectors play a role. Then, two mechanisms may be responsible for the lack of a non-trivial steady state with :
(a) if the spreading rate is small, i.e. (and thus, for all ) then the candidate non-trivial steady state is unstable;
(b) even if for some , the localization of induces (positive but vanishing): the candidate steady state is weakly stable in principle, however dynamic fluctuations are bound to deactivate it over time. In this case, a virtually stable state results in fact metastable and relatively short-lived 111We note that a similar phenomenology has been also proposed for different types of systems in which a single eigenvalue expansion is still possible Goltsev2012 ., in agreement with the Griffiths phase picture Moretti2013 .
Thus, a nonzero steady state is still possible, if one of the following two conditions is met:
i) there are some de-localized eigenstates, i.e. a pathological region in the spectrum exists around a given , characterized by high density of states and/or low localization, such that it can trigger a stable such that and ;
ii) a finite number of localized states can dynamically coalesce sustaining a global active state (see Fig. 3), i.e. no pathological pairs exist, however if is large enough, for many values of : a large enough number of potentially short-lived states is generated, large enough to sustain (or coalesce into) a long-lived steady state , however with no clear criterion to identify what a large enough is.
In order to clarify which of the two scenarios holds in the case of HMNs, and how the value of can be related to spectral properties of , we conducted an extensive numerical study of HMNs of different , targeting both the SIS dynamics direct simulation and the network spectral properties.
Our numerical results provide a clear indication that the relevant scenario for HMNs is indeed ii) as exemplified graphically in Fig. 3, illustrating the lack of any de-localized state 222Similar results (not shown here) are obtained by looking at plots of the eigenvector inverse participation ratio as a measure of localization. Similarly, we did not find any correlation between the inverse of any eigenvector and the numerically determined value of (see below), thus indicating that if an epidemic threshold is reached –above which sustained activity exists– it has to emerge owing to a finite number of unstable, though localized, active regions and their dynamical interplay.
IV Scaling of the epidemic threshold in HMNs
Given the complexity of this scenario, in which a large but undefined number of eigenvalue-eigenvector pairs is expected to play a role; is it still possible to relate to a single scalar property of the spectrum?
In order to answer this question, we notice that the properties of the higher spectral edge of HMNs can be tuned by acting on : upon increasing , the number of non-zero off-diagonal elements of increases accordingly. A simple argument to shed light on this observation is as follows: at every hierarchical level , the approximate and coarse-grained connectivity pattern between two modules would be very roughly represented by an effective weighted adjacency matrix structured as \mathbf{A}^{(i)}\sim c_{i}\left(\begin{array}[]{cc}0&\alpha\\ \alpha&0\\ \end{array}\right), which will contribute a larger eigenvalue proportional to to the higher spectral edge of . We can corroborate our view by looking at Fig. 4a, where it is shown that the value of the generic -th eigenvalue is strictly proportional to , for any value of in the higher spectral edge. This is unlike what happens in Erdös-Rényi (ER) or SF networks, where increasing connectivity – for instance by tuning the average degree in ER networks or the degree distribution in SF networks – primarily affects the scaling of the principal eigenvalue only, effectively changing the size of the spectral gap Farkas2001 . We stress that our approach here is kept purposely simple, while the correct way to address the analytical computation of HMN spectra has been recently discussed for the Laplacian spectrum of the Dyson fully connected hierarchical graph Agliari2015_PRL ; Agliari2016 .
The exceptional behavior of HMN spectra, for which a single tuning parameter is able to tune the entire spectral edge, turns crucial for our study of the epidemic threshold: provided that scales as the inverse of some relevant eigenvalues in the higher spectral edge, the similarity properties of eigenvalue spectra provides us with a simple prediction for the epidemic threshold, which can be expressed as:
[TABLE]
We measured computationally by employing the standard method of simulating SIS dynamics starting from a homogeneous initial condition of all active nodes, and recording steady states values (more refined techniques relying on susceptibility measurements have been proposed for SF networks, in which vanishing values of make their estimate a more delicate task Ferreira2012 ). Simulations we performed for sizes and , recording minimal to no deviations between the two cases. From the perspective of size scaling, it appears that in this size range ( – nodes) the dynamics display no appreciable size effects. In particular, we find that steady states for are stable against fluctuations, and do not decay as a consequence of finite sizes. Smaller sizes, however, may still allow large enough fluctuations to make steady states unstable. This apparent inconsistency (an unclear distinction between supercritical and subcritical dynamics), affects systems of very limited sizes, and is of course understandable considering that phase transitions are correctly defined only in the limit. The resulting is plotted in the inset of Fig. 4b as a function of .
The validity of Eq. (3) is confirmed by simulation results in Fig. 4b, where it is shown that there is a remarkable scaling property
[TABLE]
for all eigenvalues in the spectral edge. In passing, we note that as all eigenvalues in the range scale with , this must happen, in particular, for : while the principal eigenvalue alone by itself cannot justify the value of the epidemic threshold, the standard criterion survives in a weaker form as a scaling law (not an equality), and more importantly, it extends to all eigenvalues that participate in the onset of activity.
Finally, recalling our initial results, that for large enough networks one has , we can rewrite our estimate as
[TABLE]
The conjecture that the network dimension acts as a structural determinant of spreading activity appears corroborated: is indeed capable of tuning the value of . The picture emerging from our results is that of a complex dynamic scenario, as the one described by Eq. (2), which can be correctly understood by identifying the topological dimension as the relevant tuning parameter for epidemic spreading in HMNs.
We also remark that in the limit, Eq. (3) predicts a vanishing epidemic threshold, recovering the well-known quenched mean field result for SF networks, which are intrinsically infinite dimensional. The actual study of the existence of a finite in SF graphs requires in fact more refined theoretical tools, while here we only stress how our generalization of the QMF approach also contains its original predictions.
Finally, we addressed the question of how the supercritical phase diagram is affected by tuning , or equivalently . Fig. 5 shows the steady state density of active nodes, , as a function of , for different values of (and ). The striking result that we find is that while the emergence of scaling clearly suggests a critical scenario of the familiar form , even for the lower values of considered here the system is above its critical dimension and the exponent is insensitive to dimensionality. A detailed study of the phase transition for even lower dimensional HMNs is beyond the scope of this manuscript, and is being considered for future work. Here, we would like to emphasize that the emergence of dynamic scaling is robust against structural variations, in a range of connection densities and dimensions which we consider relevant in fields such as neuroscience.
V Conclusions
We discussed the essential reasons why the QMF approximation does not provide a correct prediction for the epidemic threshold in hierarchical modular networks. The first eigen-mode to become unstable is localized and thus, it cannot represent an endemic state of activity once fluctuations are taken into consideration. Instead, a finite number of unstable eigen-modes may induce an active state. Remarkably such set of eigenvectors does not create a spanning or percolating cluster expanding through the whole network, but just localized clusters of activity. However such “reservoirs” of instability can create a global active state owing to fluctuations that transiently activate other modes, effectively connecting diverse localized clusters.
Consequently, we introduced a novel framework, in which the epidemic threshold depends on a (large) number of eigenvalues but, remarkably, turns out to be inversely proportional to a unique parameter; the network topological dimension, . While our results corroborate this result for HMNs, the possibility of extending it to more general network classes can only be conjectured at this stage.
The importance of our results in the description of biological systems endowed with hierarchical modular organization can be better understood considering the example of brain networks. A direct dependence of on ensures that, being HMNs finite dimensional, the epidemic threshold never vanishes. Should that happen, information units would boundlessly propagate through the network, making it impossible to manage information properly, something usually associated with epileptic forms of activity. On the other hand, by simply tuning a single parameter, e.g. during the development or pruning of neuronal networks, the dynamical regime of the whole network could be established.
In conclusion, we have studied numerically some of the most relevant properties of the onset of spreading in HMNs. We have highlighted a crucial construction parameter, the connectivity strength –that controls the network fractal-like structure and shown its proportionality to the topological dimension of a HMN. We have shown how and, equivalently– are responsible for the tuning of the epidemic threshold in HMNs, by acting directly on the spectral properties of the adjacency matrix. Thus, by slightly modifying a unique network-structure controlling parameter, it is possible to regulate the spreading rate that is necessary to generate sustained activity, i.e. the “epidemic threshold” and, in this way, the overall state of activity can be controlled by the network architecture.
We hope that our work can stimulate further studies in this direction, possibly providing a deeper analytical understanding of the relationship and interplay between structural and dynamic patterns of localization.
Acknowledgements.
AS and PM acknowledge financial support from the Deutsche Forschungsgemeinschaft, under grant MO 3049/1-1. MAM is grateful to the Spanish-MINECO for financial support (under grant FIS2013-43201-P; FEDER funds). We thank P. Villegas and S. di Santo for useful discussions and for a critical reading of the manuscript.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) O. Sporns, G. Tononi, and R. Kötter, P Lo S Comput. Biol. 1(4) , e 42 (2005).
- 2(2) P. Hagmann et al. , P Lo S Biol. 6 , e 159 (2008).
- 3(3) H. Jeong, B. T. R. Albert, Z. N. Oltvai, and A.-L. Barabási, Nature 407 , 651 (2000).
- 4(4) E. Ravasz et al. , Science 297 , 1551 (2002).
- 5(5) A. Gautieri, S. Vesentini, A. Redaelli, and M. J. Buehler, Nano Lett. 11 , 757 (2011).
- 6(6) G. Tononi, O. Sporns, and G. M. Edelman, Proc. Natl. Acad. Sci. USA 91 , 5033 (1994).
- 7(7) A. Arenas, A. Díaz-Guilera, and C. J. Pérez-Vicente, Phys. Rev. Lett. 96 , 114102 (2006).
- 8(8) C. Zhou et al. , Phys. Rev. Lett. 97 , 238103 (2006).
