Metaplex networks: influence of the exo-endo structure of complex systems on diffusion
Ernesto Estrada, Gissell Estrada-Rodriguez, Heiko Gimperlein

TL;DR
This paper introduces the concept of metaplexes, analyzing how internal node structures and their interconnections influence diffusion processes, with applications to landscape and brain systems.
Contribution
It defines the metaplex framework and investigates how internal structures and coupling parameters affect global dynamics in complex systems.
Findings
Internal node structure can dominate global dynamics in brain metaplexes.
Node internal coupling location influences diffusion behavior.
Internal structure plays a regulatory role in landscape metaplexes.
Abstract
In a complex system the interplay between the internal structure of its entities and their interconnection may play a fundamental role in the global functioning of the system. Here, we define the concept of metaplex, which describes such trade-off between internal structure of entities and their interconnections. We then define a dynamical system on a metaplex and study diffusive processes on them. We provide analytical and computational evidences about the role played by the size of the nodes, the location of the internal coupling areas, and the strength and range of the coupling between the nodes on the global dynamics of metaplexes. Finally, we extend our analysis to two real-world metaplexes: a landscape and a brain metaplex. We corroborate that the internal structure of the nodes in a metaplex may dominate the global dynamics (brain metaplex) or play a regulatory role (landscape…
| 0.0265 | 0.0088 | 3.9 | 1.8 | |
| 0.034 | 0.059 | 0.028 | 0.059 | |
| 0.0064 | 1.378 | 0.0064 | 1.3283 | |
| 0.0983 | 0.1567 | 0.0983 | 0.1567 | |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
\newsiamthm
claimClaim \newsiamremarkremarkRemark \newsiamremarkhypothesisHypothesis
\headersNetworks with internal structureG. Estrada-Rodriguez, E. Estrada, and H. Gimperlein
Metaplex networks: influence of the exo-endo structure of complex systems on diffusion††thanks: Submitted to the editors. \fundingG. E. R. was supported by The Maxwell Institute Graduate School in Analysis and its
Applications, a Centre for Doctoral Training funded by the UK Engineering and Physical Sciences Research Council (grant EP/L016508/01), the Scottish Funding Council, Heriot-Watt University and the University of Edinburgh.
Ernesto Estrada Institute of Applied Mathematics (IUMA), Universidad de Zaragoza, Pedro Cerbuna 12, E-50009 Zaragoza, Spain; ARAID Foundation, Government of Aragón, E-50018 Zaragoza, Spain; and Instituto de Ciencias Matematicas e de Computacao, Universidade de Sao Paulo, Caixa Postal 668, 13560-970 Sao Carlos, Sao Paulo, Brazil (). [email protected]
Gissell Estrada-Rodriguez Maxwell Institute for Mathematical Sciences and Department of Mathematics, Heriot-–Watt University, Edinburgh, EH14 4AS, United Kingdom (, .) [email protected]
Heiko Gimperlein*‡*
Abstract
In a complex system the interplay between the internal structure of its entities and their interconnection may play a fundamental role in the global functioning of the system. Here, we define the concept of metaplex, which describes such trade-off between internal structure of entities and their interconnections. We then define a dynamical system on a metaplex and study diffusive processes on them. We provide analytical and computational evidences about the role played by the size of the nodes, the location of the internal coupling areas, and the strength and range of the coupling between the nodes on the global dynamics of metaplexes. Finally, we extend our analysis to two real-world metaplexes: a landscape and a brain metaplex. We corroborate that the internal structure of the nodes in a metaplex may dominate the global dynamics (brain metaplex) or play a regulatory role (landscape metaplex) to the influence of the interconnection between nodes.
keywords:
Complex networks, metaplex network, -path Laplacian, diffusion
{AMS} 05C81,92C99,35P05,47G99
1 Introduction
A complex system is characterized by the existence of many components which are interdependent on each other [20, 40, 49]. Each of these components is at the same time characterized by certain structure, dynamics and function [4], which influences the global behaviour of the system. The interconnection between these components represents the exo-skeleton of the complex system, and it is well characterized by the use of complex networks [20, 40, 49]. The internal structure of the corresponding entities – inside the nodes of the complex network – represents the endo structure of the system and it is not necessarily a network in itself. Let us consider some examples, from the vast variety that exists in nature and society, to illustrate the point.
The first type of systems, represented in Figure 1a, is formed by cells which are interconnected by means of their physical contacts, such as in the case of cellular systems in tissues, neuronal networks or astrocytic complexes, i.e., star-shaped glial cells [48]. In this case the exo-skeleton of the system is the cellular network per se, and their endo-skeleton is described by the crowded environment inside the cells, where up to 40% of the cytoplasmic volume is occupied by RNA, ribosomes and proteins [69, 70]. The situation is similar if we consider regions inside an organ instead of individual cells. A typical example is the consideration of anatomical or functional regions of the brain [8]. Here again the system is characterized by an exo-skeleton formed by the brain network and an endo-structure describing the interior of those regions.
In the second example illustrated in Figure 1b we consider an enriched conceptual metaplex. This is a conceptual organization model inferred by Goi et al. [31] from verbal fluency of 200 individuals. The study was aimed at finding the conceptual storage structure of the natural category of animals as a network. Thus, every node of the metaplex represents a category of animals, e.g., pets, and inside the nodes we find all the words in that category.
Our third example consists of the patches formed in an ecological landscape as illustrated in Figure 1c. In this case, the system of patches and the corridors connecting them forms an exo-skeleton known as a landscape network [63]. The combination of the geographic and ecological features of the individual patches determine their endo-structures. This example will be discussed hereafter in this work.
The final example is however at a much larger scale (see Figure 1d). It corresponds to a climate system in which the nodes represent geographical regions in the world. These regions are connected by climatic correlations or causalities, such that two regions are connected if a climatic event in one region triggers a climatic event in the other [67, 15]. Inside every region, however, there is a vast collection of complex phenomena taking place which are typically modeled by using weather and local climatic models.
A common dynamical process taking place in the systems described in Figure 1 is diffusion, which is also ubiquitous in many other physical [26], chemical [38], biological and socio-economic systems [35, 41], especially on mesoscopic scales [68]. In the systems described before, as well as in many other complex systems, there is a trade-off between a diffusive process taking place inside the entities of the systems and the diffusion taking place between them. When both, the endo- and the exo-structure of the complex system are representable by networks we can use some of the physico-mathematical tools already available in the literature, such as networks of networks [27, 59] or multiplexes [3, 30, 36, 55]. However, the main challenge here is that in many occasions the endo-structure of the system is described by a continuous space while the exo-skeleton is a discrete one, e.g., a network. In the case of cells, their interior is formed mainly by cytoplasm which is formed by 80% of water [43], while their interconnection is well described by a cellular network. Goi et al. [31] considered in their work that inside each category every pair of words were connected. Thus, it is assumed that the internal space inside categories is a continuum in which words are found in a random-walk-like navigation inside the memory of individuals. In the next example, where species are moving in a patchy environment, the movement inside the patches is better described by using continuous diffusive models [1, 9], and the hop between patches through the narrow corridors is better accounted for by using a network-theoretic approach [63]. Finally, in climate systems the processes inside the regions – nodes – are well described by aerodynamics and fluid dynamics, while the causal influence between regions is well described by a network of interactions, including long range effects [15, 67].
The implications of this endo-exo trade-off in complex systems is very important for understanding their functioning. There is experimental evidence, for instance, that the movement of small molecules inside a cell follows an anomalous diffusive processes, either subdiffusive [29, 51, 65] or superdiffusive [56]. The distinction between normal (or Fickian) and anomalous diffusion is made on the basis of the scaling of the mean squared displacement of the diffusive particle with time [7, 46], where is the current position of a particle and is the initial position. See Supplementary Information for a more detailed description of anomalous diffusion. While for normal diffusion the mean squared displacement scales linearly with time , for anomalous diffusion it scales as a power-law , with exponent larger (super-) or smaller (sub-) than one. This means that on long time scales in a superdiffusive process the space explored by the diffusive particle is larger than the one explored in a normal diffusion in exactly the same time, due to a high probability of long range hopping. In the case of a small molecule inside a cell, the anomalous diffusion is mainly due to the crowded environment inside the cells [58, 60]. However, there are more complex mechanisms inside certain types of cells that can lead to anomalous diffusive processes. An example is the generation of calcium waves [10] which have been observed in cardiac muscle [25], in skeletal muscle fibre [16], medaka eggs [57] and astrocytes [11]. This subdiffusive movement may be involved with cardiac [39, 42] and brain diseases [66, 34].
When global systems, such as tissues [50] or the whole brain [8], are analyzed, superdiffusive processes have been experimentally observed for fresh specimen of carcinoma, fibrous mastopathies, adipose and liver tissues [37] as well as for signals navigating across regions of the brain [12]. Interesting research questions emerge from these experiments: Is the anomalous diffusive behavior of a global system the consequence of sub or superdiffusive processes inside the entities, e.g., cells or regions? Are they the result of the anomalous diffusion between the entities only? Is it the combination of the exo- and endo-structures which determines the nature of the diffusive process in a complex system? How relevant is the endo-structure depending on the type of network, i.e. small-world network? Similar questions emerge for the analysis of other systems, such as the landscape system discussed above. In landscape systems the superdiffusive movement of species inside a patch is well documented and described by continuous models [1, 9, 64]. Can this behavior alone determine the nature of the diffusive process at the global landscape level?
In this work we answer these questions by introducing the concept of metaplexes. Informally, a metaplex is a representation of a complex system in which the internal structure of the nodes and the interconnection between them are considered at the same time (see Figure 2). Thus, a dynamical system on a metaplex consists of the coupling between the dynamics inside the entities, typically a continuous space, and the dynamics between these entities which is controlled by the inter-entity connectivity.
Our results show that in a linear metaplex, superdiffusion due to long range hopping in a network, as in [22], survives irrespective of the internal structure of the nodes. On the other hand, we prove that superdiffusion in the nodes can speed up regular diffusion in the metaplex, but it cannot lead to superdiffusion. The geometry of the nodes and their coupling play crucial roles for the global dynamics, which we explain in a combination of analysis and numerical experiments. The results shed light on the rich and substantially different nature of the dynamics of metaplexes and the interplay of their exo- and endo-structure, also in the real-world systems considered in Section 6.3.1.
Here we start by a formal definition of a metaplex and a dynamical system on it. We then study a linear toy model that allows us to understand some of the fundamental principles of diffusive processes on metaplexes. Finally, we study two real-world metaplexes pointing at the potential applications of this representation of complex systems.
2 Preliminaries
In this section we define the concepts and settle the notation to be used in this work. Here we consider two kinds of diffusive dynamical systems, one taking place in a continuous space and the other in a discrete one. Let us start by defining the diffusive process on the continuous space.
Let be the density of the diffusive particle at time for in a domain in . The density evolves according to
[TABLE]
where denotes a fractional Laplacian operator for The application of the fractional Laplacian to on at a fixed time is given by
[TABLE]
where denotes the Cauchy principal value, and is the following normalization constant in terms of Euler Gamma functions
[TABLE]
In a domain it is better to define the fractional Laplacian in terms of the following bilinear form:
[TABLE]
for belonging to the Sobolev space . When this operator corresponds to the differential Laplacian operator [46, 47] with Neumann boundary conditions [14].
Let us now move on to the diffusive process on a discrete space. Let be a simple, connected graph with nodes and edges. The degree of a node in is the number of its nearest neighbors. Let be the shortest path distance between the nodes and , i.e., the number of edges in one shortest path connecting both nodes. Let be the maximum distance between any pair of nodes in , i.e., the graph diameter.
Hopping between the nodes in the discrete space of a network occurs through sinks (dark blue area in Figure 2) and sources (yellow area), where particles are allowed to hop to non-nearest nodes with a certain probability. Since the metaplexes that we study are undirected, the sinks also act as sources and vice-versa (see Supplementary Note 2). The evolution of the density of the diffusive particle among the nodes of the graph is controlled by the generalized diffusion equation [19]:
[TABLE]
where is the -path Laplacian operator of the graph transformed by the coefficients . This operator is defined as follows. Let denote the set of complex-valued functions in Let then [19]
[TABLE]
Notice that if we consider only in the above definition, this operator becomes the graph Laplacian , where is a diagonal matrix of node degrees and is the adjacency matrix of the graph. The transformation of the operators through the coefficients is aimed at tuning the hopping of the diffusive particle between nearest and non-nearest neighbors in the graph. For instance, let
[TABLE]
designate the Mellin-transformed -path Laplacians of the graph where is the diameter of the graph.. Then, when the transformed operator tends to However, when is relatively small the diffusive particle can hop not only to nearest neighbors but also to distant nodes with certain probability that decays with the shortest path distance separating the origin and destination of the particle. It was recently proved that in the one-dimensional lattice when there is a superdiffusive process on the graph [22]. The same happens for two-dimensional lattices when [23]. Other transforms, such as the exponential one, also known as the Laplace transform:
[TABLE]
can also be used in the generalized diffusion equation but they have been proved to show no superdiffusive processes on the graph [22].
In the analysis of the diffusion processes on metaplexes we will refer to the rate at which the diffusive particle reaches the steady state as . The rate of convergence of the diffusion on the metaplex is controlled by the standard deviation of the density, , where the summation is over all nodes in . In our examples the steady state is the uniform distribution on .
3 Metaplexes: Structure and Dynamics
We have previously defined informally what a metaplex is. Here we present a formal definition of a metaplex and of a dynamical system on it. Let us start with the following.
Definition 3.1**.**
*A metaplex is a -tuple , where is a graph, is a set of locally compact metric spaces with Borel measures , and . *
For instance, let us consider a simple metaplex in which is a path graph, e.g., the path graph of nodes with each node given by the unit disk . In this case and is constant. The resulting metaplex is illustrated in Figure 2. The endo-structure of this metaplex is given by the internal structure inside the unit disk, and its exo-structure is given by the connectivity of the three nodes in the form of a path. In the current work we focus only on metaplexes in which the internal structure of the nodes is continuous. That is, when is a set of open domains , each endowed with the Lebesgue measure. Other scenarios in which the internal structure is a discrete space, not only a graph, should be considered in a separate analysis, and they will not be treated in the current work. Now, we are in condition to define a dynamical system on a metaplex.
Definition 3.2**.**
*A dynamical system on a metaplex is a tuple . Here is a family of operators such that the initial value problem , , is well-posed, and is a family of bounded operators . *
There are many possible dynamical systems that can be considered on a metaplex under the previous general definition. In the current work we focus only on the study of diffusive processes at the endo- and exo-structure of the metaplexes. In this scenario we consider a continuous diffusion equation inside the nodes where the evolution of the density of the diffusive particle is controlled by the fractional Laplacian operator as described in Section 2. At the exo-skeleton we consider a diffusive process in which the particle hops from a node to another as controlled by the -path Laplacian of the graph also described in Section 2. The in and out motion of the diffusive particle between nodes is carried out through the so-called* sources* and sinks inside the nodes. A source is a subdomain inside the node from which a diffusive particle can emerge to the interior of the node. A sink is another (not necessarily different) subdomain inside the node from which a diffusive particle can abandon the interior of the node towards another node in the metaplex.
In the simplest case, diffusive particles move between different nodes through such sinks and sources in the interior, corresponding to a coupled system of diffusion equations for the density of particles in the node :
[TABLE]
for . Here is the flux of particles, and is the generator of the diffusion process in , for example in the case of a normal diffusion, while for the superdiffusive Lévy process. The edges are realized by a map which specifies the jumps between domains, and the coefficients are transition rates from to : Particles jump from to with amplitude and from to with amplitude . Physically, the system Eq. 8 arises for nodes which correspond to spatially distant domains.
For the system of diffusion equations Eq. 8, , while correspond to the entries of the transition matrix of the network given by the functions .
Diffusion in a network may be studied from its generator, the graph Laplacian . A dynamical system in a metaplex is similarly described by an operator matrix . For the diffusion processes like (8) it takes the abstract form
[TABLE]
is an block operator matrix of unbounded operators on the product space , with the number of nodes in . In line with Definition 3.2 we write , where
[TABLE]
is given by the operators and
[TABLE]
describes the network diffusion defined a . Provided the adjoint , particles are conserved. Here the are transition operators between and , as given by the sources and sinks, and are the transition probabilities.
For a network, spectral properties of the network Laplacian determine the long-time behavior of diffusion. Analogously, the long-time behavior of the linear diffusion equation (9) in the metaplex is determined by the spectral properties of [62]. While the spectrum of is determined by the internal structure of the nodes, the spectrum of combines the details of the location and strength of sinks, respectively sources, with the external network structure.
In addition to the coupling by sinks and sources as in (8), numerous other types of couplings can be considered within the framework of metaplexes. While their detailed analysis is beyond the scope of this paper, we mention two important examples.
The first example is a special case of (8), with all nodes of the same geometry for every and local transitions , where Id is the identity operator (matrix) of the appropriate dimension. In this case the density may be interpreted as a vector valued function , and the network encodes the dynamics of the “internal state” of the particle described by a vector in . In biology, such processes are of interest to describe the diffusion of complex organisms [54, 18, 17].
In complex systems such as road systems or the transport of chemicals between cells, the coupling between the nodes occurs through the boundary , not through internal sinks and sources. Every edge is physically realized by open entrances and exits and , together with a homeomorphism identifying points between them. We define . If there is an edge between and , particles leave through and arrive at in .
The resulting system of diffusion equations is coupled through the boundary conditions, with a Kirchhoff’s law: For
[TABLE]
[TABLE]
where is the exterior unit normal vector. The number of particles is preserved if the transition probabilities satisfy for every .
4 Operators and spectra for metaplexes
4.1 Variation of eigenvalues with fractional exponent and spatial scale
Note that is a block diagonal operator matrix acting on . A basis of eigenfunctions of is constructed from bases of eigenfunctions of in and it is given by where the subscripts denotes the -th eigenfunction in the domain . Here denotes the -th standard unit vector in .
If is the fractional Laplacian in with Neumann boundary conditions, the eigenvalues of are homogeneous functions of the spatial scale, i.e., if the spatial variable is scaled, then also the function, , where is the degree of homogeneity. More precisely, the bilinear form of is homogeneous under scaling , . For instance, if is a ball of radius , then the scaling of the domain can be interpreted as .
From their characterization in terms of a Rayleigh quotient, the eigenvalues in are given by , if are the eigenvalues of in [13]. Only the lowest eigenvalue is fixed under this scaling.
We see that for small domains, , the spectral gap in the node increases with , and therefore Brownian motion in the nodes gives the fastest convergence to equilibrium. For large domains, , the spectral gap in the nodes decreases with , and therefore the long jumps of the fractional diffusion lead to faster equilibration than Brownian motion inside each node.
In a further section (see Section 6) we will illustrate computationally these findings.
4.2 Weakly and strongly interacting limits
The spectral properties of are most easily understood in the limit of weak network interactions between the nodes, respectively the strong network interactions for . In the former case, a particle is trapped for a long time inside the domain in which it was initially placed. The time scale of the slow global equilibration is determined by . In the latter case, the transient dynamics is governed by the dynamics of the network and geometry of the sinks and sources, i.e. , but the dynamics inside the nodes determines the long-time approach to equilibrium.
From standard perturbation theory, for general, symmetric interactions the stationary states corresponding to , , split into eigenvalues according to the eigenvalues of restricted to the kernel of . The kernel of is spanned by the constant functions in , . Hence, , , is given by an effective graph Laplacian for the metaplex, in which the internal structure has been integrated out. The eigenvalues of this matrix determine the spectral gap in terms of the spectral gap of the effective graph Laplacian , independent of . Higher eigenvalues will depend on the location of the sources and sinks and the eigenfunctions of .
Multiple eigenvalues arise, in particular, when several of the coincide. In this case the eigenvalues are determined by the restriction of to the subnetwork of those nodes where the internal diffusion has the eigenvalue .
Higher eigenvalues depend on the location of the sources and sinks. The spectral gap of the network is , and thus independent of the diffusion process .
Local equilibration within the nodes, however, happens on faster time scales, with little effect of the coupling. For small , the gap between the higher bands to the equilibrium is determined by the diffusion , up to terms of order , where are the eigenvalues of .
The case where is discussed in the Supplementary Material (Note 3). For general the spectrum of the network interaction operator will be considered elsewhere.
4.3 Numerical results of the spectral properties
We illustrate the spectral gap of for a linear network of unit disks . The lowest nonzero eigenvalues are considered as a function of , the coupling operator and the diffusion . We choose the generator of the diffusion process inside as a fractional Laplacian with Lévy exponent and approximate it by finite elements on quasi-uniform spatial meshes. See Figure 6 below for a plot of the mesh and [24] for the approximation of the fractional Laplacian.
The network coupling is taken to be a -path Laplacian (7) with hopping between and proportional to an exponential .
As is unbounded the eigenvalues of its discretization extend over several orders of magnitude, while the spectral gap is tiny. To resolve it, the discretization of the mesh needs to be small compared to the strength of the coupling, and standard Matlab routines do not identify the bounded branches of eigenvalues obtained in Section 4.2 for large . Discretization errors significantly increase as because the smoothness of the solutions in decreases.
Fig. 3 indicates the complications inherent in approximating the spectrum of a large system of differential operators. The lowest nonzero eigenvalues of are depicted for the exponential coupling as a function of the coupling strength for meshes of and degrees of freedom, , . We consider a prototypical metaplex coupling as depicted in Fig. 2 for . While results agree for large coupling strengths, the spectral gap is significantly smaller for the finer mesh at small coupling. Nevertheless, the qualitative behavior from Section 4.2 is recovered: the gap increases linearly for small , and for large it converges to the lowest eigenvalue of .
Fig. 4 connects the theory of Section 4.2 with the numerical results from Section 6 and evidences the effect of the geometry of the nodes on the dynamics of the network. In the case of the small nodes (Fig. 4 left) when the coupling is weak, the dynamics of the network is dominated by the diffusion process inside the nodes and we have almost no hopping between domains. As we increase the coupling strength, for the spectral gap is bigger than that for in agreement with Section 4.1. Similar to the case of multiplex networks, the first non-zero eigenvalue of is related to the equilibration time in the whole networks, i.e., [61]. From Fig. 4 (left) the equilibration time for the case is much longer than for the normal diffusion case inside the nodes. In a further section of this work (see Section 6) we obtain computational results that confirm the current findings.
In the case of big nodes (Fig. 4 right) the spectral gap decreases as we increase the parameter . This means that, opposite to the small node case, a metaplex with superdiffusion inside the nodes () reaches the equilibrium faster than for internal Brownian motion.
5 Analysis of diffusion in metaplexes
In this section we indicate how PDE techniques allow an analysis of the time-dependent diffusion introduced in Section 3 in a metaplex of bounded domains , as illustrated in Figure 2. We compare the interaction of diffusion, respectively superdiffusion, in the nodes with either short or long range coupling in the external network. While for general complex networks the connectivity and large scale geometry of the network will crucially influence the dynamics, here we focus on simple linear metaplexes and short times.
More precisely, we assume that the diffusion process in each node is governed by either a fractional Laplacian or a self-adjoint elliptic differential operator of second order like the Laplacian, , , with Neumann boundary conditions. The network coupling consists of disjoint sinks and sources, as in Figure 2. The amplitude is chosen according to the -path Laplacian (6), (7), with hopping between and proportional to (long range coupling), respectively (short range coupling).
When we consider a metaplex we are dealing with the endo-dynamics occurring inside the nodes and the exo-dynamics occurring between them. Inside each node the solution to the diffusion equation for with initial condition is an integral operator . The integral kernel describes the evolution of a Dirac point mass in at time . For ordinary diffusion away from the boundary it satisfies the Gaussian estimate
[TABLE]
for some , analogous to the explicit solution formula for the diffusion equation on [53]. Similar bounds are known for ordinary diffusion on metric measure spaces [32]. Fractional diffusion, on the other hand, exhibits slow algebraic decay in the form of a Poisson estimate
[TABLE]
away from [28]. In a convex domain the estimate is sharp for short times, and it allows us to estimate the diffusion between nodes across the network.
Consider the linear network in Figure 2, with an initially uniform density localized in . From Equation 8 we calculate the change of the total density in node :
[TABLE]
So, initially particles hop from node to node according to the transition probabilities of the network, from to . From Duhamel’s formula for the solution of the inhomogeneous diffusion equation, they then evolve inside according to before jumping back to node 1, or further to a different node . Both processes only enter into the next, quadratic term of the Taylor expansion in . These formal arguments are made rigorous in terms of an asymptotic expansion for of the heat kernel for the network of interacting domains, see e.g., [45].
Compared to nodes without internal structure, hopping to node is reduced by the rate of diffusing from to a point in the region of the sink to node within time . The internal diffusion thus always slows down the network dynamics if sources and sinks are disjoint.
The exit time taken to get from source to sink is well studied both for normal and fractional diffusion [2]. It satisfies a (fractional) Fokker-Planck equation and satisfies the estimate (10), respectively (11), for short times. For long times, decays exponentially fast in time.
For short times, the dependence on the internal diffusion , the geometry of , and the location of sinks and sources are well described by (10) and Equation 11. For sources and sinks which are far apart, in the case of normal diffusion Equation 10 shows a faster than exponential suppression of the transition rate due to the internal structure. Fractional diffusion suppresses the transition rate algebraically in the distance between sink and source, according to Equation 11. The smaller , the faster the equilibration and the smaller the suppression in .
Similarly if is nonzero only for , hopping to next -th nearest neighbors is suppressed times by the internal diffusion. Starting from an initial density localized in node , the total density in node will be exponentially small, for some depending on the endo-structure.
6 Numerical analysis of diffusion in metaplexes
This section investigates the influence of the internal structure of the nodes on the global metaplex dynamics, using numerical experiments for the toy example of a linear metaplex. For the localized coupling in a given area (Fig. 5) we show the rich dependence on the internal structure in a metaplex such as the geometry of the nodes and the nature of the coupling, and put the results, which we obtained in certain limits, into a wider perspective. For example, a superdiffusive process in the nodes may slow down equilibration in the metaplex, see Experiment 1. On the other hand, the network diffusion dominates the qualitative global behavior: In Section 6.3.1 we show that network superdiffusion due to long range hopping survives independently of the internal structure. This section illustrates the rich phenomena which arise from the interplay of the exo- and endo-structures of the metaplex. See Supplementary Information for numerical and analytical results for the case . The conclusions are not restricted to the linear metaplex, but will be studied in the subsequent section in some real-world examples.
6.1 Set up of numerical experiments
Here we analyze a simple metaplex consisting of identical circular domains connected in the form of a linear chain, i.e., a path graph. The nodes are labelled in consecutive order starting by one. Starting from a uniform distribution in node 1, we study the evolution of the density in the nodes depending on the network and the internal diffusion processes, the size of the nodes and the strength and nature of the coupling between the nodes.
Two different sizes of nodes are considered, , . These different sizes will also be used when we move to the analysis of real-world metaplexes. The diffusion equation (8) inside each node with Lévy exponent is approximated by finite elements in space on a quasi-uniform spatial mesh with 347 degrees of freedom. See Fig. 6 for a plot of the mesh and [24] for the numerical approximation of the fractional Laplacian. For the time discretization we use a backward Euler method in time with a sufficiently small, fixed time step .
Unless stated otherwise, the network coupling between nodes is taken to be of short range, according to the Laplace-transformed -path Laplacian (7). The coupling strength between nodes is thus proportional to for different exponents .
6.2 Experiment 1: Central coupling region
For different values of the network exponent , we compare close to normal diffusion (Lévy exponent ) to superdiffusion () inside a metaplex of small nodes . In this experiment we consider that the nodes of the metaplex are connected by means of a central region of the node, as depicted in Fig. 5a, which acts at the same time as a sinks and as a source. See Supplementary Material (Note 2) for a more detailed description of sink and sources. The coupling strength is fixed to be .
Fig. 7 shows the time at which the density in node 1 reaches the equilibrium given by , where is the density in the node at a given time and is the initial density in the metaplex. The figure illustrates the strong effect of the dynamics inside the nodes on the diffusion process, even though the networks dynamics dominates. We see that superdiffusion inside each node slows down the diffusion in the network: Due to the nature of the Lévy process, particles quickly diffuse far away from the sink. As they take time to return and hop to the next node, diffusion between nodes in the whole network is slowed down. In Section 6.3 we discuss how the size of the nodes affects this behavior.
The spatial localization of the sink and sources decreases the total strength of the coupling, resulting in a slower equilibration of the densities in the node compared to a uniform coupling discussed in the Supplementary Material (Note 3). Changing the strength of a sufficiently strong localized coupling does not affect this behavior much, as the equilibration time saturates: independent of the coupling strength, particles which are located away from the sink cannot hop to a neighboring node.
In Fig. 8 we show the evolution in time of the total density in each node . While superdiffusion inside the nodes has only limited effect on the equilibration of the densities in the network, it speeds up hopping to distant nodes. From Fig. 8 we observe that, when the network dynamics is dominated by superdiffusion (), only for short times the superdiffusion inside the nodes (red crosses) overtakes normal diffusion, while for longer times the equilibrium is attained faster for .
6.3 Experiment 2: Distant coupling regions
To study the effect of the geometry of the coupling and the node on the global dynamical process, we replace the central coupling from Section 6.2 by a prototypical metaplex coupling as depicted in Fig. 2: For the odd nodes the coupling region is located as in Fig. 5b, while for even nodes the coupling region is on the opposite side. Similar to the central coupling, the coupling regions act as sink and as sources at the same time. The coupling areas in both domains are equal, therefore, in the case of , the areas are more localized and distant.
For the network dynamics, we consider the short range coupling from Experiment 1 given by the Laplace-transformed -path Laplacian (7), with coupling between nodes proportional to , . The coupling strength is fixed to be for and for . In Section 6.3.1 we compare the resulting dynamics to a long range coupling proportional to , with the Mellin-transformed -path Laplacian (6).
In the current experiment, the distance between the sinks and sources also leads to a delay; particles appear in the node and have to diffuse to find the sink to hop to another node. Coupled with the exo-dynamics, the delay leads to small density oscillations between neighboring nodes. For clearer illustration in Figs. 10, 11, 14 and 13 we only consider the odd nodes of the metaplex.
Fig. 9a shows the deviation of the density in node 1 from equilibrium, corresponding to Fig. 7 in Experiment 1. Similar to Experiment 1, superdiffusion inside the small nodes slows down equilibration. However, the evolution in time of the total density in nodes is depicted in Fig. 10, at times . One observes that superdiffusion in the nodes allows particles to reach distant nodes more efficiently than approximately normal diffusion . This confirms the interpretation in Section 4. The case in Fig. 10 exhibits similar dynamics as in Experiment 1, where equilibrates the metaplex’s density faster on long time scales.
We conclude that particles undergoing approximately normal diffusion () are slower, but more precise. Superdiffusing particles () explore the metaplex faster, but take more time to equilibrate the density across the whole metaplex. Similar observations have been made in [44], where the targeting efficiency of E. coli bacteria was studied in simulations. They observed that bacteria with higher motility, following a superdiffusion process, found targets faster, but were also at risk of moving rapidly away from the target due to the nature of their Lévy walk. Individuals with lower motility were slower but more precise.
The following figures compare these conclusions to those obtained for a network of big nodes .
In Fig. 9b we observe that superdiffusion inside big nodes speeds up the equilibration of the densities considerably: For particles require a much smaller time to reach their distant target, the sink, than for . This is in agreement with the discussion in Section 4.1.
In Fig. 11 we plot the density as a function of the node, in a log-log plot at times . Note that because of the large distance between sources and sinks for nodes , the time scale to approach equilibrium increases significantly. We observe that superdiffusion inside the nodes accelerates the equilibration over the whole metaplex in all cases, unlike for the small nodes (Fig. 10). For in Fig. 11 we observe the accelerated diffusion clearly, with a density distribution which is far from a Gaussian parabola in the log-log plot.
6.3.1 Metaplex superdiffusion
From the discussion of Experiments 1 and 2 so far, we conclude that for the short ranged network diffusion (7), proportional to , superdiffusion in the nodes can accelerate the equilibration in the metaplex, but it cannot lead to global superdiffusion. This is in line with the discussion in Section 5. We now consider a long ranged network coupling proportional to , given by the Mellin-transformed -path Laplacian (6) for and .
In the case of this linear metaplex we count with the advantage that previous analytic results exists for the diffusion on its exo-skeleton using the -path Laplacians [19]. In this case it was proved analytically that the use of the Mellin transform may produce superdiffusive regime in an infinite linear chain of nodes for .
As in Fig. 11, Fig. 13 plots the density at times as a function of the node of the network in a log-log plot. The linear decay of the density and the peaked behaviour at node 1 indicate superdiffusion irrespective of the internal dynamics. Because of the strong network diffusion, for the big nodes the structure of the nodes proves irrelevant to the metaplex dynamics.
In Fig. 14 we exhibit the absence of superdiffusion for large Mellin exponent and : The density distribution recovers a Gaussian shape, characteristic of normal diffusion, as is clearly visible for longer times. Note that for the illustration of the Gaussian shape we have symmetrically reflected the network with respect to the -axis.
Finally, Fig. 12 shows the equilibration of the density in node 1 with time. It confirms the interplay of the nodal diffusion process and the size of the node, as observed for the short ranged network diffusion above in Fig. 9.
In closing, after all the analyses carried out in this section we can conclude that for the path graph and for given by the -path Laplacian (7), there exists such that for . In particular, superdiffusion is not possible for the considered internal diffusion .
In the case of the Mellin-transformed -Laplacian (6), the numerical results indicate that superdiffusion in the network may persist even for nodes with distant sinks and sources. While in general the range of Mellin exponents which allow superdiffusion may shrink, for certain experiments in the linear network we numerically recover superdiffusion for , as in absence of internal structure [22].
7 Real world metaplexes
In this section we study the diffusion in two real-world metaplexes of very distinctive type. The first, a landscape metaplex representing a fragmented forest from the south of Madagascar which shares some of the large-world properties of the linear metaplex in Section 6. A metaplex representing the cortical region of a macaque, used as a second example, illustrates the dominance of the endo-dynamics in an ultra small-world network.
Here we focus on the diffusive processes on both systems. The analogies between brain and ecological anomalous diffusion seem to be more than casual. Costa et al. [12] have coined the term “foraging brain” to refer to these similarities, and the connection between animal foraging and cognitive foraging has been considered by Hills [33] on an evolutionary basis.
In the following subsections we consider either small or big disks for all the nodes in the metaplex exactly as defined for the toy model. The goal of this is to analyze whether the size of the nodes have some influence on the global dynamics of the metaplex. Thus, we can consider that and are average sizes of the regions in the corresponding metaplex, such average is either relatively small or big. The coupling strength is given by for the small nodes , and for the big nodes . The nature of the coupling, as for the toy model in Section 6, is considered to be long ranged, proportional to according to the Mellin transformed -path Laplacian Eq. 6. The results for the short range coupling can be found in the Supplementary Material (Note 4).
For the landscape metaplex we discretize each node using a finite element method with 95 degrees of freedom, while for the metaplex of the cortical regions of a macaque we use a mesh of 347 degrees of freedom
The study of real-world metaplexes imposes some limits to the models in use which were not needed for the idealistic toy model studied before. The first is that the consideration of a unique source and sink at the centre of each node seems unreasonable. For both cases, the landscape and the visual cortex, we consider spatial regions which can be connected to each other by disjoint sources and sinks as in Figure 5b.
7.1 Landscape metaplex
The first example considered represents a landscape in the south of Madagascar that has been fragmented into patches, corresponding to the nodes of a metaplex, as a result of agricultural activity [6]. These patches are connected by 529 narrow corridors that creates the exo-structure of the metaplex. Such patches are vital for the survival of the ecosystem because they are now the main habitat for the Lemur catta, who plays a fundamental role as a major seeds propagator in this environment [5, 21].
Here we assume that all the patches have the same geometry. The network has relatively low edge density – number of edges divided by the maximum possible number of edges – with about 45% of nodes with degrees 2 and 3, and only two nodes with degree 16. The average separation between two patches in terms of the shortest path distance is approximately with at least one pair of patches separated at . The average degree of the patches is approximately and the maximum number of nearest neighbors that a patch has is .
Also, we can observe that most of the hubs – high degree nodes – are clumped together in a certain region of the landscape (see Figure 15a), while the low degree nodes are relatively spread across the landscape. Consequently, we have initialized the diffusive process by placing the initial condition either into a randomly selected hub or into a randomly selected low-degree node.
The next experiment allows us to investigate whether the degree of the node at which the diffusion starts makes an important influence on the global metaplex diffusion.
In Figure 16 we plot the density of the diffusive particle as a function of the shortest path distance from the initial condition when the diffusion starts at a low (Figure 16a) or at a high (Figure 16b) degree node. Here we averaged all the densities for nodes at exactly the same shortest path distance from the initial condition where three different nodes with high (resp. low) connectivity where chosen to initialize the process. We observe that there are no significant differences between Figure 16a and Figure 16b. Only when there are some differences between the process initiated at low and at high degree nodes. In this particular case, it seems that when the process starts at a low degree node the density at nodes close to the initial condition shares more concentration than those more distant from it. This localization effect can be the consequence not of the degree of the node but of the relative geographic isolation that such nodes can display in this landscape. That is, one low-degree node is essentially surrounded by other low-degree nodes (see Figure 15a). However, in all the other cases it is important to remark that the profiles of the density at different distances from the initial conditions are almost exactly the same for processes starting at low or high degree nodes. Consequently, we conclude that in this metaplex the place at which the diffusion is initiated is not relevant for the evolution of the global process. Therefore, in the rest of this section we discuss the results for the process started from low-degree nodes.
We now explore the influence of the geometry of the nodes. In Figure 17 we plot the change of the density for nodes at different shortest path distances from the initial condition, for a small (Figure 17a) and big node (Figure 17b) using the same value of . The first clear observation from these plots is the following. When the nodes are small, superdiffusion inside the nodes slows down the rate to the equilibration of the diffusion in the metaplex (notice that crosses are over the circles in Figure 17a). However, when the nodes are big, the reverse occurs, and relatively high values of slow down the equilibration of the diffusion in the metaplex (the circles are over the crosses in Figure 17b.) The same results are reproduced when a much bigger value of is used, as can be seen in Figures 17c and 17d.
The reason for this apparently counterintuitive behavior has been previously discussed for the toy model: in a small node it is counterproductive to make long jumps inside the node. The reason is that the diffusive particle will rarely find the sink to escape from the node. In a similar fashion, inside a big node it is counterproductive to make small jumps as it will slow down the mobility of particles away from the source to reach the sink and leave the node. We again conclude that the size of the nodes influences the global dynamics of the metaplex. Also importantly, the nature of the internal structure can change significantly the rate of convergence of the process and can make it faster or slower depending of the size of the nodes and the nature of the diffusive process inside them.
Let us now consider the combined influence of the endo- and exo-dynamics on the global metaplex diffusion. We start here by considering the time evolution of the diffusive particle across the metaplex after initiating the process at a randomly selected node.
In Figure 18a we illustrate the time evolution of the density (in logarithmic scale) of the diffusive particle. In the left panel of Figure 18a we observe that the diffusion with converges to the steady state at an earlier time than that for when the same value of is used. The same is observed, even clearer, in the right panel where the process for and converges significantly faster to the steady state than that for and . See Table 1 for the values of the standard deviation introduced in Section 2.
Making the nodes bigger shows the same behaviour as discussed above. The slower dynamics, compared to the small nodes, (see Figure 18b) is expected from the fact that now the diffusive particle has more area to diffuse before finding the way out of the node. However, the most interesting observation is that now, as we have previously pointed out, the order of convergence rates is reversed. For the bigger node, the global diffusion equilibrates faster when we have superdiffusion inside the nodes than when (compare values in Table 1 for ). Similar results are observed for the case .
From Figure 18a we observe that varying and changes the rate of convergence of the diffusion in the metaplex. So we conclude that, although the landscape metaplex has a large-world exo-skeleton, it displays a trade-off between the exo- and endo-dynamics that determines the global convergence of the diffusion in the metaplex. It is neither the exo-structure nor the endo-structure alone, but a complex interrelation of both which controls the global dynamics in the metaplex.
7.2 Visual cortex metaplex of macaque
The second metaplex consists of 30 regions of the macaque visual cortex. These cortex regions are functionally connected by 190 edges, which makes the exo-structure of this system very dense, with density . As a consequence of this high edge density the network is a “ultra-small-world” with average shortest path distance between cortex regions of and a maximum separation between two of these regions of only steps. This makes the exo-skeleton of this metaplex a “ultra-small-world”. The average degree is approximately with a maximum number of connections at a given node is .
This network displays an almost uniform degree distribution, particularly for degrees between and . Therefore, we just pick at random the nodes to initiate the diffusion on the metaplex as most of the nodes are degree-equivalent. We then proceed with a similar analysis as for the case of the landscape metaplex by studying the effects of the endo- and exo-dynamics on the global diffusion.
When the nodes are small, Figure 19a, we observe the same effect as in the previous cases, namely that larger values of favor the convergence of the dynamics to the steady state (see Table 2 for the standard deviation values). The results for the big nodes ( Figure 19b) are similar as for the toy model and landscape metaplex, i.e., superdiffusion inside the nodes favors the convergence of the dynamics to the steady state.
For the macaque visual cortex metaplex the change of practically changes nothing in the global dynamics. For instance, we see from Figure 19a that keeping constant and dropping from 0.8 (blue lines in the left panel) to (black lines in the right panel) almost leaves unaffected the time evolution of the diffusion. The standard deviations at time units are in Table 2. We observe a similar behaviour for the case of big nodes (see Figure 19b).
These results are in clear contrast with the ones previously discussed for the landscape metaplex. In the previous case it was observed a trade-off between the exo- and endo-dynamics to control the global diffusion at the metaplexic scale. Here, the exo-dynamics does not play any significant role in the global dynamics of the metaplex. The factor which determines such global dynamics is the endo-structure of the nodes in the metaplex. The reasons for this extreme case of dependence of the global dynamics almost exclusively is two-fold. Firstly, the exo-skeleton of the macaque visual cortex analyzed here is an ultra-small-world, where long range hops are not possible. The second is the almost-complete nature of this exo-structure, i.e., its high density and uniformity of degree distribution. It is intuitively clear that in a complete network there are no topological effects that can affect the dynamics. In this case only the endo-dynamics has a significant influence on the metaplexic global dynamics.
Most real-world metaplexes are expected to have exo-structures which are not so dense and uniform as the one of the macaque visual cortex. Although they certainly display small-world properties, they show a larger variability of shortest path distances than the macaque cortex. Thus, it is expected that they display certain trade-off between the endo- and the exo-structures like the one observed here for the landscape metaplex in determining the global dynamics of the system.
8 Summary
The concept of metaplex introduced in this work allows to study the trade-off between the internal structure and dynamics of/in the nodes. Here we provide the basic notions and motivations for the study of metaplexes with continuous internal structure of the nodes and discrete inter-node dynamics. Additionally, we provide theoretical and computational support for a series of results related to the study of diffusive dynamics on metaplexes. In particular, we present examples in which the endo structure of the metaplex determines almost uniquely the global dynamics: in the macaque visual cortex the exo-structure plays no fundamental role. On the other hand, in the linear metaplex chain there is a trade-off between the endo- and exo-dynamics to determine the global diffusion. This is reflected in the Madagascar metaplex landscape. We have also studied here the effect of the geometry, such as the size of nodes, location of sink and sources, and the nature and strength of the coupling between nodes.
Our numerical results show that superdiffusion due to long range hopping in the linear network , as in [22], survives irrespective of the internal structure of the nodes (Figure 13). The parameter range of Mellin exponents for which superdiffusion is observed, , is the same as for ordinary networks of point nodes without internal structure. The conclusion extends to certain networks from applications, of a large diameter, here studied for the landscape network of habitats of L. catta (Figure 17). The combine influence of the endo- and exo-structure determined the global diffusion in such networks.
The endo-structure, on the other hand, dominates at shorter distances and therefore becomes crucial for diffusion in small-world metaplexes. This was illustrated for the cortical metaplex of the macaque, Figure 19. The effect of the internal dynamics in the whole metaplex strongly depends on the geometry of the nodes and the nature of the coupling. When sinks and sources overlap, internal superdiffusion may slow down the metaplex dynamics, and normal diffusion is faster on small scales. When sinks and sources are in separate, distant locations, superdiffusion in the nodes allows particles to explore the entire metaplex much faster than classical diffusion. While it accelerates diffusion, the internal superdiffusion cannot, by itself, induce superdiffusion in the metaplex.
Our results can be understood from the local description we provide of the distribution of particles inside each node. The combination of analytical methods for the PDE description in the node, and network methods for their interconnection in the exo-skeleton gives a new perspective not only on classical complex network descriptions, but also for the study of PDEs describing physical systems which can be either split into continuous regions interconnected in a discrete way or involve a network of internal degrees of freedom. This illustrates how the study of metaplexes will draw tools from a wide range of areas, such as the geometric analysis of coupled PDEs and interface problems, spectral theory of operator matrices, high-dimensional stochastic processes etc. Conversely, it suggests the relevance of network theory for old problems in these fields, such as the problem of finding effective descriptions of interacting many-particle systems with high-dimensional internal degrees of freedom.
From a computational point of view, numerical experiments for large metaplexes become a challenge, due to the new internal degrees of freedom in each node. For applications to real-world networks, future work should explore methods which represent this internal dynamics efficiently. Model order reduction or generalized finite element methods [52] are examples which have been used in related settings to achieve a reasonable accuracy already for small degrees of freedom.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Frederic Bartumeus, P Fernández, MGE da Luz, Jordi Catalan, Ricard V Solé, and Simon A Levin. Superdiffusion and encounter rates in diluted, low dimensional worlds. The European Physical Journal Special Topics , 157(1):157–166, 2008.
- 2[2] Jean Bertoin. Lévy Processes . Cambridge University Press, 1998.
- 3[3] Stefano Boccaletti, Ginestra Bianconi, Regino Criado, Charo I Del Genio, Jesús Gómez-Gardenes, Miguel Romance, Irene Sendia-Nadal, Zhen Wang, and Massimiliano Zanin. The structure and dynamics of multilayer networks. Physics Reports , 544(1):1–122, 2014.
- 4[4] Stefano Boccaletti, Vito Latora, Yamir Moreno, Martin Chávez, and D-U Hwang. Complex networks: Structure and dynamics. Physics Reports , 424(4-5):175–308, 2006.
- 5[5] Örjan Bodin and Jon Norberg. A network approach for analyzing spatially structured populations in fragmented landscape. Landscape Ecology , 22(1):31–44, 2007.
- 6[6] Örjan Bodin, Maria Tengö, Anna Norman, Jakob Lundberg, and Thomas Elmqvist. The value of small size: loss of forest patches and ecological thresholds in southern madagascar. Ecological applications , 16(2):440–451, 2006.
- 7[7] Jean-Philippe Bouchaud and Antoine Georges. Anomalous diffusion in disordered media: statistical mechanisms, models and physical applications. Physics reports , 195(4-5):127–293, 1990.
- 8[8] Ed Bullmore and Olaf Sporns. Complex brain networks: graph theoretical analysis of structural and functional systems. Nature Reviews Neuroscience , 10(3):186, 2009.
