An almost-solvable model of complex network dynamics
Qi Guo, Artur Sowa

TL;DR
This paper introduces RandLOE, a novel model for large multi-agent network dynamics combining deterministic laws and randomness, which allows for analytic study and stable simulation beyond traditional stochastic differential equations.
Contribution
The paper presents RandLOE, a new operator-based model for complex networks that extends the logistic equation framework and enables analysis of diverse dynamical behaviors.
Findings
RandLOE can simulate large networks efficiently.
The model exhibits cycles of expansion and contraction.
It provides a new analytical approach outside stochastic differential equations.
Abstract
We discuss a specific model, which we refer to as RandLOE, of a large multi-agent network whose dynamic is prescribed via a combination of deterministic local laws and random exogenous factors. The RandLOE approach lies outside the framework of Stochastic Differential Equations, but lends itself to analytic examination as well as to stable simulation even for relatively large networks. RandLOE is based on the logistic operator equation (LOE), which is a multidimensional dynamical system extending the classical logistic equation via an operator-algebraic interaction term. The network is defined by interpreting the LOE variable as an adjacency matrix of a complete graph. Depending on the choice of parameters, it can display a number of essentially distinct dynamical characteristics: e.g. cycles of expansion and contraction.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
An almost-solvable model of complex network dynamics
Qi Guo1, Artur Sowa1
1Department of Mathematics and Statistics, University of Saskatchewan
Abstract
We discuss a specific model, which we refer to as RandLOE, of a large multi-agent network whose dynamic is prescribed via a combination of deterministic local laws and random exogenous factors. The RandLOE approach lies outside the framework of Stochastic Differential Equations, but lends itself to analytic examination as well as to stable simulation even for relatively large networks.
RandLOE is based on the logistic operator equation (LOE), which is a multidimensional dynamical system extending the classical logistic equation via an operator-algebraic interaction term. The network is defined by interpreting the LOE variable as an adjacency matrix of a complete graph. Depending on the choice of parameters, it can display a number of essentially distinct dynamical characteristics: e.g. cycles of expansion and contraction.
Keywords: hierarchical complex networks, operator equations, multi-agent interactions, resolvents of random matrices
PACS numbers: 89.65.Gh, 89.75.Hc, 89.75.Fb
AMS classification: 60K35, 60H25, 60H35, 47B80, 47H40
I Introduction
Complex Network Theory (CNT) aspires to furnish a unifying quantitative foundation for a number of scientific disciplines, including Economics, Computer Science, Biology, and Social Sciences, (see e.g. Souma , Albert , Thiery , Girvan , or a review in Newman ). While there is no generally accepted standard definition of CNT, the following characterisation seems to capture much of the essence: “[CNT is a study of] networks whose structure is irregular, complex and dynamically evolving in time, with the main focus moving from the analysis of small networks to that of systems with thousands or millions of nodes, and with a renewed attention to the properties of networks of dynamical units”, Boccaletti . The emancipation of CNT from its graph-theoretic roots is most manifest in the character of new results, such as the discovery of a power-law governing random, large networks, such as the www, Faloutsos . Another distinctive feature of CNT is its emphasis on statistical properties as well as on various questions of control, stability, robustness, Albert , Tannenbaum , sensitivity of dynamics to network structure, Nishikawa , and on questions of epidemiological character, Pastor . New types of structures have been found to occur in real networks, such as the small-world structure, Watts , Amaral . These discoveries shed some light on the function of most complex systems, such as the human brain, Liu , Wu .
Our focus in this work is on quantitative analysis of network dynamics. There is a body of preexisting work in this direction, e.g. results on small-world networks of oscillators, Hong , or scale-free random networks, Barabasi . An alternative approach is via operator equations, particularly the logistic operator equation (LOE), Sowa2015interacting . While inspired by considerations from Quantum Statistical Mechanics, the LOE, and the related stochastic process, may be interpreted as prescribing complex network dynamics. Indeed, the LOE captures complex interactions in a hierarchical structure that is either pulled toward equilibrium or forced into a cyclical shift between expansion and contraction, while in both cases being perturbed by random exogenous forces. While, in principle, similar models could be formulated within the frame of Stochastic Differential Equations, computational simulation of such structures is prohibitively slow and inaccurate for a large number of variables. In contrast, the LOE is amenable to accurate simulation even for a relatively large size. That is due to the fact that the solutions are in large part determined by explicit, perfectly accurate, recursive schemas.
Our focus in this work is on new types of solutions of the LOE and the stochastic processes that they induce. One of the main observations is that a special (unimodal, i.e. non-hierarchical) case of such a process is, in fact, an Itô process, see Section II. In Section III we study a much more complex multimodal LOE, and provide an algorithmic description of the deterministic solutions. While in the seminal work, Sowa2015interacting , the multimodal hierarchy of modes (eigenvalues) scales as where are consecutive primes, in the present work it scales as , where are consecutive integers. In Section IV we outline some properties of the resulting stochastic process. We summarize in Section V by highlighting the network interpretation. The results presented here are mostly theoretical. However, many insights, not to mention the showcased graphs, grew out of numerical experiments, involving custom codes in MATLAB, also using a third-party package, NCSOStools , Python, Python , and Cytoscape, Cytoscape . Although this report is focused on theoretical aspects, we envision a number of real-life applications. In particular, this framework may be deployed toward valuation of futures associated with commercial networks that display significant interactivity and hierarchization. It may also be used toward analyses of the stability of such networks, opening toward applications in macroeconomics. The importance of complex networks approach to stability analysis has been highlighted in Battiston .
II The resolvent and the unimodal RandLOE
We fix a Hilbert space (generally complex, but alternatively real when so indicated) and an a basis (). Let be an operator. Recall, the resolvent of is defined111Note that another variant of the definition of the resolvent, namely , is also encountered in literature. as
[TABLE]
Let () be the eigenvalues of . It is well known, see Kato , that is a meromorphic matrix-valued function. Its only poles occur at points . Locally, say, around , the resolvent may be represented via the power series It seems less commonly known that the resolvent satisfies the following differential equation:
[TABLE]
Indeed, applying the product rule to one readily finds On the other hand, , hence (2). Equation (2) and its generalizations are the main focus of this work. We observe that for a smooth curve , where is a real parameter interpreted as time, (2) yields
[TABLE]
This equation furnishes a model for deterministic dynamic. It also induces a stochastic dynamic as follows: Assume that is a real Hilbert space, and let
[TABLE]
be a random matrix whose entries are mutually independent standard Wiener processes . We define a special (unimodal) case of the RandLOE as
[TABLE]
Next, we demonstrate that this is an Itô process. The proof requires the following observation:
Lemma II.1**.**
For an arbitrary -by- matrix and as in (4), we have
[TABLE]
where denotes the transpose of .
Proof.
Let , where are coefficients of . We have
[TABLE]
where we have used identity . ∎
The following is the main result of this section:
Theorem II.1**.**
* defined in (5) is an Itô process, and satisfies*
[TABLE]
Proof.
Note that the Itô lemma indicates the general fact that satisfies a stochastic differential equation; we only need to identify its form. To this end, we engage infinitesimal stochastic calculus. First, observe
[TABLE]
and
[TABLE]
Combining these identities we obtain
[TABLE]
where we have cancelled the term which has order . Next, observing we obtain
[TABLE]
At this stage we use a bootstrapping argument. Namely, the term has only the component, and that can only depend on the component of . Since the latter is , we obtain
[TABLE]
In light of (6) this is equivalent to (8). ∎
Stochastic process (5) is well defined as long as does not coincide with any of the eigenvalues of . This may be ensured for a considerable time interval by choosing the initial conditions in which is separated from all the eigenvalues of (which are all zero for the standard Wiener process) by considerable distance. However, other considerations may also affect the choice of curve . In particular, it is especially interesting to examine the paths and . In the first case the resolvent series may be interpreted as a Fourier series, and in the second as a generalized Dirichlet series. The first type of process is adequate to modelling phenomena that display some cyclicity, whereas the second type to phenomena that display damping in some charcteristic time period.
III LOE in a new regime
The special case of LOE given by (2) is characterized by unimodality, i.e. the diagonal solutions are scalar multiples of the identity; namely, for some parameter . We now turn attention to a multimodal LOE, which admits more complex diagonal solutions.
As before, we fix a Hilbert space with a distinguished basis . In this section, it may be either finite dimensional () or infinite-dimensional (), as well as complex or real. The multimodal LOE is defined as:
[TABLE]
The dependent variable is an analytic operator-valued function with . An elementary argument shows that the nontrivial222We do not consider the trivial vanishing solutions. diagonal solution is necessarily of the form
[TABLE]
where are arbitrary. The diagonal entries may be interpreted as eigenmodes of the system described by the dynamic (9).
Next, we wish to consider analytic solutions of (9) in full generality. In contrast to (2), we are not aware of the closed-form formula for solutions of this equation. Thus, we resort to a search for solutions in the form of a power series with matrix coefficients. The outcome is a recurrence formula for the coefficients, which characterizes such solutions, namely:
Theorem III.1**.**
Assume satisfies (9) and . Then for an arbitrary vector . Moreover:
- •
When (infinite-dimensional Hilbert space) we have for
[TABLE]
and vectors are arbitrary.
- •
When , formula (10) remains valid with the convention for all .
Proof.
First, we assume that the Hilbert space is infinite dimensional. Substituting the power series of into (15) and comparing coefficients we obtain
[TABLE]
For , this implies , i.e. need to be idempotent; in particular, , which we chose a priori, is admissible. Next, (11) yields
[TABLE]
Note that . In particular, the operator is invertible when restricted to the orthogonal complement of . This readily implies
[TABLE]
Next, when , (11) yields
[TABLE]
As before, we notice that . In particular, the operator is invertible when restricted to the orthogonal complement of . Moreover, the inverse of the restricted operator is given explicitly as
[TABLE]
Thus, is determined by all with , but only up to a term for an arbitrary vector . Namely, from (13) we obtain a recurrence formula in the form
[TABLE]
It follows from this formula and (12) by induction that the range of is a subspace of . Hence the formula simplifies to the form (10).
Finally, when the Hilbert space has finite dimension , the operators are invertible (in the entire space) for all . Thus, the above argument leading to the recurrence formula may be repeated verbatim, except that terms need to be set to zero when . This completes the proof. ∎
Remark 1**.**
Denote . The recurrence formula indicates that each is a polynomial in variables . Here are a few examples:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
The general formula is not given explicitly. However, we can summarize as follows:
[TABLE]
where are some constant coefficients. (We use the convention .) A direct induction argument based on (10) yields , so that the right hand side of (14) always contains the term .
We also note that the recurrence yields an upper bound on the growth of the operator norm of . Indeed, denoting , and using the subadditivity and submultiplicativity of the operator norm, we see that is bounded above by a polynomial in , e.g. one readily finds
We emphasize that we do not undertake here the problem of analytic continuation, or even convergence of the series , cf. Remark 2.
IV The multimodal RandLOE
In what follows we only consider the finite-dimensional -by- version of the LOE. We start by observing that choosing a path in the complex plane gives a deterministic dynamic equation for , namely
[TABLE]
We write for short. Note that for the special choice the diagonal modes are logistic curves and for , complex-valued logistic curves. In either case, the non-diagonal solutions are more interesting. The recurrence formula given in Theorem III.1 enables simulation of such solutions with nearly perfect accuracy. Recall, the singular value decomposition of an arbitrary matrix , namely:
[TABLE]
and both and are unitary. The singular values are the square roots of the eigenvalues of , where is the adjoint of . Fig. 1 illustrates the evolution of singular values of for the two highlighted curves.
Remark 2**.**
The numerical work relies on partial sums of the series for . Heuristic arguments and numerical experiments strongly point to series convergence when (for ) with an arbitrary and positive . We point out that the right-hand side of (15) is only locally Lipschitz continuous. Thus, based on ODE theory, solutions of the initial value problem are only guaranteed to exist locally in time; in other words, the possibility of finite time blowup is not excluded a priori. Matters are even more complicated as regards the series solutions that are our focus. Indeed, we have , which series is not a priori guaranteed to converge. Such convergence conundrums are characteristic of combinatorially complex symmetry-based calculations, Quantum Field Theory being another example.
We wish to consider a LOE-based stochastic process obtained by randomizing the exogenous variables in (10). Namely, let the exogenous variables be time-dependent in the form of mutually independent -dimensional Wiener processes, i.e.
[TABLE]
where are standard mutually independent Wiener processes. Formula (10) renders , , as time-dependent stochastic processes. Subsequently, this gives rise to the main stochastic process:
[TABLE]
We will refer to it as multimodal RandLOE. This random process is easy to simulate numerically by combining a simulation of (16), e.g. via the Karhunen-Loève method, with computation of via (10). An example of the evolution of the singular values of for the two highlighted curves is given in Fig. 2.
We would like to know if the multimodal RandLOE is also an Itô process, just as its unimodal counterpart (5)? What differentiates it from the special case is lack of a closed-form formula for . This may be more than a mere technicality. Indeed, the multimodal RandLOE seems to have a greater inherent complexity. Based on this observation, we venture a hypothesis that the general RandLOE is not an Itô process. At present this is an open problem.
In order to gain some additional insight into the nature of multimodal RandLOE we investigate its mean. This is somewhat akin to the mean field approach to network analysis, Barabasi . We observe the following:
Proposition IV.1**.**
Let be the coefficients of multimodal RandLOE. When is odd . For an even , is a diagonal matrix whose entries are polynomials in of degree .
Proof.
The proof relies essentially on Theorem III.1. As before, let where are as in (16). We invoke the well-known formula for the moments of a normally distributed variable:
[TABLE]
It follows that the only polynomials in that have a nonzero expected value are periodic with an even number of cycles. More precisely, these are of the form
[TABLE]
We readily obtain
[TABLE]
Note that if is even, then so is . We emphasize that all other polynomials have vanishing expectation. On the other hand, (10) implies
[TABLE]
It follows by induction that is a polynomial of degree in with , cf. (14). (18) implies in particular that is a diagonal matrix. In addition, only if is even. An inductive argument also shows that contains the term , which contributes a monomial of the highest possible degree . This completes the proof. ∎
Example 1**.**
Proceeding as in Remark 1 we present some computed examples333We have used a Matlab package NCSOStools and a custom Python code to accomplish this computation.:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Remark 3**.**
It is interesting to observe the analogous result for the unimodal RandLOE. Recall that the series coefficients in this case are , where is an -by- matrix whose entries are independent standard Wiener processes. It is easy to observe that for even, where is a constant. Also, when is odd. Thus, the expected values of coefficients in the unimodal case are monomials, contrasting with the nontrivial polynomials of the multimodal case. To our knowledge this by itself does not provide any clues as to whether the latter case is an Itô process or not.
V Summary: RandLOE as a complex network dynamics
A network is understood to be a complete graph. Its vertices represent the nodes, e.g. market players, internet servers, etc. Any pair of nodes are connected by two edges (arrows) with opposite orientations. The arrows represent exchange channels for transporting goods or information. In addition, each node is connected to itself via an un-oriented looping edge. All arrows and loops are assigned complex-valued weights, which change in time. The network dynamic is the time-evolution of the weights. The magnitude of the weights is interpreted as the capacity of their respective channels. The weights are allowed to take on complex values in order to incorporate interference effects, which may be synergetic (amplifying) or uncooperative (suppressing), depending on the temporal distribution of phases.
A network dynamics is then encoded by a time-dependent complex matrix , so that is the weight of the arrow from node to node , and is the weight of the loop at node . Although many particular scenarios could be considered, the LOE dynamic (15) has the advantage of being relatively simple. The choice of path and the choice of determine the character of dynamics, see Fig. 1. Note also that this type of dynamics factors to subalgebras, e.g. one may consider upper-triangular matrix solutions, etc.
In our interpretation, the deterministic LOE alone describes network evolution in the absence of external stimuli. We extended the model, introducing the multimodal RandLOE, in order to study evolution of networks stimulated by random exogenous factors. Samples of the resulting stochastic processes are given (via the singular values) in Fig. 2. Naturally, numerical simulations take into account only finitely many terms of the (theoretically defined) infinite series. We have not investigated the problem of convergence, as it presents a formidable challenge that deviates from the core goal of this work, cf. Remark 2. However, we are satisfied that the model is computationally stable.
Acknowledgments
We acknowledge helpful discussions while this work was underway with Professors Shahedul Khan, Raymond Spiteri, and FangXian Wu. We also acknowledge partial support of the BIT-UofS FLAGSHIP (a framework for scientific collaboration between the Beijing Institute of Technology and the University of Saskatchewan).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) R. Albert, H. Jeong, and A.-L. Barabási, Error and attack tolerance of complex networks , Nature 406 (2000), 378-382
- 2(2) L.A.N. Amaral, A. Scala, M. Barthelemy, and H.E. Stanley, Classes of small-world networks , PNAS 97 (2000), 11149–11152
- 3(3) A.-L. Barabási, R. Albert, and H. Jeong, Mean-field theory for scale-free random networks , Physica A: Statistical Mechanics and its Applications 272 (1999), 173–187
- 4(4) S. Battiston, J. D. Farmer, et al. (2016). Complexity Theory to Support Public Policy and Financial Regulation: Economic Policy Needs Network Analysis and Behavioral Modeling , Science 351 (6275), (2016), 818–819
- 5(5) S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D.-U. Hwang, Complex networks: Structure and dynamics , Physics Reports 424 (2006), 175–308
- 6(6) K. Cafuta, I. Klep, J. Povh, http://ncsostools.fis.unm.si/
- 7(7) M. Faloutsos, P. Faloutsos, and C. Faloutsos, On power-law relationships of the Internet topology , in: SIGCOMM ’99: Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, ACM SIGCOMM computer communication review 29 (1999), 251–262
- 8(8) M. Girvan and M.E. Newman, Community structure in social and biological networks , PNAS 99 (2002), 7821–7826
