Diffusion equations from master equations -- A discrete geometric approach --
Shin-itiro Goto, Hideitsu Hino

TL;DR
This paper reformulates continuous-time master equations in nonequilibrium statistical mechanics using discrete geometric methods, revealing their equivalence to diffusion equations and analyzing their spectral and convergence properties.
Contribution
It introduces a discrete geometric framework for master equations, establishing their connection to diffusion equations and providing new tools for analyzing their dynamics.
Findings
Master equations under detailed balance are equivalent to discrete diffusion equations.
The Laplacians in these diffusion equations are self-adjoint and have an isospectral property.
Convergence to equilibrium can be analyzed through the spectral properties of these Laplacians.
Abstract
In this paper, continuous-time master equations with finite states employed in nonequilibrium statistical mechanics are formulated in the language of discrete geometry. In this formulation, chains in algebraic topology are used, and master equations are described on graphs that consist of vertexes representing states and of directed edges representing transition matrices. It is then shown that master equations under the detailed balance conditions are equivalent to discrete diffusion equations, where the Laplacians are defined as self-adjoint operators with respect to introduced inner products. An isospectral property of these Laplacians is shown for non-zero eigenvalues, and its applications are given. The convergence to the equilibrium state is shown by analyzing this class of diffusion equations. In addition, a systematic way to derive closed dynamical systems for expectation values…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Diffusion equations from master equations
— A discrete geometric approach —
Shin-itiro GOTO and Hideitsu HINO
The Institute of Statistical Mathematics,
10-3 Midori-cho, Tachikawa, Tokyo 190-8562, Japan
Abstract
In this paper, continuous-time master equations with finite states employed in nonequilibrium statistical mechanics are formulated in the language of discrete geometry. In this formulation, chains in algebraic topology are used, and master equations are described on graphs that consist of vertexes representing states and of directed edges representing transition matrices. It is then shown that master equations under the detailed balance conditions are equivalent to discrete diffusion equations, where the Laplacians are defined as self-adjoint operators with respect to introduced inner products. An isospectral property of these Laplacians is shown for non-zero eigenvalues, and its applications are given. The convergence to the equilibrium state is shown by analyzing this class of diffusion equations. In addition, a systematic way to derive closed dynamical systems for expectation values is given. For the case that the detailed balance conditions are not imposed, master equations are expressed as a form of a continuity equation.
1 Introduction
Master equations are vital in the study of nonequilibrium statistical mechanics [1, 2, 3], since they are mathematically simple and show relaxation processes towards to equilibrium states under some conditions [4]. These equations describe the time evolution of probabilities, and they are first order differential or difference equations. In addition, these equations are used in Monte Carlo simulations [5]. Quantum mechanical case can be considered by extending classical systems [6]. Thus there have been a variety of applications in mathematical sciences, and its progress continues to attract attention in the literature [7, 8, 9, 10].
Algebraic topology and graph theory have been applied to a variety of sciences and mathematical engineering. Several topological approaches to master equations exist in the literature [11, 12, 13, 14, 15]. Not only master equations, but also random walks on lattices [16], electric circuits [17, 18, 19], and so on, have been studied from the viewpoint of algebraic topology. By introducing inner products for functions on graphs together with coboundary operator, one can define the adjoint of the coboundary operator, and Laplacians as self-adjoint operators [16]. Corresponding operators in the continuous case are useful as proven in the literature of functional analysis [20]. An amalgamation of these mathematical disciplines may be called discrete geometry. It is then of interest to explore how above-mentioned operators in discrete geometry can be used for master equations. Moreover, although discrete diffusion equations have been derived from master equations in some cases, the condition when such diffusion equations can be derived is not known. Since the knowledge of discrete diffusion equations has been accumulated, clarifying such a condition is expected to be fruitful for the study of master equations.
In this paper continuous-time master equations are formulated in terms of functions of chains, where states and transition matrices for master equations are described by chains used in algebraic topology. In particular, probability distribution function is regarded as a function of [math]-chain, and transition matrix a function of -chain, where a discrete state is expressed as a vertex or a [math]-chain. After introducing some inner products for functions on chains and current as a function on -chain, master equations are shown to be written in terms of the adjoint of the coboundary operator acting on the current:
Claim*.*
Master equations can be written as a form of a continuity equation (See Theorem 3.1 for details).
In addition, under the assumption that the detailed balance conditions hold, an equivalence between master equations and discrete diffusion equations is shown, where the Laplacians are constructed by choosing appropriate measures for inner products:
Claim*.*
Master equations under the detailed balance conditions are equivalent to discrete diffusion equations (See Theorem 3.2 for details).
By applying this statement, it is shown that probability distribution functions relax to the equilibrium state (See Corollary 3.1 and Proposition 3.2). Contrary to this, it is shown that discrete diffusion equations yield master equations (See Proposition 3.1). Meanwhile, an isospectral property for non-zero eigenvalues of these Laplacians is given (See Theorem 3.3), and this can be referred to as a supersymmetry [21]. With this supersymmetry dynamical systems for expectation variables are derived without any approximation (See Propositions 3.5— 3.8). Some inequalities are also derived (See Propositions 3.3 and 3.4).
These theorems, corollary, and so on should be compared with those in the existing literature. In the study of random walks on lattices, chains, functions and their Laplacians are also used [16]. In the literature the probability distribution functions are identified with functions on -chains, which is different to the present formalism. The differences appear since transition matrices are introduced for describing state transitions for the present study only. In contrast, similarities between the present study and existing studies appear due to the use of Laplacians. Laplacian is a self-adjoint operator with respect to an inner product, and brings several properties as well as the case of the standard Riemannian geometry.
The rest of this paper is organized as follows. In Section 2, some preliminaries are provided in order to keep this paper self-contained. They include boundary operators, inner products, and Laplacians. Most of such tools and notions have been described in Ref. [16], while others are invented in this paper. In Section 3, master equations are formulated as dynamical systems on graph, and the main claims of this paper and their consequences are provided. Namely, diffusion equations are derived by means of tools introduced in the previous section. Moreover, various inequalities and dynamical systems for expectation variables are derived. Section 4 summarizes this paper and discusses some future studies.
2 Preliminaries
Let be a directed graph with a vertex set and an edge set. Throughout this paper, every graph is finite (), connected, and allowed to have loop edges. In addition, an inverse edge is assumed to exist for each edge . However parallel edges that will be defined later are excluded from this contribution. Details of these assumptions are explained in Section 2.1.
2.1 Standard operators
In this subsection, most of notions and notations follow Ref. [16]. However, some variants are also introduced.
For a given edge , the inverse of , the terminus of , and the origin of are denoted by , , and , respectively, as follows:
[TABLE]
where has not been depicted in the left graph, and has not been depicted in the right graph above. Then, it follows that
[TABLE]
In this paper is assumed to exist for any edge . Thus, even is not depicted for a given , the existence of its inverse edge is assumed in this section. A loop edge is such that , and parallel edges are such that with and . Parallel edges are assumed not to exist in any graph in this paper.
Then one defines the groups of [math]-chains and -chains on a graph with coefficients
[TABLE]
respectively. Here denotes the sum over all in the sense that
[TABLE]
As an example, consider the graph with
[TABLE]
In this case, with some , an element of is expressed as
[TABLE]
Then with some , an element of is expressed as
[TABLE]
The spaces of functions on and are denoted by
[TABLE]
Elements of the subset of being dual to are referred to as [math]-cochains. Here the dual space of a linear space is, by definition, a linear space in general. Similarly, elements of the subset of being dual to are referred to as -cochains. The set is also denoted by in this paper. Note that with needs not be linear in , and that with needs not be linear in . The subsets and are defined by
[TABLE]
In what follows, and are often abbreviated as and , respectively. Similar abbreviations will be adopted.
The boundary operator is defined as
[TABLE]
and the linearity holds:
[TABLE]
The dual of the boundary operator, the coboundary operator, is defined by
[TABLE]
and the linearity holds:
[TABLE]
If is a [math]-cochain, then it follows that . For any loop edge , it follows from that . This is indeed an element belonging to , as shown below. For any and , one has that
[TABLE]
To define inner products,
[TABLE]
one introduces some measures. Let and be elements of and , such that
[TABLE]
and
[TABLE]
This is referred to as a reversible measure.
The following are inner products
[TABLE]
Associated with this set of inner products, one defines the adjoint of the coboundary operator . This is also referred to as co-derivative in this paper, which is explicitly written as
[TABLE]
where
[TABLE]
It follows from (3) that the linearity holds:
[TABLE]
Notice that the decomposition of the sum
[TABLE]
holds. To show examples of (4) and (5), consider the graph ,
[TABLE]
For all vertexes, (4) is expressed as
[TABLE]
and the sum (5) with is expressed as
[TABLE]
The operator is indeed the adjoint one of as shown below.
Lemma 2.1**.**
[TABLE]
Proof**.**
Straightforward calculations with (5) yield
[TABLE]
∎
Remark 2.1**.**
An operator analogous to in the continuous standard Riemannian geometry is referred to as divergence. Thus, can be referred to as *divergence * on graph [22]. This operator is denoted by
[TABLE]
The Laplacian acting on , , is defined as
[TABLE]
The explicit form of its action is obtained as follows. By putting for , one has
[TABLE]
Since and are linear operators, is also a linear operator:
[TABLE]
Moreover, it follows that
[TABLE]
To see a link between (8) and a well-known form of discrete Laplacian, choose and for all and , where is a constant. Then consider the graph
[TABLE]
where and have been omitted. For this graph, one has the well-known form:
[TABLE]
By taking the limit appropriately, one has the second derivative of . See Ref. [24] for another link between this Laplacian and the so-called adjacency operator.
The operator is self-adjoint as shown below.
Lemma 2.2**.**
[TABLE]
Proof**.**
It follows that
[TABLE]
∎
The Laplacian acting on , , is defined as
[TABLE]
This operator is self-adjoint as shown below.
Lemma 2.3**.**
[TABLE]
Proof**.**
It can be proven by straightforward calculations. To this end, we put and then it follows that
[TABLE]
∎
Most of the operators and their properties discussed so far are well-known [16]. By contrast, those discussed in the next subsection are not standard ones.
2.2 Operators for master equations
To discuss how to describe master equations in the language of discrete geometry, one first introduces
[TABLE]
Then, with a prescribed , one introduces
[TABLE]
The operator associated with is defined as
[TABLE]
and the linearity in holds:
[TABLE]
Condition in (10) is to guarantee the property for ,
[TABLE]
The above equality is verified as
[TABLE]
Remark 2.2**.**
In the case that is such that for any , one has that for any . The operator is an analogue of the one introduced in Ref. [23].
As well as the case for , one introduces an inner product on
[TABLE]
associated with a reversible measure . The value of the inner product is the same as (2):
[TABLE]
The inner product (12) should be notationally distinguished from (2), since (2) has been defined as . The inner product coincides with when for all . With (12), one introduces the co-derivative on , with such that
[TABLE]
Lemma 2.4**.**
For and , one has
[TABLE]
Proof**.**
Substituting
[TABLE]
into
[TABLE]
one has
[TABLE]
∎
Although the following operators will not be used in Section 3, the Laplacians are discussed for the sake of completeness. The Laplacian is defined as
[TABLE]
The explicit form of its action is obtained as follows. By putting for , one has
[TABLE]
This operator is self-adjoint:
[TABLE]
since
[TABLE]
In addition, the Laplacian is defined as
[TABLE]
This operator is self-adjoint:
[TABLE]
since
[TABLE]
3 Master equations
Master equations are used to model nonequilibrium time-development in various systems [4, 11], and they are written as
[TABLE]
where are discrete states, a probability distribution function of at time , a transition matrix that describes the transition rate from a state to another state . In addition, the set is chosen so that the conservation law holds, and is used to model physical process of a system under consideration. In this paper we focus on the case where does not depend on time. The equilibrium state at is denoted by . In what follows, these objects, , , and , are treated as given data. Although there are several closely related equations of (13), including backward master equations, discrete-time master equations, and so on [3], they are not addressed in this paper.
In this section, a graph formulation of master equations is shown in terms of objects developed in Section 2. Main claims of this paper and their consequences are then provided.
3.1 Graph formulation
Introduce a graph and associated with the given data and such that the following hold :
- •
For any , is an element of , that is, .
- •
Let be such that for with and .
- •
For any , its inverse exists, that is, . If does not exist, then let be such that .
Then, regard as follows :
- •
so that for any .
The master equations (13) can be written in terms of these graph terminologies as
[TABLE]
where
[TABLE]
The correspondence between (14) and (13) is obvious. Vertexes and in (14) correspond to states and in (13), and the first and second in (14) correspond to and in (13), respectively. Notice that the conservation law for (13) translates into for (14). By construction of the present graph formulation, (14) reduces further. Given an and , there exists , such that
[TABLE]
It then follows that and , from which
[TABLE]
Then (14) reduces to
[TABLE]
An example of this set of the procedures is given below.
Example 3.1**.**
(A two-state model). Consider the set of master equations whose total number of states is ,
[TABLE]
where is a positive constant. This set of equations can be represented in terms of the graph
[TABLE]
where the edge has been added such that exists. A consistency between this graph expression and the given set of master equations is verified as follows. Since ,, , , and , (15) yields
[TABLE]
and
[TABLE]
For completeness, the solution satisfying the conservation law for all is explicitly shown as
[TABLE]
where and are constants satisfying and .
In what follows, master equations are rewritten in the language discussed in Section 2. To this end, one defines and so that
[TABLE]
One verifies that immediately, and that is the summand in the right hand side of (15),
[TABLE]
and thus,
[TABLE]
The physical meaning of the case of for a given is that the probability flow or current is locally balanced. If the condition is satisfied for all , then one has
[TABLE]
This relation corresponds to Fick’s law of diffusion in continuous media [1].
To describe some measures, introduce
[TABLE]
In terms of these objects, one has the following:
Theorem 3.1**.**
*(Continuity equation as master equations).
Choose and to be*
[TABLE]
Then (15) is identical to
[TABLE]
Proof**.**
With the choices and , the co-derivative defined in (3) reduces to the one such that
[TABLE]
From this and (15), one has
[TABLE]
for any . Thus, the desired expression is obtained. ∎
It is worth mentioning that (18) is written as a form of a continuity equation in continuum mechanics
[TABLE]
where has been defined in (6). In continuum mechanics a continuity equation for a time-dependent scalar quantity with an associated current leads to a conservation law by integration over a spatial region. Correspondingly, the equivalent form (19) of (15) leads to a conserved law by summing over all states (See Remark 3.1). Besides, in the study of master equations the form similar to (19) is well-known in another formulation (See Refs. [14, 15] for example).
Theorem 3.1 deals with . By contrast, an equality on associated with the master equations is obtained from (18) as
[TABLE]
where has been defined in (9).
An example is shown below so that how introduced objects can be calculated from a given set of master equations, and that how (18) is applied.
Example 3.2**.**
(A one-way interaction model on a ring). Consider the set of master equations whose total number of states is ,
[TABLE]
where so that for all , and is a positive constant for each . This model expresses a class of the so-called one-step processes [4], and can be represented as the graph depicted as follows:
[TABLE]
In the graph above, there is no for a given . Introducing the edge set from such that there exists for all , one has the graph with depicted as
[TABLE]
To gain physical insight by analyzing a simple case, all the constants are assumed to be equal, which is denoted by . Then, to simplify the notation, is abbreviated to so that (21) is written as
[TABLE]
Introduce such that
[TABLE]
From (19), the divergence of at is expressed as
[TABLE]
For completeness, the solution satisfying the conservation law for all is shown. First, introduce the Fourier transform of with respect to as
[TABLE]
From this expression of , it is straightforward to show that
[TABLE]
Second, it follows that the Fourier transformed variables satisfy
[TABLE]
The solution to its initial value problem is immediately obtained as
[TABLE]
which contains the conservation law at ,
[TABLE]
Finally, the solution to the initial value problem in terms of the original variables is
[TABLE]
3.1.1 Expectation values
Much attention is devoted to expectation values with respect to in applications of master equations. To discuss such expectation values, one introduces that is to be summed over vertexes at fixed time. In this subsection, and are chosen as (17).
The expectation value of with respect to is denoted by
[TABLE]
which is written in terms of the inner product with (17) as
[TABLE]
From the master equations (18) and Lemma 2.1, the time-development of
[TABLE]
is described by
[TABLE]
Equivalently, it follows from (19) that
[TABLE]
Remark 3.1**.**
Combining the sum over vertexes at fixed time ,
[TABLE]
the identity
[TABLE]
and (23), one verifies that the derivative of with respect to time vanishes:
[TABLE]
where denotes derivative of with respect to time , .
Remark 3.2**.**
For with being constant, one has
[TABLE]
The inner product for and is . In the case where and that does not depend on time , one uses (20) to obtain
[TABLE]
3.2 Detailed balance conditions
Let be a prescribed probability distribution function so that
[TABLE]
Impose for any connected states and
[TABLE]
which are known as the detailed balance conditions [4, 11]. These conditions imply the following. When is a stationary solution of the master equations, , one has from (13) that
[TABLE]
If (24) holds, then (25) is satisfied. In this subsection (24) is assumed to hold.
These conditions are written in the graph theoretic language as
[TABLE]
and
[TABLE]
The later leads to
[TABLE]
if does not vanish for all . Thus, for any loop edge , and
[TABLE]
To seek a reversible measure incorporating (26), let be such that
[TABLE]
from which . Thus, this can be used for a reversible measure defining (2) if does not vanish.
The master equations (15) under the detailed balance conditions are written as
[TABLE]
This can be written in terms of , that is (11) with , as
[TABLE]
The above equations involve . In (28), there is no loop edge contribution since and for any loop edge , (See Remark 2.2). Although there is no self-adjoint operator in (28), there exists a way to express master equations in terms of a Laplacian, which is accomplished by a change of variables.
The following is the main theorem in this paper:
Theorem 3.2**.**
(Diffusion equations from master equations). Consider the master equation (15) in the case that
the prescribed stationary solution does not vanish, that is, , for all , and 2. 2.
the detailed balance conditions are satisfied, that is, satisfies (26).
Choose the measures and to be
[TABLE]
respectively. Then introduce such that
[TABLE]
where is a solution to the master equation (15). This function satisfies the diffusion equation
[TABLE]
where has been defined in (7).
Proof**.**
Substituting (30) into (27), and using the definition of the Laplacian (7), one can complete the proof. The details are as follows:
From (30) and (27), and , one has
[TABLE]
from which
[TABLE]
Since the action of the Laplacian (8) with (29) on is
[TABLE]
one obtains (31). ∎
Remark 3.3**.**
The explicit expression (32) reduces further. It follows from for that
[TABLE]
Remark 3.4**.**
The conservation law of the sum
[TABLE]
can be shown below. With (31), one can show
[TABLE]
Remark 3.5**.**
Theorem 3.2 and (8) indicate that (31) does not involve any loop edge. This property also holds for the equations written in terms of , (27).
Remark 3.6**.**
Since the diffusion equation (31) can be written as
[TABLE]
one has the form of continuity equation by introducing
[TABLE]
where has been defined in (6). For the case where the detailed balance conditions need not hold, but the conditions hold for all , Fick’s law (16) holds. Besides, in the present case, the corresponding Fick’s law is
[TABLE]
for all . Hence the current on is expressed as the difference between and as follows:
[TABLE]
The following is an example of how this formulation can be applied to a model studied in nonequilibrium statistical mechanics:
Example 3.3**.**
(Kinetic Ising model without spin-coupling, [25]). Let be a spin variable, and an equilibrium distribution of . Consider the master equations
[TABLE]
where the detailed balance condition is satisfied:
[TABLE]
This set of master equations induces and . This consists of and , where and . The and are such that
[TABLE]
Introduce such that
[TABLE]
With these variables and the detailed balance condition
[TABLE]
one has that
[TABLE]
from which
[TABLE]
This derived set of equations is consistent with (33).
Note that diffusion equations in Example 3.2 are not obtained by applying Theorem 3.2, since the detailed balance conditions are not satisfied.
To investigate the long-time behavior of the system (31), rewrite (31) as
[TABLE]
where has been defined such that
[TABLE]
The following Lemmas will be used:
Lemma 3.1**.**
The non-trivial solutions, , to the equations for any are , where is constant.
Proof**.**
For general , it follows that
[TABLE]
The equality holds only when . It implies that
[TABLE]
Since
[TABLE]
and the assumption that the graph is connected, the solution is with being constant. ∎
Lemma 3.1 states that the steady state for (31), , is . In other words, this forms a fixed point set for this system. The following describes the stability for :
Lemma 3.2**.**
The state is asymptotically stable for (37), where is constant.
Proof**.**
Introduce the dynamical system for ,
[TABLE]
where has been defined such that
[TABLE]
It immediately follows that
[TABLE]
where is the element of such that for any . This states that is a fixed point set for (38). The relation between (38) and (37) is as follows. If is a solution to (37), then is a solution to (38). This is due to
[TABLE]
On the contrary, if is a solution to (38), then is a solution to (37). This is due to
[TABLE]
Hence, the solution to (37) is obtained by with being a solution to (38).
Then define such that
[TABLE]
It immediately follows that for any , where is a solution to (38). In addition, one has that for any , since
[TABLE]
From these properties, is a Lyapunov function. Applying these statements to the Lyapunov stability theorem, one has that in the dynamical system (38) is asymptotically stable. This yields that is asymptotically stable for (37). ∎
Then one has the following from Theorem 3.2:
Corollary 3.1**.**
(Convergence of solutions to master equations).
[TABLE]
Proof**.**
It follows from Lemmas 3.1 and 3.2 that
[TABLE]
This and the normalization condition lead to
[TABLE]
Meanwhile, the conservation law (34) holds. Thus, the left hand side of the equation above is unity:
[TABLE]
Therefore,
[TABLE]
∎
It has been shown that discrete diffusion equations are derived from master equations under the conditions that the detailed balance conditions are satisfied. Its converse statement under these conditions also holds.
Proposition 3.1**.**
*(From diffusion equations to master equations). Let be a transition matrix, and an equilibrium distribution function. Assume that the detailed balance conditions (26) hold. Choose and so that and as in (29). Then, the diffusion equations (31) yield master equations. *
Proof**.**
Introduce the inner products (1) and (2). In addition, introduce that depends on such that . Then multiplying both sides of the diffusion equations by , one has
[TABLE]
With (26), the equations above can be written as
[TABLE]
This can also be written in terms of as
[TABLE]
∎
So far, basic statements of the system have been given. These include asymptotic behavior of the diffusion equations, Lemma 3.2. Furthermore, if the eigenvalues and eigenfunctions of the Laplacian are known, then an explicit solution for the initial value problem of the diffusion equations (31) can be obtained. Since the diffusion equations are linear, it is enough to consider the case where the solution space is a linear space of . Moreover, from Theorem 3.2, one has the equation on
[TABLE]
Since (39) is linear, eigenvalues and eigenfunctions of play roles. Thus in what follows and denote linear spaces. Then how to construct an explicit solution to the diffusion equations is argued below.
Let be a linear operator acting on a finite-dimensional vector space , and a non-zero number satisfying
[TABLE]
where is not [math]. Then and are referred to as an non-zero eigenvalue and its associated or corresponding eigenfunction, respectively. For a self-adjoint operator , it is known that all the eigenvalues are real, . In addition, if all the non-zero eigenvalues are positive, then is referred to as a positive operator. If with non-zero , then is referred to as the eigenfunction associated with the zero-eigenvalue.
Since the Laplacian is a linear operator acting on and is self-adjoint as shown in Lemma 2.2, one can discuss if is a positive operator or not. Then one has the following:
Lemma 3.3**.**
The negative of the Laplacian acting on , , is a positive operator.
Proof**.**
Let be a non-zero eigenvalue labeled by , and an associated eigenfunction of so that . Then it follows that
[TABLE]
for all . Applying the assumed conditions and to the obtained inequality , one concludes that . ∎
Remark 3.7**.**
Repeating similar arguments in the proof of Lemma 3.3, one has that all the eigenvalues of are negative or zero,
[TABLE]
where is the eigenfunction associated with for . For , denotes the eigenfunction associated with the zero-eigenvalue .
Moreover, given a self-adjoint operator acting on a linear space with an inner product , it is known that has an orthonormal basis consisting of eigenvectors of . By applying this, one has the decomposition
[TABLE]
where denotes a label for eigenfunction, the totality of labels for non-zero eigenfunctions, the real-valued function labeled by of , and the Kronecker delta, giving unity if and zero otherwise.
The normalized eigenfunction associated with the zero-eigenvalue is obtained as follows:
Lemma 3.4**.**
The normalized zero-eigenfunction is :
[TABLE]
Proof**.**
It follows that . Then, the normalization condition is verified as
[TABLE]
∎
To discuss properties of the zero-eigenfunction further, let be the space spanned by the zero-eigenfunction :
[TABLE]
Then, one has the following:
Lemma 3.5**.**
A normalized zero-eigenfunction in Lemma 3.4 is unique up to sign, and .
Proof**.**
First, is proved. The proof below is similar to the proof of Lemma 3.1.
For general , it follows that
[TABLE]
The equality holds only when . It implies for that
[TABLE]
Thus, for all ,
[TABLE]
or equivalently,
[TABLE]
Combining this equality and the assumption that the graph is connected, one has that
[TABLE]
where is constant. Thus , and the equality holds.
In general, given a non-zero vector, the normalized vector is uniquely determined up to sign. It follows from this uniqueness with that the normalized zero-eigenfunction is uniquely determined up to sign. ∎
The sign ambiguity in Lemma 3.5 is fixed when one constructs with the properties and for all and . Observe from Lemma 3.5 that the number of the elements of is calculated as .
With these Lemmas, the solution to (31), , is obtained as follows:
Proposition 3.2**.**
(Spectrum decomposition). Let be the totality of non-zero eigenvalues of , and that of the corresponding eigenfunctions. Then
[TABLE]
*is a solution to the diffusion equations (31) derived from the master equations. *
Proof**.**
From (40), it follows that
[TABLE]
With these equations and (31), one has
[TABLE]
from which . Taking into account Remark 3.7, one can write . Combining these arguments, one has
[TABLE]
Finally it follows from Corollary 3.1 that above is unity. This completes the proof. ∎
Notice that
[TABLE]
and
[TABLE]
An example of the spectrum decomposition of is given below.
Example 3.4**.**
(Eigen system for kinetic Ising model without spin-coupling). Consider Example 3.3. The matrix form of (36) is immediately obtained as
[TABLE]
Two eigenvalues of are obtained as
[TABLE]
Their orthonormal eigenfunctions are
[TABLE]
where
[TABLE]
The orthonormality is verified as
[TABLE]
where the normalization of and the detailed balance condition have been used. In Ref. [25], the equilibrium distribution and were chosen so that they depend on parameters and as
[TABLE]
The physical meaning of is a quantity that is proportional to the inverse temperature, and that of is a characteristic relaxation time. The non-zero eigenvalue and its corresponding eigenfunction for this case are
[TABLE]
Thus, the spectrum decomposition (41) is obtained as
[TABLE]
where
[TABLE]
with being an initial constant for the dynamical system .
So far eigenvalues and eigenfunctions of have been investigated. There exists a link between eigenvalues of and those of . To state this, notations are introduced as follows. Let be the totality of labels for non-zero eigenfunctions of , and the totalities of non-zero eigenvalues of and that of , respectively. Moreover, recall , from Lemma 3.5, and let
[TABLE]
[TABLE]
First, one has the following:
Lemma 3.6**.**
[TABLE]
Proof**.**
This proof can be split into two steps. First, is shown. Then, is shown. From these, one completes the proof.
(Proof of ): Take , i.e., . Then it follows that
[TABLE]
from which .
(Proof of ): Take , i.e., . Then it follows from
[TABLE]
that . Thus, .
These two steps yield . ∎
Similar to Lemma 3.6, one has the following:
Lemma 3.7**.**
[TABLE]
Proof**.**
A way to prove this is analogous to that of Lemma 3.6. ∎
Then one has the following property, referred to as supersymmetry [21]:
Theorem 3.3**.**
(Supersymmetry of Laplacians).
[TABLE]
Proof**.**
This proof can be split into two steps. First, is shown. Then, is shown. From these, one completes the proof.
( Proof of ): Assume that , . Then, . From this assumption and Lemma 3.6, it follows that . Since
[TABLE]
one has that for each . This yields that .
( Proof of ): Assume that , . Then, . From this assumption and Lemma 3.7, it follows that . Since
[TABLE]
one has that for each . This yields that .
These two steps yield the desired equality. ∎
Due to Theorem 3.3, non-zero eigenvalues and are not distinguished. In what follows they are denoted .
3.2.1 Expectation values
For the case where the detailed balance conditions are not imposed, how expectation values are described has been argued in Section 3.1.1. It is also of interest to formulate how expectation values are described for the case that the detailed balance conditions are satisfied. To establish such a formulation, a relation between an expectation value and the inner product on is shown first. Second, inequalities for sums involving over vertexes are shown. Then some identities for such sums are shown. Finally dynamical systems for expectation variables are constructed. In general, one of the most fundamental roles in statistical mechanics is to link properties of macroscopic quantities and microscopic dynamical systems. For the case that macroscopic quantities can be identified with expectation variables, and microscopic dynamical variables can be identified with master equations, the approaches shown below are expected to be employed in a wider class of systems.
The expectation value of is denoted by as in (22). This expectation value is written in terms of the inner product with (29) as
[TABLE]
where in (30) has been used. The time-development of
[TABLE]
for is then described by
[TABLE]
Equivalently, it follows from (35) that
[TABLE]
The H function or KL-divergence defined by
[TABLE]
plays a central role in information theory. It is known that [28]
[TABLE]
This can be proven in the present formulation as follows. The derivative of with respect to is written in terms of and as
[TABLE]
Then applying the inequality
[TABLE]
and (31), one has
[TABLE]
Finally from , one has the desired inequality:
[TABLE]
It is then of interest to explore similar inequalities for sums involving over vertexes. Define to be
[TABLE]
A significance of is discussed after showing the following Proposition:
Proposition 3.3**.**
(Inequality for ).
[TABLE]
Proof**.**
By applying the inequality
[TABLE]
to the equality
[TABLE]
one has
[TABLE]
∎
From (44), the quantity obeys an integral fluctuation theorem in the sense that [26],
[TABLE]
Fluctuation theorems hold in far from equilibrium states, and thus they are used as basic tools in the study of nonequilibrium statistical mechanics [27]. Note that Proposition 3.3 can be written as . Related to this, it is shown below how the time-dependence of is related to eigenvalues of the derived diffusion equations. To this end, define
[TABLE]
Then one has the following.
Proposition 3.4**.**
(Inequality for time-derivative of ).
[TABLE]
Proof**.**
Substituting the inequality
[TABLE]
[TABLE]
From this and (40), it follows that
[TABLE]
from which
[TABLE]
Since for (See Remark 3.7), one has that
[TABLE]
∎
To construct a dynamical system for an expectation variable with the spectrum decomposition, one starts with
[TABLE]
where (43) has been used. The right hand side of the equation above might not be written in terms of a function of
[TABLE]
For this reason, it is not obvious whether there exists a closed dynamical system for . Nevertheless, for some simple systems, such closed dynamical systems can be constructed from master equations. For example, one has the following:
Proposition 3.5**.**
(Dynamical system for master equations with a unique non-trivial eigenvalue). Consider the case where . In this case, one has the dynamical system on
[TABLE]
Proof**.**
Since , one has from (46) that
[TABLE]
and from (47) that
[TABLE]
Substituting the second equation into the first one, one completes the proof. ∎
The solution to (48) is obtained as
[TABLE]
It follows from this expression with that the equilibrium state for is indeed uniquely realized as :
[TABLE]
The following is an example associated with Proposition 3.5:
Example 3.5**.**
(Dynamical system for magnetization driven by kinetic Ising model). Consider Examples 3.3 and 3.4. In this analysis is abbreviated as . Choose to be
[TABLE]
The expectation variable of this is time-dependent magnetization, expressed as
[TABLE]
Its derivative with respect to is calculated, and that derivative can be expressed in terms of as
[TABLE]
Substituting into the equation above, one has the closed dynamical system for
[TABLE]
which is a dynamical system studied in Ref. [25].
There exist closed dynamical systems for expectation variables with some appropriately chosen . Such systems are given as follows:
Proposition 3.6**.**
(Dynamical systems for expectation variables 1). Consider the case where
[TABLE]
Then,
[TABLE]
follows the dynamical system
[TABLE]
Proof**.**
It follows from (42) and (40) that
[TABLE]
From this and (42), one has the closed form
[TABLE]
∎
To show how (49) is linked to another dynamical system in another scientific literature, it is shown below that the diffusion equations derived from master equations (31) are used to facilitate the derivation of a dynamical system discussed in information geometry. Here information geometry is a geometrization of mathematical statistics [29].
In the context of dynamical systems theory in information geometry, the dynamical system
[TABLE]
has been studied in [30, 31, 32, 33]. The variables in (50) correspond to the expectation values for an exponential family of probability distribution functions, are constants, and is the number of canonical parameters of the exponential family. In Ref. [31], (50) was constructed as a gradient flow by introducing the so-called divergence function. By contrast, how to establish (50) in terms of probability distribution functions obeying master equations has remained unclear.
Introduce a dynamical system that is slightly different from (50)
[TABLE]
with some scaled time variables . It is shown below how (49) is linked to (51).
Proposition 3.7**.**
The dynamical system (49) yields (51).
Proof**.**
First, introduce and so that
[TABLE]
from which
[TABLE]
Substituting this into (49), one has
[TABLE]
Second, introduce and constant so that
[TABLE]
The variable obeys
[TABLE]
This is (51) with being replaced with . ∎
Similar to Proposition 3.6, closed equations on are obtained as follows. Define for ,
[TABLE]
Differentiating this equation with respect to and using (39), one has
[TABLE]
Then one has the following:
Proposition 3.8**.**
*(Dynamical systems for expectation variables 2). Consider the case where *
[TABLE]
Then, one has the closed dynamical system
[TABLE]
Proof**.**
It follows from that
[TABLE]
∎
4 Conclusions
This paper offers a viewpoint that master equations employed in nonequilibrium statistical mechanics can be analyzed in discrete geometry. As the main theorem in this paper, when the detailed balance conditions are satisfied, master equations induce diffusion equations, where Laplacians are associated with chosen inner products. These diffusion equations can analytically be solved and then explicit solutions have been obtained. With the self-adjoint property of the Laplacians, the orthonormal decomposition of the solution and closed equations for expectation variables have been obtained. Furthermore, the coboundary operator and its adjoint enable us to simplify various calculations including expectation values, and to show the so-called supersymmetry for two classes of Laplacians. Moreover, to illustrate how to apply these, some examples have been shown.
The significance of this discrete geometric description of master equations is argued from a mathematical viewpoint as follows. Although various graph theoretic approaches to master equations exist in the literature, none of them have yielded reduced equations such as diffusion equations without any approximation. A crucial point of the derivation of the diffusion equations is to introduce freedom to choose weights defining inner products for functions on graphs. Here the introduction of weights, or equivalently the additional freedom, has been incorporated in discrete geometry [16], and has then induced wider classes of Laplacians on graphs whose eigenvalues are real due to the self-adjoint property. The usefulness of this self-adjoint property of Laplacians has been employed throughout this paper.
The significance of the present study is argued from a physical viewpoint as follows. Given master equations satisfying the detailed balance conditions, diffusion equations have been obtained by introducing new variables. Since diffusion equations are ubiquitous in physics, insight can be gained from the physical literature. For instance, such insight is to identify the time-development of master equations with how an ink is spread in a fluid. It is one of relaxation processes in nonequilibrium systems, and this time-development of master equations can be expressed as the sum of exponential decays with real decay rates. Thus, oscillatory behavior in time is not observed in the new variables. Meanwhile, inner products have been introduced by choosing measures in this paper. Choosing these measures has provided preferred or biased ways to describe the time-development of the master equations. Hence, other choices of measures could be suitable for master equations with other conditions. In addition, the use of inner products is similar to that in quantum mechanics [7]. This similarity is expected to be useful for introducing notions developed in quantum mechanics to the study of master equations. It should be mentioned that one of the most fundamental roles in statistical mechanics is to link properties of macroscopic quantities and microscopic dynamical systems. When macroscopic quantities can be identified with expectation variables, and microscopic dynamical variables can be identified with master equations, the approaches to construct dynamical systems for expectation variables shown in this paper are expected to be used in a wider class of systems.
There are numbers of extensions that follow from this study. One of them is to apply the present approach to quantum systems, chemical reactions, and economical systems. Another example is to consider the case where the detailed balance conditions are not satisfied [10]. Moreover, some infinite graph case and discrete-time case should be addressed, and their applications to mathematical engineering, including Monte-Carlo simulations, should be considered as future works.
Acknowledgments
S.G. was partially supported by JSPS (KAKENHI) Grant No. JP19K03635 and is also grateful to Shuhei MANO for fruitful discussions. H.H. was partially supported by JSPS (KAKENHI) Grant No. JP17H01793.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] R. Kubo, et Al, Statistical physics II , Springer (1991).
- 2[2] J. Krafter and I.M. Sokolov, First Steps in Random Walks: From Tools to Applications , Oxford University Press, (2011).
- 3[3] M.F. Weber and E. Frey, Rep. Prog. Phys., 80 , 046601, (2017).
- 4[4] N.G. Van Kampen, Stochastic Processes in Physics and Chemistry , 3rd edition, North Holland, (2007).
- 5[5] K. Binder, Rep. Prog. Phys., 60 , 487–599, (1997).
- 6[6] G. Lindblad, Commun. math. Phys. 48 , 119–130, (1976).
- 7[7] J. Baez and J.D. Biamonte, Quantum Techniques in Stochastic Mechanics , World Scientific, (2018).
- 8[8] S. Goto and H. Hino, Geometric Science of Information. GSI 2019 , Springer Lectures Notes in Computer Science (Springer, 2019), 11712 , 239–247.
