Averaging principle for stochastic differential equations in the random periodic regime
Kenneth Uda

TL;DR
This paper establishes a stochastic averaging principle for non-autonomous SDEs with fast motions exhibiting random periodic solutions, addressing challenges in multi-scale stochastic systems with time-dependent dynamics.
Contribution
It introduces a novel approach combining Lyapunov methods, coupling, and Feller properties to prove ergodicity and averaging limits in time-periodic stochastic systems.
Findings
Proves ergodicity of time periodic measures for fast motions.
Identifies the averaging limit in non-autonomous stochastic systems.
Extends averaging principles to systems with random periodic solutions.
Abstract
We present the validity of stochastic averaging principle for non-autonomous slow-fast stochastic differential equations (SDEs) whose fast motions admit random periodic solutions. Our investigation is motivated by some problems arising from multi-scale stochastic dynamical systems, where configurations are time dependent due to nonlinearity of the underlying vector fields and the onset of time dependent random invariant sets. Averaging principle with respect to uniform ergodicity of the fast motion is no longer available in this scenario. Lyapunov second method together with synchronous coupling and strong Feller property of Markovian flows of SDEs are used to prove the ergodicity of time periodic measures of the fast motion on certain minimal Poincare section and consequently identify the averaging limit.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and financial applications · Stability and Controllability of Differential Equations · Quantum chaos and dynamical systems
Averaging principle for stochastic differential equations in the random periodic regime
Kenneth Uda
Department of Mathematics, University of Edinburgh, Scotland, UK
Abstract.
We present the validity of stochastic averaging principle for non-autonomous slow-fast stochastic differential equations (SDEs) whose fast motions admit random periodic solutions. Our investigation is motivated by some problems arising from multi-scale stochastic dynamical systems, where configurations are time dependent due to nonlinearity of the underlying vector fields and the onset of time dependent random invariant sets. Averaging principle with respect to uniform ergodicity of the fast motion is no longer available in this scenario. Lyapunov second method together with synchronous coupling and strong Feller property of Markovian flows of SDEs are used to prove the ergodicity of time periodic measures of the fast motion on certain minimal Poincaré section and consequently identify the averaging limit.
Keywords: Periodic measures; PS-ergodicity; random periodic solutions; stochastic averaging; Hömander’s Lie bracket conditions; strong Feller property.
Contents
1. Introduction, notations and setup
1.1. Introduction
Many nonlinear deterministic and stochastic dynamical models in science and engineering consist of motions at disperate spatiotemporal scales, giving rise to slow-fast systems. Multi-scale methods may be employed to analyse some of the desirable structures of these slow-fast motions in the long run. Multi-scale methods are well-established theoretical and computational techniques in nonlinear stochastic dynamical systems and related areas, its applications range from signal processing, climate dynamics, material science, mathematical finance, molecular dynamics, etc. Averaging principle is an important multi-scale technique, it suggests that the slow subsystem of a slow-fast system may be approximated by a simpler system obtained by averaging over the fast motion. The active usage of various averaging could be traced back to 18th century as a well-known approximation procedure in celestial mechanics, for example, in the study of perturbation of planetary motion from the periodic variation in the orbital elements. Rigorous results justifying averaging principle go back to series of papers by Krylov, Bogolyubov and Mitropol’skii (e.g.,[6]). Generalisation of averaging principle to chaotic and stochastic dynamical systems with important applications in science and engineering are among the most investigated problems in nonlinear dynamical systems and related areas (see e.g., [28, 18, 31, 44]). In probabilistic language, averaging principle is a variant of weak law of large numbers.
The primary objective of the present paper is to investigate averaging principle in the random dynamical systems (RDS) framework (e.g., [3, 31, 32, 33, 34, 44, 50]) for fully coupled slow-fast SDEs with time dependent vector fields. Our investigation stems from some problems arising from long time behaviour of stochastic dynamical systems, where dynamical configurations are time dependent due to the existence of time dependent random invariant sets. Models whose evolution rule are time dependent slow-fast SDEs are particularly natural in numerous applications and are speedily becoming cradle for the development new mathematical ideas. Two applicable examples are the following:
- •
Climate-weather interactions when diurnal cycle and seasonal cycle are taken into consideration and one has to encode the time dependent statistics of the fast variables (the weather) when making predictions (e.g., [7, 11, 37, 38]).
- •
Neuronal learning models, where the strength of neurons connections evolve at a slower rate to account for synaptic events (synaptic plasticity), leading to a time dependent slow-fast SDE (e.g, [19]), etc.
The study of these class of systems are important and challenging problems in modern applied mathematics. One of the technical challenges is to identify the right notion of convergence of the slow motion to the averaged motion. There are no many theoretical results in this direction, however, significant progress have been made over the last decade in the study of the long time behaviour of time dependent RDS (e.g., [15, 16, 17, 47, 48, 53, 54, 55, 57]). Based on these results, one can justify averaging principle for time dependent RDS once a suitable notion of ergodicity is known.
The purpose of ergodicity is to study invariant measures and related problems, it is one of the well studied problems in dynamical systems, stochastic analysis, statistical physics and related areas. Intuitively, ergodic dynamical system is the one that the behaviour of observables averaged over long time is the same as the behaviour of observables averaged over phase space. In RDS, ergodicity is the cornerstone in the study of long time behaviour (e.g., part II and III of [1] and references therein) and in particular, in the investigation of averaging. Various caveats of ergodicity such as uniform/unique or non-uniform ergodicity exist in the literature, depending on the mode of convergence and or existence of unique or several extremal invariant measure(s). Averaging principle for SDEs when the fast subsystem is independent of the slow variable holds true whenever the fast motion is uniform or unique ergodic (e.g., [28, 44, 18]). In general, uniform or unique ergodicity is not available in the fully coupled case and in particular, time dependent setting, so one has to resort to other form of ergodicity to identify the averaging limit. In the time dependent framework, some form of ergodicity like ergodicity on Poincaré sections (PS-ergodicity [17, 49]) or semi-uniform ergodicity (e.g, [46]) of the fast subsystem could be employed to identify the averaging limit. In this paper, we restrict ourselves to when the fast subsystem is SDE with time periodic forcing, then under some weak dissipative conditions, PS-ergodicity is proved and consequently, used to identify the averaging limit. Extra essential difficulty in our case is that we avoid some analytic assumption such as uniform ellipticity of the fast subsystem, at the expense of proving the existence of unique stable random periodic process and non-degeneracy of Malliavin covariance of solution flows under certain weak dissipative assumptions, restricted Hömander’s Lie bracket condition and Lyapunov second method.
Lyapunov second method is a powerful technique for the investigation of stability of solutions of nonlinear dynamical systems and control systems in finite and infinite dimensions. Its extension to random dynamical systems generated by SDEs is essentially due to Hasminskii (e.g., [27]). This method was explored further by X. Mao (e.g., [40]) and extended further by Schmalfuss in ([45]) to the case of nontrivial stationary solutions and random attractors. The method involves the study of random invariant sets without explicit knowledge of solutions of the system. The framework of Lyapunov second method is simple in the sense that its verification is based explicitly on the underlying vector fields without explicit representation of flows of solutions. Here, we employ Lyapunov second method together with synchronous coupling to prove the existence of unique stable random periodic solution and ergodicity of the corresponding periodic measures. These techniques are valid even when the drift of the SDE is only one-sided Lipschitz continuous. Importantly, it makes it easier to prove results in the narrow topology generated by the dual of the Markov evolutionary semigroup of the flows of SDEs.
The rest of the paper is organised as follows. In §1.2, we fix some revelant function spaces used in the paper and in §1.3, we formulate and describe the problem considered in the paper. The existence of random periodic solutions and ergodic periodic measures for fast subsystem are considered in §2. The validity of the averaging principle in the random periodic regime is proved in §3, and we conclude with a toy example arising from kinetic theories of turbulent flows.
1.2. Notations
Let be a complete separable metric space, we denote the set of bounded continuous real-valued functions by
[TABLE]
The set of bounded Lipschitz continuous real-valued functions is denoted by
[TABLE]
Let be a Borel measure space, we denote as the set of real-valued Lebesgue integrable functions defined by
[TABLE]
Let be a non-empty Borel measurable set, we shall most at times restrict the set of functions above on , for example, means , where
Definition 1.1** ([2, 36]).**
Let and
- (a)
Let , denote as the Fréchet space of functions which are continuously differentiable and -th derivative is -Hölder continuous, with the semi norms
[TABLE]
Here is a compact convex subset of and and
[TABLE]
- (b)
Let be the Banach space of the functions which are in the Fréchet space with the norm
[TABLE]
We endow the space with the norm
[TABLE]
Let be a complete probability space and we denote as the space of -measurable random variables such that equiped with the norm
We shall fix the probability space as the classical Wiener space, i.e., , is a linear subspace of continuous functions that take zero at , endowed with compact open topology defined via
[TABLE]
The sigma algebra is the Borel sigma algebra generated by open subsets of and is the Wiener measure, i.e., that the law of the process with
1.3. The averaging setup
We are concerned with the following slow-fast SDE
[TABLE]
where is the time scales separation between and . The vector fields and are such that and . Given this regularity of the vector fields, the solutions of the SDE (1.1) exist and generate stochastic flow of diffeomorphisms with (e.g., [14, 29, 35, 36]). We define the flow map by for almost all where is -dimensional Wiener space equiped with compact open topology.
If the flow reduces to where is the solution of the following fast subsystem with the slow variable frozen
[TABLE]
It is natural to think of the slow-fast SDE (1.1) as a perturbation of the parametrised SDE (1.2). In this way, the flow map describes idealised physical system where are fixed parameters, whereas the perturbed flow is describing real system with the evolution of the parameters taken into consideration.
In some previous works (e.g., [30, 5, 31, 32, 34, 50]), the validity of averaging principle for fully coupled ODEs and SDEs were investigated. The averaging principle for the fully coupled system is significantly different from the one when the fast motion is independent of the slow variables. The required assumptions in the fully coupled case depend on the specific class of systems and convergence of the slow motion to averaged motion is in a different sense (e.g., [18, 31, 42]). Consider the limit defined by
[TABLE]
For example, if is an ergodic invariant measure of the fast motion , then the limit (1.3) exists for -almost all due to ergodicity and it coincides with the following integral
[TABLE]
In the case, where the vector fields are independent of the fast flow defines a closed system, i.e., and in this case, one recovers the averaging principle proved long ago by Hasminskii ([28]). So the averaged vector field inherit the regularities of slow vector field thus, there exists a unique solution to the following averaged equation
[TABLE]
In this case, the averaging principle states (e.g., [28, 33]), for
[TABLE]
where .
If is autonomous but depend on the averaged vector field need not be continuous in let alone Lipschitz continuous; so the averaged equation (1.5) may admit infinitely many solutions or no solution at all. This is partly because in this case, the fast motions do not define a closed system, as may have different properties for different hence, no well-defined family of invariant measures Even in the rare case when is the same for all averaging in fully coupled system may not satisfy the limit (1.6), for example in the presence of resonance (e.g., [31, 42]). It is proved in (e.g.,[3, 30]) that if the convergence in (1.3) is uniform in and that any limit points in probability of as solves the averaged equation
[TABLE]
Note that the limit (1.3) is uniform with respect to if and only if the fast flow is uniquely ergodic, this occurs rather rarely and exclude some important models. In general, averaging in the fully coupled case requires different setup with stronger and specific assumptions (c.f. [31]). Precisely, it is noted in ([31, 33, 34]) that in the fully coupled case, it is useful to have necessary and sufficient conditions which ensure the following:
- Given that admit the disintegration with and then for 111 means that is a non-empty relative compact subset of . and and any
[TABLE]
The averaging principle in the form (1.8) was proved long ago by Anosov in the case when the fast subsystem satisfy Liouville property (see chapter 2 of [42]). It was later generalised by Kifer to the case when the fast subsystem is axiom A dynamical systems and to the case of Markovian SDEs ([31, 33, 34] and references therein).
In the present paper, the fast motion is time dependent, so ergodic invariant measures may not exist. However, if for example, the coefficients of the slow-fast SDE (1.1) are time periodic, quasi-periodic, uniform almost periodic or uniform almost automorphic, one may consider evolution system of probability measures (e.g., [10]) generated by the Markov evolution of the fast motion, i.e.,
[TABLE]
One can exploit the nice property of the above evolution system of probability measures with some dissipative conditions on the coefficients of the fast subsystem to identify the averaging limit. There are existing results in this time dependent case; for example, when the fast subsystem is time periodic and uniform elliptic was considered in (e.g., [51, 52]) and applied to investigate the long time behaviour of neuronal learning models in [19]. The case of uniform almost periodic fast subsystem was recently considered for stochastic reaction-diffusion equation in [9]. In this paper, we shall assume that the coefficients of the fast motion is periodic in time, i.e., exists such that , . Under this time periodicity and regularity of the vector fields it have been rigorously established in (e.g., [15, 16, 17, 47, 48, 49, 57]) that the SDE (1.2) admit random periodic solution (see §2.2). The law of the random periodic solution generate evolution system of probability measures and, in particular, periodic measures (see §2.3). Under some dissipative conditions on the fast SDE (1.2), we establish ergodicity of the periodic measures on certain minimal Poincaré section, we refer to this notion as PS-ergodicity of periodic measures as recently introduced in [17] (see §2.3).
A useful way to visualise PS-ergodic periodic measures is to lift the stochastic flow to the cylinder 222i.e., , with the homeomorphism . and obtain an autonomous stochastic flow of the form with the initial value The random periodic solution on then takes the form In this case, the slow-fast SDE on the extended phase space reads
[TABLE]
where is a one dimensional Brownian motion independent of the -dimensional Brownian motion . Apparently, this lifting does not reduce the complexity of the problem, but the SDE is now autonomous. In this way, under the regularity of the coefficients, the lifted slow-fast SDE (1.10) generate a Markovian RDS on the extended phase space (see [2], chapter 2 of [1] and references therein).
In addition to the PS-ergodicity of the periodic measures, it is important in this fully coupled case to prove that the branches of the periodic measures are Lipschitz continuous w.r.t. in the narrow topology of where is the union of minimal Poincaré sections (see §3.1). This Lipschitz property of periodic measures together with the regularity of the slow vector field would guarantee the existence of such that
[TABLE]
where
[TABLE]
and with . The local Lipschitz and boundedness property (1.11) would yield the existence of a unique solution to the averaged equation
[TABLE]
Finally, given the PS-ergodicity and Lipschitz dependence of the family , we are able to deduce averaging principle in the form of the limit (1.8) with the set replaced by minimal Poincaré section (see §3.2).
2. Random periodicity
In this section, we investigate the existence of unique stable random periodic solution and PS-ergodicity of periodic measures for Markovian RDS generated by some class of SDEs in finite dimensions. To facilitate our presentation, we first recall definitions of stochastic flows and RDS (see, e.g., [1, 2, 35, 36]) and random periodic solutions (see, e.g., [15, 16, 17, 57]).
2.1. Random periodic solutions
Definition 2.1** (Stochastic flow [35, 36]).**
Let be a smooth manifold and let be a random field defined on a complete probability space The map is called a stochastic flow of homeomorphism if there exists a null set such that for any the family of continuous maps is a flow of homeomorphism in the following sense:
- (i)
holds for any
- (ii)
, for all
- (iii)
the map is a homeomorphism for any .
The map is a stochastic flow of -diffeormorphism, if it is a homeomorphism and is -times continuously differentiable with respect to for all and the derivatives are continuous in
Let be the smallest sub -field of containing \cap_{\varepsilon>0}\sigma\big{(}\Xi_{u,v}:s-\varepsilon\leq u,v\leq t+\varepsilon\big{)} and all null sets of . Then the two parameter filtration is the filtration generated by the stochastic flow
Definition 2.2** (RDS [1, 2]).**
Let be a measurable space and be an ergodic flow of measurable transformations of a complete probability space a random dynamical system (RDS) over is a mapping such that
- (a)
is measurable,
- (b)
for all and
- (c)
(cocycle property),
- (d)
if is a topological space, then is continuous if is continuous,
- (e)
if is a manifold then is smooth of class if -times differentiable with respect to and the derivatives are continuous with respect to
Let be a -measurable flow defined by
[TABLE]
It is well known that the measurable flow is ergodic and defines a filtered metric dynamical system (e.g., [1, 2]). Furthermore, under suitable regularity of the coefficients of autonomous SDEs together with appropriate adoption of two-sided stochastic calculus, it is well known that the solutions of autonomous SDEs on finite dimensions generate RDS over (e.g., [1, 2, 14, 29, 36]).
Definition 2.3** (Random periodic solution for stochastic flows [15, 16, 57]).**
A random periodic solution of period of a stochastic flow is an -measurable function such that
[TABLE]
for any and where
Example 2.4**.**
Let consider the following SDE
[TABLE]
Assume that are continuous functions and there exists such that and with
[TABLE]
The stochastic flow generated by the SDE (2.2) is defined by
[TABLE]
and the process defined by
[TABLE]
is a random periodic solution of period .
Definition 2.5** (Random periodic solution for RDS [17, 57]).**
A random periodic path of period of an RDS is an -measurable function such that for almost all
[TABLE]
for .
Example 2.6** ([15, 16]).**
Let be a regular vector field and let be a deterministic flow generated by the ODE
[TABLE]
If is a periodic solution of the ODE (2.4) of period i.e.,
[TABLE]
Consider the stochastic process where solves the following time periodic forcing SDE
[TABLE]
where and If is a random periodic solution of the time periodic forcing SDE (2.5), then is a random periodic solution of the autonomous SDE
[TABLE]
2.2. Existence of stable random periodic solutions
Here, we present a version of a random periodic results in ([47, 49]). This result will be used to prove PS-ergodicity and Lipschitz dependence of periodic measures on parameters. As pointed in the introduction, the technique here is a variant of Hasminksii’s method for stability of solutions of SDEs (see, e.g., [27, 40, 45]). The central idea is to investigate the infinitesimal separation of trajectories via the average growth of a Lyapunov function along the two-point motions which leads to the existence of (pre)-fixed point via Arzelá–Ascoli like argument.
First, we fix and recall that the transition probability function induced by solutions of the SDE (1.2) is defined by
[TABLE]
The Markov evolution is defined by
[TABLE]
and for any probability measure on , the Markov dual is defined
[TABLE]
Next, the average growth of the function along the trajectory gives rise to the generator ,
[TABLE]
For we use Itô’s formula to write as
[TABLE]
Now, consider the difference between two solutions of the fast subsystem starting from two different initial values Here, we think of as a special case of coupling two copies of Itô process namely; so that . Then, by generalised Itô’s formula (Theorem 8.1 in [35]), the average growth of the function along the trajectory , yields the second order differential operator , defined by
[TABLE]
where \sigma(t,y)=(\sigma_{ik}(t,y))_{1\leqslant i,k\leqslant N},\quad D_{y}V=\Big{(}\frac{\partial V}{\partial y_{i}}\Big{)}_{1\leqslant i\leqslant N},\quad D_{y}^{2}V=\Big{(}\frac{\partial^{2}V}{\partial y_{i}\partial y_{j}}\Big{)}_{1\leqslant i,j\leqslant N}.
Finally, we return to the lifted fast subsystem on the cylinder
[TABLE]
where the vector fields are given by
[TABLE]
Throughout the remaining part of this section, we denote the stochastic flow generated by the lifted SDE (2.12) by
[TABLE]
In some places, we may skip the dependence on when it does not cause confusion.
Next, recall that the transition probability function in space-time takes the form
[TABLE]
In particular, the transition probability function and the Markov evolution (now Markov semigroup) on is defined for as
[TABLE]
The Markov dual on is
[TABLE]
With all the above notations in place, we present our result on the existence and uniqueness of stable random periodic solution on under the following assumptions.
Assumption 2.7**.**
In addition to the regularity and time periodicity of the coefficients of the fast subsystem, we suppose further that the following hold:
- There exists a function , -periodic in the time component such that and for all
[TABLE]
for with
[TABLE]
where .
Moreover, let be the lifted stochastic flow generated by the fast subsystem with the slow variable frozen such that
[TABLE]
Theorem 2.8** (Existence of stable random periodic path [47, 49]).**
Let be a stochastic flow generated by an SDE with the coefficients -periodic and continuously differentiable in time component satisfying assumptions 2.7. Then, there exist a unique -measurable and exponential stable random periodic process .
Proof. Our presentation is in two steps, in the first step, we show that is a Cauchy sequence in and converges exponentially fast, the uniqueness of the limit follows by cocycle property of on . The second step is to show via the cocylce property again and time periodicity of the coefficients of our SDE that the limit from the first step satisfies the definition of random periodic solution.
Step I: We investigate the separation of the trajectories and Let for some , following same construction as in [45], we set
[TABLE]
Notice that is -measurable and satisfies the condition (2.16), since the random variable satisfies the same condition (2.16). Denote and for We apply Itô’s formula (e.g., [35, 45]) on the logarithmic process , to obtain
[TABLE]
where
[TABLE]
Using a variant of Doob’s martingale inequality (c.f. Lemma 6.2 of [40], see also, [45]), we have
[TABLE]
Moreover, by the -preserving property of we obtain
[TABLE]
Next, we use conditions (2.14) and Borel Cantelli lemma, we have for
[TABLE]
Inequality (2.2) and conditions (2.14) together with the cocycle property of , lead to the following estimate
[TABLE]
As satisfies condition (2.16), there exist with , a random variable with such that for any and , there exists such that for
[TABLE]
Finally, the cocycle property of , leads to
[TABLE]
This implies that is a Cauchy sequence in Letting be the limit of this sequence, then by the cocycle property of i.e., , we have
[TABLE]
Next, observe that the random variable is -measurable and given the -preserving property of we can derive the same property by replacing by . Indeed, we have
[TABLE]
so that
[TABLE]
The continuity of the flow map for almost all and the equality (2.23), then for any with we have
[TABLE]
Finally, we show the exponential stability and the uniqueness of the limit For this, let be any two -measurable random variables, we deduce from (2.2) that
[TABLE]
exponentially fast, -a.s. In particular, take we obtain the exponential stability and the uniqueness of .
Step II: Now, it only remains to show the random periodicity of . We start by using that the coefficients of our SDE are -periodic in time, so that for
[TABLE]
On the other hand,
[TABLE]
Then by uniqueness of solution of our SDE and the -preserving property of the equations (2.2) and (2.27) lead to
[TABLE]
Now, we return to the lifted flow ,
[TABLE]
Define a projection map , . Next, from the limit (2.22) and the random periodic property in (2.28) together with the continuity of the projection , we have
[TABLE]
The continuity of the flow map for almost all and the equality (2.2), yield
[TABLE]
This implies that is a random periodic solution of the -periodic flow on (see Definition 2.3). Set for it is relative easy to verify that
[TABLE]
and (2.2) leads to
[TABLE]
This implies that is a random periodic solution of on and the uniqueness of the limit (2.22), gives us ∎
Remark 2.9**.**
In practise, the construction of Lyapunov function is not simple and depends on a specific problem. However, one can construct a polynomial Lyapunov function growing at infinity like , for a class of SDEs with coefficients satisfying the following dissipative conditions:
[TABLE]
such that
[TABLE]
where for some The function is defined by
[TABLE]
where is a Borel function defined by
[TABLE]
There are many important class of SDEs in theory and applications satisfying the above dissipative conditons (2.33) – (2.34). The existence and uniqueness of random periodic solution for a class of SDEs satisfying related conditions was proved in [47, 49].
2.3. Ergodic periodic measures on Poincaré sections
In this subsection, we discuss the ergodicity of the fast subsystem (2.12) in the random periodic regime. Many studies of invariant measures for Markovian RDS generated by SDEs are normally via stochastic analysis or dynamical systems perspectives (e.g., [1, 12]). From stochastic analysis perspective, invariant measures are investigated via Markov transition function, in this sense, ergodicity is based on the dynamics of Markov evolution. From dynamical description, one investigates random invariant probability measures whose conditional expectation with respect to a sub-algebra of has one-to-one correspondence with the invariant measure of the Markov evolution. Here, we are interested in capturing the ergodicity of transition probability function of random periodic solutions (the law of random periodic solutions). Ergodicity on Poincaré sections (PS-ergodcity) is a form of ergodicity suitable in this case. PS-ergodicity of stochastic dynamical systems was recently developed by Feng and Zhao [17], it gives a new perspective and a generalised form of Poincaré-Bendixson theorem for stochastic dynamical systems. We would like to argue that the random periodic measure of the fast subsystem (1.2) is PS-ergodic under Assumption 2.7 and restricted Hömander Lie bracket conditions.
We start with preparatory definitions leading to the presentation of our ergodicity result (Theorem 2.19).
Definition 2.10** (Periodic measure [17]).**
Let be a Polish space, a measure is called a periodic measure of period , on the phase space for the Markovian stochastic flow , if for , the following hold
[TABLE]
It is called a periodic measure with minimal period if is the smallest number such that (2.35) holds.
Let be a random periodic solution of the RDS . Consider a probability measure defined by
[TABLE]
Then the measure is -periodic as
[TABLE]
Moreover, as it was shown in [17], satisfies (2.35). Thus, the law of random periodic solution satisfies Definition (2.10).
Next, we define a Poincaré section for the lifted Markov semigroup on
Definition 2.11** (Poincaré section for lifted Markov semigroup [17]).**
The Borel subsets of are called Poincaré sections for the Markov semigroup on the cylinder , if
[TABLE]
Remark 2.12**.**
The choice of Poincaré section is not unique, for example and satisfy the definition of Poincaré section. However, the family is a minimal Poincaré section or -irreducible Poincaré section [17]. To see this, fix and any open set such that with , we have for all
[TABLE]
This implies that is not a Poincaré section for the Markov semigroup on the cylinder .
Let the periodic measure be given, we consider its time average over the interval defined by
[TABLE]
It is realtively easy to check that this time average measure is invariant under the Markov semigroup (see also [17]). Moreover, from the definition of random periodic solution (Definition 2.3) and -preserving property of we have for any
[TABLE]
This implies that the expected time spent in a Borel set by the random periodic path over a time interval of exactly one period at any time is independent of the starting point. More precisely, this leads to the notion of PS-ergodicity of periodic measures.
Definition 2.13** (PS-ergodicity [17]).**
A family of -periodic measures is said to be PS-ergodic if for each as an invariant measure of the Markov semigroup at the integral multiples of the period on the Poincaré section is ergodic.
Equivalently, a family of -periodic measures is PS-ergodic, if for any with the following holds
[TABLE]
The limit (2.40) is the Krylov-Bogolyubov scheme for periodic measures [17, 27].
Now, given the random periodic paths we want to show that is ergodic under the discrete Markov semigroup for fixed under the Assumption 2.7. Precisely, we want to prove the convergence of the Krylov–Bogolyubov scheme for periodic measures. To this end, we start with the following simple and useful Lemma.
Lemma 2.14**.**
Let be -periodic measures generated by the random periodic solutions of the SDE (2.12). If there exist and such that
[TABLE]
and for all ,
[TABLE]
Then,
[TABLE]
Proof. The proof is relatively straightforward, the idea is to employ density argument. For this, let be a closed set, take and let the sequence of functions be defined by
[TABLE]
where . Then,
[TABLE]
Consequently, for all we have
[TABLE]
This implies that , so that by (2.42) and as is invariant w.r.t. we have
[TABLE]
It then follows by covering lemma that for any with
[TABLE]
By the condition (2.41), there exist , such that
[TABLE]
leading to
[TABLE]
This gives the desired convergence. ∎
It is not very simple to verify the inequality (2.42), some non-degenerate conditions would be required. In fact, the sufficient condition for inequality (2.42) to hold is the strong Feller property of the Markov semigroup . Recall, that a Markov semigroup has strong Feller property, if for any , we have . Equivalently, a Markov semigroup has strong Feller property, if and only if
- (i)
is a Feller semigroup, i.e., and
- (ii)
the family is equicontinuous.
The first item follows from the existence of stochastic flows (e.g., [36, 27]) and the second item require non-degeneracy and certain integrability of Malliavin covariance of the flows of solutions of the fast motion . Intuitively, the strong Feller property states that for any nearby initial data and and any realisation of the past of the driving noise, it is possible to construct a coupling between two solutions and such that with a probability close to as one has for (e.g., [22, 24, 25]). As elucidated by Hairer, Mattingly and others (e.g., [22, 25, 26, 21]), one way of achieving such a coupling is via change of measure on driving process for one of the two solutions such that the noises and driving the solutions and respectively, are related by
[TABLE]
where is a control process that steers the solution towards the solution (cf., [26]). If one sets and look for controls of the form then as the random variable will induce a deformation onto the solution after time in the form of Malliavin derivative 333 see equation (2.47) below. of at in the direction of , i.e.,
[TABLE]
On the other hand, the effect of the perturbation of the initial condition by is given as the directional deriative of the solution at in the direction of , i.e.,
[TABLE]
As extensively discussed in [22] for a more general and highly degenerate infinite-dimensional stochastic dynamical systems, in order to prove strong Feller property, the main task is to find a control such that
[TABLE]
To be able to construct the above control process satisfying (2.44) with appropriate integrable condition, we impose the following restricted Hömander’s Lie bracket condition.
Assumption 2.15**.**
Let and for such that
[TABLE]
or equivalently, there exists such that for all we have
[TABLE]
where and is the Lie bracket between the vector fields and defined by
[TABLE]
The restricted Hömander brackets condition above generalises uniform ellipticity condition; this follows by noting that uniform ellipticity condition implies that for every point in the neigbhourhood of that the linear span of is the whole of
For convenience, we briefly recall derivation on the Wiener space , we refer interested reader to (e.g., [20, 24, 25, 39, 41, 43, 56] ) for accessible treatment. Let and let be a real separable Hilbert space. An -valued random variable will be called smooth if it admit the following representation
[TABLE]
where and
The derivative of a smooth random variable is a random variable taking values on the Hilbert space given by
[TABLE]
for each and
Observe that for any the random variable can be interpreted as the directional derivative
[TABLE]
where .
Moreover, to establish strong Feller property, the following preparatory lemmas would be useful. We skip the dependence on in the proofs to simplify notation.
Lemma 2.16**.**
Let and be stochastic flow generated by the lifted SDE (2.12) with the Jacobian matrix at . Then, for all and the following hold,
[TABLE]
where are constants depending on and their derivatives up to second order.
Moreover, there exist constants depending on the coefficients and their derivatives w.r.t up to second order such that
[TABLE]
where is the Malliavin covariance of the flow map , also defined for as follows
[TABLE]
Proof. First, use that and Gronwall’s inequality, for all and to obtain
[TABLE]
Let , then the Malliavin derivative of for is
[TABLE]
and for , we have In fact, the Malliavin derivative is simply the composition of the derivative flows starting from at time . So, by the regularity of the coefficients and Gronwall’s inequality on , one arrive at
[TABLE]
Integrating over , we have
[TABLE]
For the second assertion, we recall from (e.g., Proposition 5.2 in [23]) that the Malliavin derivative of the Jacobian matrix solves the following variational equation
[TABLE]
So that,
[TABLE]
It then follows that
[TABLE]
For the final assertion, by product rule of differentiation, we have
[TABLE]
So that
[TABLE]
In a similar fashion as in the first and second assertions, there exist constants depending on the coefficients and their derivatives up to second order, such that
[TABLE]
∎
Lemma 2.17**.**
Let for be -periodic in time. If the assumptions 2.7 and 2.15 are satisfied. Then, there exists such that
[TABLE]
for all where
Proof. To derive the first estimate, we notice that
[TABLE]
The restricted Hómander condition 2.15, implies there exists such that (e.g., [20, 43]),
[TABLE]
and since , we have
[TABLE]
Finally, substituting (2.53), 2.54) and (2.50) into (2.52), then for all , we have
[TABLE]
Now, we turn to the second estimate, we note that
[TABLE]
and
[TABLE]
We derive bound on as follows
[TABLE]
It remains to find bound for To this end, we have,
[TABLE]
Recall that the Fréchet derivative of a square matrix in the direction of is given by , so that by chain rule, we have
[TABLE]
and,
[TABLE]
Now, we apply Lemma 2.16 to obtain
[TABLE]
and,
[TABLE]
Substituting (2.3) and (2.61) into (2.59), we have
[TABLE]
Put the inequality (2.3) in (2.3), we have
[TABLE]
Next, we derive bound on as follows
[TABLE]
Finally, for , again, we use that the Fréchet derivative of a square matrix in the direction of is given by , we have
[TABLE]
We obtain the following estimate,
[TABLE]
Then, by Lemma 2.16, we have constants depending on the coefficients and their derivatives up to second order such that
[TABLE]
If we put the estimates (2.3), (2.3) and (2.3) into the inequality (2.3), and then subsitute into the double integral (2.3), we obtain the desired bound. ∎
With the above preparatory estimates at hand, we derive the strong Feller property of the Markov semigroup we shall skip the dependence on to simplify notation.
Proposition 2.18**.**
Let for be -periodic in time. If the assumptions 2.7 and 2.15 are satisfied. Then, there exists such that for with and , we have
[TABLE]
Proof. First, recall the Malliavin integration by part formula (e.g., [20, 24, 25, 39, 43, 4]) yield
[TABLE]
where for and . Note that need not be adapted to , however, one can interprete the stochastic integral (2.68) in the sense of Skorokhod (cf. [20]).
Next, since is dense in , we have such that
[TABLE]
for all convergence being uniform (e.g., [13]). On the other hand, the regularity of the coefficients and assumption 2.15 ensure the existence of a function such that . This implies that
[TABLE]
The equalities (2.69) and (2.3), yield (2.68) for all By Cauchy Schwartz inequality, we have
[TABLE]
Then by generalised Itô isometry (cf. [20, 43]) and Lemma 2.17, we have
[TABLE]
It follows from (2.71), that
[TABLE]
Finally, let and , by the mean value theorem, we have
[TABLE]
∎
Theorem 2.19**.**
Suppose that the coefficients of the SDE (1.2) are -periodic in time and satisfy Assumptions 2.7 and 2.15. Suppose further that
[TABLE]
then, for fix the family of periodic measures induced by the random periodic path is PS-ergodic.
Proof. The idea of the proof is to use the construction carried out in Theorem 2.8 to verify the conditions of Lemma 2.14. To this end, we skip the dependence on to simplify notation and divide the proof into three steps.
Step I: We show that for any and for the following inequality holds
[TABLE]
To derive this, set \alpha(t)=\exp\Big{(}-\int_{0}^{t}\lambda(r)ds\Big{)} and
[TABLE]
then, by Itô’s formula ([35, 36, 45]), we obtain
[TABLE]
This implies for
[TABLE]
We use that to obtain for ,
[TABLE]
Step II: In this step, we show that there exists such that for any the following inequality holds
[TABLE]
where H_{r}(k\tau)=\eta_{r}(k\tau)+\exp\Big{(}\frac{1}{2}\beta k\tau\Big{)} and
[TABLE]
To see this, recall a construction done in Theorem 2.8, precisely, equation (2.22) reads
[TABLE]
As then by equation (2.3) in step I, estimate (2.2) and triagngle inequality, we have
[TABLE]
where and are random variables appearing in (2.2). Now, set by the cocycle property of and step I again, we have
[TABLE]
Consequently, we have
[TABLE]
and using that , we obtain
[TABLE]
Finally, by the condition (2.72) together with the -preserving property of , we arrive at the required estimate (2.74).
Step III: In this step, we show that the conditions of Lemma 2.14 are satisfied. For this purpose, we use step II and invariance of w.r.t. the discrete Markov semigroup and for any to obtain
[TABLE]
i.e., there exists such that
[TABLE]
Finally, let be given. Setting in (2.75), we have by Proposition 2.18 and by the invariance of under the Markov semigroup we have
[TABLE]
where . It then follows that for any and
[TABLE]
this implies that there such that (2.42) holds. Then, by Lemma 2.14, we have the convergence of Krylov–Bogolyubov scheme for periodic measures.
∎
Remark 2.20**.**
The approach adopted in this subsection relies on the construct periodic measure from the random periodic path . It is also possible to construct random periodic paths given periodic measures. To see this, we proceed as in [17] and suppose that we are given the periodic measures of period for a Markovian RDS on Let the skew product flow be defined by
[TABLE]
Note that the two sided skew product in (2.76) is defined by running two independent Brownian motions and (e.g., [1, 36]). Set
[TABLE]
It is relatively straightforward to check that defines an RDS over the ergodic base dynamical system A random periodic path for the enlarged RDS is constructed as follows: for any
[TABLE]
Finally, the transition probability of is the same as and the law of is
[TABLE]
Note the resemblance of the process and the limit of the Cauchy sequence in equation (2.22) from Theorem 2.8, the major difference is that the construction involve different ergodic base dynamical system. Related idea was previously employed in [48] to construct stable random periodic solutions for a Markovian RDS on a cylinder .
3. Stochastic averaging in the random periodic regime
One of the difficulties in averaging for non-autonomous SDEs is to give a suitable notion of ergodic evolution system of probability measures. This issue has been resolved in subsection §2.3 for some class of SDEs with time periodic forcing. Having established the ergodicity of periodic measures for a class of systems satisfying the Assumptions 2.7 and 2.15, the proof of averaging principle will follow the same line of argument as in (e.g., [18, 28, 31, 42]) once we know the manner in which the PS-ergodic measures depend on the frozen slow variables . First, we deal with dependency of the PS-ergodic measures on the parameter in §3.1 and subsequently, identify the averaged equation. We prove an averaging principle in the random periodic regime in §3.2 and conclude with a toy example arising from kinetic theories of turbulent flows (e.g., [8]).
3.1. The averaged equation
A crucial step in averaging principle is to identify the averaged equation via the vector field of the slow motion and the ergodic measures of the fast subsystem. As the averaging framework considered in this paper is fully coupled, some degree of regularity of the invariant measures will be required. In fact, Lipschitz continuity with respect to the parameter is enough for our purpose. This Lipschitz property together with the regularity of the slow vector field would ensure the unique local solvability of the averaged equation. We employ similar argument as the one in §2.3 to prove Lipschitz dependence of periodic measures on parameters.
We recall the notion of Lipschitz continuity of probability measures in the sense of the narrow topology on Consider a real-valued function and the space of -Lipschitz functions defined by
[TABLE]
The space of -Lipschitz functions generate a narrow topology on (e.g., [12]) with the metric
[TABLE]
Definition 3.1** (Lipschitz continuity of probability measures).**
We say that a probability measure is Lipschitz continuous in the sense of narrow topology, if there exists a constant such that
[TABLE]
With the above notations in place, we have the following result on the Lipschitz dependence of PS-ergodic periodic measures on parameters.
Proposition 3.2**.**
Let be a non-empty relative compact subset of , i.e., and let be a family of periodic measures generated by the SDE (1.2) on with coefficients satifying Assumptions 2.7 and 2.15. Then, there exists such that for all we have
[TABLE]
Proof. Recall from the definition of periodic measure that for
[TABLE]
In particular, for any we have
[TABLE]
Next, by Step I in Theorem 2.19, i.e., equation (2.3) and the stability of random periodic solution, we have for any
[TABLE]
Integrating both sides of (3.3) over and dividing by the length of the interval, we obtain
[TABLE]
Finally, taking supremum of (3.4) over we arrive at the desired inequality
[TABLE]
∎
Now, given the ergodic property of periodic measures and Lipschitz dependence on parameter , we identify the averaged vector field from the slow vector filed . Importantly, we show that is regular enough to ensure local solvability of the corresponding averaged equation. The argument here is fairly straightforward, due to the regularity of the slow vector field and that of the periodic measures with respect to parameters Consider a vector field defined by
[TABLE]
where is a projection map, i.e.,
Proposition 3.3**.**
Let and let be a family of periodic measures generated by the fast SDE satisfying Assumptions 2.7 and 2.15. Then, the family of vector fields
[TABLE]
is -periodic. Moreover, there exists such that for all
[TABLE]
Proof. The periodicity part follows from the -periodicity of the periodic measure and the fact that is time independent. It only remains to prove the local Lipschitz and boundedness property (3.7). As , then by the mean value theorem and Lipschitz property of we have the existence such that for
[TABLE]
For the second assertion, since , there exists such that
[TABLE]
Now, consider the vector fields defined by
[TABLE]
It follows that is bounded Lipschitz continuous and for any , we have
[TABLE]
We use the inequality (3.8) and the moment bound on the periodic measures or random periodic solutions, i.e., equation (2.3), to obtain
[TABLE]
This implies that, for any and we can choose large enough such that
[TABLE]
So, we obtain
[TABLE]
Finally, since is arbitrary, we may take limit as to arrive at the required bound.
∎
3.2. The Averaging limit
In this subsection, we present an averaging result in the random periodic regime; we follow Hasminskii’s time discretisation scheme (e.g., [18, 28, 31]). The idea of the scheme is to decompose the time interval into subintervals of length , such that in each subinterval the slow variable is almost everywhere constant and the fast variable after appropriate rescaling is well captured by the long time behaviour of the one-point motion for fixed . First, we write the slow-fast SDE in the fast time scale as follows,
[TABLE]
where is a projection map. Next, we write as a union of subintervals and set as an auxillary process defined on each subinterval as follows (c.f. [18])
[TABLE]
where is the same Brownian path used in the definition of as a stochastic flow on
Next, we give some preparatory lemmas on how to choose the integer such that the interval spacing is not too small as PS-ergodicity need some time to occur.
Lemma 3.4** (c.f. [52]).**
Let . Then, there exists such that
[TABLE]
Proof. Let then there exists such that for any we have
[TABLE]
Next, we use Cauchy Schwartz inequality on the drift part and Itô isometry on the diffusion part to obtain
[TABLE]
By the regularity of then by the mean value theorem, there exist such that
[TABLE]
Next, by the regularity of , there exist such that
[TABLE]
so that
[TABLE]
Finally, by Gronwall lemma, we have the desired bound
[TABLE]
∎
We choose thanks to the above Lemma 3.4 (see, also [18, 31]). The next lemma deals with the interval spacing. We take and consider the solution of the equation
[TABLE]
Lemma 3.5**.**
Let and Assumptions 2.7 and 2.15 hold. Then, there exist constants such for any , we have
[TABLE]
for some mapping with
[TABLE]
and, for any
[TABLE]
Proof. We proceed as in the proof of Lemma 7.2 in [9] or as in the proof of Lemma 3.2 in [52], we have
[TABLE]
Next, by Markov property of , we have for
[TABLE]
By Cauchy-Schwartz inequality, we have
[TABLE]
Next, we estimate the integrand using the regularity of vector fields and PS-ergodicity of the fast motion (see §2.3), these yield the existence of such that
[TABLE]
Also, as there exists such that
[TABLE]
The inequality (3.12) together with PS-ergodicity of the fast variables yield
[TABLE]
We substitute the above estimates (3.2) and (3.13) into the integral (3.2) to obtain
[TABLE]
Finally, from Proposition 3.3, we see that the family of vector fields
[TABLE]
is -periodic, then by PS-ergodicity of the fast motion, we know that
[TABLE]
In view of this, we may define the mapping by
[TABLE]
∎
With the above preparatory lemmas and notations in place, we are ready to state and prove a stochastic averaging principle in the random periodic regime.
Theorem 3.6**.**
Assume that and . If for fixed the coefficients are time periodic and satisfy Assumptions 2.7 and 2.15. Moreover, if is such that each is a -irreducible Poincaré section, then
[TABLE]
where and
Proof.
We start by using the Lipschitz property of the averaged vector field to obtain
[TABLE]
and by Gronwall’s lemma, we have
[TABLE]
Next, from Lemmas 3.4 and 3.5, we can choose and set (see, also [18, 31]) and write the integral in RHS of the inequality (3.15) in the form
[TABLE]
Now, by the regularity of the vector field we have the existence of such that
[TABLE]
In a similar fashion, by the regularity of and that of averaged vector field , we obtain
[TABLE]
Given with we use (3.2) and (3.17) to obtain the following inequality (see also [31]),
[TABLE]
Recalling from the discretisation scheme that the slow motion is almost everywhere constant on each sub-interval of length then by Lemma 3.5, we have
[TABLE]
where
[TABLE]
Integrating both sides of (3.15) with respect to and taking note of (3.2) and (3.2), we have
[TABLE]
Taking limit as and recalling that as and in view of (3.19), the proof is complete. ∎
Example 3.7**.**
We consider the following time periodic forcing SDE in two dimensions with and .
[TABLE]
where and is a polynomial.
Proof. Here, the solution of fast subsystem can be written explicitly as
[TABLE]
and the random periodic solution of period is given by
[TABLE]
The lifted random periodic solution on the cylinder is
[TABLE]
The corresponding periodic measure is given by
[TABLE]
where
[TABLE]
and solves the Lyapunov equation .
Given the periodic measure , we calculate he averaged vector field as follows
[TABLE]
We compute the process as
[TABLE]
and the integral of over is
[TABLE]
Finally, the rescaled slow motion as , can be approximated by the ODE
[TABLE]
∎
4. Conclusions and future work
We proved a stochastic averaging principle for fully coupled SDEs with time periodic forcing. The ergodicity of evolution system of periodic probability measures on an irreducible Poincaré section is a key step to the identification and validity of the averaging limit. This key step is natural in applications like climate change studies and neural networks, for example, only the statistics and not a particular path of the weather (fast variables) are important in climate evolution (e.g., [3]).
Averaging is one of the important steps for climatological applications, but it does not give the whole applicable recipes required in climate change studies. Some moderate and large deviation results for the slow motion from averaged motion are required for sensitive and rare events analysis. It is possible to use our framework to develop large deviation results and fluctuation dissipation theorems (FDTs) (e.g., [7, 37, 38]), particularly important in climate and neuronal models governed by multi-scale SDEs with time periodic forcing, where usual detailed balance condition (symmetry of stationary measures) fails. We shall investigate this aspect in the future publications and hope to carry out Hasselmann’s program (e.g., [3, 5, 32]), i.e., approximation of slow subsystem by a nonlinear SDE where random fluctuations are taken into account, providing description for hopping of the slow variables (climate) between local basins of attractors/metastable states (extreme climate events).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. Arnold, Random Dynamical Systems, Springer, 1998.
- 2[2] L. Arnold and M. Scheutzow, Perfect cocycles through stochastic differential equations, Probability Theory and Related Fields Vol. 101 (1995), 65-88.
- 3[3] L. Arnold, Hasselmann’s program revisted: the analysis of stochasticity in deterministic climate models , Stochastic Climate Models: Progress in Probability, Vol. 49 (2001) , 141 – 157, Birkhäuser, Basel.
- 4[4] M. Arnaudon and A. Thalmaier, The differentiation of hypoelliptic diffusion semigroups , Illinois Journal of Mathematics, 54 (2010), 1285 – 1311.
- 5[5] V. Bakhtin and Y. Kifer, Diffusion approximation for slow motion in fully coupled averaging, Probability Theory and Related Fields, Vol. 129 (2004), 157 – 181.
- 6[6] N. N. Bogolyubov, Y. A. Mitropol’skii, Asymptotic methods in theory of nonlinear oscillations , Gordon and Breach, Delhi, 1961.
- 7[7] M. Branicki and A. J. Majda, Quantifying uncertainty for predictions with model error in non-Gaussian systems with intermittency , Nonlinearity, Vol. 25 (2012) 2543 – 2578.
- 8[8] F. Bouchet, T. Grafke, T. Tangarife and E. Vanden-Eijnden, Large deviations in fast-slow systems , Journal of Statistical Physics, Vol. 162 (2016), 793 – 812.
