Existence of Noise Induced Order, a Computer Aided Proof
Stefano Galatolo, Maurizio Monge, Isaia Nisoli

TL;DR
This paper provides a rigorous computer-aided proof of Noise Induced Order in a chaotic chemical reaction model, demonstrating how increased noise amplitude can induce a transition from chaos to order.
Contribution
It introduces a novel computer-assisted method to rigorously prove the existence of Noise Induced Order in a specific dynamical system, with potential applicability to similar systems.
Findings
Proves the transition from chaos to order as noise increases.
Establishes Lipschitz continuity of the stationary measure under perturbations.
Shows Lyapunov exponent varies H"older continuously with noise amplitude.
Abstract
We prove the existence of Noise Induced Order in the Matsumoto-Tsuda model, where it was originally discovered in 1983 by numerical simulations. This is a model of the famous Belosouv-Zabotinsky reaction, a chaotic chemical reaction, and consists of a one dimensional random dynamical system with additive noise. The simulations showed that an increase in amplitude of the noise causes the Lyapunov exponent to decrease from positive to negative; we give a mathematical proof of the existence of this transition. The method we use relies on some computer aided estimates providing a certified approximation of the stationary measure in the norm. This is realized by explicit functional analytic estimates working together with an efficient algorithm. The method is general enough to be adapted to any piecewise differentiable dynamical system on the unit interval with additive noise. We…
| , noise size | a priori err. on measure | refined err. on measure | rig. estimate on Lypunov exponent | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Existence of Noise Induced Order, a Computer Aided Proof
Stefano Galatolo, Maurizio Monge, Isaia Nisoli
Dipartimento di Matematica, Universita di Pisa, Via Buonarroti 1, Pisa - Italy. Email: [email protected] Instituto de Matemática, Univ. Fed. do Rio de Janeiro, Av. Athos da Silveira Ramos 149, Bloco C Cidade Universitária, Rio de Janeiro - Ilha do Fundão - Brazil. Email: [email protected] Instituto de Matemática, Univ. Fed. do Rio de Janeiro, Av. Athos da Silveira Ramos 149, Bloco C Cidade Universitária, Rio de Janeiro - Ilha do Fundão - Brazil. Email: [email protected]
Abstract
We prove the existence of Noise Induced Order in the Matsumoto-Tsuda model, where it was originally discovered in 1983 by numerical simulations. This is a model of the famous Belosouv-Zabotinsky reaction, a chaotic chemical reaction, and consists of a one dimensional random dynamical system with additive noise. The simulations showed that an increase in amplitude of the noise causes the Lyapunov exponent to decrease from positive to negative; we give a mathematical proof of the existence of this transition. The method we use relies on some computer aided estimates providing a certified approximation of the stationary measure in the norm. This is realized by explicit functional analytic estimates working together with an efficient algorithm. The method is general enough to be adapted to any piecewise differentiable dynamical system on the unit interval with additive noise. We also prove that the stationary measure of the system varies in a Lipschitz way if the system is perturbed and that the Lyapunov exponent of the system varies in a Hölder way when the noise amplitude increases.
1 Introduction
The “Noise induced order” phenomenon was discovered in numerical simulations and experiments regarding systems modeled by a deterministic dynamics perturbed by noise. The somewhat surprising phenomenon emerging is that the system appears to be chaotic for very small noise intensity, but when the intensity increases the system begins to have a less and less chaotic behavior, passing from a positive Lyapunov exponent to a negative one. A similar behavior was also found for other indicators of chaos. This paper however will focus only on the Lyapunov exponent.
The phenomenon was first discovered by numerical simulations in [23] in a system related to the famous Belousov-Zhabotinsky reaction (see Figure 1) modeled by a one dimensional map perturbed by additive noise. Real experiments confirmed the existence of the phenomenon appearing in the model of the reaction (see [32], and also [31], [33], [34], [20], [10], [24], for some examples of related works).
Despite the impact that the discovery of such noise induced phenomena had in the nonlinear science and physical literature (more than 390 citations to [23] on Google Scholar at the moment of writing this paper) to the best of our knowledge there is no mathematical literature about Noise Induced Order or rigorous proofs of its actual existence in nontrivial systems.
The mathematical study of this phenomenon is difficult because in the deterministic part of the dynamics (see Figure 2) there is a coexistence of strongly expanding and strongly contracting regions and the prevalence of expanding or contracting behavior for typical orbits is a consequence of the global structure of the dynamics. We remark that this phenomenon is one dimensional and inherently nonlinear, thus mathematically not much related to the noise induced stabilization studied in [2] and following papers. With the help of some computer aided estimates we prove that the global structure of this random system, allows expansion to prevail when the noise amplitude is very small, but the appearance of quite a large noise allows the contraction to prevail.
Our approach is based on the fact that the presence of the noise simplifies the functional analytic properties of the transfer operator associated to the system, smoothing out fine resolution details, and making it well approximable by a finite resolution and finite dimensional one. This makes a computer aided proof possible, letting the computer manage the complexity of the deterministic part of the system at a finite resolution scale and understanding the global structure of the dynamics. However, the computational power required to perform these computations in a naive way is out of the range of current computers. This is true mostly for proving that the Lyapunov exponent is positive in some case of very small noise range. Indeed small noise corresponds to high resolution needed in the study of the system. Because of this we had to find some mathematical clever way to perform the needed estimates, using different functional spaces. This is the main part of the mathematical work contained in what follows and can be applied to many other dynamical systems perturbed by noise. The algorithm we develop in this work was indeed already used in [9] and [3] for the study of other dynamical systems with additive noise considered as models of certain phenomena in climate science and neuroscience.
It is known that naive computer simulations of chaotic systems may not be reliable in some case (see for example [7],[17],[15],[19],[16] for examples of misleading naive simulations and a general discussion on the problem). Beside the pure mathematical interest of a rigorously proved result and a rigorously certified estimate, the study of inherently reliable methods for the numerical study of chaotic dynamical systems is strongly motivated.
Overview of the results. In this work we consider the model of the Belousov-Zhabotinsky reaction studied in [23] (see also [36] for explanations on how the model can be deduced from the chemical mechanism of the BZ reaction). This is a random dynamical system: a deterministic map with additive noise at each iteration. The deterministic part of the dynamics in the model is driven by a map defined by
[TABLE]
where
[TABLE]
[TABLE]
[TABLE]
The graph of an example of is shown in Figure 2. Following the Inverval Arithmetics formalism we represent intervals in the real line by subscript and superscript describing the decimal expansion of lower and upper bounds for so that means that belongs to the interval . The choice of follow the one made in [23], adding some more precision (see Remark 4 for more details).
Remark 1**.**
The interval arithmetics and its certified numerical methods (see [29] for an introduction) allow to obtain rigorous results as output of the computer aided estimates. Our computer aided estimates are implemented in this framework. We used SAGE [26] and the validated numerics packages shipped with it. (The interval package is a binding to MPFI [25].) Part of the numerical linear algebra was done using OpenCL [28] running on Nvidia graphic cards.
At each iteration of the map a uniformly distributed noise perturbation with span of size is applied. Further details on the system are presented in Section 2.
In the paper we prove that when the noise size is contained in the interval where this random system has a unique ergodic absolutely continuous stationary measure (see Proposition 45) and consider the associated Lyapunov exponent
[TABLE]
We prove that the behaviour of in the system is similar to the one found by the numerical investigations of Matsumoto and Tsuda ([23]). In particular there is a transition from positive to negative exponent as the noise amplitude increases. We provide explicit examples of values for the noise amplitude having positive and negative Lyapunov exponent. In particular, the findings of the present work applied to the Belousov-Zhabotinsky model defined above allow to state the following
Theorem 2**.**
Let be the Lyapunov expontent of the system defined above111For every choice of the coefficients of 1 as in 2,3,4. with noise of size . For each is Hőlder continuous as a function of when ; furthermore for and it holds
- I1
the Lyapunov exponent , hence it is rigorously certified to be positive;
- I2
the Lyapunov exponent , hence it is rigorously certified to be negative.
Therefore, the system exibits Noise Induced Order.
We refer to Section 6 for the certified results proving the change of sign for the Lyapunov exponent, while we refer to Section 7 (see Corollary 42) for the Hőlder regularity of the Lyapunov exponent. In the paper, we estimate similarly the Lyapunov exponent for many other values of the noise size. The results are reported in Table 6 and described in Figure 4 by a graph.
The method of proof and certification of these results relies on the approximation of the stationary measure of the system up to a certified error in the norm222The computation of stationary measures for dynamical systems perturbed by noise was approached from different points of view in [18] where the convergence (without effective bounds on the approximation error) of an approximation scheme based on Fourier analysis was proved for certain classes of maps, and in [6], where the computability of the stationary measure up to a given error was considered in an abstract framework, giving bounds on the computational complexity of the problem. The rigorous computation of the stationary measure for expanding and contracting Iterated Function Systems is considered in [14].. Using this approximation we can compute the Lyapunov exponent of the system up to a small certified error. The methods used however are general enough to be applied to any system formed by piecewise differentiable maps of the interval perturbed by additive noise having a Bounded Variation distribution (see Sections 2 and 3.3 for a more detailed discussion).
Plan of the paper. In Section 2 we describe the systems under study and we introduce the technique we use for the approximation of the transfer operator. The techniques leading to the proof of Theorems 2 are explained in a sequence of settings of decreasing generality where the needed assumptions on the system are listed (see Settings 13, 18). In Section 3 we describe how to find an explicit bound on the approximation error for the computation of the stationary measure. In Subsection 3.3 we describe an efficient procedure which exploits information coming from a coarse knowledge of the stationary measure in a bootstrap argument. This procedure uses several technical lemmas estimating the variation of certain densities and the norms of certain operators; such lemmas are listed in Section 3 and proved in Section 9 to make reading easier. In Section 4 we show an efficient procedure (which is used in the main algorithm) for the estimation of the rate of contraction of a finite rank transfer operator, when applied to zero average measures. This is a quantitative measure of the rate of convergence to equilibrium of the system which is involved in the quantitative estimate of its stability under perturbation. This is important in the estimation of the approximation error. In Section 5 we show the estimates needed to compute the Lyapunov exponent of the system once we know the stationary measure. In Section 6 we apply all these techniques to the system described in Section 2, showing the results of our computer aided estimates, and proving the existence of noise induced order (and in particular, Theorem 2). In Section 7 we consider the stability of the stationary measure to changes in the system’s parameters and of the Lyapunov exponent on changes of the noise amplitude proving the Hőlder continuity. Section 8 contains some definitions and generalities about Random Dynamical Systems we include for completeness and to justify the correctness of the notion of Lyapunov exponent which is estimated in the paper.
Aknowledgements.
The authors thank Yuzuru Sato for the nice seminar where we learned about the existence of Noise Induced Order and further explanations, EU Marie-Curie IRSES “Brazilian-European partnership in Dynamical Systems” (FP7-PEOPLE-2012-IRSES 318999 BREUDS) for support during the research and The Abdus Salam International Centre for Theoretical Physics (ICTP) where the work started. I.N. was partially supported by CNPq, University of Uppsala and KAW grant 2013.0315. I. N. thanks UFRJ, CAPES (through the programs PROEX and the CAPES-STINT project ”Contemporary topics in non uniformly hyperbolic dynamics”). S.G. thanks Leverhulm Trust grant (IN-2014-021, “Statistical properties of non uniformly hyperbolic dynamical systems: computer assisted proofs and rigorous computation”) and GNAMPA/INDAM (“Stabilita e instabilita in sistemi con rumore, un approccio computer assistito.”)
2 The system and its transfer operator
In this section we describe more precisely the system which will be studied in the paper and the associated transfer operators. Basic notions on random dynamical systems, stationary measures and Lyapunov exponents we use in the paper are presented in Section 8.
A random dynamical system with additive noise on and reflecting boundary conditions is a random perturbation of a deterministic map, defined by
[TABLE]
where is a Borel measurable map and is an i.i.d. process distributed according to a probability density and is the ”reflecting boundaries sum” on defined as follows.
Definition 3**.**
Let be the piecewise linear map
[TABLE]
Let then
[TABLE]
where is the usual sum operator on . By this
In the following we will consider the case where the noise density is the rescaling of some Bounded Variation kernel with in the interval , hence
[TABLE]
(see Definition 19 for a recall on the definition of bounded variation.)
As described in the introduction, the model studied in the present paper is the one studied in [23]. We consider a random dynamical system with additive noise, as in (5) where is defined in (1). At each iteration of the map a uniformly distributed noise perturbation with span of size with reflecting boundaries is applied.
Remark 4**.**
The parameters defined below (1) have been computed using interval arithmetic, in the implementation of our algorithm they are represented by intervals. We explain the motivation for the choice of the parameters in [23]. The parameter is defined in a way to be nearby to a value for which , making continuous at . The exact value of giving the continuity can be computed in a closed form as:
[TABLE]
The parameter is defined similarly in a way so that , making continuous at . The value of such can be computed in a closed form as:
[TABLE]
The choice of the parameter in [23] is motivated by a parallel with the logistic map. Let us denote by the map as only the parameter varies; each has a repelling fixed point . In [23] this explicit value of is chosen as an approximation of the parameter value for which following the kneading sequence “RLLL”, i.e., a Misiurewicz condition. We computed a certified interval containing using a Newton Interval Method [29]. The interval enclosing is computed giving the result shown at (3).
In our computer assisted estimates we will hence consider the map given at (1) and uniform noise, however the mathematical treatment about approximation of stationary measures in Section 3 and following is more general. We start considering a general random dynamical system where is measurable and giving general results and estimates we then improve using more assumptions on the system (i.e. piecewise smooth) putting ourselves in different general settings which are stated precisely (see Settings 13, 18), to keep the exposition as clear and general as possible.
Remark 5**.**
The reflecting boundary condition at (5) is not influent when the noise amplitude is smaller than the parameter (as it will be for all the noise amplitudes considered in our computer aided proofs, see Table 6).
**The transfer operator. **We study the statistical properties of the dynamical systems with additive noise, as defined at 5 through the study of the properties of their associated transfer operators. Let us recall that a measurable map , induces a map
[TABLE]
where is the space of Borel signed measures on The associated map is defined in the following way: if then:
[TABLE]
In the literature, is also called the pushforward map associated to , sometime denoted by . It is a linear operator on the vector space and it is also called the transfer operator associated to . The space of measures with density in can be seen as a subspace of . If is nonsingular, can be considered as an operator .
The (annealed) transfer operator associated to the system with noise is given by the composition of the transfer operator and a reflecting boundary convolution operator (a suitable modification of the usual convolution), defined by
[TABLE]
where the “reflecting boundaries convolution” is defined similarly to the reflecting boundaries sum as
Definition 6**.**
Let . Let be the piecewise linear map defined at (6) and its associated pushforward map. We consider as the “reflecting boundary” version of .
Definition 7**.**
Let , . Let defined by and by . We define
[TABLE]
where stands for the usual convolution operator on .
This boundary reflecting convolution operator is regularizing, in particular if , and has properties similar to the usual convolution operator. For its basic properties see Subsection 3.3.1.
Definition 8**.**
The annealed transfer operator associated to a deterministic system with additive noise, as described at (5) is defined as
[TABLE]
Remark 9**.**
The annealed transfer operator is obtained by averaging the transfer operator over all the possible noise perturbations. We refer to Section 8 for some basic facts on this operator. In the following we will mainly consider as an operator . In the notation we emphasize the dependence of the operator on the amplitude of the noise.
Definition 10**.**
Let be a fixed probability measure for , i.e,
[TABLE]
we will call a stationary measure for the system with additive noise or an invariant measure for .
By the regularizing properties of the convolution by a Bounded Variation kernel, and standard compactness arguments it is easy to see that the transfer operator corresponding to a map with additive noise has at least one fixed point in (see [11], Lemma 23 for more details). Following [23] we will study the Lyapunov exponent of the system as varies. The Lyapunov exponent is defined as follows:
Definition 11**.**
The average Lyapunov exponent associated to noise size is
[TABLE]
When is ergodic the average Lyapunov exponent coincides almost everywhere with the pointwise Lyapunov exponent (see Section 8). As a byproduct of our computer aided estimates, using the results given in Section 4 and 7 we will prove that the systems considered are ergodic (see Proposition 45). This justifies the correctedness of the average Lyapunov exponent as an indicator of the behaviour of the system.
The Ulam Approximation. The main tool for the study of the behavior of (10) in this work is the rigorous approximation of the stationary measure . This is done by approximating by a finite dimensional operator . The fixed points of are then approximated by the ones of with a certified bound on the approximation error.
Let be a projection on a finite dimensional space defined in the following way: the space is discretized by a partition (with elements); the projection considered is defined by the conditional expectation
[TABLE]
where is the algebra associated to the partition
The approximated operator is then defined by finite element approach, composing with :
[TABLE]
The finite dimensional approximation of an operator based on the conditional expectation, as above, is commonly called Ulam discretization or Ulam method. This method was widely studied in the literature (see, e.g [8],[21],[4],[5],[12]).
Observe that
[TABLE]
taking into account that . We remark that since and , then .
Remark 12**.**
Another discretization that could be used is
[TABLE]
*while this definition is reasonable, it is more difficult to implement and would force us to recompute the discretized operator for each size of the noise. Our definition permits us to compute once and for all which is computationally expensive but leads to a sparse matrix, and then apply the operator which is independent of the dynamics. *
3 Rigorous approximation of the stationary measure for dynamical systems with additive noise
The certified approximation of the Lyapunov exponent is based on the certified approximation of the stationary measure of the system in the norm. This is the main part of our general construction and is described in this section. The algorithm to approximate the stationary measure uses both a priori (analytical) and a posteriori (computer assisted) estimates on the measure and on the transfer operator.* For these estimates to be performed we do not need particular expansion or hyperbolicity properties of the one dimensional map driving the deterministic part of the dynamics.* We now introduce a general and simple algorithm which works for measurable maps perturbed by additive noise with a Bounded Variation kernel, in Section 3.3 we refine this algorithm, assuming that the map is piecewise smooth and getting much better estimates. In this first part of the section we will hence work in the following setting.
Setting 13**.**
Let us suppose is the transfer operator of a system with additive noise as considered in (5). We suppose the noise is distributed according to a Bounded Variation kernel with support in and the deterministic part of the system is driven by a measurable map .
Let be the Ulam approximation of , defined by projecting on a partition of size . Let respectively be invariant probability measures of and . Since the measure is a fixed point of the finite dimensional operator , it can be computed to any precision. We will treat now the issue of estimating effectively.
Lemma 14**.**
Suppose that for some
[TABLE]
where being the space of zero-average measures. Then
[TABLE]
Remark 15**.**
We remark that is a finite dimensional operator and can be represented by a matrix. Thus is possible for a computer to verify that for some .
Proof.
(of Lemma 14) Since both , are fixed points we can write
[TABLE]
Then
[TABLE]
implying the statement.
3.1 An informal description of the main algorithm to compute the
stationary measure up to a small given error.
Based on Lemma 14, a strategy to rigorously bound is the following. The computer will find an such that (12) is satisfied, then (13) will give an estimate for the approximation error. We remark that if is small enough, has a chance of being small, since it is the difference of two nearby operators, both applied to the same regular (Bounded Variation) measure. This is where the size of the approximation grid has a role in the quality of the approximation. On the other hand, may depend on . This is why a priori estimates on the approximation error are not trivial. Lemma 14 provides some a posteriori estimate on the error; the approximation error is known after the computer certifies the and the for which (12) is satisfied.
Hence the main algorithm for the approximation of the invariant measure will work as follows:
Given the grid size , compute and up to some prescribed precision. 2. 2.
Find a good and : we estimate in an efficient way, finding a good compromise between and , in a way that is not too close to and not too big. We remark that the norm of the finite dimensional operator is directly computable in principle, but if is small then the size of the associated matrix is huge and this can be a hard computational task. For this we use a coarse-fine strategy which is explained in Section 4, and which takes into account that the huge matrix representing is actually coming from a certain dynamical system with noise. 3. 3.
Find a good estimate for . We remark that in this formula is not known, but still we can find enough information on it to estimate the difference of operators we are interested in. This will be done by a method using both a priori and a posteriori estimates, using an approximated knowledge of and its variation. The procedure is explained in Section 3.2 and in the following sections. A simple but not efficient bound (equation (16)) is proved in 3.2.1; we refine the method in Section 3.3 greatly improving the efficency of the estimate with a bootstrap argument. 4. 4.
Estimate the approximation error by Lemma 14.
3.2 A bound for
Having outlined the main algorithm we now show how to perform the main needed estimates. In this Section we describe how to estimate the quantity appearing on the right hand side of (13). This will be done by splitting this term in different parts which will be treated differently. We start estimating the term as a telescopic sum whose summands will be estimated in the following subsections.
Lemma 16**.**
Let the transfer operator of the random system and its Ulam approximation, as defined in Section 2. Let be an invariant probability measure for , it holds
[TABLE]
Proof.
The proof is based on a telescopic decomposition. We have
[TABLE]
Performing a similar decomposition to . Pairing in a suitable way the terms we inserted we obtain:
[TABLE]
considering that is fixed by . Shifting indexes by in the the first sum, the estimate can be written as
[TABLE]
(notice that has always average zero for any , and consequently belongs to ).
3.2.1 An initial (a priori) bound for
Now we show a strategy to get a simple effective bound for the approximation error based Lemma 16, estimating the summands on the right hand side of (14) by quantities which are known from the description of the system or can be computed by its approximated transfer operator. In the next section we will improve the method, using more information on and and getting much more efficient estimates.
Lemma 17**.**
Let a stationary measure for a system defined as in (5) and a stationary measure for its Ulam approximation, as defined in Section 2. If there is such that
[TABLE]
then
[TABLE]
where are such that .
Proof.
The proof of the lemma is based on the following estimates, proved in Corollary 48 and Prop. 49 (Section 9) allowing a first estimate on the right hand side of (13). We have
[TABLE]
[TABLE]
Now we apply (17,18) to the summands of the righ hand side of (14). We see that all the items there have either a or a appearing. Indeed since
[TABLE]
Similarly the other summands, can be estimated recalling that and . Applying (13) we get the statement.
The estimate given at (16) mainly depend on the ratio between the partition size and the noise amplitude. This estimate is obtained without any information on the deterministic part of the dynamics, only the information about the contraction rate of the approximated transfer operator (to obtain and ). This would already allow to obtain a good approximation for the invariant density , in principle, if we had enough computation power to carry on the computation with a very small . Unfortunately, in the Matsumoto-Tsuda system, positive Lyapunov exponent appears for very small sizes of the noise making the computation unfeasible even with the help of a supercomputer, due to the growth of the computational complexity as becomes small.
Therefore, we have to apply a more subtle and complicated strategy where the bootstrap argument comes into play, i.e., using some information on (and in particular about its variation in given intervals) which we can obtain with a preliminary computation.
3.3 A stronger (a posteriori) bound
In this section we analyze better (14) and see how using some more assumptions on , more information on and the use of the Wasserstein distance, we can drastically improve the estimates given in Lemma 17. We remark that the explicit error bound provided by Lemma 17 is proportional to the new error estimate will be a sum where most summands are proportional to .
Setting 18**.**
From now on we will suppose we are in the framework of Setting 13 and furthermore we suppose being piecewise smooth. We suppose that there is a partition such that
- •
each is an interval,
- •
on each the branch is monotonic and in the interior of
- •
The limits of as tend to the frontier of exist in .
We will consider the transfer operator related to the map and to every branch of the map. For each density , we let be the component of coming from the -th monotone branch (the pushforward map related to ), that is
[TABLE]
In this way we have .
Once the discretized transfer operator is computed and has a unique fixed probability measure an approximation for can be computed up to any given small error in (this is the computation of the fixed point of the big matrix representing ). Let us assume that a numerical approximation of in the norm is computed. Using , we will look for a strategy for estimating the total error , that includes the appoximation error (because we approximated on a partition of size ) and the numerical error . We remark that
[TABLE]
For the estimation of in our algorithm we apply the same method described in [12]. To find a stronger bound for let us start again from the estimate given at Lemma 16. We will estimate independently the terms
[TABLE]
appearing at (14), using the information we can extract from the approximation . Except in the first case (that has the smallest weight in the estimate, according to (14)), the estimate will become roughly proportional to , greatly improving the quality of the approximation certification. For each of the terms in (21) we prove in Sections 3.3.2, 3.3.3, 3.3.4 bounds of the form
[TABLE]
where and depend on and become small when is small. We remark that these bounds depend on the error itself. This together with precise bounds, based on some approximation , permits us to tighten the bounds on the error , using a so called “bootstrapping” process.
3.3.1 A summary of norms and estimates
Before entering in the details of the estimate of 21, we introduce some of the norms used in the paper, and we summarize some of the bounds that are used in this section and proved in Appendix 9.
Definition 19**.**
Let be a finite union of pairwise disjoint intervals, , for . We define the variation on of the function (and denote it by ) as follows:
- •
when is an interval (the endpoints may be included or not), the variation is defined as
[TABLE]
(the supremum being over finite increasing sequences of any length contained in );
- •
when is a finite union of pairwise disjoint intervals , for , the variation is defined as .
Remark 20**.**
As it is well known, if has a weak derivative, then , see for instance [27, Chap. 4, Prop. 4.2].
We will also consider a norm which is weaker than the norm.
Definition 21**.**
Let be a function in with zero average, we define the Wasserstein-like norm of , as
[TABLE]
Let be a finite union of pairwise disjoint intervals , for , we denote by the space of functions with support contained in having zero average in each . If we define its norm by
[TABLE]
Next proposition contains a summary of the bounds used in next proofs and the location of their proof in the paper; it can be used as an handy guideline throughout the paper, we refer to the cited lemmas and proposition for details.
Proposition 22** (Summary of the bounds).**
Let be the Ulam projection on a homogeneous partition of size , as defined in (11), let be a set which is a finite union of intervals of the partition then:
, Lemma 47, 2. 2.
, Lemma 51, 3. 3.
, Lemma 52.
Let be the convolution operator then:
, Lemma 46, 2. 5.
, Lemma 50, 3. 6.
, Corollary 48, 4. 7.
, Proposition 49.
Let be the transfer operator associated to , and let the component of coming from the branch as defined at (19), then:
, Lemma 54 2. 9.
in Lemma 55 the local variation inequality is proved:
[TABLE]
3.3.2 Estimate for
We give now an estimate for the first item of (21).
Lemma 23**.**
Let be the Ulam projection on a homogeneous partition of size , then
[TABLE]
for
[TABLE]
Proof.
We estimate:
[TABLE]
where in the last line we used Proposition 22, items 6) and 1).
An upper bound on will be estimated using the results in Section 9.2.2 and the explicit knowledge of the computed .
3.3.3 Estimate for
We give now the estimate of the second item of (21). The main idea is to use a coarser partition made of intervals whose size is an integral multiple of . Then, instead of estimating globally we bound this quantity on each interval of exploiting the approximate knowledge of the variation of in the interval. This drastically improves the quality of the estimate in almost every interval of and allows the error-checking computation to be performed on a partition which is coarser than the initial partition of size .
Lemma 24**.**
Let be a uniform partition whose parts have size that is an integral multiple of , piecewise monotonic with defined as above. We have
[TABLE]
with
[TABLE]
Proof.
We can estimate as
[TABLE]
The first summand can be rewritten as
[TABLE]
splitting on the intervals of the partition, and using Lemma 55 (because each is a union of intervals of the partition of size )
[TABLE]
In the last step we used the property of the norm stated in Lemma 51 and 52. Adding the second term of (28) we have proved the result.
Therefore, once we have an approximation we can compute , by a simple algorithm that evaluates the double summation in the last equation of the above Lemma.
Remark 25**.**
When computing , the minimum could be always the one depending on . If this happens, the sum adds up to , and the new bound is worse than the a priori estimate, since we are introducing a factor .
In practice, this does not happen. On each -th preimage of an interval of the partition the new estimate will provide a better bound as soon as
[TABLE]
First of all, the variation of has an a priori bound by
[TABLE]
Now, we can try to control by using the local variation inequality in Proposition 22. If the preimage does not contain a critical point or a singular point, we expect to be small.
For the intervals where we cannot apply the local variation inequality or where it does not give us good enough bounds we fall back to the a-priori estimate depending on the mass rather than on the variation.
3.3.4 An estimate for
We give an estimate of the third item of (21). The general idea is similar to the one explained in the previous section, again, some required estimates are technical lemmas proved in Section 9.
Lemma 26**.**
Let be a uniform partition whose parts have size that is multiple of , we have:
[TABLE]
with
[TABLE]
Proof.
We have
[TABLE]
An algorithm for estimating for can be found in Lemma 56. The term can be split over the intervals and estimated as
[TABLE]
proving the statement thanks to Lemma 54 (because each is a union of intervals of the partition of size ).
Remark 27**.**
To estimate , we estimate computationally for each interval using the algorithms explained in Sections 9.2.1 and 9.2.2. As in Lemma 24, we obtain a stronger estimate in the interval as soon as
[TABLE]
Remark that in all our computations needs to be small, since it controls the approximation error (refer to Proposition 22, items 6 and 7). This implies that the inequality above will be true for most of the intervals but those where becomes very big.
3.3.5 An estimate for the error
In the previous sections we built the ingredients for estimating , but we want to estimate where is the output of a computation approximating the fixed point of . We will do so assuming that we have an estimate of the numerical error (such an estimate can be found in [12]).
Let , () be the constants defined as in (25), (24), (30). Plugging (24), (26), (29) (according to Lemmas 24 and 26) into (14), we have that can be bounded as
[TABLE]
where
[TABLE]
Thanks to (13) we have
[TABLE]
for and , is appearing in (13). Therefore, by 20 we have
[TABLE]
which implies
[TABLE]
4 Contraction speed estimates via coarse-fine methods
In this section we show an efficient way to estimate the rate of contraction of the discretized transfer operator and find the suitable and described in Section 3. Since is represented by a matrix, a first attempt to perform this task would be to iterate and estimate the norm of the iterate. This method is not very effective, since the matrix we should iterate is quite big. For this we implement a strategy in which we get information for the full matrix from the iterates of coarser versions of it. An earlier approach to this problem for deterministic systems can be found in [13].
In Lemmas 50 and 51 and Corollary 48 we have seen that
[TABLE]
We now prove the following lemma which bounds the distance between the powers of and , provided that the noise has been applied at least once before the application of and .
Lemma 28**.**
Let ; let be a linear operator such that , , and ; let .
Then
[TABLE]
In particular the Lemma applies if:
and ; 2. 2.
and , for any such that with .
As a consequence, we obtain a way to bound the contraction rate of certain operator on the zero-average space using the computed contraction rate for a coarser operator . We remark that
[TABLE]
We remark that on the left-hand side we have an in (36), which guarantees that the noise has been applied at least once; this permits us to use Lemma 28 to estimate the second summand of the right-hand of (36).
Thus, if one is searching for an such that this can be found and certified by using a suitable coarse version , computing the norm of its iterates and using Lemma 28 in a way that the second hand of (36) is smaller than .
Proof of Lemma 28.
Notice that as a consequence of the hypotheses we have
[TABLE]
because applying Lemmas 51 and 52.
The proof is along the lines of what has been proved in Section 3.2. Indeed, we have
[TABLE]
and the thesis follows from the fact that , , .
5 Estimating the average of an observable
As a result of the previous sections, we are able to obtain a precise approximation of in the norm. This is not enough in order to estimate the Lyapunov exponent which we recall can be defined as where . This is because is not in in the whole interval. In the Belouzov-Zhabotinsky case, there are two points where goes to infinity: the critical point and the point where the goes to . Outside of neighborhoods of these two points is bounded. Moreover, in these two neighborhoods still has bounded norm. This is enough to perform our estimates since we can have bounds on the stationary measure ; this allows to compute the Lyapunov exponent using alternately and estimates on and in different sets. Therefore, we can join all these observations together to obtain a rigorous approximation of applying the following strategy:
- •
we select a region of such that is in outside ;
- •
we estimate, on , the quantities and ;
- •
we approximate (keeping rigorously track of the numerical errors) the integral with (discarding the set from the computation);
- •
we estimate the error in such an approximation in terms of , , and (see Corollary 29).
In Subsection 5.1 we show how the error can be estimated in terms of the mentioned quantities. The remaining subsections are devoted to estimating and , notice that in the case of uniform noise , but we are able to obtain a better estimate via .
5.1 Approximating the average using and
estimates
In this section we assume that is an approximation of and both are probability measures, therefore has [math] average.
Corollary 29**.**
Let and be probability densities on the measure space , both contained in and in . Let be a Borel subset, and be an observable that is in . Then
[TABLE]
The proof of the corollary is straightforward, applying the following Lemma on the set
Lemma 30**.**
Let be a measure space, let , and let a function having [math] average. Then we have
[TABLE]
Proof.
Indeed, for a constant we have
[TABLE]
because has [math] average, and this is clearly optimized taking .
Remark 31**.**
Corollary 29 yields immediately an algorithm for estimating an observable that is , and is outside a neighborhood of a finite number of points where it goes to , as is the case with the observable of the system we are studying. In fact, there is a trade-off on the size of , and we attempt different sets enclosing the with intervals of different sizes on order to obtain the tightest possible estimate on the error. Every such choice of the set yields an approximation of as and a bound for the error.
5.2 bounds for the stationary measure in an interval.
To estimate the average of the unbonded observable and apply Corollary 29, in this Subsection we obtain a bound for the norm of the invariant measure on intervals of a certain partition. We derive it as a byproduct of the rigorous estimate of the error, and the algorithms explained in Sections 9.2.1 and 9.2.2, that allow to bound for each .
Lemma 32**.**
Let be a uniform partition, for each we have
[TABLE]
Proof.
Indeed,
[TABLE]
and the estimate follows because .
5.3 bounds on
In this section we compute explicit bounds for the -norm of for the map defined in Section 2 in a neighborhood of the points where it is not bounded, as required to apply Remark 31. As can be deduced from its definition in Section 2, we need to do so in intervals enclosing and . We omit the proofs, as they are all very elementary.
Lemma 33**.**
For we have
[TABLE]
Lemma 34**.**
For we have
[TABLE]
for and , where as in Section 2.
Lemma 35**.**
For we have
[TABLE]
6 Computation details and results
We give here some details about the code performing our computer aided estimates and about the results. The main algorithm is written in Python using the Sage framework and interval arithmetics ([29]), some critical parts are written in C++ and uses (optionally) the GPU, this in particular is used for the iterartion of large matrices needed to apply the methods of Section 4. Such parts have been optimized to use high performance computing; even so each contraction test has required a time of the of order of a week. 333The contraction time estimates were run on a Asus GeForce GTX 1050Ti, 4GB of Ram GPU installed in a desktop computer with an AMD A4-6300 3.4 Ghz processor and 8 Gb of Ram. The matrices were assembled on a Dell R710 server with 2 sixcore Xeon 5660 2.8 Ghz processors and 24 Gb of Ram. The code we used can be found at
http://im.ufrj.br/~maurizio.monge/wordpress/rigorous_computation_dyn/
Table 6 contains the result of the computer aided estimates we performed and the values of the parameters used in these estimates. In Figure 4 we summarize with a graph the most important information contained in the table. The graph shows intervals enclosing the Lyapunov exponent at the selected noise values. These are the final result of our computer aided estimates; it is worth to remark again that the estimated requiring more computational power are the ones performed to prove that the Lyapunov exponent is positive for small size of the noise.
To ease the understanding of Table 6, we now outline some more details of the implementation of our algorithm and how the parameters take place in the algorithm’s execution; the columns are ordered as they are subsequently used in the algorithm, or deduced from previous quantities and via computations.
One of the main ingredients and goals of the computer aided estimates is to compute the number of iterates of the transfer operator needed to contract the zero average space (see Item 1 of Section 3.1). For this we apply the ”coarse fine” methods explained in Section 4. For each value of the noise amplitude, denoted by , we build a coarse discretization of the operator , on a partition of coarse size . We then compute values of and represented in Table 6, which satisfy
[TABLE]
and compute explicit bounds for (whose value does not appear in the table). The algorithm used for these finite dimensional estimates is the same as in [12] and there explained.
We consider then a finer partition size and use the coarse fine estimates of Section 4 to compute and , where and
[TABLE]
The same bounds work for , i.e.
[TABLE]
Notice that the bigger the , the worse is going to be the estimate on the norm on , i.e., the error coming from the coarse-fine inequality. While increasing permits us to find smaller , this may not imply that the corresponding is smaller. Our algorithms attempts to find the best compromise. Needless to say, in practice this procedure may fail, if unable to detect any contraction in a reasonable time. This might happen for example if the original system is not mixing.
To estimate an upper bound to the error in the computation of the stationary measure we use the results shown in Section 3. The column ”A priori…” contains the a priori estimate on the error of the approximation of the measure on the partition of size as given using the results in Subsection 3.2.1 while the column ”Refined…” contains the error when we use the bootstrapping tecniques of Subsection 3.3.
Once we have a good approximation of the invariant measure, we compute an approximation of the Lyapunov exponent by computing an integral on a partition of size , using Section 5; the computed intervals enclosing rigorously the Lyapunov exponent are contained in the last column. This allows to prove Theorem 2.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Arnold L., Random Dynamical Systems Springer Monographs in Mathematics Springer (Berlin,2003)
- 2[2] Arnold L., Crauel H. , and Wihstutz V. Stabilization of Linear Systems by Noise SIAM J. Control Optim., 21(3), 451–461. (1983)
- 3[3] Bioni Liberalquino R., Monge M., Galatolo S., Marangio L. Chaotic Itinerancy in Random Dynamical System Related to Associative Memory Models Mathematics 6(3), 39 (2018)
- 4[4] Bose, C., Murray, R. The exact rate of approximation in Ulam’s method . Discrete Contin. Dynam. Systems 7 no. 1, pp. 219-235 (2001)
- 5[5] Boyarsky, A., Góra, P., Laws of Chaos, Invariant measures and Dynamical Systems in one dimension , Birkhäuser, (1997).
- 6[6] Braverman M., Grigo A., Rojas C. Noise vs Computational intractability in dynamics ITCS ’12 Proceedings of the 3rd Innovations in Theoretical Computer Science Conference pp. 128-141 (2012).
- 7[7] Capinski M., Simo C. Computer assisted proof for normally hyperbolic invariant manifolds. Nonlinearity, Vol. 25, No. 7, pp. 1997-2026 (2012)
- 8[8] Dellnitz M., Junge O. Set Oriented Numerical Methods for Dynamical Systems Handbook of dynamical systems vol 2 - Elsevier, (2002)
