Semi-implicit Euler-Maruyama method for non-linear time-changed stochastic differential equations
Chang-Song Deng, Wei Liu

TL;DR
This paper introduces and analyzes a semi-implicit Euler-Maruyama method for approximating non-linear time-changed stochastic differential equations, proving convergence, stability, and demonstrating effectiveness through simulations.
Contribution
The paper develops a semi-implicit EM scheme for complex SDEs with super-linear drift and time-change, establishing convergence, stability, and preservation of asymptotic properties.
Findings
Proved strong convergence of the method.
Established mean square polynomial stability.
Numerical simulations confirm theoretical results.
Abstract
The semi-implicit Euler-Maruyama (EM) method is investigated to approximate a class of time-changed stochastic differential equations, whose drift coefficient can grow super-linearly and diffusion coefficient obeys the global Lipschitz condition. The strong convergence of the semi-implicit EM is proved and the convergence rate is discussed. When the Bernstein function of the inverse subordinator (time-change) is regularly varying at zero, we establish the mean square polynomial stability of the underlying equations. In addition, the numerical method is proved to be able to preserve such an asymptotic property. Numerical simulations are presented to demonstrate the theoretical results.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and financial applications · Statistical Methods and Inference · Numerical methods in inverse problems
Semi-implicit Euler-Maruyama method for non-linear time-changed stochastic differential equations
Chang-Song Deng
School of Mathematics and Statistics
Wuhan University, Wuhan 430072, China.
Wei Liu111Corresponding author. Email: [email protected], [email protected]
Department of Mathematics
Shanghai Normal University, Shanghai, 200234, China
Abstract
The semi-implicit Euler-Maruyama (EM) method is investigated to approximate a class of time-changed stochastic differential equations, whose drift coefficient can grow super-linearly and diffusion coefficient obeys the global Lipschitz condition. The strong convergence of the semi-implicit EM is proved and the convergence rate is discussed. When the Bernstein function of the inverse subordinator (time-change) is regularly varying at zero, we establish the mean square polynomial stability of the underlying equations. In addition, the numerical method is proved to be able to preserve such an asymptotic property. Numerical simulations are presented to demonstrate the theoretical results.
Key words: time-changed stochastic differential equations, semi-implicit Euler-Maruyama method, strong convergence, mean square polynomial stability, subordinator.
2010 MSC2010: 60H10, 65C30, 60J60.
1 Introduction
In this paper, we study the numerical approximations to a class of time-changed stochastic differential equations (SDEs) which are of the form
[TABLE]
Here the coefficients and satisfy some regularity conditions (to be specified in Section 2), represents a standard Brownian motion, and is an independent time-change given by an inverse subordinator. The rigorous mathematical definitions are postponed to Section 2.
Since it is in general impossible to derive the explicit solution to such SDEs, numerical approximations become extremely important when one applies them to model uncertain phenomenon in real life. This paper aims to construct a numerical method for these time-changed SDEs. The strong convergence with the convergence rate and the mean square stability of the numerical method are investigated.
To our best knowledge, [8] is the first paper to study the finite time strong convergence of numerical methods for time-changed SDEs by directly discretizing the equations. In [8], the authors used the duality principle established in [9] to construct the Euler-Maruyama (EM) method. In a very recent work [6], the authors studied the EM method for a larger class of time-changed SDEs without the duality principle. However, both of these two works required the coefficients of the time-changed SDEs to satisfy the global Lipschitz condition. This requirement rules out many interesting SDEs like
[TABLE]
where some cubic term appears in the drift coefficient. Moreover, the EM is proved to be divergent to SDEs with super-linear growing coefficients [5].
To cope with such super-linearity, we propose the semi-implicit EM method to approximate the SDEs driven by time-changed Brownian motions in this paper. It should be noted that the semi-implicit EM (also called the backward Euler method) have been studied for approximating different types of SDEs driven by Brownian motions, see [3, 4, 10, 11, 15, 19, 21, 23] and the references therein.
Stabilities in different senses for SDEs driven by time-changed Brownian motion have been discussed in [24]. See [17, 18] for related results when the driven process is a time-changed Lévy process. As far as we know, however, there is no result concerning the stability analysis for numerical methods for time-changed SDEs.
In the three papers mentioned above, the global Lipschitz condition was required for the coefficients of the equations. In this paper, we study the the mean square stability of the underlying time-changed SDEs, where the global Lipschitz condition on the drift coefficients is not required. Then, we investigate the capability of the semi-implicit EM method to reproduce such a property under the similar condition.
The main contributions of this paper are as follows.
- •
The semi-implicit EM method is proved to be convergent to a class of time-changed SDEs and the convergence rate is explicitly given.
- •
We establish the mean square stability of the underlying time-changed SDEs. In addition, the numerical solution is proved to be able to preserve such a property.
The rest of this paper is organized as follows. Section 2 is devoted to some mathematical preliminaries for the time-changed SDEs to be considered in this paper, and some necessary lemmas. The strong convergence of the numerical method is proved in Subsection 3.1, and the mean square stabilities of both underlying and numerical solutions are shown in Subsection 3.2. In Section 4, we present numerical simulations to demonstrate the theoretical results derived in Section 3.
2 Preliminaries
Throughout this paper, unless otherwise specified, we will use the following notation. Let be the Euclidean norm in and be the inner product of vectors . If A is a vector or matrix, its transpose is denoted by . If A is a matrix, its trace norm is denoted by . For two real numbers and , we use and .
Moreover, let be a complete probability space with a filtration satisfying the usual conditions (that is, it is right continuous and increasing while contains all -null sets). Let be an -dimensional -adapted standard Brownian motion. Let denote the expectation under the probability measure .
Let be an -adapted subordinator (without killing), i.e. a nondecreasing Lévy process on starting at . The Laplace transform of is of the form
[TABLE]
where the characteristic (Laplace) exponent is a Bernstein function with , i.e. a -function such that for all . Every such has a unique Lévy–Khintchine representation
[TABLE]
where is the drift parameter and is a Lévy measure on satisfying . We will focus on the case that is a.s. strictly increasing, i.e. or ; obviously, this is also equivalent to .
Let be the (generalized, right-continuous) inverse of , i.e.
[TABLE]
We call an inverse subordinator associated with the Bernstein function . Note that is a.s. continuous and nondecreasing.
We always assume that and are independent. The process is called a time-changed Brownian motion, which is trapped whenever is constant. We remark that the jumps of correspond to flat pieces of . Due to these traps, the time-change slows down the original Brownian motion , and is understood as a subdiffusion in the literature (cf. [16, 22]).
Consider the following time-changed SDE
[TABLE]
with for any , where and are measurable coefficients. We will need the following assumptions on the drift and diffusion coefficients.
Assumption 2.1
There exists a constant such that, for all and ,
[TABLE]
Assumption 2.2
There exist constants , and such that, for all and ,
[TABLE]
and
[TABLE]
Assumption 2.3
Assume that there exist constants and such that, for all and ,
[TABLE]
and
[TABLE]
Assumption 2.4
Assume that there exist constant and such that, for all and ,
[TABLE]
By Assumption 2.3, we can see that there exists a constant such that
[TABLE]
and
[TABLE]
for all and .
According to the duality principle in [9], the time-changed SDE (2.1) and the classical SDE of Itô type
[TABLE]
have a deep connection. The next lemma states such a relation more precisely, which is borrowed from Theorem 4.2 in [9].
Lemma 2.5
Suppose Assumptions 2.1 to 2.3 hold. If is the unique solution to the SDE (2.4), then the time-changed process , which is an -semimartingale, is the unique solution to the time-changed SDE (2.1). On the other hand, if is the unique solution to the time-changed SDE (2.1), then the process , which is an -semimartingale, is the unique solution to the SDE (2.4).
The plan to numerically approximate the time-changed SDE (2.1) in this paper is as follows. Firstly, we construct the numerical method for the SDE (2.4). Secondly, we discretize the inverse subordinator . Then the combination of the numerical solution of the SDE (2.4) and the discretized inverse subordinator is used to approximate the solution to the time-changed SDE (2.1).
The semi-implicit EM method for (2.4) is defined as
[TABLE]
with , where is the Brownian increment following the normal distribution with the mean 0 and the variance and .
Note that under Assumption 2.1, the semi-implicit EM method (2.5) is well defined for any (see for example [15]). To be more precisely, this means that given is known a unique can be found. Throughout the paper, we always assume .
We also define the piecewise continuous numerical solution by for , .
We follow the idea in [2] to approximate the inverse subordinator in a time interval for any given . Firstly, we simulate the path of by with , where is independently identically sequence with in distribution. The procedure is stopped when
[TABLE]
for some . Then the approximate to is generated by
[TABLE]
for . It is easy to see
[TABLE]
The next lemma will be used as the approximation error of to , whose proof can be found in [8, 12].
Lemma 2.6
For any ,
[TABLE]
The following lemma states that the inverse subordinator is known to have the finite exponential moment, which was proved in [8, 13]. Here, we give an alternative proof, which can, furthermore, provide an explicit upper bound.
Lemma 2.7
For any , there exists such that
[TABLE]
*Proof. * By the definition of , it is clear that
[TABLE]
Note that
[TABLE]
Denote by the inverse function of . By the Chebyshev inequality,
[TABLE]
Thus, for all ,
[TABLE]
which immediately implies the assertion.
The following result is taken from [14, Theorem 4.1, p. 59].
Lemma 2.8
Suppose that Assumptions 2.1 to 2.4 hold. Then the solution to (2.4) satisfies
[TABLE]
The next lemma is easy; for the sake of completeness and our readers’ convenience, we give a brief proof.
Lemma 2.9
Suppose that Assumptions 2.1 to 2.4 hold. Then for any and with ,
[TABLE]
where is a constant independent of and .
*Proof. * For any , we derive from (2.4) that
[TABLE]
By the elementary inequality
[TABLE]
with , the Hölder inequality and [14, Theorem 7.1, p. 39], we get
[TABLE]
Combining this with (2.2), (2.3) and Lemma 2.8, we obtain
[TABLE]
where is a generic constant independent of and that may change from line to line. This completes the proof.
3 Main results
3.1 Strong convergence
Briefly speaking, the following theorem states the strong convergence with the rate of of the semi-implicit EM method, which is not surprising. But to our best knowledge, it seems that no existing result fulfills our needs in this paper. In Theorem 3.1, we need to track the temporal variable as we will replace it by in Theorem 3.2. In addition, it seems that no such a result exists on the semi-implicit EM method for non-autonomous SDEs.
Theorem 3.1
Suppose that Assumptions 2.1 to 2.4 hold with and the step size satisfies . Then the semi-implicit EM method (2.5) is convergent to (2.4) with
[TABLE]
where is a constant independent of and .
*Proof. * From (2.4) and (2.5), it holds that for ,
[TABLE]
Taking square on both sides yields
[TABLE]
where
[TABLE]
and
[TABLE]
To estimate , we rewrite the integrand of into three parts
[TABLE]
Using Assumption 2.1, we obtain
[TABLE]
Applying the elementary inequality
[TABLE]
we have
[TABLE]
By Assumption 2.2, we can see
[TABLE]
Thus,
[TABLE]
Applying the elementary inequality (3.1) and Assumption 2.3 gives
[TABLE]
Combining the upper bound estimates of , and , we conclude that
[TABLE]
By the Hölder inequality, we find
[TABLE]
Taking expectations on both sides of (3.2) and applying Lemmas 2.8 and 2.9, we obtain
[TABLE]
where (and in what follows) is a generic constant independent of and the step size that may change from line to line.
Next, we bound . Applying the elementary inequality (3.1) again, we have
[TABLE]
Taking expectation on both sides and using the Itô isometry, it follows that
[TABLE]
Rewriting the integrand of the second term on the right hand side, and using the elementary inequality (2.7) with and and Assumptions 2.2 and 2.3, we can see
[TABLE]
Now applying Lemmas 2.8 and 2.9 gives
[TABLE]
Combining (3.3) and (3.4) yields
[TABLE]
which implies that
[TABLE]
Now summing both sides from [math] to yields
[TABLE]
Due to the fact that , from combining same terms together on both sides we can derive
[TABLE]
By the discrete version of the Gronwall inequality, we have
[TABLE]
Moveover, when for some , Lemma 2.9 and (3.5) yield
[TABLE]
Therefore, the proof is completed.
Theorem 3.2
Suppose that Assumptions 2.1 to 2.4 hold with and the step size satisfies . Then the combination of the semi-implicit EM solution, , and the discretized inverse subordinator, , i.e. , converges strongly to the solution of (2.1) with
[TABLE]
where is a constant independent of and .
*Proof. * By Lemma 2.5 and (2.7) with and ,
[TABLE]
By Lemmas 2.6, 2.7 and 2.9, we can see
[TABLE]
On the other hand, it holds from Lemmas 2.6 and 2.7 and Theorem 3.1 that
[TABLE]
Combining (3.6) and (3.7), we obtain the required assertion.
3.2 Stability
In the section, we always assume the existence and uniqueness of the solutions to (2.1) and (2.4). In fact, Assumptions 2.1 to 2.3 are sufficient to guarantee it, but we do not use them explicitly.
A function is said to be regularly varying at zero with index if for any ,
[TABLE]
Denote by the class of all regularly varying functions at [math]. A function is said to be slowly varying at [math]. It is clear that every can be rewritten as
[TABLE]
where is a slowly varying function at [math].
In the following, we will assume that the Bernstein function with . Typical examples are
- •
Let with and . Then ;
- •
Let with . Then ;
- •
Let with . Then ;
- •
Let with . Then .
We refer the reader to [20, Chapter 16] for more examples of such Bernstein functions.
Lemma 3.3
If the Bernstein function with , then for any
[TABLE]
*Proof. * Denote by the Laplace transform of a function . It follows from [8, (3.10)] that for any and ,
[TABLE]
Since , we get
[TABLE]
where is a slowly varying function at [math]. Combining this with Karamata’s Tauberian theorem (cf. [1, Theorem 1.7.6]), it holds that
[TABLE]
Noting that is slowly varying at , one has (see [1, Proposition 1.3.6 (i)])
[TABLE]
which, together with (3.8), implies the desired limit.
Theorem 3.4
Assume that the Bernstein function with , and that there exists a constant such that
[TABLE]
Then
[TABLE]
In other words, the solution to (2.1) is mean square polynomially stable.
*Proof. * Given (3.9), by [14, Theorem 4.4, p. 130] we know that the solution to (2.4) is mean square exponentially stable
[TABLE]
Using Lemma 2.5, we obtain
[TABLE]
It remains to apply Lemma 3.3 to complete the proof.
Remark 3.5
It is interesting to observe that the time-changed SDEs (2.1) is polynomially stable while the dual SDEs (2.4) is stable in the exponential rate. This may be due to the effect of the time-changed Brownian, which slows down the diffusion.
Now, we present our result about the stability of the semi-implicit EM method.
Theorem 3.6
Assume that the Bernstein function with , and that there exist positive constants and with such that
[TABLE]
Then
[TABLE]
That is to say, the numerical solution to (2.1) is mean square polynomially stable.
*Proof. * Assume that (3.10) holds with , the standard approach (see for example [15]) gives
[TABLE]
where . Now, replacing by and using Lemma 2.6, we have
[TABLE]
Now, the application of Lemma 3.3 yields the desired assertion.
Remark 3.7
It is not hard to see that (3.10) together with indicates (3.9) in Theorem 3.4. Hence, it can be seen from Theorem 3.6 that the semi-implicit EM method can preserve the mean square polynomial stability of the underlying time-changed SDE.
4 Numerical simulations
In this section, we will present two numerical examples. The first example is used to illustrate the strong convergence as well as the convergence rate. The second example demonstrates the mean square stability of the numerical stability. Throughout this section, we focus on the case that is an inverse -stable subordinator with Bernstein function .
Example 4.1
A one-dimensional nonlinear autonomous time-changed SDE
[TABLE]
is considered.
It is not hard to check that Assumptions 2.1 to 2.3 hold for (4.1). Therefore, by Theorem 3.2 the numerical solution proposed in this paper is strongly convergent to the underlying solution with the rate of .
For a given step size , one path of the numerical solution to (4.1) is simulated in the following way.
Step 1. The semi-implicit EM method with the step size is used to simulate the numerical solution, , when for , to the duel SDE
[TABLE]
Step 2. One path of the subordinator is simulated with the same step size . (see for example [7]).
Step 3. The is found by using (2.6).
Step 4. The combination, , is used to approximate (4.1).
One path of the -stable subordinator is plotted using in Figure 1(a). The corresponding inverse subordinator is drawn in Figure 1(b). One path of the numerical solution to Example 4.1 is displayed in Figure 1(c).
Now we illustrate the strong convergence and the convergence rate. Since the explicit form of the true solution to (4.1) is hard to obtain. The numerical solution with a small step size, , is regarded as the true solution. The step sizes of , and are used to calculated the numerical solutions. For the given step size , the strong error is calculated by
[TABLE]
Two hundreds () sample paths are used to draw Loglog plot of the error against the step sizes in Figure 2. The red solid line is the reference line with the slope of 1/2. It can be seen that the strong convergence rate is approximately 1/2. A simple regression also shows that the rate is 0.4996, which is in line with the theoretical one.
Example 4.2
A one-dimensional nonlinear time-changed SDE
[TABLE]
is considered.
It is not hard to check that (3.9) is satisfied, thus the underlying time-changed SDE is stable in the mean square sense. In addition, (3.10) holds for (4.2) indicates the numerical solution is also mean square stable.
One hundred paths are used to draw the mean square of the numerical solutions from to . It is clear in Figure 3(a) that the second moments of the solution tends to [math] as the time advances, which indicates the numerical solution is mean square stable. In addition, five sample paths are displayed in Figure 3(b).
Acknowledgement
Chang-Song Deng would like to thank the National Natural Science Foundation of China (11401442, 11831015).
Wei Liu would like to thank the National Natural Science Foundation of China (11701378, 11871343), Chenguang Program supported by both Shanghai Education Development Foundation and Shanghai Municipal Education Commission (16CG50), and Shanghai Gaofeng & Gaoyuan Project for University Academic Program Development, for their financial support.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] N. H. Bingham, C. M. Goldie, and J. L. Teugels. Regular variation , volume 27 of Encyclopedia of Mathematics and its Applications . Cambridge University Press, Cambridge, 1987.
- 2[2] J. Gajda and M. Magdziarz. Fractional Fokker-Planck equation with tempered α 𝛼 \alpha -stable waiting times: Langevin picture and computer simulation. Phys. Rev. E (3) , 82(1):011117, 6, 2010.
- 3[3] D. J. Higham, X. Mao, and C. Yuan. Almost sure and moment exponential stability in the numerical simulation of stochastic differential equations. SIAM J. Numer. Anal. , 45(2):592–609 (electronic), 2007.
- 4[4] Y. Hu. Semi-implicit Euler-Maruyama scheme for stiff stochastic equations. In Stochastic analysis and related topics, V (Silivri, 1994) , volume 38 of Progr. Probab. , pages 183–202. Birkhäuser Boston, Boston, MA, 1996.
- 5[5] M. Hutzenthaler, A. Jentzen, and P. E. Kloeden. Strong and weak divergence in finite time of Euler’s method for stochastic differential equations with non-globally Lipschitz continuous coefficients. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. , 467(2130):1563–1576, 2011.
- 6[6] S. Jin and K. Kobayashi. Strong approximation of stochastic differential equations driven by a time-changed Brownian motion with time-space-dependent coefficients. J. Math. Anal. Appl. , 476(2):619–636, 2019.
- 7[7] E. Jum. Numerical Approximation of Stochastic Differential Equations Driven by Lévy Motion with Infinitely Many Jumps . Ph D thesis, University of Tennessee - Knoxville, 2015.
- 8[8] E. Jum and K. Kobayashi. A strong and weak approximation scheme for stochastic differential equations driven by a time-changed Brownian motion. Probab. Math. Statist. , 36(2):201–220, 2016.
