Iterative and Non-iterative Splitting approach of a stochastic Burgers' equation
J\"urgen Geiser, Karsten Bartecki

TL;DR
This paper introduces iterative and non-iterative splitting methods for solving stochastic Burgers' equations, demonstrating that iterative schemes are more accurate and efficient due to the equation's nonlinearity.
Contribution
The paper develops and compares iterative and non-iterative splitting methods, highlighting the improved accuracy and efficiency of iterative approaches for stochastic Burgers' equations.
Findings
Iterative splitting methods outperform non-iterative methods in accuracy.
Non-iterative methods are based on Lie-Trotter and Strang-splitting.
Iterative schemes leverage exponential integrators for better performance.
Abstract
In this paper we present iterative and noniterative splitting methods, which are used to solve stochastic Burgers' equations. The non-iterative splitting methods are based on Lie-Trotter and Strang-splitting methods, while the iterative splitting approaches are based on the exponential integrators for stochastic differential equations. Based on the nonlinearity of the Burgers' equation, we have investigated that the iterative schemes are more accurate and efficient as the non-iterative methods.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
11institutetext: Ruhr University of Bochum,
The Institute of Theoretical Electrical Engineering,
Universitätsstrasse 150, D-44801 Bochum, Germany
11email: [email protected]
Iterative and Non-iterative Splitting approach of a stochastic Burgers’ equation
Jürgen Geiser and Karsten Bartecki
Abstract
In this paper we present iterative and noniterative splitting methods, which are used to solve stochastic Burgers’ equations. The non-iterative splitting methods are based on Lie-Trotter and Strang-splitting methods, while the iterative splitting approaches are based on the exponential integrators for stochastic differential equations. Based on the nonlinearity of the Burgers’ equation, we have investigated that the iterative schemes are more accurate and efficient as the non-iterative methods.
Keywords: Burgers’ equation, stochastic differential equation, Operator splitting, iterative splitting, splitting analysis
AMS subject classifications. 35K25, 35K20, 74S10, 70G65.
1 Introduction
We are motivated to model the nonlinear transport phenomenon with stochastic perturbations. Such modelling problems arise in many fields, such as biology, physics, engineering and economics, where random phenomena play an important role. We concentrate on nonlinear transport with stochastic reaction, which can be modelled by the Burgers’ equation with an additional stochastic part. Many applications in transport phenomena can be modelled with uncertainties in combining deterministic and stochastic operators, see [14]. To solve such delicate problems, we consider operator splitting approaches to decompose into deterministic and stochastic operators, see [8] and [17]. The numerical schemes are discussed as noniterative schemes in the direction of Lie-Trotter-splitting and Strang-splitting schemes, see [21] and [20], which we call AB-, ABA-, BAB-schemes. The iterative schemes are discussed in the direction of Picard’s iterative schemes, see [6]. We apply the extension of the deterministic to the stochastic schemes, which are given in the numerical stochastics literature, e.g., [15], [18] and [5].
The benefit of splitting approaches arises in decomposing different operators, which can be solved numerically with more optimal methods. In the underlying stochastic Burgers’ equation, we decompose the deterministic part, which has to be solved with fast conservation methods, see [13] and [14], and the stochastic part, which has to be solved as a stochstatic ordinary differential equation, see [13] and [14].
The paper is outlined as following: The model is given in section 2. The numerical methods are discussed in section 3. The numerical analysis is presented in section 4. In section 5, we present the numerical simulations. In the contents, that are given in section 6, we summarize our results.
2 Mathematical Model
In modeling, we concentrate on nonlinear stochastic PDEs (SPDEs), which are important to fluid dynamics. Here, we deal with stochastic Burgers equation (SBE) driven by linear multiplicative noise, see [9] and [12].
The SBE is given as:
[TABLE]
where is a positive diffusion coefficient, is a two-sided one-dimensional Wiener process. is the nonlinear flux-function, e.g., . Further is globally Lipschitz continuous in . is multiplicative noise function and Lipschitz continuous in , which measures the amplitude of the noise. is an initial condition.
Such SPDEs driven by linear multiplicative noise and especially the SBE (10) are used to model turbulences or non-equilibrium phase transitions, see [4] and [16]. Further, the models are used to deal with randomly fluctuating environments [2] and also to model of parameter disturbances based on uncertainties, see [3].
We deal with a stochastic balance equation, which is given in the nonlinear transport case as a pure stochastic Burger’s equation:
[TABLE]
where is the multiplicative noise function, is the nonlinear flux function and is a Wiener process.
In the next section, we deal with the different solver methods.
3 Numerical Methods
For the numerical methods, we apply based on the idea of separating the deterministic and stochastic operators, the following numerical approaches, see also [14, 13]:
- •
Deterministic solver for the pure Burgers’ equation: Finite volume discretization for the space with the conservation law solver of Engquist-Osher, see [10] and [11].
- •
Stochastic solver for the pure stochastic ODE: Euler-Maruyama solver, Milstein solver or stochastic RK solver, see [15] and [19].
The application of the separated solver methods is done with different splitting approaches, see an overview in [6].
We have the following parts of the full equation (10).
[TABLE]
where
- •
The deterministic part:
[TABLE]
where we have the solution
[TABLE]
- •
The stochastic part:
[TABLE]
where we have the solution
[TABLE]
We concentrate on the following methods:
- •
Noniterative methods based on exponential splitting approaches:
- –
AB-splitting (Lie-Trotter scheme, see [14]),
- –
ABA splitting (Strang-splitting scheme, see [17]),
- –
BAB splitting (Strang-splitting scheme, see [17]),
- •
Iterative method based on successive relaxation approaches:
- –
Iterative splitting (Picard’s approximation, see [8]).
In the following, we discuss the different schemes.
3.1 Noniterative splitting approaches
The noniterative splitting approaches obtained results in one cycle, which means it is not necessary to relax the solution. We consider the ideas related to the exponential splitting based on the Lie-Trotter schemes, see [21] and [6], while we compute the numerical results for each operator-equation, see equation (8)-(10) and couple the results as an initial value of the successor operator-equation, for example, we apply the results of equation (8) as an initial value for the equation (10), see also [6].
AB splitting:
We have the following AB splitting approaches:
- •
A-Part
[TABLE]
where we have the solution
[TABLE]
- •
B-part:
[TABLE]
where we have the solution
[TABLE]
where we have the solution . 2. 2.
ABA splitting:
We have the following ABA splitting approaches:
- •
A-Part ()
[TABLE]
where we have the solution
[TABLE]
- •
B-part:
[TABLE]
where we have the solution
[TABLE]
- •
A-Part ()
[TABLE]
where we have the solution
[TABLE]
where we have the solution . 3. 3.
BAB splitting:
We have the following BAB splitting approach:
- •
B-part ():
[TABLE]
where we have the solution
[TABLE]
- •
A-Part ()
[TABLE]
where we have the solution
[TABLE]
- •
B-part:
[TABLE]
where we have the solution
[TABLE]
where we have the solution
[TABLE]
where we have the solution .
3.2 Iterative splitting
The iterative splitting approaches are based on successive relaxation, means we apply several times in the same time-interval the solver method and improve cyclic the solutions in this local time-interval, see [6].
To apply the iterative approaches, we can apply the iterative solvers before or after a spatial discretization, means:
- •
1.) Iterative splitting after the discretization, we apply iterative schemes for the nonlinearities.
- •
2.) Iterative splitting before the discretization, we apply the iterative scheme to decompose the differential equation into a kernel and perturbation term.
3.2.1 Iterative scheme after discretization
We have the following SDE in continuous form:
[TABLE]
and in the SDE form as:
[TABLE]
We apply the discretization in time (Milstein-scheme) and space (finite-volume scheme) and obtain:
[TABLE]
where we have the initialization .
Further the solution of the Burgers’ equation is given as:
[TABLE]
while we apply for the linearization in the Burgers’ equation.
We apply a fixpoint-scheme to improve the standard Milstein scheme (32) and obtain:
[TABLE]
where we have the initialization .
We deal with the following iterative splitting approaches:
- •
Standard Milstein-scheme of second order ():
[TABLE]
- •
Second order iterative splitting approach (related to the standard Milstein-scheme of second order) ():
[TABLE]
where and obeys the Gaussian normal distribution with and .
3.2.2 Iterative scheme before the dicretization
We have the following iterative splitting approaches, before the discretization:
We have with:
[TABLE]
where we have the initialization .
We have the solution
[TABLE]
with initialization and .
We deal with the following iterative splitting approaches: First order iterative splitting approach (related to the AB-splitting approach, means with the rectangle rule and the semi-analytical approach):
- •
(Initialization):
[TABLE]
where .
- •
(first step):
[TABLE]
where we apply the Ito’s rule with a first order scheme (Euler-Maryama-scheme) and obtain:
[TABLE]
where and obeys the Gaussian normal distribution with and .
We improve the order to with the Milstein approach in the stochastic term and obtain:
[TABLE]
and result to (while is linear and not dependent of , we only have to apply the derivative to ).
The algorithm for is given in 3.1. We have to compute the solutions for .
Algorithm 3.1
We start with the initialization (initial value) and .
We compute :
[TABLE]
*we have as starting value. * 2. 2.
*We obtain the next solution , If , we stop, *
*else we apply and goto step 1. *
Second and third order iterative splitting approach (related to the ABA-splitting approach, means with the rectangle rule and the semi-analytical approach):
The next algorithm for is given in 3.2, we improve the last with an underlying ABA-method. We have to compute the solutions for .
Algorithm 3.2
We start with the initialization (initial value) and .
We compute :
[TABLE]
*we have as starting value. * 2. 2.
We compute (with ABA as solution for ):
[TABLE]
*we have and obeys the Gaussian normal distribution with and . * 3. 3.
*We obtain the next solution , If , we stop, *
*else we apply and goto step 1. *
The next algorithm for is given in 3.3, we improve the last with additional intermediate time-steps which are computed by an underlying ABA-method. We have to compute the solutions for .
Algorithm 3.3
We start with the initialization (initial value) and .
We compute :
[TABLE]
*we have as starting value. * 2. 2.
We compute (with ABA as solution for ):
[TABLE]
*we have and and obeys the Gaussian normal distribution with and . * 3. 3.
*We obtain the next solution , If , we stop, *
*else we apply and goto step 1. *
In figure 1, we have the improvement, which are done in Algorithm 3.2 and 3.3.
In figure 3, we see the further improvements of the iterative approaches.
4 Numerical Analysis
In the numerical analysis, we concentrate on the new iterative algorithms and present the approximation to the fixpoint of the solutions.
The iterative splitting scheme is given as:
[TABLE]
where we have with the start condition .
We apply the integration and have the solution
[TABLE]
with initialization and .
Definition 1
We have and . Further, is Lipschitz contiuous on with Lipschitz-constant if
[TABLE]
for all .
We have the following assuptions:
Assumption 4.1
We have the Lipschitz-constinuous functions and , while we also assume is Lipschitz continuous.
Then, we have the following Lemma:
Lemma 1
We have and . Further, and are contraction mappings on , while we assume are Lipschitz continuous with constants and .
Proof
We have
[TABLE]
While the operator for the pure deterministic Burgers’ equation is bounded with respect to and we obtain for sufficient small and .
Further, we have
[TABLE]
while the operator is bounded and lipschitz continuous.
Theorem 4.2
* is a closed subset of and and are contraction mappings on with Lipschitz-constants and , then the iterative scheme (4) converge linearly to with the factor .*
Proof
We apply the iterative scheme:
[TABLE]
and evalutate the integral based on the Taylor-Ito scheme at the integration point and obtain, accuracy of the Milstein-scheme, which is given as:
[TABLE]
We apply:
[TABLE]
where we assume the constants and are bounded and with sufficient small and .
We apply the recursion and obtain:
[TABLE]
where we obtain .
Remark 1
We obtain a convergence to the fixpoint of the equation based on the iterative scheme. We also obtain an acceleration of the solver-process and a reduction of the numerical error with additional iterative steps.
4.1 Numerical Error Analysis (strong and weak errors)
For the verification of the theoretical results for the iterative splitting scheme in section 3, we deal with the following numerical error analysis.
We present the convergence rates of the following weak errors:
- •
Weak errors:
[TABLE]
where are the number of solutions of the stochastic Burgers’ equation.
Further is the solution of the pure Burgers’ equation and is the -th solution of the stochastic Burgers’ equation. We assume to have runs of the stochastic Burgers’ equation.
- •
Variance for the solution at and -sample paths:
[TABLE]
we deal with number of seeds and , is the result of the method at in the seed . Further, we apply for the iterative scheme steps.
Remark 2
In the numerical examples, we obtain the weak convergence rates with the weak error. Here, we also apply the weak error to obtain an overview to the accuracy of the numerical schemes.
5 Numerical experiments
In the following numerical experiments, we concentrate on pure stochastic Burgers’ equation, which is given as:
[TABLE]
For the discretization with Finite Difference or Finite Volumes, we deal with the CFL condition of the two explicit discretized terms as:
- •
, for the deterministic part,
- •
, for the stochastic part,
- •
, for both terms and we assume ,
where we use estimates for and with is Gaussian normal distributed.
We apply the following methods, that we discussed in section 3:
- •
AB-splitting,
- •
ABA-splitting,
- •
BAB-splitting,
- •
iter-splitting (where we apply iterative steps).
The -errors of the different numerical schemes are given in figure 4.
The comparison of the schemes with the iterative splitting approach is given in figure 5.
The errors are defined as errors to compare to the weak and strong convergence, while is defined to see the error of the averaged stochastic solution to the deterministic solution. The errors of the schemes are presented in figure 6.
The seeds and the blow-ups of the noniterative splitting approaches are presented in 7. For the experiments and the numerical tests, we initialize the pseudo random generator for each new perturbation with a new seed.
The numerical errors between the perturbed and unperturbed solution and the averaged results are given in figure 8.
Remark 3
With the iterative splitting schemes, we obtain more accurate results and reduce the numerical errors in each iterative step.
6 Conclusion
We presented new iterative methods based on the Picard’s approximation. Such methods allow to obtain more accurate results, while we could reduce the error with the iterative steps. We presented first numerical results with the stochastic Burgers’ equation and multiplicative noise. In future, we also apply more delicate SPDEs with respect to mixed time and spatial noises.
7 Appendix
In the following, we add some more details to the iterative and non-iterative schemes.
7.1 Derivations of the methods
The SDE is given as:
[TABLE]
is a spatial dependent amplitude, that changes over time. is a Wiener process (Standard Brownian motion, summation of white noise) over time and is its time derivative; so basically white noise. is the diffusion coefficient and can further be time variant or dependent on past values of . For the sake of brevity, some variables stay omitted.
Ignoring the stochastic part on the right, one can transform the deterministic part and match it against the standard Burgers’ equation (missing diffusion term in this case),
[TABLE]
which is solved on a discrete time grid by the conservation law solver with Engquist-Osher in the function (solve conservation law).
A stochastic equation of the form
[TABLE]
with real constants and can be solved by the Milstein method and has the numerical solution
[TABLE]
with drift and diffusion . Via pattern matching, one can deduce a numerical solution for the stochastic part:
[TABLE]
Note that the notation of an index like t may refer to a derivative in continuous time or time stamp in discrete time. This solver is implemented in the function (solve stochastic differential equation).
7.2 AB-splitting
The AB-splitting approach divides the time scale into intervals. Each interval is further split into subintervals. The AB-splitting takes an initial condition and solves the deterministic problem on the subinterval to obtain a solution . The deterministic result is used as initial condition for the stochastic solver, which calculates the final result . This process is repeated times to obtain the final result.
7.3 ABA-splitting
This algorithm works almost identically to the upper one, but with a slight modification with regards to the order and length of the solvers. The deterministic solver is used on the first half of the subinterval, resulting in a helper solution . The stochastic solver than proceeds to calculate a solution on the whole subinterval and yields another solution , which is used as initial condition for the deterministic solver in order to yield the final result for the second half of the subinterval.
7.4 BAB-splitting
The same as above, but stochastic and deterministic solver are exchanged.
7.5 iterative splitting (after discretization)
The iterative scheme, here we apply the iterative steps of a stochastic equation of the form
[TABLE]
while we obtain an analytical solution of , which is .
We apply the Milstein-scheme plus a fixpoint iterative scheme, which is given as
[TABLE]
with drift and diffusion .
7.6 iterative splitting (before discretization)
iterative Steps ):
[TABLE]
7.7 Improvements be the integration of the variation of constants
(trapezoidal rule):
[TABLE]
:
[TABLE]
with .
7.8 Numerical Errors: Weak and Strong error
- •
Strong error:
[TABLE]
where is the index of the different seeds, meaning (different Wiener-processes) and is the number of the temporal and spatial steps. Furthermore is the deterministic reference solution and we test the schemes .
- •
Weak error:
[TABLE]
where we assume , further is the index of the different seeds for (different Wiener-processes) and are the number of seeds. is the number of the temporal and spatial steps. Additionally is the deterministic reference solution and we test the schemes . The weak error is defined with the average value of the stochastic result, while the reference solution is the deterministic result.
Acknowledgments
The authors would like to thank Dr. Erlend Briseid Storrosten (University of Oslo, Norwey) for his python-code. Based on his code and the discussion with him, we could modify the experiments for our splitting approaches.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M. Beccari, M. Hutzenthaler, A. Jentzen, R. Kurniawan, F. Lindner and D. Salimova. Strong and weak divergence of exponential and linear-implicit Euler approximations for stochastic partial differential equations with superlinearly growing nonlinearities. ar Xiv e-prints, ar Xiv:1903.06066, 2019.
- 2[2] J.R. Beddington and R.M. May. Harvesting natural populations in a randomly fluctuating environment. Science, 197(4302):463-465, 1977.
- 3[3] D. Blömker. Amplitude Equations for Stochastic Partial Differential Equations . Interdisciplinary Mathematical Sciences (cvol. 3), World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2007.
- 4[4] B. Birnir. The Kolmogorov-Obukhov Theory of Turbulence: A mathematical theory of turbulence. Springer Briefs in Mathematics. Springer, New York, 2013.
- 5[5] L.C. Evans. An Introduction to Stochastic Differential Equations . American Mathematical Society, 2013.
- 6[6] J. Geiser. Iterative Splitting Methods for Differential Equations. CRC Press, Taylor & Francis, Boca Raton, London, New York, 2011.
- 7[7] J. Geiser. Multicomponent and Multiscale Systems—Theory, Methods, and Applications in Engineering. Springer-Verlag, Berlin, 2016.
- 8[8] J. Geiser. Iterative Semi-implicit Splitting Methods for Stochastic Chemical Kinetics . Finite Difference Methods: Theory and Applications, Springer International Publishing, Cham, 35-47, 2019.
