The asymptotic error of chaos expansion approximations for stochastic differential equations
Tony Huschto, Mark Podolskij, Sebastian Sager

TL;DR
This paper introduces a Wiener chaos expansion-based numerical scheme for stochastic differential equations, providing explicit error bounds and leveraging Malliavin calculus for analysis.
Contribution
It presents a novel chaos expansion approximation method with explicit error bounds for SDEs, advancing numerical analysis in stochastic calculus.
Findings
Derived explicit upper bounds for $L^2$ approximation error.
Applied Malliavin calculus to analyze the chaos expansion approximation.
Demonstrated the effectiveness of the method for square integrable SDEs.
Abstract
In this paper we present a numerical scheme for stochastic differential equations based upon the Wiener chaos expansion. The approximation of a square integrable stochastic differential equation is obtained by cutting off the infinite chaos expansion in chaos order and in number of basis elements. We derive an explicit upper bound for the approximation error associated with our method. The proofs are based upon an application of Malliavin calculus.
| Trigonometric basis | Haar basis | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| type | time | time | |||||||
| 2 | 1 | 3 | full | 0.04 | 6.04 | 6.04 | 0.03 | 5.31 | 5.31 |
| 4 | 1 | 5 | full | 0.02 | 5.68 | 5.68 | 0.02 | 5.31 | 5.31 |
| 8 | 1 | 9 | full | 0.22 | 5.49 | 5.49 | 0.04 | 5.30 | 5.30 |
| 16 | 1 | 17 | full | 0.05 | 5.40 | 5.40 | 0.19 | 5.31 | 5.31 |
| 32 | 1 | 33 | full | 0.17 | 5.35 | 5.35 | 1.31 | 5.30 | 5.30 |
| 64 | 1 | 65 | full | 1.28 | 5.33 | 5.33 | 10.12 | 5.31 | 5.31 |
| 2 | 2 | 6 | full | 0.02 | 3.04 | 3.04 | 0.02 | 1.61 | 1.83 |
| 4 | 2 | 15 | full | 0.03 | 2.35 | 2.35 | 0.05 | 1.61 | 1.76 |
| 8 | 2 | 45 | full | 0.20 | 1.98 | 1.98 | 0.82 | 1.61 | 1.69 |
| 8 | 2 | 41 | sp1 | 0.31 | 1.99 | 1.99 | 0.24 | 1.61 | 1.69 |
| 8 | 2 | 19 | sp2 | 0.04 | 2.16 | 2.16 | 0.07 | 1.61 | 1.72 |
| 16 | 2 | 153 | full | 3.85 | 1.80 | 1.80 | 18.61 | 1.61 | 1.65 |
| 16 | 2 | 141 | sp3 | 1.00 | 1.80 | 1.80 | 4.60 | 1.61 | 1.65 |
| 16 | 2 | 27 | sp4 | 0.05 | 2.07 | 2.07 | 0.19 | 1.61 | 1.67 |
| 32 | 2 | 561 | full | 86.83 | 1.71 | 1.71 | 554.61 | 1.61 | 1.63 |
| 32 | 2 | 537 | sp5 | 22.80 | 1.71 | 1.71 | 143.90 | 1.61 | 1.63 |
| 32 | 2 | 69 | sp6 | 0.31 | 1.84 | 1.84 | 3.22 | 1.61 | 1.64 |
| 64 | 2 | 2145 | full | 2189.70 | 1.66 | 1.66 | 17234.51 | 1.61 | 1.62 |
| 2 | 3 | 10 | full | 0.02 | 2.15 | 2.15 | 0.02 | 0.38 | 1.35 |
| 4 | 3 | 35 | full | 0.10 | 1.29 | 1.29 | 0.19 | 0.38 | 1.01 |
| 8 | 3 | 165 | full | 2.76 | 0.84 | 0.84 | 10.58 | 0.38 | 0.76 |
| 8 | 3 | 127 | sp7 | 0.53 | 0.85 | 0.85 | 1.77 | 0.37 | 0.76 |
| 8 | 3 | 37 | sp8 | 0.06 | 1.11 | 1.11 | 0.13 | 0.38 | 0.86 |
| 16 | 3 | 969 | full | 200.34 | 0.61 | 0.61 | 1070.17 | 0.38 | 0.58 |
| 16 | 3 | 763 | sp9 | 45.61 | 0.62 | 0.62 | 169.16 | 0.38 | 0.59 |
| 16 | 3 | 45 | sp10 | 0.14 | 1.02 | 1.02 | 0.39 | 0.38 | 0.76 |
| 2 | 4 | 15 | full | 0.02 | 1.94 | 1.94 | 0.02 | 0.07 | 1.32 |
| 4 | 4 | 70 | full | 0.30 | 1.04 | 1.04 | 0.79 | 0.07 | 0.87 |
| 8 | 4 | 495 | full | 26.99 | 0.57 | 0.57 | 117.55 | 0.07 | 0.56 |
| 8 | 4 | 303 | sp11 | 4.34 | 0.57 | 0.57 | 12.30 | 0.07 | 0.52 |
| 8 | 4 | 32 | sp12 | 0.05 | 0.96 | 0.96 | 0.12 | 0.07 | 0.75 |
| 16 | 4 | 4845 | full | 5986.44 | 0.32 | 0.32 | 30591.94 | 0.07 | 0.33 |
| 16 | 4 | 40 | sp13 | 0.08 | 0.87 | 0.87 | 0.36 | 0.07 | 0.67 |
| 32 | 4 | 92 | sp14 | 0.50 | 0.59 | 0.59 | 3.56 | 0.07 | 0.45 |
| 2 | 5 | 21 | full | 0.03 | 1.91 | 1.91 | 0.03 | 0.01 | 1.27 |
| 4 | 5 | 126 | full | 0.92 | 1.00 | 1.00 | 2.04 | 0.01 | 0.87 |
| 8 | 5 | 1287 | full | 192.98 | 0.51 | 0.51 | 855.07 | 0.01 | 0.53 |
| 8 | 5 | 599 | sp15 | 10.04 | 0.51 | 0.51 | 50.03 | 0.01 | 0.55 |
| 8 | 5 | 36 | sp16 | 0.03 | 0.92 | 0.92 | 0.11 | 0.01 | 0.74 |
| 16 | 5 | 20349 | full | 120469.96 | 0.26 | 0.26 | 600591.17 | 0.01 | 0.28 |
| 16 | 5 | 44 | sp17 | 0.06 | 0.83 | 0.83 | 0.28 | 0.01 | 0.65 |
| 32 | 5 | 98 | sp18 | 0.51 | 0.55 | 0.55 | 3.60 | 0.01 | 0.42 |
| symbol | order | index / | |||
| sp1 | 2 | 8 | 1 | 41 | |
| sp2 | 2 | 8 | 2 | 19 | |
| sp3 | 2 | 16 | 1 | 141 | |
| sp4 | 2 | 16 | 2 | 27 | |
| sp5 | 2 | 32 | 1 | 537 | |
| sp6 | 2 | 32 | 2 | 69 | |
| sp7 | 3 | 8 | 1 | 127 | |
| sp8 | 3 | 8 | 2 | 37 | |
| sp9 | 3 | 16 | 1 | 763 | |
| sp10 | 3 | 16 | 2 | 45 | |
| sp11 | 4 | 8 | 1 | 303 | |
| sp12 | 4 | 8 | 2 | 32 | |
| sp13 | 4 | 16 | 2 | 40 | |
| sp14 | 4 | 32 | 2 | 92 | |
| sp15 | 5 | 8 | 1 | 599 | |
| sp16 | 5 | 8 | 2 | 36 | |
| sp17 | 5 | 16 | 2 | 44 | |
| sp18 | 5 | 32 | 2 | 98 | |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The asymptotic error of chaos expansion approximations for
stochastic differential equations
T.Tony Huschtolabel=e1][email protected] [
M.Mark Podolskijlabel=e2][email protected] [
S.Sebastian Sagerlabel=e3][email protected] [ Department of Mathematics, \institutionHeidelberg University, Im Neuenheimer Feld 205, 69120 Heidelberg, \cnyGermany
Department of Mathematics, \institutionAarhus University, Ny Munkegade 118,8000 Aarhus, \cnyDenmark
Faculty of Mathematics, \institutionOtto-von-Guericke Universität Magdeburg, Universitätsplatz 2, 39106 Magdeburg, \cnyGermany
(2019; \sday22 11 2018; \sday9 3 2019; \sday9 3 2019)
Abstract
In this paper we present a numerical scheme for stochastic differential equations based upon the Wiener chaos expansion. The approximation of a square integrable stochastic differential equation is obtained by cutting off the infinite chaos expansion in chaos order and in number of basis elements. We derive an explicit upper bound for the approximation error associated with our method. The proofs are based upon an application of Malliavin calculus.
Chaos expansion,
Malliavin calculus,
numerical approximation,
stochastic differential equations,
65C30,
60H10,
60H07,
doi:
10.15559/19-VMSTA133
keywords:
keywords:
[MSC2010]
††volume: 6††issue: 2††articletype: research-article
\aid
VMSTA133 \startlocaldefs
\urlstylerm \endlocaldefs
\pretitle
Research Article
[type=corresp,id=cor1]Corresponding author.
\publishedonline\sday
23 4 2019
1 Introduction
We consider a one-dimensional continuous stochastic process that satisfies the stochastic differential equation
[TABLE]
where is a Brownian motion defined on a filtered probability space . Various numerical approximation schemes for the SDE (1.1) have been proposed and studied in the literature in the past decades. The probably most prominent numerical approximation for the solution of (1.1) is the Euler scheme, which can be described as follows. Let be the function defined by when . The continuous Euler approximation scheme is described by
[TABLE]
The probabilistic properties of the Euler approximation scheme have been investigated in numerous papers. We refer to the classical works [2, 3, 14, 16, 17, 23] for the studies on weak and strong approximation errors among many others. Asymptotic results in the framework of non-regular coefficients can be found in e.g. [1, 8, 9, 27].
In this paper we take a different route and propose to use the Wiener chaos expansion (also called polynomial chaos in the literature) to approximate the solution of the SDE (1.1). To explain ideas let us fix an orthonormal basis of the separable Hilbert space . It is a well-known statement (cf. [6]) that if for all , where is generated by the Brownian motion , it admits the chaotic expansion
[TABLE]
where are deterministic functions, are mutually orthogonal random projections that are associated to the basis , and the index set is defined via
[TABLE]
Such orthogonal expansions have been successfully applied in numerous fields of stochastic and numerical analysis. We refer e.g. to [11, 12, 13, 25] for applications of the Wiener chaos expansion in the context of SDEs and to [20, 21, 22, 26] for applications of polynomial expansion in modelling, simulation and filtering of stochastic partial differential equations. The aim of this work is to use the chaos expansion (1.3) to numerically approximate the solution of the SDE (1.1). For this purpose we need to truncate the infinite sum in (1.3). An obvious approach is to consider the approximation
[TABLE]
where the subset refers to using orthogonal projections only with respect to the first basis elements and only up to the th order Wiener chaos. This method is mostly related to the articles [11, 12, 22, 21]. More specifically, the works [21, 22] study the -error associated with the approximation (1.5), but only for a particular choice of the basis . In this paper we will study the decay rate of when for a general basis of applying methods from Malliavin calculus.
The paper is structured as follows. In Section 2 we present the elements of Malliavin calculus. The main results of the paper are demonstrated in Section 3. Section 4 is devoted to proofs. In Section 5 we illustrate our approach with exemplary numerical results for the Haar and a trigonometric basis, and propose a heuristic based on sparse indices for computational speedup.
2 Background on Malliavin calculus
In this section we introduce some basic concepts of Malliavin calculus. The interested readers are referred to [24] for more thorough exposition on this subject. Set and let denote the scalar product on . We note that is a separable Hilbert space and denote by an orthonormal basis of . We consider the isonormal Gaussian family indexed by defined on a probability space , i.e. the random variables are centered Gaussian with a covariance structure determined via
[TABLE]
Here and throughout the paper we assume that . In our setting we consider , where is a standard Brownian motion. We define the normalised Hermite polynomials through the identities
[TABLE]
The th Wiener chaos is the closed linear subspace of generated by the family of random variables . The vector spaces , , are orthogonal and we have the Wiener chaos expansion
[TABLE]
(See [24, Theorem 1.1.1] for more details.) Next, for , where has been introduced in (1.4), we define the random variable
[TABLE]
where is a fixed orthonormal basis of . We define and for . We deduce that the set forms a complete orthonormal basis of the th Wiener chaos and consequently is a complete orthonormal basis of (cf. [24, Proposition 1.1.1]).
Now, we introduce multiple stochastic integrals of order , which are denoted by . For an element in with , we define
[TABLE]
Assuming that the mapping is linear, the definition (2.4) can be extended to all symmetric elements by polarisation identity. Finally, for an arbitrary function we set
[TABLE]
where denotes the symmetrised version of . By definition maps into , so the multiple integrals of different orders are orthogonal. In particular, they satisfy the isometry property
[TABLE]
Furthermore, for any symmetric , the following multiplication formula holds:
[TABLE]
where the th contraction is defined by
[TABLE]
(See [24, Proposition 1.1.3].) The Wiener chaos expansion (2.2) transfers to the context of multiple integrals as follows. For each random variable we obtain the orthogonal decomposition
[TABLE]
where and the decomposition is unique when , , are assumed to be symmetric (cf. [24, Theorem 1.1.2]).
Next, we introduce the notion of Malliavin derivative and its adjoint operator. We define the set of smooth random variables via
[TABLE]
where (i.e. the space of infinitely differentiable functions such that all derivatives exhibit polynomial growth). The th order Malliavin derivative of , denoted by , is defined by
[TABLE]
Notice that is a -valued random variable, and we write for the realisation of the function at the point . The space denotes the completion of the set with respect to the norm
[TABLE]
We define . The Malliavin derivative of the random variable , , can be easily computed using the definition (2.8) and the formula :
[TABLE]
Higher order Malliavin derivatives of are computed similarly.
The operator possesses an unbounded adjoint denoted by , which is often referred to as multiple Skorokhod integral. The following integration by parts formula holds (see [24, Exercise 1.3.7]): if and , where consists of all elements such that the inequality holds for some and all , then we have the identity
[TABLE]
In case the random variable has a chaos decomposition as displayed in (2.7), the statement is equivalent to the condition . In particular, when we deduce an explicit chaos representation of the derivative
[TABLE]
where is obtained from the function by setting the last argument equal to (see [24, Proposition 1.2.7 ]). Finally, we present an explicit formula for the Malliavin derivative of a solution of a stochastic differential equation. Assume that is a solution of a stochastic differential equation (1.1) and . In this setting is given as the solution of the SDE
[TABLE]
for , and if (see [24, Theorem 2.2.1]). Throughout the paper denotes the derivative with respect to the space variable and denotes the derivative with respect to the time variable.
3 Main results
We start with the analysis of the Wiener chaos expansion introduced in (1.3). Under square integrability assumption on the solution of the SDE (1.1) we obtain the Wiener chaos expansion
[TABLE]
In order to study the strong approximation error we require a good control of the coefficients . When is sufficiently smooth in the Malliavin sense, we deduce the identity
[TABLE]
applying the duality formula (2.11). In fact, the coefficients satisfy a system of ordinary differential equations. The following propagator system has been derived in [12, 21]. We state the proof for completeness.
Theorem 3.1
Let be the unique solution of the SDE (1.1) and assume that . Then possesses the chaos expansion (1.3) and the coefficients satisfy the system of ordinary differential equations
[TABLE]
Here (resp. ) denotes the -coefficient of the Wiener chaos expansion (1.3) associated with the random variable (resp. ), and the multi-index is defined by (2.10).
Proof.
Using the SDE (1.1) and applying the formula (3.1) we obtain the identity
[TABLE]
Applying the formula (3.1) once again for the random variable we immediately deduce that
[TABLE]
On the other hand, observing the identity , we get by the duality formula (2.11) and (2.9) that
[TABLE]
Putting things together we obtain the identity
[TABLE]
Consequently, the assertion follows after taking the derivative with respect to . ∎
We remark that the propagator system (3.2) is recursive. Let us give some simple examples to illustrate how (3.2) can be solved explicitly.
Example 3.2**.**
(i) (Scaled Brownian motion with drift) We start with the toy example of a scaled Brownian motion with drift:
[TABLE]
In this case we obviously have that for any with . Applying formula (3.2) we obtain the representation
[TABLE]
which is a well known Karhunen–Loéve expansion of the scaled Brownian motion.
(ii) (Geometric Brownian motion) Let us consider the geometric Brownian motion defined via the SDE
[TABLE]
In this setting the propagator system (3.2) translates to
[TABLE]
This system of ordinary differential equations can be solved recursively. For we have and hence . If is the th canonical unit vector in (and hence ) we obtain the differential equation
[TABLE]
Hence, . Following this recursion we obtain the general formula
[TABLE]
for any with .
For a general specification of the drift coefficient and diffusion coefficient in model (1.1) the propagator system (3.2) cannot be solved explicitly. Thus, precise infinite dimensional Wiener chaos expansion (1.3) is out of reach. For simulation purposes it is an obvious idea to consider a finite subset of in the expansion (1.3). We introduce the index set
[TABLE]
The approximation of is now defined via (1.5):
[TABLE]
We remark that the quantity is more useful than the Euler approximation introduced in (1.2) if we are interested in the approximation of the first two moments of . Indeed, the first two moments of are given explicitly by
[TABLE]
while higher order moments can be computed via an application of the multiplication formula (2.6).
The strong approximation error associated with the truncation (3.4) has been previously studied in [21, 22] in a slightly different context. In particular, in both papers the authors consider one specific basis of whereas we are interested in the asymptotic analysis for a general basis . While [22] mostly uses methods from analysis, our approach is based upon Malliavin calculus and is close in spirit to [21]. The main result of our paper gives an upper bound on the -error .
Theorem 3.3
Let be the solution of the SDE (1.1). Suppose that the coefficient functions and satisfy the Lipschitz and linear growth conditions
[TABLE]
Moreover, assume that , where denotes the space of functions that are once continuously differentiable in the first component and infinitely differentiable in the second component, such that
[TABLE]
for , any , and . Then it holds that
[TABLE]
where is a positive constant and the function is defined by
[TABLE]
Let us give some remarks about the statement (3.6). First of all, recalling the Karhunen–Loéve expansion , we readily deduce that
[TABLE]
Hence, the upper bound on the right-hand side of (3.6) indeed converges to [math] when . We also note that the error associated with the truncation of the chaos order does not depend on the particular choice of the basis , while the error associated with truncation of basis strongly depends on (which is not really surprising). Furthermore, we remark that it is extremely computationally costly to compute all coefficients , , for a large chaos order . Thanks to the first bound in (3.6) it is sufficient to use small values of in practical situations (usually ).
Example 3.4**.**
Let us explicitly compute the last terms of the upper bound (3.6) for two prominent bases of .
(i) (Trigonometric basis) Consider the orthonormal basis given by
[TABLE]
In this setting we obtain that
[TABLE]
for any . Consequently, we deduce that
[TABLE]
for some .
(ii) (Haar basis) The Haar basis is a collection of functions
[TABLE]
defined as follows:
[TABLE]
In this case we deduce the following representation for :
[TABLE]
Since and only for , we finally obtain that
[TABLE]
Note that the exponential asymptotic rate for a fixed th order Wiener chaos is equivalent to , if we choose basis elements . We will come back to these two bases in Section 5 where we provide exemplary numerical results that highlight this identical asymptotic rate, but also the different error distributions over time.
4 Proofs
Throughout the proofs denotes a generic positive constant, which might change from line to line. We start with a proposition that gives an upper bound for the -norm of the Malliavin derivatives of .
Proposition 4.1
Under conditions of Theorem 3.3 we obtain the estimate
[TABLE]
Proof.
We show the assertion of Proposition 4.1 by induction over . For the result is a well-known consequence of the Lipschitz and linear growth conditions (3.5) on the functions and (see e.g. [15, Theorem 2.9, page 289] which relates the second moment of to the second moment of the initial condition ). For we known from the formula (2.13) that the process satisfies the SDE
[TABLE]
for , and for . Next, we introduce the two-dimensional stochastic process via
[TABLE]
Note that the process satisfies a two-dimensional SDE with initial condition given by . In particular, setting , we have the representation
[TABLE]
where and for . Applying again the estimates of [15, Theorem 2.9, page 289] to the diffusion process , we conclude the estimate
[TABLE]
Now, we will perform the induction step. Notice that , so its Malliavin derivative satisfies again an SDE according to [24, Theorem 2.2.2]. We define the stochastic process
[TABLE]
Assume that the assertion of Theorem 3.3 holds for all . In order to compute the estimate, we have to consider the initial values of the SDE system satisfied by . The formula below can be found in [24, Theorem 2.2.2]. Before we state it, we need some additional notation. The stochastic process D^{m}X_{t}=\{D^{m}_{s_{1},\ldots,s_{m}}X_{t}\bigm{|}(s_{1},\ldots,s_{m})\in[0,T]\} depends on the time points . For any subset of with elements, denote . Further on, we define
[TABLE]
and
[TABLE]
where the sums run over the set of all partitions of , where are disjoint sets. We determine as well. With these notations at hand, we find by (2.13) and induction that the th order Malliavin derivative satisfies the linear SDE
[TABLE]
for and else. Hence, its initial value is given by
[TABLE]
where
[TABLE]
Finally, we apply [15, Theorem 2.9, page 289] as for the case and taking into account that the assertion holds for :
[TABLE]
This completes the proof of Proposition 4.1. ∎
Now, we proceed with the proof of the main result of Theorem 3.3, which follows the ideas of [21, Proof of Theorem 2.2]. Observe the decomposition
[TABLE]
where . To determine an upper bound for , we use the chaos expansions (1.3) and (2.7) of , i.e.,
[TABLE]
with and symmetric kernel functions being defined by
[TABLE]
for all . We conclude that
[TABLE]
where we abbreviate
[TABLE]
Therefore, we deduce via (4) that
[TABLE]
Finally, using (4.8) and applying Proposition 4.1 we obtain
[TABLE]
The treatment of the term is more involved. Recalling the definition of , we introduce the characteristic set of for and . It is defined as follows: is the index of the first non-zero component of . If then is the index of the second non-zero component of ; otherwise and is the second non-zero component of . The same operation is repeated for the index and further non-zero components of . In this fashion, the characteristic set is constructed, resulting in the observation that . To give a simple example, consider the multiindex . Here the characteristic set of is given by
[TABLE]
For any with and a basis of , we denote by the (scaled) symmetrised form of defined via
[TABLE]
where is the characteristic set of and the sum runs over all permutations within the permutation group of . From (3.1) we know that . On the other hand, we have the representation
[TABLE]
Now, for any with , we obtain the identity
[TABLE]
by (2.11). Since
[TABLE]
where is obtained from by omitting and denotes the diminished multi-index as defined in (2.10), we deduce that
[TABLE]
with and , by changing the order of integration. Then for any we integrate by parts to deduce
[TABLE]
where
[TABLE]
Now, we use substitution in (4.12) by renaming in the following way for each : With for all and for all , we have by setting and . Moreover, we denote with , , the set that is generated from by taking twice. To finalize this notation, we set and . Then
[TABLE]
Because and , from (4.13) we see that by summing over all terms except one cancel out. Hence, setting
[TABLE]
we obtain from (4.12)
[TABLE]
since and . In order to interpret the last sum, consider the random variable . Then, following (4) and the identity (4.11), we conclude that
[TABLE]
Thus, we get the estimate
[TABLE]
Now, using the Cauchy–Schwarz inequality we deduce that
[TABLE]
Recall the identity . Using similar arguments as in the proof of Proposition 4.1, we obtain the inequality
[TABLE]
Since , we finally conclude that
[TABLE]
Consequently, we deduce
[TABLE]
Putting things together we conclude
[TABLE]
Combining (4) and (4.15) we obtain the result of Theorem 3.3.
5 Numerical results and sparse truncation
To get an idea of the performance of the polynomial chaos expansion for different bases and truncations, we apply the trigonometric basis from Example 3.4 (i) and the Haar basis from Example 3.4 (ii) to the geometric Brownian motion from Example 3.2,
[TABLE]
on the horizon with . In this setting we have the identity
[TABLE]
which can be used to compare the absolute errors of approximated variances using different bases and values for and . We used the ode45 solver with standard settings within Matlab 2017b (64bit, single core) on an Intel Core i5-6300U (2.4GHz, 8GB RAM).
5.1 Absolute errors of variances
Figure 1 shows the absolute errors between the variances of the analytical solution and different polynomial chaos expansions. One observes the fast decay of the approximation error for fixed and increasing , and vice versa. The main difference between the observed errors is that the maximum of the trigonometric expansion is always at the end of the time horizon at , while the Haar basis leads to almost zero error on equidistant time points, including and .
Table 1 in the Appendix lists approximation errors, numbers of coefficients, and computational times for several choices of and . The exponential increase in the number of coefficients with increasing and leads to an exponential increase in runtime, as expected. To overcome this issue, we propose a heuristic to reduce the computational burden.
5.2 Sparse truncation
The information contained in the coefficient functions decays with increasing order of the basis polynomials and the decaying rate of the Gaussian expansion, i.e., the index of the basis polynomials used for constructing [22].
Hence, we can define sparse index sets for reducing the number of multi-indices from the full truncated index set without losing too much information, i.e., accuracy in a numerical simulation.
Definition 1** (Sparse truncation of first order).**
Let be the maximum order of the index . Then the first order sparse index satisfies and we define the first order sparse index set
[TABLE]
Example 5.1**.**
Let and . Then a possible choice of the sparse index is . For constructing the first order polynomials all five first order basis polynomials can be used. The second order polynomials are comprised by all possible combinations of first order basis polynomials depending on and the second order basis polynomials of . Analogously, the third order polynomials are constructed. By using this first order sparse index set the number of coefficient functions appearing within the propagator system (3.2) can be reduced drastically without impairing the solution much. The full index set consists of terms, whereas this first order sparse index set includes terms.
An even more rigorous reduction of the number of coefficients included in the propagator system can be achieved by using a second order sparse index, i.e., a series of first order sparse indices that depend on the actual order of the polynomials with , [22]. This approach allows to exclude crossing products of random variables from the construction of higher order basis polynomials that add only negligible information to the system.
Definition 2** (Sparse truncation of second order).**
Let be the maximum order of the index . Then the second order sparse index is a series of first order sparse indices satisfying for all and we define the second order sparse index set
[TABLE]
Example 5.2**.**
Considering again the setting of the previous example with and , one possible choice of a second order sparse index is given via , , and . In constructing basis polynomials of order we can use all combinations of basis polynomials depending on the first two random variables and up to orders and , respectively. Thus, these are , , and , compare [22].
Table 2 in the Appendix lists the first and second order sparse indices that were used for the numerical study. The results in Table 1 show that at the price of a slightly higher error, and of course the loss of a guaranteed upper bound as in (3.6), the computational times could be reduced by several orders of magnitude.
Appendix
{funding}
This project has received funding from the \gsponsor[id=GS1,sponsor-id=100010663]European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No \gnumber[refid=GS1]647573), from \gsponsor[id=GS4,sponsor-id=501100001659]Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – \gnumber[refid=GS4]314838170, GRK 2297 MathCoRe, from the project “Ambit fields: probabilistic properties and statistical inference” funded by \gsponsor[id=GS7,sponsor-id=100008398]Villum Fonden, and from CREATES funded by the \gsponsor[id=GS8,sponsor-id=501100001732]Danish National Research Foundation.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] {botherref} \oauthor \bsnm Arnold, \binits S.: Approximation schemes for SD Es with discontinuous coefficients. Ph D thesis, ETH Zürich (2006) \Orig Bib Text S. Arnold (2006): Approximation schemes for SD Es with discontinuous coefficients. Ph D thesis , ETH Zürich. \end Orig Bib Text \bptok structpyb \endbibitem
- 2[2] {barticle} \bauthor \bsnm Bally, \binits V., \bauthor \bsnm Talay, \binits D.: \batitle The law of the Euler scheme for stochastic differential equations. I. Convergence rate of the distribution function. \bjtitle Probab. Theory Relat. Fields \bvolume 104( \bissue 1), \bfpage 43– \blpage 60 ( \byear 1996). \bid doi=10.1007/BF 01303802, mr=1367666 \Orig Bib Text V. Bally and D. Talay (1996): The law of the Euler scheme for stochastic differential equations. I. Convergence rate of
- 3[3] {barticle} \bauthor \bsnm Bally, \binits V., \bauthor \bsnm Talay, \binits D.: \batitle The law of the Euler scheme for stochastic differential equations. II. Convergence rate of the density. \bjtitle Monte Carlo Methods Appl. \bvolume 2( \bissue 2), \bfpage 93– \blpage 128 ( \byear 1996). \bid doi=10.1515/mcma.1996.2.2.93, mr=1401964 \Orig Bib Text V. Bally and D. Talay (1996): The law of the Euler scheme for stochastic differential equations. II. Convergence rate of the densi
- 4[4] {barticle} \bauthor \bsnm Benth, \binits F.E., \bauthor \bsnm Gjerde, \binits J.: \batitle Convergence rates for finite element approximations of stochastic partial differential equations. \bjtitle Stoch. Stoch. Rep. \bvolume 63, \bfpage 313– \blpage 326 ( \byear 1998). \bid doi=10.1080/17442509808834153, mr=1658087 \Orig Bib Text F. E. Benth and J. Gjerde (1998): Convergence rates for finite element approximations of stochastic partial differential equations. Stochastics and
- 5[5] {barticle} \bauthor \bsnm Benth, \binits F.E., \bauthor \bsnm Theting, \binits T.G.: \batitle Some regularity results for the stochastic pressure equation of Wick-type. \bjtitle Stoch. Anal. Appl. \bvolume 20, \bfpage 1191– \blpage 1223 ( \byear 2002). \bid doi= 10.1081/SAP-120015830, mr=1943795 \Orig Bib Text F. E. Benth and T. G. Theting (2002): Some regularity results for the stochastic pressure equation of Wick-type. Stochastic Analysis and Applications , 20, 1191–1223.
- 6[6] {barticle} \bauthor \bsnm Cameron, \binits R.H., \bauthor \bsnm Martin, \binits W.T.: \batitle The orthogonal development of non-linear functionals in series of Fourier-Hermite functionals. \bjtitle Ann. Math. \bvolume 48, \bfpage 385– \blpage 392 ( \byear 1947). \bid doi=10.2307/1969178, mr=0020230 \Orig Bib Text R. H. Cameron and W. T. Martin (1947): The orthogonal development of non-linear functionals in series of Fourier-Hermite functionals. Ann. Math. 48, 385–392. \end O
- 7[7] {barticle} \bauthor \bsnm Cao, \binits Y.: \batitle On convergence rate of Wiener-Itô expansion for generalized random variables. \bjtitle Stochastics \bvolume 78, \bfpage 179– \blpage 187 ( \byear 2006). \bid doi=10.1080/ 17442500600768641, mr=2241915 \Orig Bib Text Y. Cao (2006): On convergence rate of Wiener-Itô expansion for generalized random variables. Stochastics , 78, 179–187. \end Orig Bib Text \bptok structpyb \endbibitem
- 8[8] {barticle} \bauthor \bsnm Chan, \binits K.S., \bauthor \bsnm Stramer, \binits O.: \batitle Weak consistency of the Euler method for numerically solving stochastic differential equations with discontinuous coefficients. \bjtitle Stoch. Process. Appl. \bvolume 76( \bissue 1), \bfpage 33– \blpage 44 ( \byear 1998). \bid doi=10.1016/S 0304-4149(98)00020-9, mr=1638015 \Orig Bib Text K. S. Chan and O. Stramer (1998): Weak consistency of the Euler method for numerically solving stochas
