Numerical solution of fractional elliptic stochastic PDEs with spatial white noise
David Bolin, Kristin Kirchner, Mih\'aly Kov\'acs

TL;DR
This paper develops an efficient numerical method for solving fractional elliptic stochastic PDEs with spatial white noise, using integral representations, quadrature, finite element discretization, and noise approximation, with proven convergence rates.
Contribution
It introduces a novel numerical approach combining integral representation, quadrature, and finite element methods for fractional elliptic SPDEs driven by white noise, with explicit error analysis.
Findings
Numerical experiments confirm theoretical convergence rates.
Method effectively approximates solutions in 1D, 2D, and 3D.
Error analysis provides explicit strong mean-square convergence rates.
Abstract
The numerical approximation of solutions to stochastic partial differential equations with additive spatial white noise on bounded domains in is considered. The differential operator is given by the fractional power , , of an integer order elliptic differential operator and is therefore non-local. Its inverse is represented by a Bochner integral from the Dunford-Taylor functional calculus. By applying a quadrature formula to this integral representation, the inverse fractional power operator is approximated by a weighted sum of non-fractional resolvents at certain quadrature nodes . The resolvents are then discretized in space by a standard finite element method. This approach is combined with an approximation of the white noise, which is based only on the mass matrix of the finite element…
| 127 | 37 | 61 | 99 | 176 | 408 | |
|---|---|---|---|---|---|---|
| 255 | 48 | 77 | 129 | 229 | 533 | |
| 511 | 60 | 99 | 163 | 291 | 675 | |
| 1023 | 73 | 121 | 200 | 357 | 832 | |
| 961 | - | - | 43 | 75 | 171 | |
| 3969 | - | - | 62 | 109 | 253 | |
| 16129 | - | - | 86 | 152 | 352 | |
| 65025 | - | - | 113 | 203 | 469 | |
| 729 | - | - | - | - | 55 | |
| 6859 | - | - | - | - | 105 | |
| 59319 | - | - | - | - | 172 | |
| 0.25 (0.25) | 0.50 (0.5) | 0.75 (0.75) | 1.00 (1) | 1.21 (1.25) | |
| - | - | 0.29 (0.25) | 0.51 (0.5) | 0.74 (0.75) | |
| - | - | - | - | 0.26 (0.25) | |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Numerical solution of fractional elliptic stochastic PDEs with spatial white noise
David Bolin, Kristin Kirchner, and Mihály Kovács
Department of Mathematical Sciences
Chalmers University of Technology and University of Gothenburg
412 96 Göteborg, Sweden
(K. Kirchner, corresponding author) [email protected]
(Date: March 7, 2024)
Abstract.
The numerical approximation of solutions to stochastic partial differential equations with additive spatial white noise on bounded domains in is considered. The differential operator is given by the fractional power , , of an integer order elliptic differential operator and is therefore non-local. Its inverse is represented by a Bochner integral from the Dunford–Taylor functional calculus. By applying a quadrature formula to this integral representation, the inverse fractional power operator is approximated by a weighted sum of non-fractional resolvents at certain quadrature nodes . The resolvents are then discretized in space by a standard finite element method.
This approach is combined with an approximation of the white noise, which is based only on the mass matrix of the finite element discretization. In this way, an efficient numerical algorithm for computing samples of the approximate solution is obtained. For the resulting approximation, the strong mean-square error is analyzed and an explicit rate of convergence is derived. Numerical experiments for , , with homogeneous Dirichlet boundary conditions on the unit cube in spatial dimensions for varying attest the theoretical results.
Key words and phrases:
stochastic partial differential equations, Gaussian white noise, fractional operators, finite element methods, Matérn covariances, spatial statistics.
2010 Mathematics Subject Classification:
Primary: 35S15, 65C30, 65C60, 65N12, 65N30.
Acknowledgement. This work was supported in part by the Swedish Research Council (grant Nos. 2016-04187, 2017-04274), and the Knut and Alice Wallenberg Foundation (KAW 20012.0067). The authors thank Stefan A. Funken for his contribution to the FEM implementations in Matlab.
1. Introduction
A real-valued Gaussian random field defined on a spatial domain is called a Gaussian Matérn field if its covariance function is given by
[TABLE]
where is the Euclidean norm on and , denote the gamma function and the modified Bessel function of the second kind, respectively. Via the positive parameters , , and the most important characteristics of the random field can be controlled: its variance, smoothness, and correlation range. Due to this flexibility, Gaussian Matérn fields are often used for modeling in spatial statistics, see, e.g., Stein (1999). However, a major drawback of this traditional covariance-based representation of Matérn fields is its high computational effort. For instance, sampling from at locations requires a matrix factorization of an covariance matrix and, thus, in general, arithmetic operations.
There are several approaches attempting to cope with this computational problem (see, e.g., Banerjee et al., 2008; Furrer et al., 2006; Nychka et al., 2015; Sun et al., 2012). One of them is based on the insight that a Gaussian Matérn field on with parameters can be seen as the statistically stationary solution to the stochastic partial differential equation (SPDE)
[TABLE]
Here, denotes the Laplacian, , and is Gaussian white noise on . The marginal variance of is then given by .
This relation between Matérn fields and SPDEs had already been noticed by Whittle (1954, 1963). Later on, based on a finite element discretization of (1.2), where the differential operator is augmented with Neumann boundary conditions, Markov random field approximations of Matérn fields on bounded domains were introduced by Lindgren et al. (2011). Owing to the computational savings of this approach compared to the covariance-based approximations, these SPDE-based models have become very popular in spatial statistics (see, e.g., Bhatt et al., 2015; Lai et al., 2015), and they are still subject of current research, mainly because of the following reason: the SPDE formulation (1.2) facilitates various generalizations of approximations of Gaussian Matérn fields involving
(a) other differential operators (Bolin & Lindgren, 2011; Fuglstad et al., 2015; Lindgren et al., 2011),
(b) more general domains, such as the sphere (Bolin & Lindgren, 2011; Lindgren et al., 2011), and
(c) non-Gaussian driving noise (Bolin, 2014; Wallin & Bolin, 2015).
However, a considerable drawback of the finite element approximation proposed by Lindgren et al. (2011) is that it is only computable if . This limits flexibility, and, in particular, it implies that the method cannot be applied to the important special case of exponential covariance () in , which corresponds to .
With the objective of extending the approach of Lindgren et al. (2011) to all admissible values (i.e., and the generalizations mentioned above, we consider (1.2) in the more general framework of fractional order elliptic equations driven by white noise. We propose an explicit numerical scheme for generating samples of an approximation to the Gaussian solution process, which allows for any fractional power . This method is based on:
(i) a standard finite element discretization in space,
(ii) a quadrature approximation of the inverse fractional elliptic differential operator proposed by Bonito & Pasciak (2015) for deterministic equations, and
(iii) an approximation of the noise term on the right-hand side, whose covariance matrix after discretization is equal to the finite element mass matrix.
Due to (iii) no explicit knowledge of the eigenfunctions of the differential operator is needed in contrast to approximations based on truncated Karhunen–Loève expansions of the noise term (e.g., Zhang et al., 2016).
While Zhang et al. (2016) remarked that any orthonormal basis can be used in the Karhunen–Loève expansion of the noise term before projecting it onto the finite element space, their error analysis strongly benefits from the fact that the eigenfunctions of the differential operator are used. In fact, if a general orthonormal basis was used, it would be difficult to obtain explicit rates of convergence with respect to the truncation level after truncating the expansion at a finite level. Only if the constructed basis has certain smoothness with respect to the differential operator, it is possible to obtain explicit rates of convergence (see, e.g., Kovács et al., 2011, addressing this kind of problem). Constructing such an orthonormal basis requires a lot of computational effort, in particular, for complicated domains and . In contrast, the present approach is based on an expansion with respect to the standard (non-orthonormal) finite element basis for the discretized problem, which is readily available even for complex geometries.
This work follows a series of investigations of numerical methods for deterministic fractional order equations (Baeumer et al., 2015; Bonito et al., 2017; Bonito & Pasciak, 2015; Caffarelli & Silvestre, 2007; Gavrilyuk, 1996; Gavrilyuk et al., 2004, 2005; Jin et al., 2015; Nochetto et al., 2015; Roop, 2006), and for non-fractional elliptic SPDEs with random forcing (e.g., Babuska et al., 2004; Cao et al., 2007; Du & Zhang, 2003; Gyöngy & Martínez, 2006; Zhang et al., 2016). An essentially similar idea to our approach, which combines (iii) with Lanczos and Krylov subspace methods, was persued by Simpson (2008) for the differential operator in (1.2). However, neither weak nor strong convergence have been proven and the empirical results show a generally poor performance of the proposed scheme. A weak error estimate for and the non-fractional case in spatial dimensions has been derived by Simpson et al. (2012), showing quadratic weak convergence for that particular case. Since the first two moments uniquely determine the distribution of the Gaussian solution process, an alternative approach is to consider the problem of approximating the covariance function of the solution instead of solving for the solution process itself (Dölz et al., 2017). Note that this method cannot be generalized to non-Gaussian models.
The structure of this article is as follows: In §2 we present the fractional order equation with Gaussian white noise in a Hilbert space setting, the necessary assumptions, and comment on existence and uniqueness of a solution to this problem. Furthermore, we introduce the numerical approximation of the solution process and state our main result in Theorem 2.10: strong mean-square convergence of this approximation at an explicit rate. This theorem is proven in §3 by partitioning the strong mean-square error in several terms and estimating these terms one by one. In addition, a weak type convergence result is obtained in Corollary 3.4. In §4 the SPDE (1.2) is considered for numerical experiments on the unit cube with continuous, piecewise linear finite element basis functions in spatial dimensions. The outcomes of the paper are summarized in §5.
2. Model problem and main result
In the following, let denote a separable Hilbert space and be a densely defined, self-adjoint, positive definite linear operator with a compact inverse. In this case, there exists an orthonormal basis of consisting of eigenvectors of . The eigenvalue-eigenvector pairs can be arranged such that the positive eigenvalues are in nondecreasing order:
[TABLE]
We assume that the growth of the eigenvalues is given by for an exponent , i.e., there exist constants such that
[TABLE]
For and the action of the fractional power operator is defined by
[TABLE]
The subspace is itself a Hilbert space with respect to the inner product and corresponding norm given by
[TABLE]
Its dual space after identification via the inner product on is denoted by . For , the norm on the dual space enjoys the useful representation
[TABLE]
where denotes the duality pairing between and (Thomee, 2007, Proof of Lem. 5.1). We obtain the following scale of densely and continuously embedded Hilbert spaces:
[TABLE]
It is an immediate consequence of these definitions that is an isometric isomorphism from to for , since for it holds
[TABLE]
The following lemma states that can be extended to a bounded linear operator between and for all .
Lemma 2.1**.**
For , there exists a unique continuous extension of defined in (2.2) to an isometric isomorphism .
Proof.
For the isometry property and, thus, injectivity has already been observed in (2.5). Surjectivity readily follows, since for any the vector is an element of with and .
Assume now that . We obtain for and
[TABLE]
By density of , it follows that there exists a unique linear continuous extension . Moreover, it is an isometry, since the above estimate attains equality for and . Surjectivity follows similarly to from the representation of the dual norm in (2.3) applied to . ∎
Example 2.2**.**
For and a bounded, convex, polygonal domain , consider the eigenvalue value problem
[TABLE]
i.e., the operator with homogeneous Dirichlet boundary conditions on . For this case, we have , , as well as , where denotes the dual after identification via the inner product on . For one obtains the intermediate spaces
[TABLE]
where denotes the real -interpolation method (see, e.g., Thomee, 2007, Ch. 19). Furthermore, one can show (Bonito & Pasciak, 2015, Prop. 4.1) that for it holds that
[TABLE]
If is the -dimensional unit cube, then it is well-known (e.g., Courant & Hilbert, 1962, Ch. VI.4) that the above eigenvalue problem has the following eigenvectors
[TABLE]
where is a -dimensional multi-index. The corresponding eigenvalues are given by
[TABLE]
These eigenvalues satisfy (2.1) for . Note that only the values of and in (2.1) change when considering any other bounded domain with smooth or polygonal boundary. The value is the same by the min-max principle.
2.1. Fractional order equation
Motivated by (1.2) we consider for the fractional order equation
[TABLE]
where denotes Gaussian white noise defined on a complete probability space with values in the separable Hilbert space . We assume that and refer to Remark 3.6 for a discussion of the generalization to . Equation (2.8) as well as all following equalities involving noise terms are understood to hold -almost surely (-a.s.).
Note that the white noise can formally be represented by the Karhunen–Loève expansion with respect to the orthonormal eigenbasis of :
[TABLE]
where is a sequence of independent real-valued standard normally distributed random variables. As we will show in Proposition 2.3, this formally defined series converges in for any , which implies that realizations of are elements of for any -a.s. Related to this representation, we introduce for the truncated white noise
[TABLE]
The following proposition specifies mean-square regularity of the white noise with respect to the -spaces in (2.4).
Proposition 2.3**.**
For all , there exists a constant depending only on , in (2.1), and , such that the truncated white noise in (2.10) satisfies
[TABLE]
Furthermore, it holds \mathcal{W}\in L_{2}\bigl{(}\Omega;\dot{H}^{-\frac{1}{\alpha}-\epsilon}\bigr{)} for all with
[TABLE]
Proof.
The orthonormality of the vectors along with the distribution of the random variables in the expansion of and the representation (2.3) of the dual norm yield \mathbb{E}\bigl{[}\|\mathcal{W}_{N}\|_{-s}^{2}\bigr{]}=\sum_{j=1}^{N}\lambda_{j}^{-s}. Thus, we conclude with (2.1)
[TABLE]
Choosing and taking the limit shows the L_{2}\bigl{(}\Omega;\dot{H}^{-\frac{1}{\alpha}-\epsilon}\bigr{)} regularity of . ∎
Remark 2.4*.*
Proposition 2.3 implies that holds also -a.s. for any . Therefore, existence and uniqueness of a solution to (2.8) with regularity (-a.s.) follow from Lemma 2.1. In addition, the above results show that u\in L_{2}\bigl{(}\Omega;\dot{H}^{2\beta-\frac{1}{\alpha}-\epsilon}\bigr{)}. In particular, holds if .
Remark 2.5*.*
The above results are in accordance with Lemma 4.2 and Theorem 4.3 by Zhang et al. (2016), where the following semilinear elliptic stochastic boundary value problem is considered on for , , and :
[TABLE]
and mean-square regularity in the Sobolev space is proven under appropriate assumptions on the nonlinearity for
(i) the spatial white noise and and
(ii) the solution and .
Note that in the linear case when , this corresponds to Problem (2.8) with , , and the exponent of the eigenvalue growth in (2.1) is given by , see Example 2.2.
2.2. Finite element approximation
In the following, we introduce a numerical method based on a finite element discretization for solving the fractional order equation (2.8) approximately. For this purpose, we consider the family of subspaces of with finite dimensions . The Galerkin discretization of the operator is denoted by , i.e., for all . For , the finite element approximation of is then given by , where denotes the -orthogonal projection onto the finite element space , i.e.,
[TABLE]
The eigenvalues as well as the corresponding -orthonormal eigenvectors of satisfy the variational equalities
[TABLE]
These eigenvalues are again arranged in nondecreasing order:
[TABLE]
Further assumptions on the approximation properties of finite element spaces are specified below.
Assumption 2.6**.**
The family of finite-dimensional subspaces of satisfies the following:
- (i)
there exists such that for all ; 2. (ii)
there exist constants , , as well as exponents , and such that and in (2.11) satisfy
[TABLE]
for all and .
The following example illustrates that Assumption 2.6 is, in general, satisfied for -dimensional elliptic linear differential operators.
Example 2.7**.**
Let be a bounded, convex, polygonal domain and assume that is a (strongly) elliptic linear differential operator of order , i.e., there exists a constant such that
[TABLE]
where or , and denotes the duality pairing between and its dual after identification via the inner product on . Assume that is an admissible finite element space of polynomial degree with respect to a regular mesh on . In this case, Assumption 2.6 is satisfied (Strang & Fix, 2008, Thms. 6.1 & 6.2) for , , and the exponents
[TABLE]
In particular, if the family of finite element spaces is quasi-uniform and has continuous, piecewise linear basis functions, we have for with homogeneous Dirichlet boundary conditions in Example 2.2 that .
In order to approximate the white noise on the finite element space we introduce the following -valued random variables:
- (i)
an expansion with respect to the discrete eigenbasis :
[TABLE]
where is the vector of the first independent standard normally distributed random variables in expansion (2.9) of ; 2. (ii)
an expansion with respect to any basis of :
[TABLE]
where the random vector is given by
[TABLE]
It is therefore Gaussian distributed with zero mean and covariance matrix , where is the mass matrix with respect to the basis of the finite element space .
The following lemma shows that the above approximations of the white noise are equal in mean-square sense.
Lemma 2.8**.**
The noise approximations and in (2.14)–(2.15) are equivalent in , i.e., .
Proof.
Inserting the definitions (2.14)–(2.15) of and yields
[TABLE]
By definition of the matrices and and due to the distribution of the random vectors and we have for :
[TABLE]
where is the Kronecker delta. Thus, in terms of the trace of matrices we have
[TABLE]
which proves the equivalence of and in . ∎
Our numerical approach to cope with the fractional order equation (2.8) will be based on the following representation of the inverse from the Dunford–Taylor calculus due to Balakrishnan (1960), see also (Yosida, 1995, §IX.11, Eq. (4)):
[TABLE]
We choose an equidistant grid with step size for and replace the differential operator with its discrete version to formulate the following quadrature method proposed by Bonito & Pasciak (2015):
[TABLE]
Exponential convergence of order to with respect to the norm
[TABLE]
on the space has been proven (Bonito & Pasciak, 2015, Lem. 3.4, Rem. 3.1, Thm. 3.5) for the choice
[TABLE]
Note that the quadrature (2.16) involves only non-fractional resolvents of the discrete operator . Thus, the corresponding numerical method is readily implementable.
With the notions of the -orthogonal projection on , the noise approximation in (2.15) and the quadrature in (2.16) at hand, we can now introduce the numerical approximation of the solution to (2.8) as
[TABLE]
Remark 2.9*.*
We emphasize the construction of the noise term on the right-hand side of (2.18): For discretizing the white noise , it is common to project the truncated Karhunen–Loève expansion in (2.10) onto the finite element space and use the noise approximation (e.g., Zhang et al., 2016). Instead, we define in (2.15) in such a way that it is mean-square equivalent to the noise approximation in (2.14), which can be interpreted as -valued white noise expanded with respect to the -orthonormal eigenvectors of . Note that the noise approximation is needed only for the error analysis, but not for the actual implementation of the numerical algorithm.
This approach has the following two major advantages in practice:
- (i)
Samples of the truncated white noise are not needed and, thus, neither are the exact eigenvectors of the operator . 2. (ii)
For the computation of the approximation in (2.18) in practice, one has to sample from the load vector with entries
[TABLE]
where is a basis of the finite element space . We emphasize that this is computationally feasible if the basis in the noise approximation is chosen as the same, since then , where and is the mass matrix with respect to the basis , which is usually sparse. Hence, samples of can be generated from , where and is a Cholesky factor of .
The following estimate of the strong mean-square error between the exact solution to the fractional order equation (2.8) and the numerical approximation in (2.18) is our main result.
Theorem 2.10**.**
Let the family of finite element spaces satisfy Assumption 2.6 and assume that the growth of the eigenvalues of the operator is given by (2.1) for an exponent with
[TABLE]
where the values of , , and are the same as in Assumption 2.6. Then, for sufficiently small and , the strong error between the solution of (2.8) and the approximation in (2.18) is bounded by
[TABLE]
where the constant is independent of and .
3. Partition of the error and error estimates
In order to prove Theorem 2.10 we express the difference between the exact solution and the approximation as follows:
[TABLE]
and partition the strong error in (2.20) accordingly. Here, , , and are defined in terms of the truncated white noise in (2.10) and the white noise approximations in (2.14)–(2.15) as the -almost sure solutions to the following equations:
[TABLE]
and refers to the truncation with terms in (3.1). Note that by Lemma 2.8 the difference between and vanishes identically in :
[TABLE]
In the following, we address the three remaining terms separately: the truncation error, the error of the finite element discretization, and the error caused by the quadrature approximation in (2.16) of the discrete fractional inverse .
3.1. Truncation error
In the lemma below, we bound the strong mean-square error between the exact solution to the fractional order equation (2.8) and the approximation in (3.1) based on the truncated right-hand side .
Lemma 3.1**.**
Assume that the eigenvalues of the operator satisfy (2.1) and that . Let be the solution to (2.8). Then, for any , , there exists a unique solution to the truncated equation (3.1) and it satisfies
[TABLE]
where the constant depends only on , and the constants in (2.1). In particular, under Assumption 2.6 it holds that
[TABLE]
Proof.
Existence and uniqueness of a solution in follows from the fact that for any the truncated right-hand side is an element of as well as the isomorphism property of in Lemma 2.1. If , we obtain for any :
[TABLE]
Under Assumption 2.6(i) we have and (3.5) readily follows. ∎
3.2. Finite element discretization error
The next ingredient in the derivation of (2.20) in Theorem 2.10 is an upper bound for the error caused by introducing the finite element element discretization.
More precisely, the solution of the truncated problem (3.1) corresponds to the best -valued approximation of . Here, the finite-dimensional subspace is the linear span of the first eigenvectors of the operator . Subsequently, the approximation has been defined in (3.2), which takes values in another finite-dimensional subspace, namely in the finite element space .
The purpose of the following lemma is to bound the error between these two approximations when .
Lemma 3.2**.**
Let Assumption 2.6 be satisfied. Assume that the eigenvalue growth of the operator is given by (2.1) for an exponent with (2.19). Let be the unique element in satisfying (3.2), i.e.,
[TABLE]
and let denote the solution to the truncated equation (3.1) with terms. Then their difference can be bounded by
[TABLE]
for sufficiently small , where the constant depends only on , and the constants in (2.1), (2.12), and (2.13).
Proof.
In order to show the estimate in (3.6), we first note that can be expanded in terms of the orthonormal eigenvectors of by
[TABLE]
Thus, we can partition the difference in (3.6) as follows:
[TABLE]
Since the random variables are independent and standard normally distributed, we obtain for the first term by the Cauchy–Schwarz inequality for sums
[TABLE]
Assumption 2.6(i), (2.1), and (2.13) complete the estimation of the first term
[TABLE]
for , since since by (2.19). For the second term we find
[TABLE]
and conclude as for (I) that \text{{(II)}}^{2}\lesssim\bigl{(}h^{2s}+h^{2d(\alpha\beta-1/2)}\bigr{)}\|g\|_{H}^{2}. For (III) we use again the independence and distribution of the random variables and obtain
[TABLE]
By the mean value theorem, there exists such that
[TABLE]
Therefore, we can bound the third term by (2.1) and (2.12) as follows:
[TABLE]
where we used the relations from Assumption 2.6(i) and from (2.19) in the last estimate. ∎
3.3. Quadrature approximation error
As the final step for proving the strong convergence result of Theorem 2.10, we investigate the error caused by applying the quadrature in (2.16) instead of the discrete fractional inverse to the right-hand side . The difference between these two operators in the norm (2.17) on the space has been bounded by Bonito & Pasciak (2015). The following lemma is a consequence of that result and the distribution of the noise approximation .
Lemma 3.3**.**
Let be the operator in (2.16) approximating . Then it holds for sufficiently small and any that
[TABLE]
where the constant depends on and grows linearly in the largest eigenvalue of . In particular, for in (3.3) and in (2.18), it holds
[TABLE]
Proof.
The first assertion is proven in (Bonito & Pasciak, 2015, Lem. 3.4, Thm. 3.5). This bound, , and imply (3.8). ∎
3.4. Proof of Theorem 2.10 and some remarks
After having bounded the truncation, the discretization, and the quadrature errors in §§3.1–3.3, the strong convergence result of Theorem 2.10 is an immediate consequence.
Proof of Theorem 2.10.
As outlined at the beginning of the section, we partition the mean-square error as follows:
[TABLE]
By (3.5), (3.6), and (3.8) of the Lemmata 3.1–3.3 we have
[TABLE]
and by (3.4) the third term vanishes, . Thus, the assertion is proven. ∎
In §4 we will not only verify the above derived rate of strong convergence by means of numerical experiments, but also investigate weak type errors. The following result is proven similarly to Theorem 2.10.
Corollary 3.4**.**
Let the assumptions of Theorem 2.10 be satisfied. Then there exists a constant independent of and such that the following weak type error estimate between the approximation in (2.18) and the solution to (2.8) holds:
[TABLE]
where , if , and , if .
Proof.
First we note that the norm on attains the following values for in (2.8), in (3.1), and in (3.3):
[TABLE]
Again, we partition the error,
[TABLE]
and bound every term separately. By applying similar steps as in the proofs of Lemmata 3.1–3.2, we obtain for the first two terms:
[TABLE]
since and as assumed in (2.19). For the third term we find
[TABLE]
Since and for sufficiently small , we conclude with (3.7) of Lemma 3.3 that
[TABLE]
where we have used Assumption 2.6 in the last estimate. This proves (3.9). ∎
Remark 3.5*.*
The error estimates in (2.20) and (3.9) imply that the distance of the quadrature nodes has to be adjusted to the finite element mesh size . Table 1 shows the calibration between and for error studies of strong and weak type as well as the corresponding theoretical convergence rates. For the calibration, we set
[TABLE]
Remark 3.6*.*
In the non-fractional case , the discretized problem (3.3) is also non-fractional. Therefore, realizations of its solution can be computed directly and no quadrature is needed. If for some , one may apply the above described method and error estimates to and , since . Yet, the finite element theory for the operator may not be trivial.
4. An application and numerical examples
In the following numerical experiment we take up the SPDE from (1.2) in §1. More precisely, with the objective of generating computationally efficient approximations of Gaussian Matérn fields on the unit cube in spatial dimensions, we consider the following problem:
[TABLE]
and study the above presented numerical method generating the approximation in (2.18). As already observed in Example 2.2, the exponent of the eigenvalue growth is given by in this case.
Furthermore, using a finite element discretization on uniform meshes with continuous, piecewise linear basis functions, Assumption 2.6 is satisfied for this problem in all three dimensions with , see Example 2.7. The condition in (2.19) of Theorem 2.10 becomes . We emphasize that this assumption is meaningful also from the statistical point of view: on all of , corresponds to a positive smoothness parameter of the Matérn covariance function (1.1).
Thus, if the quadrature step size and the finite element mesh width are calibrated as indicated in Table 1 in §3.4, the theoretical rates of convergence for are for the strong error and for the weak type error according to Theorem 2.10 and Corollary 3.4.
For Problem (4.1) with , we investigate the empirical convergence rates
- (i)
of the strong error for and , ; 2. (ii)
of the weak type error for and .
In each dimension, we use a finite element method in space with continuous, piecewise linear basis functions on uniform meshes with mesh diameter , mesh nodes and corresponding mass matrix . We choose . The numbers of finite element basis functions and the corresponding numbers of quadrature nodes depending on used in the strong error study are shown in Table 2.
For (i), measuring the strong mean-square error between the exact solution to our model problem (4.1) and the approximation in (2.18), we proceed as follows: First, samples of an overkill approximation of the white noise
[TABLE]
are generated and evaluated on a uniform overkill mesh of with nodes. Here, are independent standard normally distributed random variables and are the eigenfunctions in (2.6). The approximation corresponds to a truncated Karhunen–Loève expansion with terms. From this, samples of the overkill solution are obtained via
[TABLE]
where are the eigenvalues from (2.7). For the sake of generating comparable samples of the approximation , we consider the same realizations of and use the load vector with entries instead of from Remark 2.9, as and we treat as the true white noise. The resulting approximation is denoted by . We choose for , for , and for .
For each value of and in every spatial dimension, we use samples of to generate samples of the overkill solution and of the numerical approximation for every mesh size . The observed strong errors are then computed as the average -errors
[TABLE]
The results are shown in the first three panels of Figure 1. The data set is then used to compute the observed rate of convergence as the least-squares solution to the linear regression for each combination of . As shown in Table 3, the resulting observed rates of convergence are in accordance with the theoretical values predicted by Theorem 2.10.
For (ii) we study the weak type error addressed in Corollary 3.4. Note that for this study no sample-wise comparison is needed and, thus, the load vector is sampled from as discussed in Remark 2.9. The variance of the exact solution can be computed directly from the known eigenvalues of the differential operator as . The variance of is approximated via Monte Carlo integration by
[TABLE]
where the number of Monte Carlo samples is and denotes a realization of the numerical approximation . The observed weak type errors and the observed rates of convergence are displayed in the fourth panel of Figure 1. The theoretical rate of convergence predicted by Corollary 3.4 is 0.5 for all three cases.
5. Conclusion
We have considered the fractional order equation (2.8) with Gaussian white noise in a Hilbert space setting. We have shown that the fractional operator is an isometric isomorphism between the -spaces in (2.4). From this result and the mean-square regularity of the white noise with respect to the -spaces, we have deduced existence and uniqueness of a solution to (2.8) with a certain regularity.
We have proposed the approximation in (2.18) based on two numerical ingredients:
(i) finite-dimensional subspaces of , and (ii) the quadrature approximation (2.16) of the inverse fractional operator.
The most advantageous and novel properties of the corresponding numerical scheme are
(a) that only solutions to integer order (i.e., local) elliptic equations have to be computed, and
(b) that it does not require the knowledge of the eigenfunctions of the differential operator .
Our main result, Theorem 2.10, shows strong mean-square convergence of the approximation to the exact solution . If the quadrature step size and the finite element mesh width are calibrated appropriately, see Table 1, the resulting strong convergence rate depends only on the fractional order , the dimension , the eigenvalue growth of the operator , and the approximation properties of the finite element spaces. In order to prove this result, we have partitioned the strong error in three terms: the truncation error, the error caused by the finite element discretization, and the error of the quadrature approximation. We have derived bounds for each of these error terms separately in §§3.1–3.3. By means of similar techniques, we have proven a weak type error estimate in Corollary 3.4.
Finally, in §4 we have applied the proposed numerical method to an explicit problem with relevance for spatial statistics: the solution to (4.1) can be regarded as an approximation of a Gaussian Matérn field on the unit cube . The performed numerical experiments with continuous, piecewise linear finite element basis functions in spatial dimensions verify the derived theoretical strong and weak type convergence rates, see Figure 1 and Table 3.
We hope that these results and insights will prove valuable for applications in spatial statistics, which often require sampling from (approximations of) Gaussian Matérn fields and their various extensions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Babuska et al. (2004) Babuska, I., Tempone, R. & Zouraris, G. E. (2004) Galerkin finite element approximations of stochastic elliptic partial differential equations. SIAM J. Numer. Anal. , 42 , 800–825.
- 2Baeumer et al. (2015) Baeumer, B., Kovács, M. & Sankaranarayanan, H. (2015) Higher order Grünwald approximations of fractional derivatives and fractional powers of operators. Trans. Amer. Math. Soc. , 367 , 813–834.
- 3Balakrishnan (1960) Balakrishnan, A. V. (1960) Fractional powers of closed operators and the semigroups generated by them. Pacific J. Math. , 10 , 419–437.
- 4Banerjee et al. (2008) Banerjee, S., Gelfand, A. E., Finley, A. O. & Sang, H. (2008) Gaussian predictive process models for large spatial data sets. J. R. Stat. Soc. Series B Stat. Methodol. , 70 , 825–848.
- 5Bhatt et al. (2015) Bhatt, S., Weiss, D., Cameron, E., Bisanzio, D., Mappin, B., Dalrymple, U., Battle, K., Moyes, C., Henry, A., Eckhoff, P. et al. (2015) The effect of malaria control on Plasmodium falciparum in Africa between 2000 and 2015. Nature , 526 , 207–211.
- 6Bolin (2014) Bolin, D. (2014) Spatial Matérn fields driven by non-Gaussian noise. Scand. J. Stat. , 41 , 557–579.
- 7Bolin & Lindgren (2011) Bolin, D. & Lindgren, F. (2011) Spatial models generated by nested stochastic partial differential equations, with an application to global ozone mapping. Ann. Appl. Stat. , 5 , 523–550.
- 8Bonito et al. (2017) Bonito, A., Lei, W. & Pasciak, J. E. (2017) The approximation of parabolic equations involving fractional powers of elliptic operators. J. Comp. Appl. Math. , 315 , 32–48.
