Reduced Basis Approximations of the Solutions to Spectral Fractional Diffusion Problems
Andrea Bonito, Diane Guignard, Ashley R. Zhang

TL;DR
This paper introduces a reduced basis method to efficiently approximate solutions to spectral fractional diffusion problems, significantly reducing computational costs while maintaining accuracy across different fractional powers.
Contribution
The work develops a fractional power-independent reduced basis strategy for spectral fractional diffusion, enabling fast online evaluations with proven exponential convergence.
Findings
Reduced basis method accelerates reaction-diffusion problem solutions.
The approach is effective uniformly over fractional powers in [s_min, s_max].
Numerical experiments confirm exponential convergence.
Abstract
We consider the numerical approximation of the spectral fractional diffusion problem based on the so called Balakrishnan representation. The latter consists of an improper integral approximated via quadratures. At each quadrature point, a reaction-diffusion problem must be approximated and is the method bottle neck. In this work, we propose to reduce the computational cost using a reduced basis strategy allowing for a fast evaluation of the reaction-diffusion problems. The reduced basis does not depend on the fractional power for . It is built offline once for all and used online irrespectively of the fractional power. We analyze the reduced basis strategy and show its exponential convergence. The analytical results are illustrated with insightful numerical experiments.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Reduced basis approximations of the solutions to spectral fractional diffusion problems
Andrea Bonito, Diane Guignard, Ashley R. Zhang
{AB, DG, AZ}, Dept. of Mathematics, Texas AM University, College Station, TX-77843, {bonito,dguignard,ashleyrzhang}@math.tamu.edu
Abstract.
We consider the numerical approximation of the spectral fractional diffusion problem based on the so called Balakrishnan representation. The latter consists of an improper integral approximated via quadratures. At each quadrature point, a reaction-diffusion problem must be approximated and is the method bottle neck. In this work, we propose to reduce the computational cost using a reduced basis strategy allowing for a fast evaluation of the reaction-diffusion problems. The reduced basis does not depend on the fractional power for . It is built offline once for all and used online irrespectively of the fractional power. We analyze the reduced basis strategy and show its exponential convergence. The analytical results are illustrated with insightful numerical experiments.
Key words and phrases:
fractional diffusion, Dunford-Taylor integral, reduced basis method, sinc quadrature, finite element method
2010 Mathematics Subject Classification:
65N30, 35S15, 65N15, 65N12
This research was supported by the NSF grant DMS-1817691 (AB-DG-AZ); DG was supported by the Swiss National Science Foundation grant P2ELP2-175056 and IAMCS at TAMU
1. Introduction
Nonlocal models have recently received a great attention due to their apparent ability to capture novel effects such as in mechanics [27] and in particular in peridynamics [26, 19], turbulence [10], biophysics [7] and image denoising [17], to mention a few.
In most of the applications, the type of nonlocal interactions are different and their scaling laws are unknown. Initiated by the work in [2], an algorithm is proposed and analyzed in [1] to identify the fractional power governing the state equation in an optimization framework. As expected, the algorithm exploits the smoothness of the map and requires many (costly) evaluations of for different . Several numerical methods are available to approximate and we refer to the surveys [3, 20] for the description of different fractional Laplacians along with their numerical approximations. Here, for and a Lipschitz domain of , , we set
[TABLE]
where are the eigenpairs of and . The eigenfunctions are chosen orthogonal in and orthonormal in . In (1) the fractional operator is referred to as the spectral fractional Laplacian and is the one considered in this work. It is worth mentioning that the methodology proposed here is not limited to the Laplacian operator and can be easily extended to regularly accretive operators as in [6].
In this work, we follow the approach proposed in [5] to approximate (1), see also [6], which is based on the Dunford-Taylor-Balakrishnan representation
[TABLE]
where solves
[TABLE]
Originally introduced in [5] and later improved in [4], a sinc quadrature coupled with a standard finite element method is used for the approximation of the integration in the variable . For , it reads
[TABLE]
with ,
[TABLE]
and where are standard finite element approximations of .
The numerical approximation of requires finite element solves to determine , . This can become prohibitive when the computation of is needed for many values of such as within an optimization loop as mentioned above. The reduced basis method seems to be a natural approach to reduce the computational cost when approximating the parametrized reaction-diffusion problems (2). In fact, reduced basis method for this type of one dimensional parametric elliptic partial differential equation has already been partially analyzed in [22, 21] and recently in [13] from which part of our analysis is inspired.
A (weak) greedy strategy is advocated (offline stage) to iteratively select snapshots , , defining the -independent reduced basis space . Galerkin approximations of can then be easily computed (online stage) to produce a reduced basis approximation of
[TABLE]
We point out that one of the difficulty faced in this study is that the approximation of the parametric elliptic partial differential equation (2) is required for in the parametric domain whose length increases as the sinc quadrature parameter decreases (improving the precision of the algorithm).
The proposed algorithm provides an approximation of the entire map , using the same reduced basis space . Our main result is Theorem 4 which guarantees an exponential convergence of the reduced basis approximation toward in a wide range of Sobolev norms, uniformly in the fractional power .
We end this introduction by noting that the idea of using the reduced basis method for fractional problems has been recently proposed for instance in [13] and [15]. In [13], the reduced basis is used for the approximation of interpolation norms, as well as evaluations of both types with fixed and variable and . A reduced basis space based on best rational approximations for a reaction diffusion problem similar to the one satisfied by is proposed and exponential convergence of the approximation with respect to the dimension of the reduced basis space is obtained. Worth mentioning, the numerical method is based on the extension method [23] but seemingly apply to other approximation techniques. Actually, this method boils down to the approximation of several reaction diffusion problems as in [5]. We take advantage of the technology developed in [13] to derive an exponential decay in the approximation of (3) by (5). In [15], a similar approximation is proposed for a different quadrature. Exponential decay of the reduced basis error is observed numerically but without analysis. In some sense, this work provides a mathematical justifications of the experimental observations in [15]. Finally, we mention that the reduced basis method has also been used in [9] to approximate the parametric PDEs , where is the parameter, in the case of the integral fractional Laplacian.
The rest of the paper is organized as follows. In Section 2, we describe the numerical approximation of by . Section 3 describes the construction of the reduced basis space and its corresponding error analysis - the main result of this work. Section 4 provides numerical experiments to illustrate the performance of the proposed methodology.
2. Spectral Fractional Laplacian and its Numerical Approximations
We start with some notations. Let be the interpolation space defined by
[TABLE]
where denotes interpolation using the real method.
Notice that for the particular case , we have
[TABLE]
which is equivalent to the norm thanks to the Poincaré inequality
[TABLE]
To simplify the notation, we write when , . Moreover, means that for a constant that does not depend on , and the discretization parameters and whose value might change at each occurrence. Also, indicates and .
2.1. Dunford-Taylor Representation
The function in (1) has the following representation [29]
[TABLE]
where is a Jordan curve oriented to have the spectrum of to its right. Deforming the contour to the negative real axis, we obtain the Balakrishnan formula, valid for ,
[TABLE]
The numerical integration of the above improper integral relies on a sinc quadrature method after the change of variable , leading to
[TABLE]
2.2. Finite Element Approximation
We assume that is a polyhedral domain and we consider a sequence of conforming and shape-regular partitions of into -simplices with maximal mesh size . Let be the space of continuous and piecewise linear finite element functions associated with . The finite element approximation of (10) is then defined by
[TABLE]
where is the solution to
[TABLE]
Here we used the notation
[TABLE]
for and
[TABLE]
for . The Poincaré inequality (7) implies that for ,
[TABLE]
which guarantees that (12) has a unique solution for any parameter by the Lax-Milgram lemma.
We now collect some estimates for , which will be used in the analysis later.
Lemma 2.1**.**
Let be the Poincaré constant in (7). For any , we have
[TABLE]
[TABLE]
[TABLE]
and
[TABLE]
Proof.
Choosing in (12) yields
[TABLE]
from which the two relations in (16) can be easily deduced. From (12) we get
[TABLE]
We now choose to get
[TABLE]
This, the Poincaré inequality (7) and (16) with yield (17).
The estimate (18) follows from (20) together with (16) with . For (19), we invoke Young’s inequality to estimate the right hand side of (20) and get
[TABLE]
It remains to invoke (16) with to derive the desired result and ends the proof. ∎
We mention that both results in (16) are standard, while the estimates (17), (18) and (19) are less common yet useful in the error analysis below. Moreover, note that (16)-left and (17) are favorable for negative , while (16)-right, (18) and (19) for positive . This plays a role in our analysis below and is observed in the numerical experiments, see Section 4.
We end this section by stating the error in the finite element method derived and analyzed in [6]. Before doing this, we define to be the elliptic pick-up regularity index, i.e. is the largest number in such that is an isomorphism from to for all . Notice that for Lipschitz domains and when is convex.
Theorem 1**.**
Let , denote the elliptic regularity pick-up and . Then for any , we have
If and then
[TABLE] 2. 2.
If and with then
[TABLE] 3. 3.
If then
[TABLE]
2.3. Sinc quadrature approximation
We discuss the sinc quadrature approximation leading to the fully discrete approximation given by (3). Recall that is the sinc quadrature parameter and that , are given by (4). This choice is dictated from the analysis of the sinc quadrature error, which is the subject of the following theorem; we refer to [4] for its proof.
Theorem 2**.**
Let and .
If then
[TABLE] 2. 2.
If and with then
[TABLE]
3. Reduced Basis Approximation
The computation of in (3) involves the finite element solution to the reaction diffusion problem (12) for different values of the parameter . We propose to use the reduced basis method to approximate the entire map . Notice that the bilinear form defining in (12) is not affine in . However, it becomes affine for .
3.1. Construction for a fixed
The reduced basis space
[TABLE]
is constructed using a greedy strategy [8]. Starting with , is selected iteratively to maximize the error
[TABLE]
on , i.e.,
[TABLE]
Here is the unique solution (from Lax-Milgram theory) to
[TABLE]
Notice that in view of the definition (12) of , the above relation is equivalent to
[TABLE]
The enrichment of the reduced basis space ends when
[TABLE]
for a prescribed accuracy or when a maximum number of basis functions is reached. Note that the relations (17) and (19) guarantee that (23) can always be achieved by a uniform selection of points in . The aim of the Greedy algorithm is to provide an alternate selection performing as well but of less cardinality.
The error defined in (21) is not a computable quantity and is usually replaced by an equivalent computable quantity leading to the so-called weak greedy algorithm [14]. In this work, we use the residual based a posteriori error estimate [24]
[TABLE]
where
[TABLE]
We have the following equivalence relation between the error and its surrogate
[TABLE]
for all . This follows from
[TABLE]
where satisfies (12), and the coercivity and continuity of the bilinear form (15).
Hence, selecting the samples using as surrogate for the error yields
[TABLE]
where
[TABLE]
The parameter corresponds to the constant in the weak greedy algorithm, see [14] for more details, and will appear in the analysis below.
The dual norm can be computed using the Riesz representation theorem, see for instance [24, 16] for more details. However, evaluating for every in remains unfeasible. In practice, the maximization is performed over a finite dimensional training set , either chosen sufficiently fine to retain the performance of the algorithm, see for instance [12], or based on a random selection of moderate size [11].
The reduced basis space is constructed offline and gives the following online approximation of
[TABLE]
Remark 1**.**
The approximate solution (3) obtained without using the reduced basis method requires to solve sparse finite element systems of dimension . In comparison, the solution of systems are needed for the approximation (27), each requiring operations, where stands for the dimension of the reduced basis space. The latter is built once for all (offline stage) with a computational cost dominated by the solve of sparse finite element systems. The value of depends on the Kolmogorov -width of the solution manifold . We refer for instance to [25, 12] for a detailed complexity analysis of the reduced basis method but note that typically for elliptic problems we have . Finally, we anticipate that the proposed reduced basis space is independent on , see Section 3.3.
3.2. Error analysis for a fixed
We now analyze the distortion between and its reduced basis approximation given by (27) in the norm. In order to avoid unnecessary technicalities, we assume from now on that is chosen such that , which includes the natural choice leading to the energy error and for the error. The discussion below can be readily extended to the case by accounting for the log factor in the finite element approximation (see Theorem 1). For , we decompose the error into three parts
[TABLE]
corresponding to the finite element error, the sinc quadrature error and the reduced basis error, respectively. Given a target tolerance , we construct a reduced basis space such that (23) holds. In view of Theorems 1 and 2, we select the space discretization and sinc quadrature parameters and to balance the finite element and sinc quadrature errors, i.e.,
[TABLE]
for some absolute constants and .
We now assess the error in the reduced basis modeling by analyzing the behavior of as increases. From the definitions (3) and (27) of and , respectively, we have
[TABLE]
Key ingredients in our analysis are estimates for the reduced basis errors in approximating the inner problems. We discuss this now. Recall that the reduced basis error for the inner problem is given by
[TABLE]
The Kolmogorov -width
[TABLE]
is the benchmark for the best achievable decay. By convention, we set
[TABLE]
It is quite remarkable that the linear space constructed by the (weak) greedy selection discussed in Section 3.1 leads to an error (31) equivalent to [14]. In particular, an exponential decay of the Kolmogorov -width guarantees an exponential decay of the (weak) greedy error. In order to prove that the error in (31) decays exponentially with , see Lemma 3.1 below, we will thus show that the Kolmogorov -width exhibits an exponential decay.
To facilitate the analysis of , we use the notations in (13) and provide a representation of the finite element functions in term of the eigenpairs , , of the generalized eigenvalue problem
[TABLE]
Without loss of generality, we assume that the are -orthonormal, i.e.
[TABLE]
The inverse inequality
[TABLE]
together with the Poincaré inequality (7), yield
[TABLE]
With these notations, we can rewrite in (12) as
[TABLE]
We are now in position to assess the reduced basis approximation property.
Lemma 3.1**.**
For any we have
[TABLE]
where is given by (26), is a constant only depending on and
[TABLE]
Proof.
We follow [13] to construct a linear space with such that for some constants , and we have
[TABLE]
Let , where the are chosen such that the are the transformed Zolotarëv points as in [13], see also [18, 28]. Notice that this interval is dictated by the lower and upper bound of the eigenvalues , see (34). Now, given , we define the approximation
[TABLE]
where the coefficients are such that
[TABLE]
The above system is a particular rational interpolation problem and has a unique solution according to Lemma 5.13 in [13]. Furthermore, thanks to Lemma 5.17 in [13], we have
[TABLE]
where
[TABLE]
Hence, the error between in (35) and in (39) satisfies
[TABLE]
where we have used the -orthonormality of the . With the help of (16), this implies
[TABLE]
The above estimate is (38) with and only depending on and the hidden constant in (40). Moreover, thanks to (16) we also have , where is defined in (33). Therefore, we have shown that the Kolmogorov -width (see (32) and (33)) satisfies
[TABLE]
To conclude, it remains to relate the error decay of the reduced basis generated by the weak greedy algorithm with parameter (see ) and the Kolmogorov -width . Corollary 8.4 in [12], see also Corollary 3.3 in [14], guarantees that (41) implies (36) with and . ∎
Remark 2**.**
We mention that an exponential decay for the reduced basis error for one dimensional parametric problem of the form (12) has already been obtained in [22, 21]. However, the exponential decay is guaranteed for for some integer depending on the length of the parameter interval . We did not pursue this route as the latter restriction seems prohibitive to take full advantage of the performances of the reduced basis method.
We now use the exponential decay of the reduced basis error for obtained in Lemma 3.1 to estimate the error for defined in (30).
Lemma 3.2**.**
Let and be the finite element and sinc quadrature parameters. Let . For , we have
[TABLE]
where and are the constants in (36).
Proof.
Because are interpolation spaces between and , see (6), the Poincaré inequality (7) yields
[TABLE]
Therefore, using the estimate (30) for the error and invoking Lemma 3.1, we get
[TABLE]
which is the claimed estimate. ∎
Remark 3**.**
From (37), we see that the constant that appears in (36) and (42) tends to [math] as tends to [math]. In other words, the reduced basis performances deteriorate as the target accuracy tends to [math]. This phenomenon is observed in the numerical experiments reported in Figure 4 of Section 4.
Using Lemma 3.2, we directly derive the following result providing a sufficient condition on the dimension of the reduced space to achieve an error under a specified tolerance .
Theorem 3**.**
(offline construction of the reduced space) Let be a given tolerance. Assume that and are chosen so that (29) holds and that the reduced basis space is constructed such that (23) holds. Then, for any we have
[TABLE]
provided
[TABLE]
where is a constant only depending on and and is as in Theorem 1. In particular
[TABLE]
when .
Proof.
The claims directly follow from Lemma 3.2 together with (29). ∎
3.3. Universal Reduced Basis Space
In the previous section we constructed a reduced basis space to approximate for a fixed . We now show that it is possible to take real advantage of the offline work and construct reduced basis spaces approximating the map for , with fixed.
To see this, it suffices to adjust the constant depending on as follows. First, we let
[TABLE]
Then, we define the domain containing for all and, similarly to (26), we introduce the parameter
[TABLE]
Finally, for all we approximate by , where the reduced basis space is constructed as detailed in Section 3.1 upon replacing , , and by , , and , respectively.
With this uniform construction, we directly obtain the universal version of Lemma 3.2 and Theorem 3.
Lemma 3.3**.**
Let and be the finite element and sinc quadrature parameters. Let . For and any we have
[TABLE]
where and are the constants in (36).
Theorem 4**.**
(offline construction of the universal reduced space) Let be a given tolerance. Assume that and are chosen so that (29) holds and that the reduced basis space is constructed such that (23) holds. Then, for any we have
[TABLE]
provided
[TABLE]
where is a constant only depending on , and , and is as in Theorem 1. In particular
[TABLE]
when .
4. Numerical Experiments
We present numerical results to illustrate the performances of the reduced basis approach analyzed in the previous section. Since the focus of this paper is on the reduced basis approximation, the finite element meshsize and the sinc quadrature parameter are chosen sufficiently small not to influence the total error, unless otherwise specified. We refer to [5, 4] for an extensive numerical study on the influence of the discretization parameters and . The space is built using a weak greedy algorithm on , starting with the snapshot . Moreover, the training set consists of uniformly distributed points in . Finally, we set in all the numerical examples.
4.1. 1D example
We consider the case . The subdivision of consists of a uniform partition of with subintervals of length . The sinc quadrature parameter is fixed to and the fractional power varies from to . In this setting, we have and .
4.1.1. Reduced basis error for
We provide in Figure 1-left the evolution of
[TABLE]
versus as indicator of the error
[TABLE]
The observed exponential decay matches the estimate of Lemma 3.1.
Moreover, Figure 1-right reports the values of the selected parameters by the weak greedy procedure. We observe that except for , they are all located in the interval . This behavior can be in part explained by the estimates provided in Lemma 2.1, indicating the robustness of for small values of and the smallness of for large. The fact that no negative is selected is also attributable to the choice of the initial snapshot, namely , which already provides a good approximation of for . We mention that similar results are obtained when changing the range for , for instance setting and .
We comment on the use of an a posteriori error estimate (weak greedy) in place of the true error (greedy), see (25). For this, we compare in Figure 2 the performance of both algorithms and we can conclude that very little efficiency is lost in using the computable a posteriori error estimator.
4.1.2. Reduced basis error for
We now turn our attention to the approximation of by . Figure 3 depicts the evolution of
[TABLE]
for various values of fractional power. In agreement with Theorem 4, exponential decay is observed in all cases when using the universal reduced basis space. Notice that in this experiment the sinc quadrature requires points for , points for and points for to guarantee a sinc quadrature error of the order for . A comparable reduced basis accuracy in the norm is achieved for only for .
Finally, we study numerically the behavior of the constant given by (37). We set and consider a sequence of uniform partitions of with subintervals of length for . The reduced basis error versus is reported in Figure 4 for each finite element discretization. As predicted by Theorem 4, the exponential decay encoded in deteriorates as . The norm of the error behaves like for and for .
4.2. 2D examples
We now consider two dimensional domains: a square domain and an L-shaped domain . The space discretization consists of a Delaunay triangulation with elements for and elements for . In both cases, the elements in the triangulation have diameters between and . All the other parameters are the same as in Section 4.1.
The evolution of the reduced basis error for different values of is reported in Figure 5. As for the one dimensional case, exponential decays are observed for all values of and irrespectively of the shape of the domain.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] H. Antil and E. Otárola. A FEM for an optimal control problem of fractional powers of elliptic operators. SIAM J. Control Optim. , 53(6):3432–3456, 2015.
- 2[2] H. Antil, E. Otárola, and A.J. Salgado. Optimization with respect to order in a fractional diffusion model: Analysis, approximation and algorithmic aspects. J. Sci. Comput. , 77(1):204–224, 2018.
- 3[3] A. Bonito, J.P. Borthagaray, R.H. Nochetto, E. Otárola, and A.J. Salgado. Numerical methods for fractional diffusion. Comput. Visual. Sci. , 19(5):19–46, 2018.
- 4[4] A. Bonito, W. Lei, and J.E. Pasciak. On sinc quadrature approximations of fractional powers of regularly accretive operators. J. Numer. Math. , 2018.
- 5[5] A. Bonito and J.E. Pasciak. Numerical approximation of fractional powers of elliptic operators. Math. Comp. , 84(295):2083–2110, 2015.
- 6[6] A. Bonito and J.E. Pasciak. Numerical approximation of fractional powers of regularly accretive operators. IMA J. Numer. Anal. , 37(3):1245–1273, 2017.
- 7[7] A. Bueno-Orovio, D. Kay, V. Grau, B. Rodriguez, and K. Burrage. Fractional diffusion models of cardiac electrical propagation: role of structural heterogeneity in dispersion of repolarization. J. Royal Soc. Interface , 11(97):20140352, 2014.
- 8[8] A. Buffa, Y. Maday, A.T. Patera, C. Prud’homme, and G. Turinici. A priori convergence of the greedy algorithm for the parameterized reduced basis. ESAIM: Math. Model. Numer. Anal. , 46(3):595–603, 2012.
