A fast method for variable-order space-fractional diffusion equations
Jinhong Jia, Xiangcheng Zheng, Hong Wang

TL;DR
This paper introduces a fast, efficient numerical method for solving variable-order space-fractional diffusion equations, overcoming structural challenges in the stiffness matrix and significantly reducing computational complexity.
Contribution
The paper presents a novel divided-and-conquer collocation method that approximates the stiffness matrix with a sum of Toeplitz matrices, improving computational efficiency for variable-order fractional PDEs.
Findings
Achieves $O(kN ext{log}^2 N)$ memory usage.
Achieves $O(k N ext{log}^3 N)$ computational complexity.
Demonstrates effectiveness through numerical experiments.
Abstract
We develop a fast divided-and-conquer indirect collocation method for the homogeneous Dirichlet boundary value problem of variable-order space-fractional diffusion equations. Due to the impact of the space-dependent variable order, the resulting stiffness matrix of the numerical approximation does not have a Toeplitz-like structure. In this paper we derive a fast approximation of the coefficient matrix by the means of a sum of Toeplitz matrices multiplied by diagonal matrices. We show that the approximation is asymptotically consistent with the original problem, which requires memory and computational complexity with and being the numbers of unknowns and the approximants, respectively. Numerical experiments are presented to demonstrate the effectiveness and the efficiency of the proposed method.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFractional Differential Equations Solutions · Differential Equations and Numerical Methods · Numerical methods for differential equations
∎
11institutetext: Jinhong Jia 22institutetext: School of Mathematics and Staticstics, Shandong Normal University, Jinan, Shandong 250358, China
22email: [email protected] 33institutetext: Xiangcheng Zheng and Hong Wang 44institutetext: Dempartment of Mathematics, University of South Carolina, Columbia, South Carolina 29208, USA
44email: [email protected] and [email protected]
A fast method for variable-order space-fractional diffusion equations
Jinhong Jia
Xiangcheng Zheng
Hong Wang
(Received: date / Accepted: date)
Abstract
We develop a fast divided-and-conquer indirect collocation method for the homogeneous Dirichlet boundary value problem of variable-order space-fractional diffusion equations. Due to the impact of the space-dependent variable order, the resulting stiffness matrix of the numerical approximation does not have a Toeplitz-like structure. In this paper we derive a fast approximation of the coefficient matrix by the means of a sum of Toeplitz matrices multiplied by diagonal matrices. We show that the approximation is asymptotically consistent with the original problem, which requires memory and computational complexity with and being the numbers of unknowns and the approximants, respectively. Numerical experiments are presented to demonstrate the effectiveness and the efficiency of the proposed method.
Keywords:
Variable-order space-fractional diffusion equation Collocation method Divide-and-conquer algorithm Toeplitz matrix
MSC:
65F0565M70 65R20
1 Introduction
Field tests showed that space-fractional diffusion equations (sFDEs) provide more accurate descriptions of challenging phenomena of superdiffusive transport and long range interaction, which occur in solute transport in heterogeneous porous media and other applications, than integer-order diffusion equations do BenSchMee ; DelCar ; MetKla04 ; SchBenMee01 . In fact, integer-order diffusion equations were derived if the underlying independent and identically distributed particle movements have (i) a mean free path and (ii) a mean waiting time. In this case, the central limit theorem concludes that the (normalized) partial sum of the independent and identically distributed particle movements converges to Brownian motions. The probability density distribution of finding a particle somewhere in space is Gaussian, which satisfies the classical Fickian diffusion equation MeeSik ; MetKla04 .
Note that assumptions (i) and (ii) hold for diffusive transport of solute in homogeneous porous media, where solute plumes were observed to decay exponentially Bear61 ; Bear72 and so can be described accurately by integer-order diffusion equations. However, field tests showed that solute transport in heterogeneous aquifers often exhibit highly skewed and power-law decaying behavior, while sFDEs were derived under the assumption that the solutions have such behavior BenSchMee ; MeeSik ; MetKla04 . This is why sFDEs can accurately describe the solute transport in heterogeneous media more accurately than integer-order diffusion equations do. Consequently, they have attracted extensive research activities in the last few decades ErvRoo05 ; LiZha ; LiChe ; LiuAnh .
However, sFDEs present new mathematical and numerical issues that are not common in the context of integer-order diffusion equations. Because of their nonlocal nature, numerical discretizations of sFDEs usually yield dense or full stiffness matrices Den ; LiZha ; LiuAnh ; Roo . A direct solver typically has computational complexity and memory requirement. A conventional Krylov subspace iterative method has computational complexity per iteration, but may diverge due to significant amount of round-off errors WanDu13a . In any case, the significantly increased computational complexity of numerical discretizations of sFDEs compared to their integer-order analogues is deemed computationally intractable for realistic simulations in multiple space dimensions, especially when parameter learning or control of the systems is involved.
It was discovered that the stiffness matrices of the numerical discretizations of constant-order sFDEs on a uniform partition typically possess a Toeplitz-like structure WanWanSir , which reduces the memory requirement from to and computational complexity from to per Krylov subspace iteration via the discrete fast Fourier transform. Furthermore, different preconditioners were employed to futher improve the computational efficiency and even convergence behavior BaiPan ; Daniele ; JinF ; Jin3 ; LinNGSun ; LinNGSun1 ; PanNgWang ; WanDu13a ; ZJinL .
However, Ervin et al. ErvHeu16 proved that the one-dimensional constant-order constant-coefficient linear sFDEs with smooth right-hand side generate solutions with singularity at the end points of the spatial interval, which is in sharp contrast to their integer-order analogues and makes the error estimates of their numerical approximations derived under full regularity assumptions inappropriate. The singularity of the solutions to constant-order sFDEs seems to be physically irrelevant to the diffusive process of the solute, and occurs due to the incompatibility between the nonlocality of the power law decaying tails of the sFDEs inside the domain and the locality of the imposed classical boundary conditions. Intuitively, a physically relevant sFDE model should not only properly model the anomalous transport of solutes in heterogeneous porous media, but also correct the non-physical behavior of solutions to the existing sFDEs and thus maintain the smoothing nature of the diffusive transport process.
Recently, the wellposedness and smoothing properties of a variable-order linear sFDE was analyzed in ZheWan : If the variable order has an integer limit at the boundary then the solutions have the full regularity as their integer-order analogues do; Otherwise, the solutions exhibit certain singularity at the boundary as their constant-order sFDE analogues do. Thus, the variable-order sFDE provides a feasible approach to resolve the non-physical singularity of solutions to constant-order sFDEs near the boundary while retaining their advantages. In fact, variable-order sFDEs have been used in many applications SunChaZha ; SunCheChe , as the variable order is closely related to the fractal dimension of the porous media via the Hurst index EmbMae ; MeeSik and so can account for the changes of the geometrical structure or properties of the media.
Some numerical studies of variable-order FDEs can be found in the literature in recent years. First-order convergence rates were proved for finite difference methods for space-time-dependent variable-order space-fractional advection-diffusion equations in one space dimension under (the artificially assumed) full regularity assumptions of the true solutions without addressing the singularity issue of the problem ZhuLiu . A spectral collocation method using weighted Jacobi polynomials was derived for variable-order sFDEs ZenZhaKar , in which numerical experiments were presented to demonstrate the utility of the proposed method. The stability and convergence of an implicit alternating direct method was proved in CheLiuBur under the assumptions of the smoothness of the true solutions and (somewhat artificial) monotonicity of the diffusivity coefficients. However, due to the impact of variable order of the FDEs, the numerical discretizations of variable-order sFDEs no longer have Toeplitz-like stiffness matrices, so the fast solvers developed for constant-order sFDEs do not apply. Also, the spectral methods do not have diagonal stiffness matrices.
In this paper we develop a fast numerical solution technique for an indirect collocation method to the homogeneous Dirichlet boundary-value problem of a one-sided variable-order sFDE in one space dimension. We approximate the stiffness matrix by a finite sum of Toeplitz-like matrices that is asymptotically convergent to the stiffness matrix. Then we develop a fast divided and conquer (DAC) solver for the approximated system by employing the Toeplitz-like structures of each summand to reduce the computational complexity from to and the memory requirement from to .
The rest of the paper is organized as follows. In Section 2 we present the model problem and its numerical discretization. In Section 3 we approximate the coefficient matrix by a sum of Toeplitz-like matrices and analyze its asymptotic consistency. In Section 4 we develop a fast DAC method for the approximated system. We perform numerical experiments to test the performance of the method in the last section.
2 A variable-order sFDE model and its indirect collocation method
2.1 Model problem
An sFDE of order was proposed in del to model the anomalously superdiffusive transport of solute in heterogeneous porous media
[TABLE]
where refers to the second-order derivative of and the Caputo fractional derivative is defined by Pod
[TABLE]
Equation (1) is proposed based on the fact that a large amount of solute particles may travel through high permeability zones in a superdiffusive manner BenSchMee ; MeeSik , which may deviate from the transport of the solute particles in the bulk fluid phase that undergo a Fickian diffusive transport Bear72 . Therefore, in model (1), the term represents the portion of the total solute mass undergoing the Fickian diffusive while the term refers to the portion of the total solute mass undergoing the superdiffusive transport in high permeability zones.
Note that in realistic applications, the reservoir may consist of different types of porous media that have different fractional dimensions. Hence, in this paper we consider the homogeneous Dirichlet boundary-value problem of the following one-sided variable-order linear sFDE as a variable extension of (1)
[TABLE]
where ( if ) and is the fractional diffusivity. The variable-order Caputo fractional derivative is defined by ZenZhaKar ; ZhuLiu
[TABLE]
where refers to the Gamma function.
2.2 An indirect collocation method
We rewrite (2) in terms of
[TABLE]
Then the solution to model (2) can be obtained by postprocessing
[TABLE]
Let be a uniform partition of with for and . Let be the piecewise-linear basis functions with and for . Each element in the space of continuous and piecewise linear functions on can be represented by
[TABLE]
Then an indirect collocation method for model (2) reads:
Step 1
Find such that for
[TABLE]
Step 2
Obtain an approximation of by
[TABLE]
The following error estimate of the method was proved ZheWan under the assumptions that , and are second-order continuously differentiable on , and with if
[TABLE]
Instead, for sufficiently smooth, we have .
2.3 Solution of the numerical scheme
For we obtain from (6) that . We then plug (5) into (6) for and move the terms containing to the right-hand side of the resulting equation to get a linear system with the unknowns
[TABLE]
where is a lower triangular matrix of the form
[TABLE]
[TABLE]
and with given by
[TABLE]
With obtained from (9), we plug into (7) to obtain the approximation to . In particular, the discrete approximation with can be evaluated inductively as follows.
Theorem 2.1
The can be computed by
[TABLE]
where and is inductively generated by
[TABLE]
Proof
For (7) with , we obtain the first equation of (12) by a direct calculation. For (7) with and , we split the first integral on to those on and and split the kernel to in the first resulting integral to obtain
[TABLE]
Note that as is a piecewise linear function, defined by (13) represents the integration of over . Therefore, the second term on the right-hand side of (14) equals to . From (7) with we have
[TABLE]
We plug this into (14) to get
[TABLE]
which finishes the proof.
3 An approximated collocation scheme
As is a lower triangular matrix, a direct solution of the numerical scheme requires storage and has computational complexity. Once we obtained , only storage and operations are needed to compute by Theorem 2.1. That is, the main task lies in reducing the memory requirement and the computational complexity of (9). To do so, we approximate by a finite sum of Toeplitz-like matrices.
Theorem 3.1
For , defined by (11) can be approximated by
[TABLE]
for some with the residue given by
[TABLE]
Proof
We decouple the nonlinear dependence of and in (cf (11)) for by applying the Taylor’s expansion of power functions to the first and the third terms on the right-hand side of (11) as follows
[TABLE]
where are the remainders of the Taylor’s expansion
[TABLE]
Here . We plug (17) into (11) to obtain
[TABLE]
[TABLE]
Due to the impact of the variable order , the matrix of entries is not Toeplitz. The assumption on (preceding (8)) implies . We use the Taylor’s expansion of with and to obtain
[TABLE]
[TABLE]
Substituting (21) into (19) yields
[TABLE]
[TABLE]
Then we replace the terms in the first and second brackets by (19) and (21), respectively, to obtain (16). Dropping the truncation error in (23), we get the approximation (15) of for .
Replacing in the entries of by the right-hand side of (15) leads to the corresponding approximated system
[TABLE]
Theorem 3.2
For and with , the local truncation error can be bounded by
[TABLE]
Consequently, we have for
[TABLE]
That is, the approximation scheme (24) is asymptotically consistent with the original problem (9) with respect to and .
Proof
We bound and respectively. The binomial coefficients in (20) can be represented in terms of the gamma functions as follows
[TABLE]
We use the asymptotic expansions of Gamma functions ((KilSri, , Eq. 1.5.15))
[TABLE]
to get
[TABLE]
We note that for the left-hand side of (17) with the minus sign in “” vanishes, so , and thus the first term on the right-hand side of the equal sign“=” in (28), vanishes. We thus bound the remaining factors on the right hand of (20) by
[TABLE]
We incorporate the proceeding estimates to obtain the estimates of the local truncation error
[TABLE]
We note that in (22) satisfies and use the Stirling’s formula for gamma functions to get
[TABLE]
We thus bound by
[TABLE]
We combine (29) and (30) to bound in (16) by
[TABLE]
where in the first inequality we have used the Taylor’s expansion as in (17) and the expression (18) for with
[TABLE]
By setting in the first term on the right-hand side of (31) we obtain (25) and (26).
4 A fast divided-and-conquer solver
We develop a fast DAC solver for the collocation system (24). Due to the impact of the variable order in the sFDE (2), the stiffness matrix in (9) no longer has Toeplitz structure so the DAC algorithm MSun ; FMWang developed for constant-order FDEs cannot apply. We develop a fast DAC method by expressing the stiffness matrix in (24) as
[TABLE]
By Theorem 3.2 the truncation errors are not necessarily small when is small, so the approximations of the corresponding entries may lose accuracy. To ensure the accuracy of the approximations, we evaluate entries on the right-up bands of with width (i.e., colored entries in the matrix below) exactly as follows
[TABLE]
Thus, the matrix has () nonzero entries totally, which indicates the matrix-vector multiplication can be computed exactly in of memory and of computational work.
Theorem 4.1
The sub-matrix in (32) can be expressed as a sum of Toeplitz matrices multipied by diagonal matrices, so the corresponding system can be stored in and can be solved in operations by the fast approximated DAC method (see Algorithm 2).
Proof
We combine (33) with (15) to express as
[TABLE]
where and for are given by
[TABLE]
and
[TABLE]
with and the first column and the first row of , respectively
[TABLE]
It is well known that can be performed in operations via the discrete fast Fourier transform (FFT), which implies that can be evaluated in operations. To store , we only need to store , , and that require memory. If we take according to Theorem 3.2, the computational cost and the memory requirement of become and , respectively. Then the total number of computations and the storage of the proposed fast method can be evaluated by
[TABLE]
By (33), the storage and the computational cost of are both . Thus the total computational cost and the storage are
[TABLE]
Then totally flops and storage of the fast approximated algorithm can be estimated by
[TABLE]
which finishes the proof.
Remark 1
It takes computational works to generate the entries of the original coefficient matrix , while in the fast approximated DAC method only operations are needed to generate all the entries of the approximated coefficient matrix .
5 Numerical experiments
We perform numerical experiments to investigate the performance of the fast DAC method (FDAC) by comparing it with the Forward Substitution method (FS). The approximated system (24) will be solved and the convergence rates of the indirect collocation method, the CPU times (in seconds) of generating the coefficient matrix () and of solving the lower triangular linear system () will be recorded. We set the parameter appeared in Theorem 3.1 equal to throughout the experiments.
Experiment 1.
We set and
[TABLE]
with , . The exact solution and the corresponding right hand term is given by
[TABLE]
The results are presented in Table 1 and Table 2, from which we notice that
- •
The CPU time consumed by FS increases at about a quadruple rate between two consecutive numbers of collocation grids while the increment of the CPU time of the FDAC is almost liner;
- •
It is more efficient in the FDAC to generate the entries of the coefficient matrix than that in the FS. For instance, when , the FS takes 352 seconds to compute the entries of while the FDAC only requires seconds;
- •
when , the FDAC is more efficient than FS for solving the linear systems. For instance, for the case of , the of FS is seconds while in the FDAC it is seconds;
- •
The FS is out of memory for while the FDAC still works even for ;
- •
The FDAC has almost the same accuracy and convergence rates as FS for relatively small while for large the convergence rate is affected by the round-off errors.
From the observations mentioned above, the presented FDAC has shown strong potentials for efficiently and effectively solving the variable-order space-fractional diffusion equations by reducing the memory requirement and improving the efficiency of generating entries of the coefficient matrix and solving the linear systems. This implies that the proposed fast method is particularly suitable for the large-scale simulations.
Experiment 2.
Let and . We choose a solution with a boundary layer at
[TABLE]
The corresponding right-hand side is
[TABLE]
Numerical results are presented in Table 3–5, which is strongly consistent with the observations in Experiment 1.
Acknowledgments
This work was funded by the OSD/ARO MURI Grant W911NF-15-1-0562, by the National Science Foundation under grants DMS-1620194 and by Natural Science Foundation of Shandong Province under grants ZR2019BA026.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) Bai, Z., Lu, K., Pan, J.: Diagonal and Toeplitz splitting iteration methods for diagonal-plus-Toeplitz linear systems from spatial fractional diffusion equations. Numer. Lin. Algebra Appl. 24 , e 2093(2017)
- 2(2) Bear, J.: Some experiments on dispersion. J. Geophys. Res. 66 , 2455-2467(1961)
- 3(3) Bear, J.:Dynamics of Fluids in Porous Media. Elsevier, New York(1972)
- 4(4) Benson, D., Schumer, R., Meerschaert, M. M., Wheatcraft, S. W.: Fractional dispersion, Lévy motions, and the MADE tracer tests. Transport in Porous Media. 42 , 211-240(2001)
- 5(5) Bertaccini, D., Durastante, F.: Block structured preconditioners in tensor form for the all-at-once solution of a finite volume fractional diffusion equation. Appl. Math. Lett. 95 , 92-97(2019)
- 6(6) Chen, S., Liu, F., Burrage, K.: Numerical simulation of a new two-dimensional variable-order fractional percolation equation in non-homogeneous porous media. Comput. Math. Appl. 68 , 2133–2141(2014)
- 7(7) Del-Castillo-Negrete, D., Carreras, B. A., Lynch, V. E.: Fractional diffusion in plasma turbulence. Phys. Plasmas. 11 , 3854(2004)
- 8(8) Del-Castillo-Negrete, D.: Front propagation in reaction-diffusion systems with anomalous diffusion. Boletín de la Sociedad Matemática Mexicana. 20 , 87-105(2014)
