Spectral approximation of fractional PDEs in image processing and phase field modeling
Harbir Antil, S\"oren Bartels

TL;DR
This paper develops a spectral approximation method for fractional PDEs, demonstrating its effectiveness in image processing and phase field modeling through theoretical analysis and numerical experiments.
Contribution
It introduces a spectral numerical scheme for fractional PDEs and analyzes its efficiency, specifically applied to image processing and phase field models.
Findings
Spectral method effectively approximates fractional PDEs.
Numerical experiments confirm the method's efficiency.
Applications include image processing and phase field modeling.
Abstract
Fractional differential operators provide an attractive mathematical tool to model effects with limited regularity properties. Particular examples are image processing and phase field models in which jumps across lower dimensional subsets and sharp transitions across interfaces are of interest. The numerical solution of corresponding model problems via a spectral method is analyzed. Its efficiency and features of the model problems are illustrated by numerical experiments.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Spectral approximation of fractional PDEs in image processing and phase field modeling
††thanks: The work of the first author is partially supported by NSF grant DMS-1521590.
Harbir Antil Department of Mathematical Sciences, George Mason University, Fairfax, VA 22030, USA. [email protected]
Sören Bartels Department of Applied Mathematics, Mathematical Institute, University of Freiburg, Hermann-Herder-Str 9, 79104 Freiburg I. Br. Germany. [email protected]
Abstract
Fractional differential operators provide an attractive mathematical tool to model effects with limited regularity properties. Particular examples are image processing and phase field models in which jumps across lower dimensional subsets and sharp transitions across interfaces are of interest. The numerical solution of corresponding model problems via a spectral method is analyzed. Its efficiency and features of the model problems are illustrated by numerical experiments.
keywords:
Fractional Laplacian; image denoising; phase field models; error analysis; Fourier spectral method.
**AMS subject classification **35S15, 26A33, 65R20, 65N12, 65N35, 49M05, 49K20
1 Introduction
Let , , be the -dimensional torus. The purpose of this paper is to study the approximation of problems involving the fractional Laplace operator of order
[TABLE]
using the Fourier spectral method and to illustrate the importance of fractional differential operators. Such operators appear in various models with periodic boundary conditions, see [18, 28, 32]. The approach discussed here extends to problems with other boundary conditions such as Dirichlet or Neumann boundary conditions. For a discussion on nonhomogeneous boundary conditions we refer to [2].
Motivated by applications including fracture mechanics and turbulence, see [24, 16, 21], problems with fractional derivatives have recently gained a lot of interest. Several experiments suggest the presence of fractional derivatives, for instance, the electrical signal propagation in a cardiac tissue [10]. The appearance of fractional derivatives there is attributed to the heterogeneity of the underlying medium. A question arises: can one, for example, tailor the diffusion coefficient in [10] to get the same effects as the fractional model? Indeed to arrive at a direct evidence justifying the presence of fractional derivatives is a difficult question to address. This paper is an attempt to partially address this question by considering two specific applications where the presence of spectral fractional operators makes a significant difference. In particular, we illustrate the effect and advantages of fractional derivatives on two, by now, classical problems: image denoising and phase field modeling.
A well-known total variation based image denoising model is the so-called Rudin–Osher–Fatemi (ROF) model [33] which seeks a minimizer for
[TABLE]
Here denotes the image domain, is the norm in with corresponding inner product , and is a regularization parameter. The function represents the given observed possibly noisy image. The first term in is the total variation which has a regularizing effect but at the same time allows for discontinuities which may represent edges in the image. The second term is the fidelity term which measures the distance to the given image. Often, weaker norms such as the norm are considered to define the latter term. While the existence and uniqueness of a minimizer can be established via the direct method of calculus of variations, the non-differentiability of the total variation is challenging from a computational point of view. In fact, a non-exhaustive list of papers that have attempted to resolve this are [5, 7, 15, 27, 19, 25, 30, 6]. Another question to ask is, whether natural images belong to . The paper [26] shows that natural images are incompletely represented by functions. We will handle both these shortcomings by replacing the total variation term in (1.1) by a squared fractional Sobolev norm. In other words, we propose to minimize
[TABLE]
with and . The first order necessary and sufficient optimality condition determines the unique minimizer via
[TABLE]
which is a linear elliptic partial differential equation (PDE) that can be efficiently solved using, for instance, the Fourier spectral method (which is the focus of this paper) or the so-called Caffarelli-Silvestre extension (in ) [11] and the Stinga-Torrea extension (in bounded domains) [32, 37], see also [31]. Our experiments reveal that the fractional model (1.3) leads to results which are comparable to those provided by the ROF model but at a significantly reduced computational effort (see Section 4). We remark that fractional derivatives have been used in image processing before; see [13, 14], where the authors use spectral methods, and [23], where the authors use the finite element method. However, in both these cases the authors solve a fractional dynamical system with initial condition given by . For completeness, we also refer to [4] where the authors consider a fractional norm equivalent regularization in the context of optimal control problems and parameter identification problems – this equivalent norm was realized using a mutilevel approach.
A mathematical justification of our choice of (1.2) as a substitute to (1.1) is given next. We seek solving (1.3) in a fractional Sobolev space . Moreover, we notice that if then following Theorem 3.5 part (1)(b) of [38] it is possible to show that , see also [3]. We will next see that is contained in for . Indeed by Lemma 38.1 of [39] we have the following continuous embedding
[TABLE]
where is a Besov space. In addition, using Proposition 1.2 of [20], see also [29, pg. 1222] and [41, Section 3], we have the following continuous embedding
[TABLE]
provided that . Finally, combining the inclusions we arrive at
[TABLE]
which justifies our energy functional (1.2). We remark that the regularizing quadratic term in (1.2) does not have the gradient sparsity property of the total variation norm. This effect however cannot be proven for the ROF model in general due the presence of the quadratic fidelity term but is certainly visible in experiments.
As a second example we consider gradient flows of the energy functional
[TABLE]
with initial condition . The -gradient flow of (1.4) leads to the fractional Allen–Cahn equation
[TABLE]
where , , and is typically nonlinear in . Moreover,
[TABLE]
where . When , we set . The gradient flow, with leads to the fractional Cahn–Hilliard equation
[TABLE]
By testing (1.6) with a constant function it is easy to check that (1.6) is mass conserving. We note that throughout this article we consider as a fixed small number. The aforementioned scaling of is the right scaling to obtain a sharp interface limit as we refer the reader to [35]. We remark that even though the optimality system in case of image denoising is linear (1.3), the system for the fractional phase field model is nonlinear (1.6) and controlling these nonlinearities in the presence of fractional derivatives turned out to be a nonobvious task.
When , a standard numerical method requires a fine mesh resolution around interfaces to capture sharp transitions [8]. The fully discrete scheme proposed in this paper is unconditionally stable and supported by a rigorous error analysis. In our experiments we observe that using the spectral method and choosing small values for , it is possible to obtain sharp interfaces on relatively coarse meshes and moderate values for .
We remark that the use of spectral methods in the context of phase field models (when , or ) has been considered before, see [9, 17]. We further remark that the recent paper [36] also investigates a fractional Allen–Cahn equation and uses the fractional Riemann-Liouville derivative which is different from our definition. In addition, few analytical details are provided. We also refer to [1] which discusses analytical properties of a fractional Cahn–Hilliard equation with fixed . The authors report that the dynamics in case and are closer to the classical Cahn-Hilliard equation than to the Allen-Cahn equation. The error analysis provided there is restricted to spatial discretizations while the used fully discrete scheme treats the nonlinearity explicitly and is hence only conditionally stable.
We remark that the goal of this article is to show possible applications of fractional PDEs. The simple image denoising problem serves as a model problem in which the effect of fractional derivatives of different order becomes directly apparent. The nonlinear evolution model defined by the fractional phase field equation combines different effects so that an interpretation of the effect of fractional derivatives of different order requires a more careful interpretation. Our experiments are meant to illustrate these effects for different parameters .
This paper is organized as follows: In Section 2 we recall facts about spectral interpolation estimates in fractional Sobolev spaces. The fractional Laplace operator and its discretization by the spectral method are addressed in Section 3. We present the details on the fractional image denoising problem in Section 4. Section 5 is devoted to a general error analysis for a numerical scheme covering both the fractional Allen–Cahn and Cahn–Hilliard equations. We conclude with several illustrative numerical examples in Section 6.
2 Spectral approximation
In this section we specify notation needed to define the discrete Fourier transformation and recall elementary approximation results in fractional Sobolev spaces.
2.1 Discrete Fourier transformation
We consider the -periodic torus and the set of grid points on defined by where \mathbb{N}_{n}^{d}=\big{\{}j=(j_{1},\dots,j_{d})\in\mathbb{Z}^{d}\mathrel{\mathop{\mathchar 58\relax}}0\leq j_{i}\leq n-1\big{\}}. A family of grid functions is defined by
[TABLE]
where \mathbb{Z}_{n}^{d}=\big{\{}k=(k_{1},\dots,k_{d})\in\mathbb{Z}^{d}\mathrel{\mathop{\mathchar 58\relax}}-n/2\leq k_{i}\leq n/2-1\big{\}} and . For grid functions and we define the discrete scalar product
[TABLE]
The associated norm is denoted . Notice that the family defines an orthogonal basis for the space of grid functions with . The discrete Fourier transform of a grid function is the coefficient vector with
[TABLE]
With these coefficients we have
2.2 Trigonometric interpolation
We consider the space of trigonometric polynomials defined via
[TABLE]
with the functions which define an orthogonal basis for with respect to the inner product in . With we associate a grid function via , . Notice that for with associated grid functions we have
[TABLE]
The discrete Fourier transformation gives rise to a nodal interpolation operator.
Definition 1**.**
Given with nodal values and discrete Fourier coefficients , the trigonometric interpolant of is defined via
[TABLE]
Remark 2**.**
*(i) Note that for all .
(ii) We have for all .
(iii) We have for all and .*
The (continuous) Fourier transform of a function is the coefficient vector defined by
[TABLE]
Note that here the inner product is used instead of its discrete approximation. With respect to convergence in we have that and, in particular, Plancherel’s formula .
2.3 Approximation in Sobolev spaces
We analyze the approximation properties of the interpolation operator in terms of Sobolev norms and with the help of the projection onto which is obtained by truncation of the Fourier series of a function.
Definition 3**.**
The projection is for defined by the condition that for all we have
[TABLE]
Note that for every we have . The following definition is motivated by the fact that for every .
Definition 4**.**
Given the Sobolev space consists of all functions with
[TABLE]
Its dual consists of all linear functionals with
[TABLE]
where .
The Sobolev spaces allow us to quantify approximation properties of the operators and . We refer the reader to Chapter 8 in [34] for details.
Lemma 5** (Projection error).**
For with and we have
[TABLE]
By comparing and we obtain a trigonometric interpolation estimate. It is shown in Remark 8.3.1 of [34] that the conditions of the following result cannot be improved in general.
Lemma 6** (Interpolation error).**
If , , and we have
[TABLE]
with a constant that is independent of and .
We conclude the section with an inverse estimate. Particularly, for every function and we have that
[TABLE]
3 Fractional Laplace operator
We define subspaces of Sobolev spaces via
[TABLE]
For the subspaces consist of Sobolev functions with vanishing mean. On the subspaces the corresponding seminorms are norms.
Definition 7**.**
For and the fractional Laplacian of is the (generalized) function defined by
[TABLE]
Given with vanishing mean the fractional Poisson problem seeks with
[TABLE]
The unique solution to (3.1) is given by
[TABLE]
and in fact satisfies . More generally, for we have
[TABLE]
i.e., the fractional Laplacian defines an isometric isomorphism
[TABLE]
We define the fractional Laplace operator of negative order as the inverse of , i.e.,
[TABLE]
Note that for and with we have
[TABLE]
If we have the continuous embedding property
[TABLE]
The discretized fractional Poisson problem seeks for a given with vanishing mean a function with
[TABLE]
The uniquely defined solution is given by
[TABLE]
There are two noticeable differences between the continuous (3.2) and the discrete solutions (3.5). Besides the finite and the infinite sums, contains the discrete Fourier coefficients and contains the continuous Fourier coefficients . The following a priori error estimates hold.
Theorem 8**.**
Let and solve the continuous (3.1) and the discrete (3.4) problems, respectively. We have
[TABLE]
In particular, if and we have
[TABLE]
while if with and we have
[TABLE]
Proof.
In view of (3.1) and (3.4) we have
[TABLE]
This implies the general estimate and in combination with Lemma 5 the estimate in case . With (3.3) and Lemma 6 we deduce that
[TABLE]
which implies the estimate. ∎
4 Fractional image denoising
Our second problem is a replacement of the ROF image denoising model (1.1). Given an image we propose to minimize
[TABLE]
with and . The minimization is carried out over when and over when is positive. In the latter case we assume that has a vanishing mean. The existence and uniqueness of a minimizer follows by using the direct method in the calculus of variations. The first order necessary and sufficient optimality condition determines the unique minimizer via
[TABLE]
We note that since , we have . In particular, the solution to (4.2) is
[TABLE]
The discretized problem seeks for a given a function with
[TABLE]
The uniquely defined solution is given by
[TABLE]
Theorem 9**.**
Let and solve the continuous and the discrete problems (4.3) and (4.2), respectively. We have that
[TABLE]
In particular, if and we have
[TABLE]
while if with and we have
[TABLE]
Proof.
Testing the difference of (4.2) and (4.3) by implies that
[TABLE]
The estimates follow from using and arguing as in the proof of Theorem 8. ∎
5 Fractional phase field equations
Given parameters we recall the fractional Cahn-Hilliard equation (1.6)
[TABLE]
on a -dimensional torus and with initial condition . We recall that gives rise to the fractional Allen–Cahn equation (1.5). Below we will impose the restrictions and .
We assume a splitting of the nonnegative potential into convex and concave parts and which induces a decomposition of into a monotone and an antimonotone part
[TABLE]
We assume for simplicity that and are smooth and Lipschitz continuous. The latter condition is justified by a maximum principle in the case for the Allen–Cahn equation and bounds for solutions of the Cahn–Hilliard equation [12] corresponding to and , respectively.
5.1 Numerical scheme and error analysis
The numerical scheme computes iterates via
[TABLE]
where with being the time step-size and is a suitable approximation of . By applying the operator and testing the resulting identity with constant functions we observe the mass conservation property if . Existence of the iterates is established via convex minimization problems; if the convex part of is quadratic then is linear and the scheme (5.2) defines a linear system of equations. The scheme is unconditionally energy stable in the sense that we have
[TABLE]
with the discrete energy functional
[TABLE]
This follows from testing (5.2) with , using
[TABLE]
and noting that as a consequence of convexity and concavity we have
[TABLE]
Assuming initial data with as , the energy estimate provides a priori bounds on interpolants of the approximations which allows us to select an accumulation point
[TABLE]
as and . Its identification as a solution for the fractional Cahn–Hilliard equation follows from the Aubin–Lions lemma provided that . Uniqueness of solutions is a consequence of the assumed Lipschitz continuity of . For an error analysis we note that , let with , and define
[TABLE]
where is the orthogonal projection given in Definition 3. Note that we have but unless belongs to . We omit the subscript whenever the scalar product is applied to two functions belonging to . For ease of readability we abbreviate
[TABLE]
The sequences and satisfy the discrete equations
[TABLE]
where we used that commutes with for every . Subtracting the identities leads to the error equation
[TABLE]
with the discretization errors
[TABLE]
Testing the error equation with shows that we have
[TABLE]
To bound the first term on the right-hand side we insert , use Lemma 6, the inverse estimate (2.1), and insert to deduce with the Lipschitz continuity of that
[TABLE]
For the second term we have that
[TABLE]
where we used the inverse estimate if . For the third term we assume that and estimate
[TABLE]
A combination of the estimates, multiplication by , and summation over , yield that
[TABLE]
If we may directly apply the discrete Gronwall lemma to obtain an error estimate. If we assume , require that so that , and use the bound
[TABLE]
to deduce with Young’s inequality the estimate
[TABLE]
Here, is the sum of the first four terms on the right-hand side of the above estimate and . The discrete Gronwall lemma leads to the estimate
[TABLE]
for all with provided that . With the triangle inequality and approximation estimates for we obtain the following error estimate.
Theorem 10**.**
Let solve (1.6) and let the sequence be defined via (5.2). There exists a constant such that we have
[TABLE]
for all and .
The constant , in general, depends exponentially on . For the derivation of this estimate we used the indicated regularity assumption. By standard arguments, see [40] the regularity assumption on the exact solution can be weakened to the conditions
[TABLE]
The suboptimal term corresponds to the semi-implicit treatment of the nonlinearity which makes the scheme (5.2) fully practical.
5.2 Improved error estimate via spectral bounds
A significantly improved error estimate can be obtained if additional analytical knowledge about the evolution is available, e.g., in the form of lower bounds for the principal eigenvalue
[TABLE]
For ease of presentation we only consider the fractional Allen–Cahn equation with and outline the main arguments following [22, 8]. We focus on the contribution to the error equation resulting from the nonlinearity and write it with abstract consistency functionals as
[TABLE]
A precise formula for is obtained from subtracting the projected partial differential equation evaluated at onto from the numerical scheme as above, e.g., in case of a fully implicit numerical scheme with a nodal interpolation of the nonlinear term we have
[TABLE]
To relate the error equation to the principal eigenvalue we require a controlled failure of monotonicity for in the sense that there exists a constant such that for all we have
[TABLE]
With this estimate we deduce with that
[TABLE]
We incorporate the eigenvalue via
[TABLE]
Choosing and letting thus leads to the estimate
[TABLE]
Rearranging terms gives
[TABLE]
In an inductive argument we may assume that and use the discrete Gronwall lemma to obtain an error estimate that depends exponentially on the principal eigenvalue . Hence, if is uniformly bounded from below the resulting error estimate depends only algebraically on . More generally, it suffices to assume that a discrete time integral of is uniformly bounded from below. This allows us to cover large classes of evolutions including topological changes.
6 Numerical Examples
In this Section, we present several numerical examples. In Section 6.1 we discuss the approximation of the fractional Poisson problem. Section 6.2 is devoted to image denoising problem. In Section 6.3 we study features of the fractional Allen–Cahn equation. We conclude with experiments for the fractional Cahn–Hilliard equation in Section 6.4.
6.1 Approximation of the Poisson problem
To construct a nonsmooth solution for the fractional Poisson problem we first let be defined via
[TABLE]
Since we find for with an integration-by-parts that
[TABLE]
i.e., if is odd and if is even. We have . We then let be for defined via
[TABLE]
We have if and . We set , i.e., for let . Note that if and only if . We choose the approximation which is explicitly available here. The output for and is displayed in Figure 1. In contrast to solutions of the classical Poisson problem we observe here the occurrence of kinks in the solution.
6.2 Fractional image denoising
The fractional Laplacian with is closely related to the total variation norm (see Section 1) which motivates its application in image processing. Given a noisy image we define a regularized image via
[TABLE]
The fidelity parameter penalizes the deviation of from in the metric. Alternatively, this distance can be taken in the weaker metric of which leads to the equation
[TABLE]
where we assume that has vanishing mean and look for with vanishing mean. The results of two experiments are displayed in the rows of Figure 2. In the first experiment we set , , and . In the second experiment we used , and . The first and second columns display the original and noisy images, respectively. The third and fourth columns show the results of and fidelity. We note that in the first example, where the additive noise is normally distributed with mean zero and standard deviation , the -fidelity almost perfectly recovers the original image reflecting the fact that for Gaussian noise this is statistically the optimal choice. In the second example where the noise is given by the nodal interpolant of the sinusoidal function
[TABLE]
we obtain better recovery using the -fidelity. We remark that it took 0.2 sec and 0.006 sec to solve the first and the second problem in Matlab on a MacBook Pro with an 2.8 GHz Intel Core i7 processor (16 GB 1600 MHz DDR3 RAM).
Comparison between fractional and total variation
We next compare the fractional and the total variation (TV) based models (1.1) with the help of three examples. This comparison was carried out in Python which was specifically chosen due to the availability of SciKit-Image toolbox [42]. In all the examples we assume that original image denoted by (without noise) is known. For the fractional case we compute the optimal parameters by solving a minimization problem: , subject to solving We further assume that lies in a closed convex set, i.e., and . We solve this optimization problem using an in-built optimization algorithm in Python. The corresponding optimization problem for TV is solved for using a genetic algorithm.
Our first example uses a picture of Gauss (cf. Figure 3, top row). The left image is the original image with . Our second example (cf. Figure 3, middle row) uses a synthetic image with . Our final example (cf. Figure 3, bottom row) is based on an in-built image from SciKit with different number of points in the and directions, i.e., , . We note that even though the approach discussed in Section 4 assumes it is directly extended to this case where . In the second column (from the left), in all the examples, we have added a normally distributed noise with mean zero and standard deviation , we denote the resulting noisy image by .
For the fractional case the optimal parameters are for the first example and for the second and third examples. On the other hand, for TV case the optimal parameters are , , and , respectively. Using these parameters we solve the corresponding image denoising problems using the fractional approach (third column from the left) and compare the results with the in-built TV algorithm from [42]. We observe that the two approaches give comparable results in all three examples. The fractional approach is significantly cheaper as only two discrete Fourier transformations have to be computed. The CPU times for implementations of the fractional and TV approach in Matlab and Python, respectively, are provided in the caption of Figure 3. They show a reduction of the computing times by factors 10-100. We remark that certain aspects in the Chambolle–Pock algorithm implemented in Scikit such as the specification of a suitable stopping criterion and choice of step-sizes may lead to different results.
6.3 Fractional Allen–Cahn equation
We consider the fractional Allen-Cahn equation (1.5) with a given initial function . The function is the derivative of a double well potential with quadratic growth, i.e.,
[TABLE]
which leads to linear systems of equations in our semi-implicit time discretization. Snapshots of the evolutions with , , and at , , , and (rowwise) are shown in Figure 4. The first column corresponds to , second to , third to , and finally fourth to . Clearly the interface in case of a fractional model is sharper, however the dynamics are slower.
6.4 Fractional Cahn-Hilliard equation
We next study the fractional Cahn–Hilliard equation specified in (1.6) defining and as in Subsection 6.3. In a first experiment we define the initial condition as
[TABLE]
Snapshots of the evolutions with , , and at , , , and (rowwise) are shown in Figure 5 for , , , and (columnwise) with in all cases.
In a second experiment we focus on the coarsening dynamics of the fractional phase field equation. As in [1] the initial condition is given by where is a random perturbation uniformly distributed in [-0.2,0.2]. Snapshots of the evolutions with , , , and at , , , and (rowwise) are shown in Figure 6. The first two columns correspond to with and , respectively. The last two columns are obtained with with and , respectively.
Acknowledgement
We thank Pablo Stinga for stimulating discussions. We also thank Diego Torrejon for help with Python.
Funding
The work of the first author is partially supported by NSF grant DMS-1521590.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M. Ainsworth and Z. Mao. Analysis and Approximation of a Fractional Cahn–Hilliard Equation. SIAM J. Numer. Anal. , 55(4):1689–1718, 2017.
- 2[2] H. Antil, J. Pfefferer, and S. Rogovs. Fractional operators with inhomogeneous boundary conditions: Analysis, control, and discretization. ar Xiv preprint ar Xiv:1703.05256 , 2017.
- 3[3] H. Antil, J. Pfefferer, and M. Warma. A note on semilinear fractional elliptic equation: analysis and discretization. To appear: ESAIM: M 2AN , 2017.
- 4[4] U. Aßmann and A. Rösch. Regularization in Sobolev spaces with fractional order. Numer. Funct. Anal. Optim. , 36(3):271–286, 2015.
- 5[5] S. Bartels. Total variation minimization with finite elements: convergence and iterative solution. SIAM J. Numer. Anal. , 50(3):1162–1180, 2012.
- 6[6] S. Bartels. Numerical methods for nonlinear partial differential equations , volume 47 of Springer Series in Computational Mathematics . Springer, Cham, 2015.
- 7[7] S. Bartels. Broken Sobolev space iteration for total variation regularized minimization problems. IMA J. Numer. Anal. , 36(2):493–502, 2016.
- 8[8] S. Bartels, R. Müller, and C. Ortner. Robust a priori and a posteriori error analysis for the approximation of Allen-Cahn and Ginzburg-Landau equations past topological changes. SIAM J. Numer. Anal. , 49(1):110–134, 2011.
