Analysis of the spectral symbol function for spectral approximation of a differential operator
Davide Bianchi

TL;DR
This paper investigates the spectral symbol function for discretized differential operators, establishing conditions under which it accurately approximates the spectrum and challenging the effectiveness of uniform sampling methods.
Contribution
It proves that the spectral symbol provides a necessary condition for spectral approximation and shows that uniform sampling of the symbol is generally insufficient for accurate spectrum approximation.
Findings
Spectral symbol is necessary for spectral approximation.
Uniform sampling of spectral symbol often fails to approximate spectra accurately.
Proper discretization and grid refinement improve spectral approximation.
Abstract
Given a differential operator along with its own eigenvalue problem and an associated algebraic equation obtained by means of a discretization scheme (like Finite Differences, Finite Elements, Galerkin Isogeometric Analysis, etc.), the theory of Generalized Locally Toeplitz (GLT) sequences serves the purpose to compute the spectral symbol function associated to the discrete operator We prove that the spectral symbol provides a necessary condition for a discretization scheme in order to uniformly approximate the spectrum of the original differential operator . The condition measures how far the method is from a uniform relative approximation of the spectrum of . Moreover, the condition seems to become sufficient if the…
| 5.8049 | 0.3912 | 0.0103 | 4.2392e-06 |
| 0.0326 | 3.3223e-04 | 3.3283e-06 | ||
| 20.3811 | 0.2076 | 0.0021 | ||
| 325.3811 | 3.3222 | 0.0333 | ||
| 0.0041 | 4.1363e-05 | 4.1438e-07 | ||
| 2.5395 | 0.0259 | 2.5899e-04 | ||
| 40.6422 | 0.4136 | 0.0041 | ||
| 0.0026 | 2.6120e-05 | 2.6167e-07 | ||
| 1.6056 | 0.0163 | 1.6354e-04 | ||
| 25.7979 | 0.2612 | 0.0026 | ||
| 0.0020 | 2.0008e-05 | 2.0044e-07 | ||
| 1.2389 | 0.0125 | 1.2528e-04 | ||
| 20.4017 | 0.2002 | 1.2528e-04 | ||
| 0.0210 | 0.0036 | 0.0016 | ||
| 0.0482 | 0.0128 | 0.0065 | ||
| 0.0249 | 0.0044 | 0.0020 | ||
| 0.0615 | 0.0157 | 0.0079 | ||
| 0.0297 | 0.0052 | 0.0024 | ||
| 0.0765 | 0.0191 | 0.0095 |
| 0.0104 | 0.0010 | 2.0853e-04 | ||
| 0.7900 | 0.7880 | 0.7878 | ||
| 0.0158 | 0.0016 | 3.1754e-04 | ||
| 0.6700 | 0.6680 | 0.6676 | ||
| 0.0180 | 0.0018 | 3.6226e-04 | ||
| 0.64 | 0.6310 | 0.6302 | ||
| 0.0518 | 0.0097 | 0.0032 | ||
| 1 | 1 | 1 |
| uniform grid | 0.3201 | 0.9057 | 1.0000 |
| non-uniform grid | 0.5939 | 0.2210 | 0.1814 |
| Uniform grid | Nonuniform grid | ||||
| 0.0369 | 0.0018 | 2.7821e-04 | 2.7510e-06 | ||
| 0.9100 | 0.9050 | 1 | 1 | ||
| 0.0628 | 0.0096 | 0.0086 | 8.2742e-05 | ||
| 1 | 1 | 1 | 1 | ||
| uniform grid | 1.7653 | 1.0688 | 1.1465 |
| non-uniform grid | 0.4433 | 0.0483 | 0.0265 |
| Uniform grid | Nonuniform grid | ||||
| 0.3397 | 0.0881 | 0.0016 | 1.7241e-04 | ||
| 1 | 1 | 0.9400 | 0.9300 | ||
| 0.1735 | 0.0425 | 0.0016 | 1.7243e-04 | ||
| 1 | 1 | 0.9400 | 0.9300 | ||
| 11.7523 | 37.0283 | 52.3532 | |
| 0.4133 | 0.4136 | 0.4136 | |
| 3.9990 | 4 | 4 | |
| 2.8296 | 2.8296 | 2.8296 | |
| 3.7663 | 3.9200 | 3.9428 | |
| \hdashline[1pt/1pt] | 4 | 4 | 4 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Numerical Analysis Techniques · Advanced Numerical Methods in Computational Mathematics · Matrix Theory and Algorithms
Analysis of the spectral symbol function for spectral approximation of a differential operator
Davide Bianchi111University of Insubria - Como (Italy). Email: [email protected] ,222Partially supported by INdAM-GNCS Gruppo Nazionale per il Calcolo Scientifico
Abstract
Given a differential operator along with its own eigenvalue problem and an associated algebraic equation obtained by means of a discretization scheme (like Finite Differences, Finite Elements, Galerkin Isogeometric Analysis, etc.), the theory of Generalized Locally Toeplitz (GLT) sequences serves the purpose to compute the spectral symbol function associated to the discrete operator
We prove that the spectral symbol provides a necessary condition for a discretization scheme in order to uniformly approximate the spectrum of the original differential operator . The condition measures how far the method is from a uniform relative approximation of the spectrum of . Moreover, the condition seems to become sufficient if the discretization method is paired with a suitable (non-uniform) grid and an increasing refinement of the order of approximation of the method.
On the other hand, despite the numerical experiments in many recent literature, we disprove that in general a uniform sampling of the spectral symbol can provide an accurate relative approximation of the spectrum, neither of nor of the discrete operator .
Keywords Spectral approximation differential operators Spectral symbol Eigenvalue problem Sturm-Liouville Matrix methods Generalized locally Toeplitz
Mathematics Subject Classification 65N25 65N06 65N30 65N35 65L15
1 Introduction
For simplicity, throughout this paper our main model problem will be the one dimensional Sturm-Liouville equation
[TABLE]
and its associated (regular) Sturm-Liouville eigenvalues problem (SLP)
[TABLE]
As it will be clear in Subsection 5.2, a generalization to other kind of differential operators in higher dimensions can be handled by the same techniques we are going to discuss for this model case.
There are several many approaches to compute the eigenvalues related to Problem (1.2), such as matrix methods, Prüfer’s methods, sampling methods, etc. We refer to [40, 47, 55] and [13, 2] for a general basic overview and we cite some recent interesting papers about transmutation operator methods [37, 36].
Matrix methods consist in discretizing Problem (1.2) in the form
[TABLE]
where is a matrix of order , with a mesh fineness parameter, and then solving the associated algebraic eigenvalue problem. They generally suffer of a (fast) growth of the absolute (and relative) error, that is the quality of the numerical approximation they provide for the -th eigenvalue deteriorates significantly as the index increases. Even if there have been developed suitable correction techniques for improving the accuracy of the computed eigenvalues (see as an example for the FD case the first paper appeared in this sense [39], and a more recent development [1] for the Numerov’s method), if the interest relies only on the computation of the eigenvalues/eigenfunctions, then other methods typically can be a better choice, such as shooting-type methods for example, which can provide more uniformly accurate estimates of the eigenvalues with respect to the index , at the cost of a fair more effort in the implementation, see [40, Chapter 5].
Nevertheless, many other problems demand to discretize equation (1.1) in such a way that the spectrum of the discrete operator preserves the spectrum of the continuous operator uniformly with respect to . Within this regard, see for example the spectral gap problem of the wave equation for the uniform observability of the control waves, [30] and [21, 7], or structural engineering problems, see [29, Section 3.1], or finally the discretization of the Laplace-Beltrami operator by means of the graph-Laplacian, see [42, 10, 33].
In this setting, the theory of Generalized Locally Toeplitz (GLT) sequences provides the necessary tools to understand whether the matrix methods used to discretize the operator are efficient or not to spectrally approximate it. The GLT theory originated from the seminal work of Tilli on Locally Toeplitz (LT) sequences [50] and then afterwards developed by Serra-Capizzano in [45, 46]. It was devised to compute and analyze the spectral distribution of matrices arising from the numerical discretization of integral equations and differential equations. One of the purposes of this spectral analysis is the design of efficient numerical methods for computing the related numerical solutions by fast iterative solvers (especially, multigrid and preconditioned Krylov methods), in this sense see for example the related works [17, 18, 19].
It often happens that the discrete operator from (1.3), properly weighted by a power of (depending on the dimension of underlying space and on the maximum order of derivatives involved) and which we will denote as , enjoys an asymptotic spectral distribution as , i.e., as the mesh is progressively refined. More precisely, for any test functions ,
[TABLE]
where is the -th eigenvalue of the weighted operator and is referred to as the spectral symbol of the sequence , see [9, Definition 2.6] in relation with Toeplitz operators.
The GLT theory serves the purpose to compute the spectral symbol related to matrix methods employed to get the matrix equation (1.3), especially if the numerical method belongs to the family of the so-called local methods, such as FD methods, Finite Element (FE) methods and collocation methods with locally supported basis functions.
In several recent papers it was advanced the suggestion to exploit the sampling of the spectral symbol for approximating the spectrum of the discrete operator , see as a main reference the paper [26] with all the references therein, which is a full review up to the state-of-the-art of the symbol-based analysis for the eigenvalues distribution carried on in the framework of the isogeometric Galerkin approximation (IgA). Unfortunately, this does not apply in general, as we are going to prove.
Nevertheless, the spectral symbol provides to a matrix method a necessary condition for the uniform spectral approximation of the continuous operator , in the sense of the relative error. The condition is easily computable and it seems to be sufficient if the discretization method is paired with a suitable (non-uniform) grid and an increasing refinement of the order of approximation of the method.
The paper is organized as follows.
- •
Section 2 is a summary about the main properties concerning the SLP model equations (1.1) and (1.2).
- •
In Section 3, the theory of GLT sequences is briefly introduced. In Subsections 3.2 and 3.3 we present the spectral symbols concerning the discretization of (2.2) by means of central FD and IgA schemes of varying order, respectively. In Subsection 3.4 it is introduced the monotone rearrangement of the spectral symbol and it is explained how to compute an approximation of it, whenever it is not feasible to get an exact analytical expression. We highlight the connection with the theory of uniformly distributed sequences, see Theorem 3.4.1.
- •
Section 4 is mainly dedicated to numerical experiments: we analyze the SLP in the Euler-Cauchy equation case. Since the eigenvalues for this regular SLP are computable in closed form, it is a suitable toy-model example with variable coefficients. In Subsection 4.1, by easy calculations we show that a uniform sampling of the monotone rearrangement of the spectral symbol produces a positive lower bound in the relative error approximation, independent by the mesh finesse parameter , which prevents to obtain an accurate approximation of the eigenvalues of the Euler-Cauchy differential operator. In Subsection 4.4, furthermore we present a negative result in the case of spectral symbols belonging to the class. Finally, numerical validations are provided to the necessary condition for a uniform spectral approximation.
In Subsection 4.2 and Subsection 4.3 we generalize what observed in the previous subsection to the case of central FD and IgA methods of higher order. By means of a suitable non-uniform grid suggested by the spectral symbol, we observe by numerical experiments that the discretization methods produce a uniform relative approximation of the spectrum of the continuous differential operator, as the mesh fineness parameter and the order of the methods increase.
- •
In Section 5 we collect the proof of the results discussed previously. In particular:
- –
it is proved that in general a uniform sampling of the spectral symbol does not produce an accurate approximation nor of the eigenvalues of , nor of the eigenvalues of ;
- –
it is provided a necessary condition to a numerical matrix method for the relative uniform approximation of the spectrum of ;
All the results can be extended to different matrix methods and differential operators, once there are known the spectral symbol of the matrix method and the asymptotic expansion of the eigenvalues of the differential operator.
1.1 About the notations
We will use the notation to indicate general square matrices, and we will use the notation to indicate a square matrix which is the discretization of a differential operator by means of a numerical method of order of approximation . In the case that the approximation order is implied by the context, then we will omit it. If the discretized operator is weighted by a constant depending by the finesses mesh parameter , then we will denote it with . We will use the subscripts dir and BCs to indicate a (discretized) differential operator characterized by Dirichlet or generic BCs, respectively. When it will be necessary to highlight the dependency of the differential operator with respect to the coefficients and the endpoints , we will write them as right and left subscripts/supscripts. So, for example, the weighted discretization of a Sturm-Liouville operator with Dirichlet BCs by means of the IgA method of order will be denoted by
[TABLE]
In the special case of the (negative) Laplace operator we will use the symbol , and all the other previous notations will apply.
For all the constants we will use the letter , making explicit the dependency to other parameters if needed.
Finally, if not stated differently, we will always consider a non-decreasing ordering of the eigenvalues of a given operator.
2 The model equation
Our model equation will be the following Sturm-Liouville equation with separated boundary conditions (BCs),
[TABLE]
and its associated weighted Sturm-Liouville eigenvalue problem (SLP)
[TABLE]
There is an extensive literature concerning the Sturm-Liouville eigenvalue boundary problem (2.2), see as a (not exhaustive) collection of references [22, 43, 54]. We will write and equivalently to indicate the first derivative of a function with respect to its argument.
If not otherwise explicitly stated, we will suppose that , , and . Under these conditions, problem (2.2) is regular and the differential operator
[TABLE]
defined over an appropriate domain , depending on the boundary conditions, is self-adjoint and has an increasing sequence of positive real eigenvalues of multiplicity one and such that
[TABLE]
By the Liouville transformation
[TABLE]
the regular SLP (2.2) converts to the Liouville normal form
[TABLE]
where is the Laplace operator and
[TABLE]
Indicating with a solution of the differential equation in (2.5) and normalizing it by the initial conditions at , namely
[TABLE]
then the corresponding solution of (1.2) is normalized by
[TABLE]
Therefore, the eigenvalues of the SLP (2.2) are the same of the eigenvalues of the SLP (2.5), being the zeros of the entire function
[TABLE]
In particular, the eigenvalues and eigenfunction norms remain invariant under the change from (2.2) to (2.5).
3 Generalized Locally Toeplitz sequences and spectral symbol
In this section we are going to provide a brief summary about the theory of GLT sequences, starting from the spectral symbol, see Definition 3.1.1. For a detailed treatment of the theory of the GLT sequences we invite the reader to look at [24, 25] and all the references therein. In Subsections 3.2 and 3.3 we present the spectral symbols concerning the discretization of (2.2) by means of -points central FD approximation and Isogeometric Galerkin approximation (IgA) based on B-splines of degree and smoothness . We will not discuss directly here the case of spectral symbols concerning Finite Elements method or IgA with more general smoothness assumptions, in order to avoid that this paper becomes unnecessarily long.
In Subsection 3.4, we present a natural way to approximate the monotone rearrangement of a spectral symbol .
3.1 Preliminaries on GLT sequences and spectral symbol
A matrix is said to be Toeplitz if it is a matrix with constant coefficients along its diagonals, i.e., if it is of the form for all , and with . If is the -th Fourier coefficient of a complex integrable function defined over the interval , then is said to be the Toeplitz matrix generated by . Matrices with a Toeplitz-related structure naturally arise when discretizing, over a uniform grid, problems which have a translation invariance property, such as differential operators with constant coefficients.
From [24] we have the following definitions.
Definition 3.1.1** (Spectral symbol)**
Let be a sequence of matrices tending to infinity as . Let be a measurable function defined on a set with , where is the Lebesgue measure on , and
[TABLE]
We say that has a spectral (or eigenvalue) distribution described by , and we write
[TABLE]
if for all functions (i.e., continuous with compact support) we have
[TABLE]
In this case, is called spectral (or eigenvalue) symbol of . See Subsection 3.4 for its monotone rearrangement.
Relation (3.2) is satisfied for example by Hermitian Toeplitz matrices generated by real-valued functions , i.e., , see [28, 51, 52]. For a general overview on Toeplitz operators and spectral symbol, see [9].
Remark 1
In particular, if is compact, real and continuous, and for every , then taking , with a cut-off of such that on , then
[TABLE]
Because the Riemannian sum over equispaced points converges to the integral of the right hand side of the above formula, then (3.3) could suggest us that the eigenvalues can be approximated by a pointwise evaluation of the symbol over an equispaced grid of , for , expect for at most an of outliers, see Definition 3.1.5. This is mostly the content of [24, Remark 3.2] and [26, Section 2.2].
We remark that in the special cases of Toeplitz matrices generated by enough regular functions , then
[TABLE]
see [53] and [8]. In some sense, this justifies the informal meaning given above to the spectral distribution .
An important consequence of (3.1) is contained in the next Theorem 3.1.1, but we need a couple of definitions more.
Definition 3.1.2** (Clustering)**
Given a subset and a positive number , define the -expansion of as
[TABLE]
We say that a matrix sequence is weakly clustered at if for every it holds that
[TABLE]
Definition 3.1.3** (Spectral attraction)**
Let . Given a matrix sequence , let us order the eigenvalues of according to their distance from , i.e.,
[TABLE]
We say that strongly attracts the spectrum of with infinite order if
[TABLE]
Definition 3.1.4** (Essential range)**
Let be a -measurable function and define the set as
[TABLE]
We call the essential range of . is closed.
Theorem 3.1.1
Let be a matrix sequence such that
[TABLE]
Then is weakly clustered at and every point of strongly attracts the spectrum of with infinite order.
Proof. See [24, Theorem 3.1].
Definition 3.1.5** (Outliers)**
Given a matrix sequence such that , if , we call it an outlier.
The matrices which represent the discrete version of a general differential operator do not always own a Toeplitz structure and therefore we cannot know beforehand whether they posses a spectral symbol or not. Hereafter we begin to introduce the concepts which will bring us to the definition of GLT sequences.
Definition 3.1.6** (Approximating class of sequences)**
Let be a matrix-sequence and let be a sequence of matrix-sequences. We say that is an approximating class of sequences (a.c.s.) for , and we write
[TABLE]
if the following condition is met: for every there exists such that, for ,
[TABLE]
where depend only on , and
[TABLE]
Roughly speaking, is an a.c.s. for if, for all sufficiently large , the sequence approximates in the sense that is eventually equal to plus a small-rank matrix (with respect to the matrix size ) plus a small-norm matrix.
Definition 3.1.7** (Locally Toeplitz operators and Locally Toeplitz sequences)**
Let , let and let . The locally Toeplitz (LT) operator is defined as the following matrix:
[TABLE]
where is a Toeplitz matrix of size generated by and is the zero matrix of size .
Let be a matrix-sequence. We say that is locally Toeplitz (LT) sequence with symbol , and we write , if
[TABLE]
The functions and are, respectively, the weight function and the generating function of .
We can finally give the definition of GLT sequence.
Definition 3.1.8** (GLT sequence)**
Let be a matrix-sequence and let be a measurable function. We say that is a GLT sequence with symbol , and we write , if the following condition is met: for every there exists a finite number of LT sequences , , such that
- (1)
* in measure as ;* 2. (2)
* a.c.s. as .*
We have the following main property (see [24, Property GLT 1 p. 170]) which connects the GLT symbol with the spectral symbol of Definition 3.1.1.
Proposition 3.1.1
If and are Hermitian, then .
3.2 -points central FD discretization of the SLP (2.2)
The (central) Finite Difference method basically consists in the approximation of the -derivative by means of Taylor expansions, centered at , at points with and such that . Given a standard equispaced grid , with
[TABLE]
let us consider a -diffeomorphism such that , and let us consider its piecewise -extension such that
[TABLE]
By means of the piecewise -diffeomorphism we have a new grid , non necessarily uniformly equispaced, with . Combining together the high-order central FD schemes in [3, 4, 31], it is not difficult to obtain the following general matrix eigenvalue problem to approximate the SLP (2.2) in the case of Dirichlet BCs:
[TABLE]
with
[TABLE]
[TABLE]
and finally
[TABLE]
where, if we define the -extension of to as
[TABLE]
and the element as
[TABLE]
then the generic matrix element of is given by
[TABLE]
With abuse of notation, we will call the order of approximation of the central FD method. We have the following results.
Theorem 3.2.1
In the above assumptions, for , defining
[TABLE]
it holds that
- (i)
the eigenvalues are real for every and
[TABLE] 2. (ii)
[TABLE]
where
[TABLE]
and
[TABLE]
Proof. See Appendix A.
Corollary 3.2.1
The function from Theorem 3.2.1 is differentiable, nonnegative, monotone increasing on and it holds that
[TABLE]
Proof. See Appendix A.
3.3 Isogeometric Galerkin discretization of the SLP (2.2) by B-slpine of degree and smoothness
The Galerkin discretization approach deals with the SLP in its weak formulation. For simplicity, let and in (2.2). In the standard Galerkin method, fix a set of basis functions defined on the reference domain and vanishing on the boundary, and look for approximations of the exact eigenpairs of Problem (2.2) by solving the following matrix eigenvalue problem:
[TABLE]
where
[TABLE]
are the stiffness and mass matrices, respectively. In the isogeometric Galerkin method (IgA), the physical domain is described by a global geometry map such that , and . Within this reparametrization of the domain, the stiffness and mass matrices assume the following form
[TABLE]
The numerical eigenvalues are simply the eigenvalues of . Due to the assumption of strictly positivity of and , then both and are symmetric positive definite matrices for any basis functions and diffeomorphism . In the next theorem we collect the results of [24, Theorem 10.15] in a shortened way and according to our notations. For a detailed treatment of the IgA, see [14].
Theorem 3.3.1
Let be discretized by a uniform mesh of step-size (i.e., it divides the interval into equispaced subintervals) and let a -diffeomorphism such that and for every . Let and let the basis functions be taken as , where for are the B-splines of degree and smoothness defined on the knot sequence
[TABLE]
Indicating with the cardinal B-spline of degree , then
- (i)
for every fixed
[TABLE] 2. (ii)
it holds the following spectral distribution
[TABLE]
where
[TABLE]
and and are given by
[TABLE]
For , equation (3.7) gives
[TABLE]
Proof. For item (i) see [6, 41]. For item (ii), see [24, Theorem 10.15].
We have an analogue of Corollary 3.2.1.
Corollary 3.3.1
The function is differentiable, nonnegative, monotone increasing on and it holds that
[TABLE]
Proof. See [20, Theorem 1, Theorem 2 and Lemma 1].
With abuse of notation, we will call the order of approximation of the IgA method.
3.4 The monotone rearrangement of
From here on, if not differently stated, we will consider to be a real valued measurable function in .
It is always nice to deal with an univariate and monotone spectral symbol . Unfortunately, in general is multivariate or not monotone. Nevertheless, in such cases, it is possible to consider a rearrangement , where is the essential range of as in Definition 3.1.4, such that is univariate, monotone nondecreasing and
[TABLE]
i.e.,
[TABLE]
This can be achieved by defining
[TABLE]
where
[TABLE]
Clearly, is a.e. unique, univariate, monotone strictly increasing and right-continuous, which make it a good choice for an equispaced sampling. On the other hand, could not have an analytical expression or it could be not feasible to calculate, therefore it is often needed an approximation . Hereafter we summarize the steps presented in [24, Example 10.2] and [26, Section 3] in order to approximate the eigenvalues by means of an equispaced sampling of the rearranged symbol (or its approximated version ). For the sake of clarity and without loss of generality, we suppose that and continuous.
Algorithm I
Fix such that , and fix the equispaced grid over , where , for ; 2. 2)
Get the set of samplings and form a nondecreasing sequence ; 3. 3)
Define as the piecewise linear nondecreasing function which interpolates the samples over the nodes ; 4. 4)
Sample over the set and define
[TABLE] 5. 5)
Finally, approximate the eigenvalues of by , i.e.,
[TABLE]
Obviously, if is available then use it instead of and define
[TABLE]
As standard result in approximations of monotone rearrangements, it holds that as , see [12, 49]. See moreover [16, Definition 3.1 and Theorem 3.3] and [44], where the monotone rearrangement were first introduced in the context of spectral symbol. We have the following limit relation.
Theorem 3.4.1** (Discrete Weyl’s law)**
Let be the monotone rearrangement 3.9 of a spectral symbol of the matrix sequence . Let be piecewise Lipschitz continuous. Then
[TABLE]
In particular, let be such that as for a fixed and definitely. Then
[TABLE]
Proof. By our assumptions, such that , , and since is rectifiable then it induces a positive Borel measure on , which we call . If the subsets are disjoint, then can be extended on all over by defining for every . The same applies to , which can be extended to a positive measure defined on , which we keep calling , such that . It holds that
[TABLE]
Then equation (3.11) follows immediately from [38, Theorem 7.1] and the definition of asymptotic distribution function mod , [38, Definition 7.1], and recalling that is weakly clustered at by Theorem 3.1.1. Equation (3.12) follows instead from (3.11) and again by Theorem 3.1.1, taking and applying to both sides.
Corollary 3.4.1
In the same hypothesis of Theorem 3.4.1 and in presence of no outliers as in Definition 3.1.5, then the absolute error between a uniform sampling of and the eigenvalues of converges to zero, namely
[TABLE]
Proof. Let us suppose that there exists a sequence such that for every . Since is bounded then there exists a convergent subsequence, which we keep calling , such that . Therefore , which contradicts (3.12).
In some sense, can be intended as the inverse cumulative distribution function of the eigenvalue distribution of , and the limit relation (3.8) as the strong law for large numbers for specially chosen sequences of dependent complex-valued random variables. See [32] as a recent survey about equidistributions from a probabilistic point of view.
4 Application to the Euler-Cauchy differential operator
We are now in position to begin our analysis with respect to a toy-model example. The main tasks of this section are:
- •
to disprove that, in general, a uniform sampling of the spectral symbol can provide an accurate approximation of the eigenvalues of the weighted and un-weighted discrete operators and , respectively;
- •
to show numerical evidences of Theorem 5.1.1, i.e., that the spectral symbol measures how far a matrix discretization method is from a uniform approximation of the spectrum of the continuous operator , in the sense of the relative error.
- •
to show that a matrix discretization method, if paired with a suitable (non-uniform) grid can produce a uniform relative approximation of , as the order of approximation of the method increases.
Let us fix and let us consider the following SLP with Dirichlet BCs,
[TABLE]
that is (2.2) with , , and ,. It is an Euler-Cauchy differential equation and by means of the transformation (2.4), i.e., , Problem (4.1) is (spectrally) equivalent to
[TABLE]
which is the normal form of a Sturm-Liouville equation, with constant reaction term (or potential) . If we write
[TABLE]
for the self-adjoint operator in Equation (4.1) and
[TABLE]
for the self-adjoint operator in the form of Equation (4.2), then it is clear that
[TABLE]
For later reference, notice that
[TABLE]
namely, the diffusion coefficient produces a constant shift of to the eigenvalues of the unperturbed Laplacian operator with Dirichlet BCs, i.e., .
We introduce the following definition.
Definition 4.0.1** (Numerical and analytic relative error)**
Let be the discrete differential operator obtained from (4.3) by means of a generic numerical discretization method, and suppose that
[TABLE]
Fix , with and , and compute the following quantities
[TABLE]
where and is the (approximated) monotone rearrangement of the spectral symbol obtained by the procedure described in Algorithm I. We call the numerical relative error and the analytic relative error. We say that spectrally approximates the discrete differential operator if
[TABLE]
4.1 Approximation by -points central FD method on uniform grid
In our example, if we apply the standard central -point FD scheme as in (3.4) with and , then the weighted discretization matrix of Problem (4.1) has spectral symbol
[TABLE]
Working with this toy-model problem in the -points central FD scheme provides us a further advantage, since we can calculate the exact monotone rearrangement , or at least a finer approximation than which does not depend on the extra parameter and which is less computationally expensive. Indeed, from equation (3.10) we have that
[TABLE]
where
[TABLE]
and where
[TABLE]
Clearly, , and having an analytic expression for , it is then possible to compute a numerical approximation of its inverse over the uniform grid , for example by means of a Newton method. This approximation of does not depend on the extra parameter and with abuse of notation we will call it . Henceforth, we will work with both and , and when we will compute the analytical relative error with respect to , we will write without the subscript .
Finally, let us begin our analysis. In the above Figure 1 it is possible to check how an equispaced sampling of seems to distribute exactly as the eigenvalues of the unweighted discrete operator .
Moreover, according with equation (4.4), we observe that
[TABLE]
and so
[TABLE]
which means that the monotone rearrangement converges to the spectral symbol as , with
[TABLE]
that is the spectral symbol which characterizes the differential operator discretized by means of a 3-points FD scheme. In Figure 2 and Table 1 it is visually and numerically summarized this last observation. The eigenvalues of are the exact sampling of over the uniform grid , see [48, p. 154].
All these remarks would suggest that , or equivalently , spectrally approximates the weighted discrete operator .
Unfortunately, this conjecture looks to be partially proven wrong by Figure 3. There it is shown the comparison between the graphs of the numerical relative error and the analytic relative error , for several different increasing values of the parameter . We observe a discrepancy in the analytical prediction of the eigenvalue error , for small , with respect to the numerical relative error .
In particular, the maximum discrepancy is achieved at the first eigenvalue approximation , for every . The discrepancy apparently decreases as the number of grid points increases, as well observed in [26, Figure 48] for some test-problems in the setting of Galerkin discretization by linear B-spline. In that same paper, some plausible hypothesis and suggestions were advanced:
- •
the discrepancy could depend on the fact that it has been used instead of , and then that discrepancy should tend to zero in the limit , since .
- •
numerical instability of the analytic relative error for small eigenvalues,[26, Remark 3.1].
- •
Change the sampling grid into an “almost uniform”grid: see [26, Rermark 3.2] for details.
The problem is that these hypothesis, which stem from numerical observations, cannot be validated: the descent to zero of the observed discrepancy as increases is only apparent. Indeed, as we are going to show below, for every fixed it holds that
[TABLE]
with independent of and . Let us explain here the reason for this mismatch between the numerical relative error and the analytic relative error .
First of all, as we already observed in Subsection 3.4, for it holds that . Then we can work directly with , avoiding us to pass through its approximation . Moreover, for fixed and large enough, it holds that
[TABLE]
see for example [27, Lemma 7.1 and Lemma 7.2]. So, from here after we will consider large enough such that the above approximation holds. We can then rewrite as
[TABLE]
From (4.5), for , it holds that
[TABLE]
with a monotone increasing function with respect to and such that , for every fixed . In particular, for it holds that
[TABLE]
Therefore, for every sufficiently small, from (3.9) we have that
[TABLE]
and then, provided that , for every
[TABLE]
If now we let as , then for every fixed it holds that
[TABLE]
We then have a lower bound for the analytic relative error which can not be avoided by refining the grid points. Of course, as , then as increases. This is summarized below by Figure 4 and Table 2.
The problem lies on the wrong informal interpretation given to the limit relation in Definition 3.1.1, and suggested by Remark 1. Indeed, that limit relation tells us that
[TABLE]
or equivalently
[TABLE]
for every such that , see Theorem 3.4.1. Therefore, since , it follows that
[TABLE]
as observed for example in [24, Example 10.2 p. 198]. On the contrary, a uniform sampling of the symbol does not necessarily provide an accurate approximation of the eigenvalues of the weighted operator , in the sense of the relative error. The uniform sampling of the symbol works perfectly only on certain subclasses of symbol functions , but it fails in general. We loose convergence even for the absolute error as soon as we relax the hypothesis on , requiring it to be just Lebesgue integrable over , see Subsection 4.4.
As a last remark, in general there does not exist an “almost”uniform grid as well, nor in an asymptotic sense as described in [26, Rermark 3.2]. Knowing the exact sampling grid which guarantees to spectrally approximate the discrete differential operator is equivalent to know the eigenvalue distribution of the continuous differential operator .
What we can say instead is that every strongly attracts the spectrum of with infinite order, see Definition 3.1.3 and Theorem 3.1.1. In particular, in presence of no outliers, it holds that
[TABLE]
and so
[TABLE]
In Table 3 we can see that (4.10) is confirmed.
Therefore, any numerical scheme which is characterized by a spectral symbol of the form such that
[TABLE]
will not provide a relative uniform approximation of the eigenvalues of the continuous differential operator of Problem 4.1, namely
[TABLE]
see Corollary 5.1.3. This is the case of the method we implemented in this subsection, i.e., the 3-points uniform FD scheme, as it can be easily checked by Table 3 and Figure 5.
Actually, Theorem 5.1.1 says more: it says that if and in presence of no outliers, it holds that
[TABLE]
In Figure 5 and Table 4 it is validated numerically (4.13), i.e., the thesis of Theorem 5.1.1 set in this specific case.
4.2 Discretization by -points central FD method on non-uniform grid
Clearly, everything said in the preceding Subsection 4.1 remains valid even if we increase the order of accuracy of the FD method, namely, the spectral symbol of equation (3.4) does not spectrally approximate the discrete differential operator , in the sense of the relative error, for any . See Figure 6 in relation with Figure 3.
What is interesting instead is to change the sampling grid and to increase the order of accuracy of the FD discretization method. Indeed, as it was observed in the relations (4.11), (4.12) and (4.13), it is not possible to achieve a relative uniform approximation of the eigenvalues if . From (3.4), for every it is easy to check that , and so we do not have any improvement by just increasing the order of accuracy . But let us observe that:
- •
from Corollary 3.2.1 and equation (3.4),
[TABLE]
- •
is such that .
In some sense, the spectral symbol suggests us to change the uniform grid
[TABLE]
by means of the diffeomorphism induced by the Liouville transformation. Indeed, from (2.4) we have that
[TABLE]
and therefore we can construct a -diffeomorphism such that
[TABLE]
[TABLE]
The new non-uniform grid is then given by
[TABLE]
and it holds that
[TABLE]
and therefore
[TABLE]
Of course, this last equality is not enough to guarantee that
[TABLE]
since
[TABLE]
is only a necessary condition, see Theorem 5.1.1. Nevertheless, from figures 7, 8 and Table 5 we can see that (4.16) seems to be validated numerically. This would suggest that condition (4.15) becomes sufficient if paired by a suitable rearranged (non-uniform) grid and an increasing refinement of the method order. This phenomenon is not confined to this specific case but it occurs in several many different other cases we tested. More investigations will be carried on in future works.
Finally, in Table 6 we check numerically the validity of Theorem 5.1.1.
4.3 IgA discretization by B-slpine of degree and smoothness
In this subsection we continue our analysis in the IgA framework. We just collect all the numerical results of the tests, which confirm again what observed in subsections 4.1 and 4.2. The only difference relies on the fact that we took out the largest eigenvalues of the discrete operator . This is due to the fact that the IgA discretization suffers of a fixed number of outliers which depends on the degree and it is independent of , see [14, Chapter 5.1.2 p. 153]. So, we consider only the eigenvalues such that
[TABLE]
We stress out the fact that the number of outliers is fixed for every , in accordance with Theorem 3.1.1.
In Figure 9 we observe again the discrepancy between the analytic relative errors and the numerical relative error.
In Figure 10 and Figure 11 we compare the graphs of the eigenvalue distributions and the relative errors, respectively, between the discrete eigenvalues and the exact eigenvalues , for different values of on uniform and non-uniform grids. They line up with the numerics of Table 7: if the sampling grid is given by (4.14), the maximum relative error decreases as the order of approximation increases.
4.4 The case
We leave for a moment the case of regular SLPs. In [23] it was addressed the issue of extending the spectral symbol analysis to the case of coefficients. We show in the next example that the sampling of the spectral symbol does not provide accurate approximation of the eigenvalues of the weighted matrix discretization operator even in the sense of the absolute error.
Let us fix , in (2.1) with Dirichlet BCs, namely
[TABLE]
Then the spectral symbol given by a -points central FD scheme is
[TABLE]
see [24, Theorem 10.5] (the proof works fine even if is replaced by ). It is not difficult to prove that the monotone rearrangement is such that
[TABLE]
and that
[TABLE]
where the upper bound on the largest eigenvalue is proven by the Gershgorin theorems. The limit relation in Remark 1 still holds,
[TABLE]
but on the other hand,
[TABLE]
In Figure 12 and Table 9 it is possible to see a summary of these last considerations.
Remark 2
Let us observe that Corollary 3.4.1 is still valid on every compact subset . For example, let : then
[TABLE]
Indeed, is absolute continuous on every compact subset which does not contain .
5 Theoretical results
5.1 Proofs of results presented in Section 4
We summarize and generalize the results of Section 4.
Proposition 5.1.1
Let us consider the Sturm-Liouville eigenvalue problem
[TABLE]
such that
- (i)
; 2. (ii)
; 3. (iii)
, .
Discretize the above Problem (5.1) by means of a numerical matrix method, and let be the correspondent discrete operator, where is the mesh finesse parameter and is the order of approximation of the numerical method. Define . If:
- (a)
for every fixed ,
[TABLE] 2. (b)
there exists , such that
[TABLE] 3. (c)
for every , the monotone rearrangement , as defined in (3.9), is such that
[TABLE]
Then, for every fixed
[TABLE]
with independent of . The inequality is strict, i.e., for every such that
[TABLE]
where is the differential operator associated to the normal form (2.5) of Problem (5.1) by the Liouville transform (2.4), and is the (negative) Laplacian operator with Dirichlet BCs over the domain .
In particular,
[TABLE]
where is the analytical error defined in Definition 4.0.1.
Proof. By hypothesis, for every fixed
[TABLE]
where are the eigenvalues of the continuous differential operator, and
[TABLE]
where is the differential operator associated to the normal form (2.5) of Problem (5.1) through the Liouville transform. Let us observe that for and Dirichlet BCs, then
[TABLE]
Therefore, from item (c)
[TABLE]
Then it is immediate to prove that if
[TABLE]
then
[TABLE]
Moreover,
[TABLE]
and then as .
Corollary 5.1.2
If
[TABLE]
with nonnegative, nondecreasing and such that as , then item (c) of Proposition 5.1.1 is satisfied.
Proof. From (3.10) and (3.9), for all , with
[TABLE]
we have that
[TABLE]
By the monotonicity of , it holds that as . For every there exists such that for every then , and so
[TABLE]
with
[TABLE]
So we have that
[TABLE]
By definition (3.9), as and then it holds that
[TABLE]
and the thesis follows.
Remark 3
The matrix methods of subsections 3.2, 3.3 satisfy the hypothesis of Proposition 5.1.1, see theorems 3.2.1, 3.3.1 and corollaries 3.2.1, 3.3.1. Therefore, in general, a uniform sampling of their spectral symbols does not provide an accurate approximation of the eigenvalues and , in the sense of the relative error. See subsections 4.1,4.2 and 4.3 for numerical examples. On the other hand,
[TABLE]
if we exclude the outliers, see Corollary 3.4.1 and figures (1) and (12).
Theorem 5.1.1
Let us consider Problem 5.1 such that items (i)-(iv) of Proposition 5.1.1 are satisfied. Let be the discrete operator of Problem 5.1 obtained by means of any matrix method such that
- (a)
[TABLE] 2. (b)
[TABLE] 3. (c)
[TABLE]
with and real; 4. (d)
the monotone rearrangement , defined as in equation (3.9), is piecewise Lipschitz.
Then
[TABLE]
Moreover, if for large enough there are not outliers as in Definition 3.1.5, i.e., if for every
[TABLE]
then
[TABLE]
Proof. Since is bounded then is compact and are well-defined. Let .
Without loss of generality, let us suppose moreover that are distinct for every ,
[TABLE]
so we can uniquely define the permutation index function such that the new index is reordered according to the distance of from , in ascending order. Namely, such that
[TABLE]
where
[TABLE]
and
[TABLE]
For every , choose such that . By Theorem 3.1.1 we have that
[TABLE]
and by Theorem 3.4.1 it holds that
[TABLE]
Therefore,
[TABLE]
and then for every
[TABLE]
The thesis follows at once.
Corollary 5.1.3
In the same hypothesis of Theorem 5.1.1, if
[TABLE]
then the numerical method used for the discretization of Problem 5.1 can not provide a relative uniform approximation of the eigenvalues of the continuous operator . In particular, it is enough that
[TABLE]
Proof. Immediate from Theorem 5.1.1.
Corollary 5.1.4
In the same hypothesis of Theorem 5.1.1, for every diffeomorphism , the numerical methods in subsections 3.2, 3.3 verify condition (5.3), for any fixed order of approximation .
Proof. For every fixed , it is easy to check that both the methods satisfy the hypothesis of Theorem 5.1.1, in particular . By the regularity of the functions , it holds that is twice differentiable almost everywhere and , with as in (3.10). At the point , with
[TABLE]
there exists such that
[TABLE]
It can be proved by direct computation, using the same approach as in Corollary 5.1.2, we skip the details.
Therefore, even if for every , there exists a non-negligible compact set such that .
On the contrary, if the order of approximation is let free to increase, then the maximum of the relative error seems to decrease to zero, provided that the discretization is made on an appropriate non-uniform grid. See subsections 4.2 and 4.3.
5.2 Further generalizations
As we stated at the beginning of the Introduction, the results of this section can be generalized to different kind of differential operators in any dimension. In particular, Theorem 5.1.1 basically relies just on Theorem 3.4.1 and the Weyl’s law for Sturm-Liouville operators. Therefore, if we know the asymptotic distribution of the discrete spectrum of the operator , we can measure the lower bound of the maximum relative approximation error by means of the spectral symbol which characterizes the matrix method used for the discretization.
As a plain example, consider the following Dirichlet boundary value problem on the unit square,
[TABLE]
The eigenvalues are given by for . If we indicate with the inverse cumulative distribution function for the eigenvalue distribution of , even if there is not a closed formula as in the one dimensional case for all , clearly we have that .
On the other hand, discretizing problem (5.4) by means of -points FD as described in [25, Chapter 7.3], we get
[TABLE]
Even in the discrete case there is not a closed formula for , but nevertheless we have that
[TABLE]
6 Conclusions
Although in the present paper for simplicity all the examples and the theory were developed mostly among the setting of regular Sturm-Liouville problems, a generalization to a wider class of differential operators in dimension is feasible by means of the techniques presented in this paper.
Given a differential operator discretized by means of a numerical scheme, the sampling of the spectral symbol calculated by the theory of GLT sequences does not provide in general an accurate approximation of the eigenvalues . Nevertheless, by Theorem 5.1.1 the knowledge of the spectral symbol provides to a numerical discretization scheme a necessary condition for the uniform spectral approximation of , in the sense of the relative error. It can measure how far the discretization method is from a uniform approximation of all the modes of the differential operator and this can be useful for engineering applications, see for example [29]. Moreover, the condition seems to become sufficient if the discretization method is paired with a suitable (non-uniform) grid and an increasing refinement of the order of approximation of the method. In light of this, it becomes a priority to devise new specific discretization schemes with mesh-dependent order of approximation which guarantee a good balance between convergence to zero of the relative spectral error and computational costs.
Finally, in reference with Theorem 3.4.1, corollaries 3.2.1, 3.3.1, and [35, Remark 15], since the spectral symbol is deeply related to the Weyl’s asymptotic distribution of the eigenvalues of the differential operator, this connection can be exploited to give better estimates of the Weyl function of generic elliptic operators on manifolds with bounded geometry, through a smart discretization of the elliptic operator itself and the analysis of the associated spectral symbol generated by the discretization scheme.
Appendix A Proofs of Subsection 3.2
Theorem 3.2.1 Proof. The proof of item (i) is long and technical, and we avoid to present it here. Let us just mention that it can be proved by a straightforward generalization of standard techniques, see [11, Theorem 1] and [27, 15]. About item (ii), let us preliminarily observe that in case of and , then is a symmetric Toeplitz matrix defined by
[TABLE]
where are the coefficients defined in (3.5), see [31, Corollary 2.2] and [34, Equation (27)]. Therefore,
[TABLE]
Let us now define an approximation of , namely
[TABLE]
is symmetric and . Moreover, by [24, GLT 3-4 p. 160] and Proposition 3.1.1, it holds that
[TABLE]
By the regularity of and , it is not difficult to prove that
[TABLE]
such that
[TABLE]
Combining now (A.1) and (A.2), by [24, Property S 4 p. 156] we get that
[TABLE]
Finally, it is immediate to check that and again, by [24, properties GLT 3-4 p. 160] and [24, Property S 4 p. 156] we conclude that
[TABLE]
Corollary 3.2.1. Proof. is obviously . Let us begin to prove that as and that it is monotone nonnegative on . By the Taylor expansion at we get
[TABLE]
Moreover, let us observe that
[TABLE]
Define then
[TABLE]
It is immediate to check that and that
[TABLE]
By [5, Theorem 1] we can conclude that on and then on . Since , we deduce that on .
The second part of the thesis is an immediate consequence of identities (3.5). Indeed, for every fixed it holds that
[TABLE]
and
[TABLE]
Since , we conclude that
[TABLE]
Therefore, for every fixed ,
[TABLE]
being the Fourier coefficients of on , and the convergence is uniform.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. Aceto, P. Ghelardoni, and C. Magherini, ”Boundary Value Methods as an extension of Numerov’s method for Sturm–Liouville eigenvalue estimates . Appl. Numer. Math. 59(7) (2009): 1644–1656.
- 2[2] S. D. Algazin, Calculating the eigenvalues of ordinary differential equations . Comput. Math. Math. Phys. 35(4) (1995): 477–482.
- 3[3] P. Amodio, I. Sgura, High-order finite difference schemes for the solution of second-order BV Ps . J. Comput. Appl. Math. 176(1) (2005): 59–76.
- 4[4] P Amodio, G. Settani, A matrix method for the solution of Sturm-Liouville problems . JNAIAM 6(1-2) (2011): 1–13.
- 5[5] R. Askey, J. Steinig, Some positive trigonometric sums . Trans. Amer. Math. Soc. 187 (1974): 295–307.
- 6[6] Y. Bazilevs, L. Beirao da Veiga, J. A. Cottrell, T. J. Hughes, G. Sangalli, Isogeometric analysis: approximation, stability and error estimates for h-refined meshes . Math. Models Methods Appl. Sci. 16(07) (2006): 1031–1090.
- 7[7] D. Bianchi, S. Serra-Capizzano, Spectral analysis of finite-dimensional approximations of 1d waves in non-uniform grids . Calcolo 55(47) (2018).
- 8[8] J. M. Bogoya, A. Böttcher, S. M. Grudsky, E. A. Maximenko, Eigenvalues of Hermitian Toeplitz matrices with smooth simple-loop symbols . J. Math. Anal. Appl. 442(2): 1308–1334.
