Computing Spectral Measures and Spectral Types
Matthew John Colbrook

TL;DR
This paper introduces the first general algorithms for computing spectral measures and decompositions of infinite-dimensional normal operators, enabling advances in quantum mechanics, PDEs, and signal processing.
Contribution
It provides novel algorithms that compute spectral measures and decompositions for a broad class of operators, extending computational spectral theory to infinite dimensions.
Findings
Algorithms efficiently compute spectral measures and decompositions.
Methods generalize to partial differential operators and evolution PDEs.
Applications include quantum systems, quasicrystals, and classical theorems.
Abstract
Spectral measures arise in numerous applications such as quantum mechanics, signal processing, resonances, and fluid stability. Similarly, spectral decompositions (pure point, absolutely continuous and singular continuous) often characterise relevant physical properties such as long-time dynamics of quantum systems. Despite new results on computing spectra, there remains no general method able to compute spectral measures or spectral decompositions of infinite-dimensional normal operators. Previous efforts focus on specific examples where analytical formulae are available (or perturbations thereof) or on classes of operators with a lot of structure. Hence the general computational problem is predominantly open. We solve this problem by providing the first set of general algorithms that compute spectral measures and decompositions of a wide class of operators. Given a matrix…
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Computing Spectral Measures and Spectral Types
Matthew J. Colbrook Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK.
Email: [email protected]
Abstract
Spectral measures arise in numerous applications such as quantum mechanics, signal processing, resonance phenomena, and fluid stability analysis. Similarly, spectral decompositions (into pure point, absolutely continuous and singular continuous parts) often characterise relevant physical properties such as the long-time dynamics of quantum systems. Despite new results on computing spectra, there remains no general method able to compute spectral measures or spectral decompositions of infinite-dimensional normal operators. Previous efforts have focused on specific examples where analytical formulae are available (or perturbations thereof) or on classes of operators that carry a lot of structure. Hence the general computational problem is predominantly open. We solve this problem by providing the first set of general algorithms that compute spectral measures and decompositions of a wide class of operators. Given a matrix representation of a self-adjoint or unitary operator, such that each column decays at infinity at a known asymptotic rate, we show how to compute spectral measures and decompositions. We discuss how these methods allow the computation of objects such as the functional calculus, and how they generalise to a large class of partial differential operators, allowing, for example, solutions to evolution PDEs such as the linear Schrödinger equation on . Computational spectral problems in infinite dimensions have led to the Solvability Complexity Index (SCI) hierarchy, which classifies the difficulty of computational problems. We classify the computation of measures, measure decompositions, types of spectra, functional calculus, and Radon–Nikodym derivatives in the SCI hierarchy. The new algorithms are demonstrated to be efficient on examples taken from orthogonal polynomials on the real line and the unit circle (giving, for example, computational realisations of Favard’s theorem and Verblunsky’s theorem, respectively), and are applied to evolution equations on a two-dimensional quasicrystal.
Contents
1 Introduction
The analysis and computation of spectral properties of operators form core parts of many branches of science and mathematics, arising in diverse fields such as differential and integral equations, orthogonal polynomials, quantum mechanics, statistical mechanics, integrable systems and optics [110, 44, 138, 15, 43, 129, 69]. Correspondingly, the problem of numerically computing the spectrum, , of an operator acting on the canonical separable Hilbert space has attracted a large amount of interest over the last 60 years or so [5, 7, 8, 6, 22, 26, 24, 123, 46, 49, 79, 81, 94, 98, 99, 27, 21, 120, 80, 122, 124, 73, 116, 38, 40, 34]. However, the richness, beauty and difficulties that are encountered in infinite dimensions lie not just in the set , but also in the generalisation of projections onto eigenspaces and the possibility of different spectral types. Specifically, given a normal operator , there is an associated projection-valued measure (resolution of the identity), which we denote by , whose existence is guaranteed by the spectral theorem and whose support is [86, 87, 113]. This allows the representation of the operator as an integral over , analogous to the finite-dimensional case of diagonalisation:
[TABLE]
where denotes the domain of . For example, if is compact, then corresponds to projections onto eigenspaces, familiar from the finite-dimensional setting. However, in general, the situation is much richer and more complicated, with different types of spectra (pure point, absolutely continuous and singular continuous). An excellent and readable introduction can be found in Halmos’ article [77].
The computation of , along with its various decompositions and their supports, is of great interest, both theoretically and for practical applications. For example, spectral measures are intimately related to correlation functions in signal processing, resonance phenomena in scattering theory, and stability analysis for fluids. Moreover, the computation of allows one to compute many additional objects, which we provide the first general algorithms for in this paper, such as the functional calculus (Theorem 4.1), the Radon–Nikodym derivative of the absolutely continuous component of the measure (Theorem 4.2), and the spectral measures and spectral set decompositions (Theorem 3.2 and Theorem 5.1). For instance, in §1.2.1 we show how our results allow the computation of spectral measures and the functional calculus of almost arbitrary self-adjoint partial differential operators on . An important class of examples is given by solutions of evolution equations such as the Schrödinger equation on with a potential of locally bounded total variation. We prove that this is computationally possible even when an algorithm is only allowed to point sample the potential. A numerical example of fractional diffusion for a discrete quasicrystal is also given in §6.4.
Despite its importance, there has been no general method able to compute spectral measures of normal operators. Although there is a rich literature on the theory of spectral measures, most of the efforts to develop computational tools have focused on specific examples where analytical formulae are available (or perturbations thereof) or on classes of operators that carry a lot of structure. Indeed, apart from the work of Webb and Olver [151] (which deals with compact perturbations of tridiagonal Toeplitz operators) and methods for computing spectral density functions of Sturm–Liouville problems and other highly structured operators, there has been limited success in computing the measure .111See §1.7 for connections with previous work. In some sense, this is not surprising given the difficulty in rigorously computing spectra. One can consider computing spectral measures/projections as the infinite-dimensional analogue of computing projections onto eigenspaces.222Of course eigenvectors exist in the infinite-dimensional case, but not all of the spectrum consists of eigenvalues. The projection-valued measure generalises the notion of projections onto eigenspaces. Thus, from a numerical/computational point of view, the current state of affairs in infinite-dimensional spectral computations is highly deficient, analogous in finite dimensions to being able to compute the location of eigenvalues but not eigenvectors! It has been unknown if the general computation of spectral measures is possible, even for simple subclasses such as discrete Schrödinger operators. In other words, the computational problem of “diagonalisation” through computing spectral measures remains an important and predominantly open problem.
In this paper, we solve this problem by providing the first set of algorithms for the computation of spectral measures for a large class of self-adjoint and unitary operators, namely, those whose matrix columns decay at a known asymptotic rate. This is a very weak assumption and covers the majority of operators, even unbounded, found in applications. In particular, those whose representation is sparse (such as many of the graph or lattice operators typically dealt with in physics) and also partial differential operators, once a suitable basis has been selected (see Theorem 1.1 and Appendix B). We also show how to compute spectral measure decompositions, the functional calculus, the density of the absolutely continuous part of the measure (Radon–Nikodym derivative) and different types of spectra (pure point, absolutely continuous and singular continuous - these sets often characterise different physical properties in quantum mechanics [119, 2, 53, 127, 61, 41, 93, 42]). A central ingredient of these new algorithms is the computation of the resolvent operator with error control through appropriate rectangular truncations (Theorem 2.1). Furthermore, we demonstrate the applicability of our algorithms. The algorithms are efficient and parallelisable, allowing large scale computations.
1.1 The Solvability Complexity Index and classification of problems
A surprise thrown up by the infinite-dimensional spectral problem, which turns out to be quite generic, is the Solvability Complexity Index (SCI) [81]. The SCI provides a hierarchy for classifying the difficulty of computational problems. In classical numerical analysis, when computing spectra, one hopes to construct an algorithm, , with one limit such that for an operator ,
[TABLE]
preferably with some form of error control or rate of convergence. However, this is not always possible. For example, when considering the class of bounded operators, the best possible alternative is an algorithm depending on three indices such that
[TABLE]
Any algorithm with fewer than three limits will fail on some bounded operator, and neither error control nor convergence rates on any of the limits are possible since these would reduce the required number of limits. However, for self-adjoint operators, it is possible to reduce the number of limits to two, but not one [81, 12]. With more structure (such as sparsity or column decay) it is possible to compute the spectrum in one limit with a certain type of error control [40]. Hence, the only way to characterise the computational spectral problem is through a hierarchy, classifying the difficulty of computing spectral properties of different subclasses of operators. The SCI classifies difficulty by considering the minimum number of limits that one must take to calculate the quantity of interest (see Appendix A for a full definition). The SCI has roots in the work of Smale [132, 134], and his program on the foundations of computational mathematics and scientific computing, though it is quite distinct. The notions of Turing computability [145] and computability in the Blum–Shub–Smale (BSS) [17] sense become special cases, and impossibility results that are proven in the SCI hierarchy hold in all models of computation. The phenomenon of needing several limits also covers general numerical analysis problems, such as Smale’s question on the existence of purely iterative algorithms for polynomial root finding [133]. As demonstrated by McMullen [101, 102] and Doyle and McMullen [51], this is a case where several limits are needed in the computation, and their results become special cases of classification in the SCI hierarchy [12]. Extensions of the hierarchy to error control [37, 36, 33] also have potential applications in the growing field of computer-assisted proofs, where one must perform a computation with absolute certainty. See, for example, the work of Fefferman and Seco on the Dirac–Schwinger conjecture [55, 56] and Hales on Kepler’s conjecture (Hilbert’s 18th problem) [75], both of which implicitly provide classifications in the SCI hierarchy. As well as spectral problems [40, 38, 36, 37, 39, 33, 81, 12], the SCI hierarchy has recently been used to solve problems related to computing resonances [13, 14], computing solutions of semigroups and evolution PDEs [35, 10], and computational barriers for stable and accurate neural networks [4].
An informal definition of the SCI hierarchy is as follows, with a detailed summary contained in Appendix A. The SCI hierarchy is based on the concept of a computational problem. This is described by a function
[TABLE]
that we want to compute, where is some domain, and is a metric space. For example, we could take (the spectrum) for some class of operators and the collection of non-empty closed subsets of equipped with the Attouch–Wets metric. The SCI of a computational problem is the smallest number of limits needed in order to compute the solution. For a given set of evaluation functions (the information our algorithm is allowed to read - in our case, or defined in (1.18)), class of objects (in our case, subclasses of operators acting on ) and model of computation (in this paper general, , or arithmetic, ) we define:
- (i)
is the set of problems that can be computed in finite time, the SCI .
- (ii)
is the set of problems that can be computed using one limit (the SCI ) with control of the error, i.e. a sequence of algorithms such that .
- (iii)
is the set of problems that can be computed using one limit (the SCI ) without error control, i.e. a sequence of algorithms such that .
- (iv)
, for , is the set of problems that can be computed by using limits, (the SCI ), i.e. a family of algorithms such that
[TABLE]
The class is, of course, a highly desired class; however, non-trivial spectral problems are higher up in the hierarchy. For example, the following classifications are known [81, 12]:
- (i)
The general spectral problem is in .
- (ii)
The self-adjoint spectral problem is in .
- (iii)
The compact spectral problem is in .
Here, the notation indicates the standard “setminus”. Hence, the computational spectral problem becomes an infinite classification theory to characterise the above hierarchy. In order to do so, there will, necessarily, have to be many different types of algorithms. Characterising the hierarchy will yield a myriad of different approaches, as different structures on the various classes of operators will require specific algorithms.
This paper provides classifications of spectral problems associated with (such as decompositions of the measure and spectrum) in the SCI hierarchy, some of which can be computed in one limit. We provide algorithms for these problems, and one of the main tools used is the computation of the resolvent operator with error control (Theorem 2.1). This is possible through appropriate rectangular truncations of the infinite-dimensional operator. This approach differs from finite-dimensional techniques, which typically consider square truncations.
Remark 1** (Recursivity and independence of the model of computation).**
The constructive inclusion results we provide hold for arithmetic algorithms and the impossibility results hold for general algorithms. We refer the reader to Appendix A for a detailed explanation. Put simply, this means that the algorithms constructed can be recursively implemented with inexact input and restrictions to arithmetic operations over the rationals (it is also straightforward to implement them using interval arithmetic), whereas the impossibility results hold in any model of computation (such as the Turing or BSS models).
1.2 Summary of the main results
1.2.1 Partial differential operators
For , consider the operator formally defined on by
[TABLE]
where throughout we use multi-index notation with and . We will assume that the coefficients are complex-valued measurable functions on and that is self-adjoint. For dimension and consider the space
[TABLE]
where denotes the set of measurable functions on the hypercube and denotes the total variation norm in the sense of Hardy and Krause [103]. This space becomes a Banach algebra when equipped with the norm [18]
[TABLE]
Let consist of all such such that the following assumptions hold:
- (1)
The set of smooth, compactly supported functions forms a core of . 2. (2)
For each of the functions , there exists a positive constant and an integer (both possibly unknown) such that
[TABLE]
almost everywhere on , that is, we have at most polynomial growth of the coefficients. 3. (3)
The restrictions for all .
We consider the case where our algorithms can do the following:
Evaluate any coefficient to a given precision at , where denotes the field of rationals, and output an approximation in . 2. 2.
For each , evaluate a positive number such that the sequence satisfies
[TABLE]
In Appendix B, we prove (and state a more precise version of) the following theorem.
Theorem 1.1** (Spectral properties of self-adjoint partial differential operators can be computed).**
Given the above set-up, there exist sequences of arithmetic algorithms that compute spectral measures, the functional calculus, and Radon–Nikodym derivatives of the absolutely continuous part of the measure over the class . In other words, these objects can be computed in one limit with .
Remark 2**.**
As noted in Appendix B, we can extend this result to computing the decompositions into pure point, absolutely continuous and singular continuous parts of measures and spectra (with ).
The above properties characterising are deliberately very weak, and hence the class is very large. For example, Schrödinger operators with polynomially bounded potentials of locally bounded total variation are a subclass of . Hence, in this case, the theorem says that we can compute the spectral properties (measures, functional calculus etc.) of by point sampling the potential , if we have an asymptotic bound on the total variation of over finite rectangles. In particular, we can solve the Schrödinger equation
[TABLE]
by computing with guaranteed convergence. Applications of some of our results to semigroups (where error control can also be provided) are given in [35]. The proof of Theorem 1.1 can also be extended to other domains such as the half-line, and can be adapted to cope with other types of coefficients that are not of locally bounded total variation (for instance, Coulombic potentials for Dirac or Schrödinger operators). In order to prove Theorem 1.1, we prove theorems for operators on .
1.2.2 Operators on
We consider self-adjoint operators given as an infinite matrix whose columns decay at a known asymptotic rate:
[TABLE]
for a sequence and function , where denotes the orthogonal projection onto the linear span of the first canonical basis vectors. This set-up is adapted in Appendix B to prove Theorem 1.1, where we make use of the following theorems proven for operators on .
We consider the problem of computing spectral measures. Specifically, for operators of the form (1.7) we develop the first algorithms and SCI classifications for:
- •
Theorem 3.1: classification for the projection-valued spectral measure and, through taking inner products, the computation of the scalar spectral measures defined via
[TABLE]
This is done for open sets and can be extended to other types of sets such as closed intervals or singletons (Theorem 5.2 shows that the problem in certain cases). These scalar-valued spectral measures play an important role in, for example, quantum mechanics, where they correspond to the distribution of the physical observable modelled by a Hamiltonian .
- •
Theorem 3.2: classification for the decompositions of the projection-valued and scalar-valued spectral measures into absolutely continuous, singular continuous and pure point parts. These decompositions often characterise different physical properties in quantum mechanics [119, 2, 53, 127, 61, 41, 93, 42]
- •
Theorem 4.1: classification for the functional calculus of operators, i.e. the computation of for suitable functions . For brevity, we consider functions that are bounded and continuous on the spectrum of . However, the proof makes clear that wider classes can be dealt with. In some cases, error control is possible, for instance, when considering the holomorphic functional calculus (see §6.4). A key application of this result is the computation of solutions of many evolution PDEs, such as the Schrödinger equation through the function .
- •
Theorem 4.2: classification for the Radon–Nikodym derivatives (densities) of the absolutely continuous parts of the scalar spectral measures with convergence in the sense on an open set. This requires a certain separation condition, without which our algorithm converges (Lebesgue) almost everywhere.
We also consider the computation of spectra as sets in the complex plane. Convergence is measured using the Hausdorff metric in the bounded case and using the Attouch–Wets metric in the unbounded case (i.e. uniform convergence on compact subsets of ). Specifically, we provide the first algorithms computing these quantities and prove in Theorem 5.1 that:
- •
The absolutely continuous spectrum can be computed in two limits but not one limit ( classification).
- •
The pure point spectrum can be computed in two limits but not one limit ( classification).
- •
The singular continuous spectrum can be computed in three limits ( classification). If , then the computation cannot be done in two limits ( classification). That is, if the local asymptotic bandwidth is allowed to grow sufficiently rapidly, three limits are needed, and this computational problem is exceedingly difficult. We do not know whether this growth condition on can be dropped. However, without it, the problem still requires at least two limits ( classification).
The main tool used to prove the above results is
- •
Theorem 2.1 and Corollary 2.2: The action of the resolvent can be computed with error control. This also opens up potential applications in computer-assisted proofs.
We demonstrate that the “one-limit” algorithms constructed in this paper are implementable and efficient. These provide the first set of algorithms addressing these problems, and we have provided extensive numerical experiments in §6. This includes orthogonal polynomials on the real line and unit circle (where we also discuss acceleration through extrapolation), as well as fractional diffusion for a two-dimensional quasicrystal. Since writing the initial version of this paper, our algorithms have also been implemented in the software package SpecSolve of [39], which uses the machinery of high-order rational kernels to accelerate computation of the Radon–Nikodym derivative of regular enough measures. In the current paper, we also show that in the case where the measure is regular enough, a global collocation method and local Richardson extrapolation for the computation of the Radon–Nikodym derivative can both accelerate convergence.
Finally, some brief remarks are in order.
- (i)
The impossibility results hold in general, even when restricted to tridiagonal operators. Furthermore, many of the impossibility results hold for structured operators such as bounded discrete Schrödinger operators. Our results (constructive algorithms and impossibility results) also carry over to a large class of normal operators, including unitary operators or skew-adjoint operators, both of which are important in applications. For the sake of clarity, we have stuck to the self-adjoint case in the statement of theorems and proofs. Numerical examples for unitary operators are given in §6.3.
- (ii)
The difficulty encountered when computing the singular continuous spectrum is partly due to the negative definition of the singular continuous part of a measure. It is the “leftover” part of the measure, the part that is not continuous with respect to Lebesgue measure and does not contain atoms. The challenge of studying analytically also reflects this difficulty - singular continuous spectra were once thought to be rather rare or exotic. However, they are quite generic; see, for example, [128] for a precise topological statement to this effect.
- (iii)
One might at first expect computational results to be independent of the function due to tridiagonalisation. However, the infinite-dimensional case is much more subtle than the finite-dimensional case. Using Householder transformations on a bounded sparse self-adjoint operator leads to a tridiagonal operator, but, in general, this operator is restricted to a strict subspace of . Part of the operator may be lost in the strong operator limit. Instead, one must consider a sum of possibly infinitely many tridiagonal operators (see [78, Ch. 2 & 8]). Hence some spectral problems may have different classifications for different .
1.3 Open problems
This results of this paper form part of a program [40, 38, 34, 36, 37, 39, 33] on determining the foundations of computation (boundaries of what is possible) for infinite-dimensional spectral problems. As such, there remain many interesting open problems related to this paper, such as:
- •
Computation of spectral measures for more general normal operators: Proposition 2.4 demonstrates how the techniques of this paper can be generalised to certain classes of normal operators whose spectrum does not necessarily lie along a curve. However, it is not obvious how to extend the techniques to completely general normal operators. For example, the method of integrating the resolvent along a contour cannot be easily extended to interior points of the spectrum.
- •
Brown measure for non-normal operators: There is an extension of spectral measures to certain non-normal operators known as the Brown measure [25, 71, 72]. Computing spectra of non-normal operators is generally harder (in a sense made precise by the SCI hierarchy) than for normal operators (issues such as numerical stability are also present even in the finite-dimensional case). It would be interesting to see if this phenomenon is also present for computing the Brown measure. Some works on approximating the Brown measure from matrix elements include [81, 7, 11].
1.4 A motivating example
As a motivating example, consider the case of a Jacobi operator with matrix
[TABLE]
where and . An enormous amount of work exists on the study of these operators, and the correspondence between bounded Jacobi matrices and probability measures with compact support [143, 45]. The entries in the matrix provide the coefficients in the recurrence relation for the associated orthonormal polynomials. To study the canonical measure , one usually considers the principal resolvent function, which is defined on via
[TABLE]
and then takes close to the real axis. The function is also known in the differential equations and Schrödinger communities as the Weyl -function [143, 64] and one can develop the discrete analogue of what is known as Weyl–Titchmarsh–Kodaira theory for Sturm–Liouville operators. Going back to the work of Stieltjes [136] (see also [1, 149]), there is a representation of as a continued fraction:
[TABLE]
One can also approximate via finite truncated matrices [143].
However, there are two major obstacles to overcome when using (1.9) and its variants as a means to compute measures. First of all, this representation of the principal resolvent function is structurally dependent. For example, (1.9) is valid for the restricted case of Jacobi operators and hence one is led to seeking different methods for different operators (such as tight-binding Hamiltonians on two-dimensional lattices which have a growing bandwidth when represented as operators on ). Second, this would seem to give the wrong classification of the difficulty of the problem in the SCI hierarchy, giving rise to a tower of algorithms with two limits. One first takes a truncation parameter to infinity to compute for , and then a second limit as approaches the real axis. One of the main messages of this paper is that both of these issues can be overcome. Measures can be computed in one limit via an algorithm and for a large class of operators. The only restriction is a known asymptotic decay rate of the off-diagonal entries. As a by-product, we compute the -function of such operators with error control. Specific cases where this can be written explicitly do exist, such as periodic Jacobi matrices or perturbations of Toeplitz operators [52] (see also §1.7). However, there has been no general method proposed to compute the resolvent with error control. This consideration is crucial to allow the computation of measures in one limit.
To see how we might compute the measure using the resolvent, consider the Poisson kernels for the half-plane and the unit disk, defined respectively by
[TABLE]
where denote the usual polar coordinates. Let be a normal operator, then for , we have from the functional calculus that
[TABLE]
For self-adjoint , () and , we define
[TABLE]
Similarly, if is unitary, (with ) and , we define
[TABLE]
We change variables and, with an abuse of notation, write . A simple calculation then gives
[TABLE]
Returning to our example, we see that the computation of the resolvent with error control allows the computation of with error control through taking inner products. By considering , this allows the computation of the convolution of the measure with the Poisson kernel . In other words, we can compute a smoothed version of the measure with error control. We can then take the smoothing parameter to zero to recover the measure (one can show that these smoothed approximations converge weakly in the sense of measures). Figure 1 demonstrates this for a typical example.
1.5 Functional analytic setup
We consider the canonical333By a choice of basis our results extend to any separable Hilbert space. separable Hilbert space , the set of square summable sequences with canonical basis . Let be the set of closed densely defined linear operators such that forms a core of and . The spectrum of will be denoted by and the point spectrum (the set of eigenvalues) by . The latter set is not always closed and in general the closure of a set will be denoted by . The resolvent operator defined on will be denoted by .
This paper focusses on the subclass of normal operators, that is, operators for which and for all . The subclasses of self-adjoint and unitary operators will be denoted by and respectively. For and , and respectively, where denotes the unit circle. Given and a Borel set , will denote the projection . Given , we can define a bounded (complex-valued) measure via the formula
[TABLE]
Via the Lebesgue decomposition theorem [76], the spectral measure can be decomposed into three parts
[TABLE]
the absolutely continuous part of the measure (with respect to the Lebesgue measure), the singular continuous part (singular with respect to the Lebesgue measure and atomless) and the pure point part. When considering , we will consider Lebesgue measure on and let
[TABLE]
the Radon–Nikodym derivative of with respect to Lebesgue measure. Of course this can be extended to the unitary (and, more generally, normal) case. This naturally gives a decomposition of the Hilbert space . For and , we let consist of vectors whose measure is absolutely continuous, singular continuous and pure point respectively. This gives rise to the orthogonal (invariant subspace) decomposition
[TABLE]
whose associated projections will be denoted by , and respectively. These projections commute with and the projections obtained through the projection-valued measure. Of particular interest is the spectrum of restricted to each , which will be denoted by . These different sets and subspaces often, but not always, characterise different physical properties in quantum mechanics (such as the famous RAGE theorem [119, 2, 53]), where a system is modelled by some Hamiltonian [42, 41, 61, 93]. For example, pure point spectrum implies the absence of ballistic motion for many Schrödinger operators [127].
1.6 Algorithmic setup
Given an operator , we can view it as an infinite matrix
[TABLE]
through the inner products444Our convention throughout will be that the inner product is linear in the first component and conjugate-linear in the second. . All of the algorithms constructed can also be adapted to operators on , either through the use of a suitable re-ordering of the basis, or though considering truncations of matrices in two directions, which is useful numerically since it preserves bandwidth. To be precise about the information needed to compute spectral properties, we define two classes of evaluation functions as
[TABLE]
These can be understood as different sets of information our algorithms are allowed to access (see Appendix A for a precise meaning). All the results proven in this paper can be easily extended to the case of inexact input. This means replacing the evaluation functions by
[TABLE]
such that and . Hence, the existence results carry over to algorithms that are only allowed to perform arithmetic operations over . This could be useful for rigorous bounds using interval arithmetic and computer-assisted proofs (for those familiar with the term, our algorithms are Turing recursive), though for brevity, we stick to and throughout. For discrete operators, the above information is often given to us, for example, in tight-binding models in physics or as a discretisation of a PDE, and hence it is natural to seek to compute spectral properties from matrix values. The set is motivated via variational problems. For partial differential operators, such information is often given through inner products with a suitable basis, and in this case, the inexact input model is needed due to approximating the integrals (see Appendix B). For the classes considered in this paper, the evaluation sets and are in general different, yet the classifications in the SCI remain the same.
We will be concerned operators whose matrix representation has a known asymptotic rate of column/off-diagonal decay. Namely, let with and let be null sequences555We use the term “null sequence” for a sequence converging to zero. of non-negative real numbers. We then define for or ,
[TABLE]
where denotes the orthogonal projection onto . In using the notation, the hidden constant is allowed to depend on the operator or the vector . We will also use
[TABLE]
When discussing and we will use the notation and . The collection of vectors in satisfying will be denoted by . Finally, when , we will abuse notation slightly in requiring the stronger condition that
[TABLE]
Thus is the class of self-adjoint operators whose matrix sparsity structure is captured by the function . For example, if , we recover the class of self-adjoint tridiagonal matrices, the most studied class of infinite-dimensional operators. When discussing classes that include vectors , we extend to include pointwise evaluations of the coefficients of . Other additions are sometimes needed, such as data regarding open sets as inputs for computations of measures, but this will always be made clear. When considering the general case of , the function and sequence can also be considered as inputs to the algorithm - in other words, the same algorithm works for each class.
1.7 Connections with previous work
We have mentioned the literature on infinite-dimensional spectral problems and the SCI hierarchy. Computationally, our point of view in this paper is closest to the work of Olver, Townsend and Webb on practical infinite-dimensional linear algebra [106, 105, 104, 107, 151]. Their work includes efficient codes, such as the infinite-dimensional QL (IQL) algorithm [150] (see also [38] for the IQR algorithm, which has its roots in the work of Deift, Li and Tomei [46]), as well as theoretical results. A PDE version of the FEAST algorithm based on contour integration of the resolvent has recently been proposed by Horning and Townsend in [84], which computes discrete spectra. The set of algorithms we provide can be considered as a new member within the growing family of infinite-dimensional techniques.
A similar, though different, object studied in the mathematical physics literature, particularly when considering random Schrödinger operators, is the density of states [89, 29, 91], which we mention for completeness and also to avoid potential confusion. This object is defined via the “thermodynamic limit”, where instead of considering the infinite-dimensional operator , one considers finite truncations, say , and the limit of the measure . This measure is subtly different from the spectral measure of (for instance, on the discrete spectrum). The density of states is an important quantity in quantum mechanics, and there is a large literature on its computation. We refer the reader to the excellent review article [95], which discusses the most common methods. The idea of using the resolvent to approximate the density of states of finite matrices can be found in the method of [82], which approximates the imaginary part of for . Similarly, in the random matrix literature, the connection is made through the Stieltjes transformation (see, for example, [9]). There are three immediate differences between our algorithms and those that compute the density of states. First, we seek to deal with the full, infinite-dimensional, operator directly to compute the spectral measure (and not the limit of increasing system sizes). Second, the object we are computing contains more refined spectral information of the operator and does not involve an averaging procedure. The density of states does not capture the full spectral information, such as the contribution of eigenvalues in the discrete spectrum, whereas the projection-valued spectral measure does. Third, there is a subtlety regarding the limits as goes to zero and the truncation parameter goes to infinity (a similar trade-off also occurs in random matrix literature when theoretically analysing the density of states - see [54]). In our case, appropriate rectangular truncations of the infinite-dimensional operator are required to compute the resolvent with error control (see Theorem 2.1). This approach differs from finite-dimensional techniques, which typically consider square truncations.
For the -algebra viewpoint of the density of states, we refer the reader to the work of Areveson [7] and the references therein. Estimating the spectrum of via is known as the finite section method. This has often been viewed in connection with Toeplitz theory. See, for example, the work by Böttcher [20, 19], Böttcher and Silberman [23], Böttcher, Brunner, Iserles and Nørsett [21], Brunner, Iserles and Nørsett [27], Hagen, Roch and Silbermann [73], Lindner [96], Marletta [98], Marletta and Scheichl [99], and Seidel [121].
The study of spectral measures also has a rich history in the theory of orthogonal polynomials and quadrature rules for numerical integration going back to the work of Szegő [139, 50], briefly touched upon in §1.4. In certain cases, one can recover a distribution function for the associated measure of the Jacobi operator as a limit of functions constructed using Gaussian quadrature [31, Ch. 2]. Our examples in §6.1 can be considered as a computational realisation of Favard’s theorem.
There are several results in the literature considering the computation of spectral density functions for Sturm–Liouville problems. In the case of Sturm–Liouville problems, the spectral density function corresponds to the multiplicative version of the spectral theorem. This is subtly different from the measures we compute, which arise from the projection-valued measure version of the spectral theorem. A common approach to approximate spectral density functions associated with Sturm–Liouville operators on unbounded domains is to truncate the domain and use the Levitan–Levinson formula, as implemented in the software package SLEDGE [111, 60, 59]. This approach can be computationally expensive since the eigenvalues cluster as the domain size increases; often, hundreds of thousands of eigenvalues and eigenvectors need to be computed. More sophisticated methods avoiding domain truncation are considered for special cases in [57, 58], and an application in plasma physics can be found in [152]. These make use of the additional structure present in Sturm–Liouville problems using results analogous to (1.9) in the continuous case. Our results, particularly Theorem 1.1, hold for partial differential operators much more complicated than Sturm–Liouville operators (see Appendix B).
Finally, we wish to highlight the work of Webb and Olver [151], which is of particular relevance to the present study. There the authors studied, through connection coefficients, Jacobi operators that arise as compact perturbations of Toeplitz operators. Similar perturbations (where a stronger exponential decay of the perturbation is crucial for analyticity properties of the resolvent) were studied in the work of Bilman and Trogdon [16] in connection with the inverse scattering transform for the Toda lattice. (See also the work of Trogdon, Olver and Deconinck [144] for computations of spectral measures for inverse scattering for the KdV equation.) The results proven in [151] can be stated in terms of the SCI hierarchy:
- •
If the perturbation is finite rank (and known), the computation of lies in , and the computation of the lies in (note that is known analytically).
- •
If the perturbation is compact with a known rate of decay at infinity, then the computation of the full spectrum lies in .
The current paper complements the work of [151] by; considering operators much more general than tridiagonal compact perturbations of Toeplitz operators (we deal with arbitrary self-adjoint operators and assume we know such that (1.20) holds) and partial differential operators, allowing operators to be unbounded, building algorithms that are arithmetic and can cope with inexact input, and considering computation of a wider range of spectral information. At the price of this greater generality, the objects we study are generally not computable with error control (unless one has local regularity assumptions on the measure - see [33, Ch. 4]), and some lead to computational problems higher up in the SCI hierarchy, though still computationally useful as we shall demonstrate. Our methods are also entirely different and rely on estimating the resolvent operator with error control (Theorem 2.1).
1.8 Organisation of the paper
The paper is organised as follows. In §2 we consider the computation of the resolvent with error control and generalisations of Stone’s formula. The computation of measures, their various decompositions and projections are discussed in §3. We then discuss the functional calculus and density of measures in §4. The computation of the different types of spectra as sets in the complex plane is discussed in §5. We run extensive numerical tests in §6, where we also introduce a new collocation method for the computation of the Radon–Nikodym derivative. We find that increased rates of convergence can also be obtained through iterations of Richardson extrapolation. A summary of the SCI hierarchy can be found in Appendix A and a proof of Theorem 1.1 in Appendix B. Throughout, our theorems and proofs use the notation introduced in §1.5 and §1.6.
2 Preliminary Results
The algorithms built in this paper rely on the computation of the action of the resolvent operator for with (asymptotic) error control. Given this, one can compute the action of the projections for a wide range of sets (Theorem 3.1 and its generalisations), and hence the measures . This section discusses the computation of the resolvent with error control and generalisations of Stone’s formula, which relate the resolvent to the projection-valued measures.
2.1 Approximating the resolvent operator
The key theorem for computing the action of the resolvent operator is the following, where we use to denote the injection modulus of an operator defined as
[TABLE]
The proof of the following theorem boils down to a careful computation of a least-squares solution of a rectangular linear system.
Theorem 2.1**.**
Let and be null sequences, and with . Define
[TABLE]
and for (defined in (1.19)), let , be such that
, 2. 2.
,
where, for notational convenience, we drop the dependence in the notation for and . Then there exists a sequence of arithmetical algorithms
[TABLE]
each of which use the evaluation functions in (defined in (1.18)), such that each vector has finite support with respect to the canonical basis for each , and
[TABLE]
Moreover, the following error bound holds
[TABLE]
If a bound on and are known, this error bound can be computed to arbitrary accuracy using finitely many arithmetic operations and comparisons.
Proof.
Let . We have that for large since and (recall that ). Hence we can define
[TABLE]
Suppose that is large enough so that . Then is a least-squares solution of the optimisation problem . The linear space forms a core of and hence also of . It follows by invertibility of that given any , there exists an and a with such that
[TABLE]
It follows that for all ,
[TABLE]
This implies that
[TABLE]
In particular, since and are null, this implies that is uniformly bounded in . Since was arbitrary, we also see that converges to .
Define the matrices
[TABLE]
Given the evaluation functions in , we can compute the entries of these matrices to any given accuracy and hence also to arbitrary accuracy in the operator norm using finitely many arithmetic operations and comparisons (using the error in the Frobenius norm to bound the error in the operator norm). Denote approximations of and by and respectively and assume that
[TABLE]
for null sequences . Note that can be computed using finitely many arithmetic operations and comparisons. So long as is small enough, the resolvent identity implies that
[TABLE]
By taking and smaller if necessary (so that the algorithm is adaptive and it is straightforward to bound the norm of a finite matrix from above), we can ensure that and . From Proposition A.7 and a simple search routine, we can also compute to arbitrary accuracy using finitely many arithmetic operations and comparisons. Suppose this is done to an accuracy and denote the approximation via . We then define
[TABLE]
where . It follows that can be computed using finitely many arithmetic operations and, for large ,
[TABLE]
so that converges to . By construction, has finite support with respect to the canonical basis.
Furthermore, the following error bound holds (which also holds if )
[TABLE]
since is normal so that . This bound converges to [math] as . If the and are known it can be approximated to arbitrary accuracy using finitely many arithmetic operations and comparisons. ∎
Remark 3**.**
If corresponds to a choice of basis in a space of functions (for example when using a spectral method), there is often a link between the regularity of the functions and the decay of the terms . The bound (2.1) can then often be adapted to include such asymptotics, and hence indicate how large needs to be to gain a given approximation.
Of course, a vast literature exists on computing , especially for infinite matrices with structure (such as being banded) and we refer the reader to [96, 112, 121, 70] for a small sample. Note that if is banded with bandwidth , then we can take and the above computation can be done in operations [66]. The following corollary of Theorem 2.1 will be used repeatedly in the following proofs.
Corollary 2.2**.**
There exists a sequence of arithmetic algorithms
[TABLE]
with the following properties:
For all and , has finite support with respect to the canonical basis and converges to in as . 2. 2.
For any , there exists a constant such that for all ,
[TABLE]
Proof.
Let , where are the algorithms from the statement of Theorem 2.1 and is a subsequence diverging to infinity as . Clearly statement (1) holds so we must show how to choose the sequence such that (2) holds (and hence our algorithms will be adaptive). From (2.1), it is enough to show that can be chosen such that
[TABLE]
The left-hand side can be approximated to arbitrary accuracy using finitely many arithmetic operations and comparisons. Hence by repeatedly computing approximations to within , we can choose the minimal such that these approximate bounds are at most . ∎
2.2 Stone’s formula and Poisson kernels
Here we briefly discuss Stone’s famous formula [137, 32, 113], which relates the convolution of spectral measures with Poisson kernels to the pointwise action of the projection-valued measures associated with an operator as (see §1.4). Stone’s formula can also be generalised to unitary operators and a much larger class of normal operators (see Proposition 2.4). We include a short (and standard) proof of Proposition 2.3 for the benefit of the reader.
Proposition 2.3** (Stone’s formula).**
The following boundary limits hold:
- (i)
Let . Then for any and ,
[TABLE]
- (ii)
Let . Then for any and ,
[TABLE]
where denotes the image of under the map .
Proof.
To prove (i), we can apply Fubini’s theorem to interchange the order of integration and arrive at
[TABLE]
But
[TABLE]
is bounded and converges pointwise as to , where denotes the indicator function of a set . Part (i) now follows from the dominated convergence theorem.
To prove (ii), we apply Fubini’s theorem again, now noting that
[TABLE]
We can split the interval into small intervals of width (where ) around each point where , and a finite union of intervals on which is positive, bounded away from [math]. On these later intervals, the limit vanishes as . Hence by periodicity and considering odd and even parts, we are left with considering
[TABLE]
Explicit integration yields and hence the contribution vanishes in the limit. We also have
[TABLE]
This converges to as . Considering the contributions of and in (2.2), we see that (2.2) converges pointwise as to
[TABLE]
Since the integral is also bounded, part (ii) now follows from the dominated convergence theorem and change of variables. ∎
This type of construction can be generalised to whose spectrum lies on a regular enough curve. However, it is much more straightforward in the general case to use the analytic properties of the resolvent. The next proposition does this and also holds for operators whose spectrum does not necessarily lie along a curve.
Proposition 2.4** (Generalised Stone’s formula).**
Let and be a rectifiable positively oriented Jordan curve with the following properties. The spectrum intersects at finitely many points and in a neighbourhood of each of the , is formed of a line segment meeting only at , at which point has a local exterior cone condition with respect to (see Figure 2). Let . Then we can define the Cauchy principal value integral of the resolvent along and have
[TABLE]
where is the closure of the intersection of with the interior of .
Proof.
We will argue for the case , and the general case follows in exactly the same manner. Let be small so that in a neighbourhood of the ball around , is given by a straight line. We then decompose into two disjoint parts
[TABLE]
where denotes the line segment of at most away from (as shown in Figure 2). We set
[TABLE]
We then consider the inner integral
[TABLE]
If is inside then via Cauchy’s residue theorem. Similarly, if is outside then . To calculate , consider the contour integral along in Figure 2. We see that
[TABLE]
and hence . We would like to apply the dominated convergence theorem. Clearly, away from , is bounded as . Now let then
[TABLE]
for some . Taking the pointwise limit , we see that is bounded for in a neighbourhood of as if the same holds for
[TABLE]
By rotating and translating, we can assume that and without loss of generality. Let and . Using the cone condition gives for some . Assume then
[TABLE]
where and . Note that and without loss of generality we take . Define
[TABLE]
Note that as . We must show that is bounded above for . It is enough to consider points where which occur when We have
[TABLE]
and hence we have proved the required boundedness. We then define
[TABLE]
The relation (2.3) now follows from the dominated convergence theorem. ∎
3 Computation of Measures
For the sake of brevity, the analysis in the rest of this paper will consider the self-adjoint case , which is the case most encountered in applications. However, the algorithms we build are based on Theorem 2.1 (and Corollary 2.2) and the link with Poisson kernels/Cauchy transforms. Given the relation (1.13) and Proposition 2.4, many of the results can be straightforwardly extended to the unitary case and more general cases where conditions similar to that of Proposition 2.4 hold. We consider examples of unitary operators in §6.3.
3.1 Full spectral measure
We start by considering the computation of , where is a non-trivial open set. In other words, is not the whole of or the empty set. The collection of these subsets will be denoted by . To be precise, we assume that we have access to a finite or countable collection such that can be written as a disjoint union
[TABLE]
With an abuse of notation, we add this information as evaluation functions to (defined in (1.18)).
Theorem 3.1** (Computation of measures on open sets).**
Given the set-up in §1.5, §1.6 and the previous paragraph, consider the map
[TABLE]
Then . In other words, we can construct a convergent sequence of arithmetic algorithms for the problem.
Remark 4**.**
Essentially, this theorem tells us that if we can compute the action of the resolvent operator with asymptotic error control near the real axis, then we can compute the spectral measures of open sets in one limit. In the unitary case, this can easily be extended to relatively open sets of if we can evaluate the resolvent near the unit circle. For any , the approximation of has finite support, and hence we can take inner products to compute .
Remark 5**.**
One may wonder whether it is possible to upgrade the convergence of the algorithm in Theorem 3.1 from to . In other words, whether it is possible to compute the measure with error control. However, this is difficult because the measure may be singular. Theorem 5.2 shows this is impossible even for singleton sets and discrete Schrödinger operators acting on .
Proof of Theorem 3.1.
Let and . By the resolvent identity and self-adjointness of ,
[TABLE]
Hence, for with , the vector-valued function (considered with argument ) is Lipschitz continuous with Lipschitz constant bounded by . Now consider the class and let . From Corollary 2.2, we can construct a sequence of arithmetic algorithms, , such that
[TABLE]
for all . It follows from standard quadrature rules and taking subsequences if necessary (using that and are null), that for , the integral
[TABLE]
can be approximated to an accuracy using finitely many arithmetic operations and comparisons and the relevant set of evaluation functions (the constant now becomes due to not knowing the exact value of ).
Recall that we assumed the disjoint union
[TABLE]
where and the union is at most countable. Without loss of generality, we assume that the union is over . We then let be such that and as with and hence . Let
[TABLE]
then the proof of Stone’s formula in Proposition 2.3 (essentially an application of the dominated convergence theorem) can be easily adapted to show that
[TABLE]
Note that we do not have to worry about contributions from endpoints of the intervals since we approximate strictly from within the open set . To finish the proof, we simply let be an approximation of the integral
[TABLE]
with accuracy . By the above remarks, such an approximation can be computed using finitely many arithmetic operations and comparisons from the relevant set of evaluation functions . ∎
This theorem can clearly be extended to cover the more general case of Proposition 2.4 if is regular enough to allow approximation of
[TABLE]
given the ability to compute with asymptotic error control. Note that when it comes to numerically computing the integrals in Propositions 2.3 and 2.4, it is advantageous to deform the contour so that most of the contour lies far from the spectrum so that the resolvent has a smaller Lipschitz constant. The proof can also be adapted to compute , where is a closed interval, by considering intervals shrinking to ( finite). A special case of this is the computation of the spectral measure of singleton sets. However, for these it much easier to directly use the formulae
[TABLE]
for and respectively.
3.2 Measure decompositions and projections
Recall from §1.5 that denotes the orthogonal projection onto the space , where denotes a generic type ( or ). We have included the continuous and singular parts denoted by or which correspond to and respectively. These are often encountered in mathematical physics. As in §3.1, we assume the decomposition in (3.1) and add the as evaluation functions to (defined in (1.18)). In this section, we prove the following theorem.
Theorem 3.2**.**
Given the set-up in §1.5, §1.6 and §3.1, consider the map
[TABLE]
for or . Then for
[TABLE]
To prove this theorem, it is enough, by the polarisation identity, to consider (note that all the projections commute). We will split the proof into two parts: the inclusion, for which it is enough to consider , and the exclusion, for which it is enough to consider .
3.2.1 Proof of inclusion in Theorem 3.2
Proof of inclusion in Theorem 3.2.
Since , and , it is enough, by Theorem 3.1 and Remark 4, to consider only and .
Step 1: We first deal with , where we shall use a similar argument to the proof of Theorem 4.1 (which is more general than what we need). We recall the RAGE theorem [119, 2, 53] as follows. Let denote the orthogonal projection onto vectors in with support outside the subset . Then for any ,
[TABLE]
The proof of Theorem 4.1 is easily adapted to show that there exists arithmetic algorithms using such that
[TABLE]
for all . Note that this bound can be made independent of (as we have written above) by sufficiently approximating the function (it has known total variation for a given and uniform bound). We now define
[TABLE]
Using the fact that for ,
[TABLE]
it follows that
[TABLE]
Hence
[TABLE]
where Clearly the first term converges to [math] as , so we only need to consider the second. Using (3.4), it follows that for any
[TABLE]
But converges strongly to [math] as and hence the quantity
[TABLE]
uniformly in as . It follows that
[TABLE]
and hence
[TABLE]
Step 2: Next we deal with the case . Note that for , is simply the Stieltjes transform (also called the Borel transform) of the positive measure
[TABLE]
The Hilbert transform of is given by the limit
[TABLE]
with the limit existing (Lebesgue) almost everywhere. This object was studied in [109, 108], where we shall use the result (since the measure is positive) that for any bounded continuous function ,666Note that this is stronger than weak∗ convergence which in this case means restricting to continuous functions vanishing at infinity. That the result holds for arbitrary bounded continuous functions is due to the tightness condition that the result holds for the function identically equal to .
[TABLE]
Now let with
[TABLE]
where and the disjoint union is at most countable as in (3.1). Without loss of generality, we assume that the union is over . Due to the possibility of point spectra at the endpoints , we cannot simply replace by in the above limit (3.5). However, this can be overcome in the following manner.
Let denote the boundary of defined by and let denote the measure . Let denote a pointwise increasing sequence of continuous functions, converging everywhere up to , such that the support of each is contained in
[TABLE]
Such a sequence exists (and can easily be explicitly constructed) precisely because is open. We first claim that
[TABLE]
To see this note that for any , the following inequalities hold
[TABLE]
where the last equality is due to (3.5). Taking yields
[TABLE]
so we are left with proving a similar bound for the limit supremum. Note that any point in the support of is of distance at least from . It follows that there exists a constant independent of such that for any ,
[TABLE]
Now let . Then, for large , and hence
[TABLE]
Now let be any bounded continuous function such that . Then using (3.8),
[TABLE]
Now we let , with pointwise convergence everywhere. This is possible since the complement of is open. By the dominated convergence theorem, and since was arbitrary, this yields
[TABLE]
where the last equality follows from the definition of . The claim (3.6) now follows.
Let be a sequence of non-negative continuous piecewise affine functions on , bounded by and such that if and if . Consider the integrals
[TABLE]
where is an approximation of
[TABLE]
to pointwise accuracy over . Note that a suitable piecewise affine function can be constructed using , as can suitable , and a suitable approximation function can be pointwise evaluated using (again by Corollary 2.2). To see this, recall the definition of in (1.18) and that we added from (3.1) to . To define , we can define the function by suitable piecewise affine functions on each interval . It follows that there exists arithmetic algorithms using such that
[TABLE]
The dominated convergence theorem implies that
[TABLE]
Note that continuity of is needed to gain convergence almost everywhere and prevent possible oscillations about the level set . We also have
[TABLE]
The same arguments used to prove (3.6), therefore show that
[TABLE]
Hence,
[TABLE]
completing the proof of inclusion in Theorem 3.2. ∎
3.2.2 Proof of exclusion in Theorem 3.2
To prove the exclusion, we need two results which will also be used in §5. First, we consider a result connected to Anderson localisation (Theorem 3.3) and, second, we consider a result concerning sparse potentials of discrete Schrödinger operators (Theorem 3.4). The free Hamiltonian acts on via the tridiagonal matrix representation
[TABLE]
We define a Schrödinger operator acting on to be an operator of the form
[TABLE]
where is a bounded (real-valued) multiplication operator with matrix .
Since Anderson’s introduction of his famous model 60 years ago [3], there has been a considerable amount of work by both physicists and mathematicians aiming to understand the suppression of electron transport due to disorder (Anderson localisation). A full discussion of Anderson localisation is beyond the scope of this paper, and we refer the reader to [29, 42, 90] for broader surveys. When considering Anderson localisation, we will assume that is a collection of independent identically distributed random variables. Following [67], we assume that the single-site probability distribution has a density with (with respect to the standard Lebesgue measure). For such a potential, a measure of disorder is given by the quantity . The first result we need is the following theorem which follows straightforwardly from the technique of [67], and hence we have not provided a proof which would be almost verbatim to [67].
Theorem 3.3** (Anderson Localisation for Perturbed Operator [67]).**
There exists a constant such that if and has compact support, then the operator has only pure point spectrum with probability 1 for any fixed self-adjoint operator of the form
[TABLE]
In other words, the operator ’s matrix with respect to the canonical basis has only finitely many non-zeros.
The second result we need is the following from [92].
Theorem 3.4** (Krutikov and Remling [92]).**
Consider discrete Schrödinger operators acting on . Let be a (real-valued and bounded) potential of the following form:
[TABLE]
Then and the following dichotomy holds:
- (a)
If then is purely absolutely continuous on .
- (b)
If then is purely singular continuous on .
Proof of exclusion in Theorem 3.2.
Since , and , it is enough, by Theorem 3.1 and Remark 4, to consider , and . We restrict the proof to considering bounded Schrödinger operators acting on , which are clearly a subclass of for . Note that since the evaluation functions in can be recovered from those in in this special case, we can assume that we are dealing with . We also set , with the crucial properties that this vector is cyclic and hence has the same support as , and that . Throughout, we also take .
Step 1: We begin with . Suppose for a contradiction that there does exist a sequence of general algorithms such that
[TABLE]
We take a general algorithm, denoted , from Theorem 3.1 which has
[TABLE]
Since is cyclic, this limit is non-zero if . We therefore define
[TABLE]
We will use Theorem 3.3 and the following well-known facts:
If for any there exists such that , then . 2. 2.
If there exists such that is [math] for , then [114], but (the potential acts as a compact perturbation so the essential spectrum is ). 3. 3.
If we are in the setting of Theorem 3.3, then the spectrum of is pure point almost surely. Moreover, if for some constant , then almost surely.
The strategy will be to construct a potential such that , yet does not converge. This is a contradiction since by our assumptions, for such a we must have
[TABLE]
To do this, choose for some constant such that the conditions of Theorem 3.3 hold and define the potential inductively as follows.
Let be a potential of the form (with the density ) such that is pure point. Such a exists by Theorem 3.3 and we have . Hence for large enough it must hold that . Fix such that this holds. Then only depends on for some integer by (i) of Definition A.2. Define the potential by for all and otherwise. Then by fact (2) above, but , and hence for large , say for . But then only depends on for some integer .
We repeat this process inductively switching between potentials which induce for even and potentials which induce for odd. Explicitly, if is even then define a potential by for all and (with the density ) otherwise such that the spectrum of is pure point. Such a exists from Theorem 3.3 applied with the perturbation to match the potential for . If is odd then we define by for all and otherwise. We can then choose such that the above inequalities hold and such that only depends on . We also ensure that .
Finally set for . It is clear from (iii) of Definition A.2, that and this implies that cannot converge. However, since , for any odd we have . Fact (1) implies that , hence and therefore converges. This provides the required contradiction.
Step 2: Next we deal with . To prove that one limit will not suffice, our strategy will be to reduce a certain decision problem to the computation of . Let be the discrete space , let denote the collection of all infinite sequence with entries and consider the problem function
[TABLE]
which maps to . In Appendix A, it is shown that (where the evaluation functions consist of component-wise evaluation of the array ). Suppose for a contradiction that is a height one tower of general algorithms such that
[TABLE]
We will gain a contradiction by using the supposed tower to solve .
Given , consider the operator , where the potential is of the following form:
[TABLE]
Then by Theorem 3.4, if (that is, if ) and otherwise. Note that in either case we have . We follow Step 1 and take a general algorithm, denoted , from Theorem 3.1 which has
[TABLE]
Since is cyclic, this limit is non-zero for , where is of the form (3.10). We therefore define
[TABLE]
It follows that
[TABLE]
Given , we can evaluate any matrix value of using only finitely many evaluations of and hence the evaluation functions can be computed using component-wise evaluations of the sequence . We now set
[TABLE]
The above comments show that each of these is a general algorithm and it is clear that it converges to as , the required contradiction.
Step 3: Finally, we must deal with . The argument is the same as Step 2, replacing with and the resulting with . ∎
4 Two Important Applications
Two important applications of our techniques are the computation of the functional calculus and of the Radon-Nikodym derivative of with respect to Lebesgue measure, denoted by . Both of these have applications throughout mathematics and the physical sciences, some of which are explored numerically in §6. For example, suppose that we wish to solve the Schrödinger equation
[TABLE]
where is some self-adjoint Hamiltonian. We can express the solution at time as
[TABLE]
For example, the quantity
[TABLE]
known as the autocorrelation function [141], is simply the Fourier transform of the spectral measure . In particular, if is absolutely continuous, then and form a Fourier transform pair. The computation of evolution generated by an operator is in some sense dual to the computation of the spectral measure. This interpretation of a time evolution can be adapted to describe many signals generated by PDEs [126, 85, 48] and stochastic processes [88, 65] [118, Ch. 7]. In this section, we show how to compute the functional calculus and .
4.1 Computation of the functional calculus
Recall that given a possibly unbounded complex-valued Borel function , defined on , and , is defined by
[TABLE]
is a densely defined closed normal operator with dense domain given by
[TABLE]
For simplicity, we will only deal with the case that is a bounded continuous function on , that is, . In this case is the whole of (the variations are finite) and we can use standard properties of the Poisson kernel. We assume that given , we have access to piecewise constant functions supported in such that . Clearly other suitable data also suffices and, as usual, we abuse notation slightly by adding this information to the evaluation sets (recall that are defined in (1.18)).
Theorem 4.1** (Computation of the functional calculus).**
Given the set-up in §1.5 and §1.6, consider the map
[TABLE]
Then .
Proof.
Let then by Fubini’s theorem,
[TABLE]
The inner integral is bounded since is bounded and the Poisson kernel integrates to along the real line. It also converges to everywhere. Hence by the dominated convergence theorem
[TABLE]
We now use the same arguments used to prove Theorem 3.1. Using Corollary 2.2, together with and the fact that is Lipschitz continuous with Lipschitz constant for some (possibly unknown) constants and , we can approximate this integral with an error that vanishes in the limit . ∎
If is bounded, then, with slightly more information available to our algorithms, a simpler proof holds using the Stone–Weierstrass theorem. Suppose that given , the vectors can be computed to arbitrary precision. There exists a sequence of polynomials converging uniformly to on . Assuming such a sequence can be explicitly constructed (for example using Bernstein or Chebyshev polynomials), we can take as approximations of . If we can bound with null, then the vector can be computed with error control. However, computing for large (even if ) may be computationally expensive as was found in the example in §6.4. We will also see in §6.4 that if is bounded and is analytic in an open neighbourhood of , then can be computed with error control by deforming the integration contour away from the spectrum. Such a deformation is useful since we the resolvent does not blow up along such a contour, and we can bound its Lipschitz constant.
4.2 Computation of the Radon–Nikodym derivative
Recall the definition of the Radon–Nikodym derivative in (1.16) and note that for . We consider its computation in the sense in the following theorem, where, as before, we assume (3.1), adding the approximations of to our evaluation set (defined in (1.18)), along with component-wise evaluations of a given vector . However, we must consider the computation away from the singular part of the spectrum.
Theorem 4.2** (Computation of the Radon–Nikodym derivative).**
Given the set-up in §1.5 and §1.6, consider the map
[TABLE]
We restrict this map to the quadruples such that is strictly separated from and denote this subclass by . Then . Furthermore, each output of the algorithms constructed in the proof consists of a piecewise affine function, supported in with rational knots and taking (complex) rational values at these knots.
Remark 6**.**
Essentially, this theorem tells us that if we can compute the action of the resolvent operator with asymptotic error control, then we can compute the Radon–Nikodym derivative of the absolutely continuous part of the measures on open sets which are a positive distance away from the singular support of the measure. The assumption that is separated from may seem unnatural but is needed to gain convergence of the approximation. However, without it, the proof still gives almost everywhere pointwise convergence.
Proof.
Let . For we decompose as follows
[TABLE]
The first term converges to in as since . Since we assumed that is separated from , it follows that the second term of (4.1) converges to [math] in as . Hence we are done if we can approximate in with an error converging to zero as .
Recall that is Lipschitz continuous with Lipschitz constant at most . By assumption, and using Corollary 2.2, we can approximate to asymptotic precision with vectors of finite support. Hence the inner product
[TABLE]
can be approximated to asymptotic precision (now with a possibly unknown constant also depending on ) and is Lipschitz continuous with Lipshitz constant at most .
Recall that can be written as the disjoint union
[TABLE]
where and the union is at most countable. Without loss of generality, we assume that the union is over . Given an interval , let such that and and . Let be a piecewise affine interpolant with knots supported on with the property that . Here is some unknown constant which occurs from the asymptotic approximation of that arises from Corollary 2.2 and we can always compute such in finitely many arithmetic operations and comparisons.
Let be the function that agrees with on for and is zero elsewhere. Clearly the nodes of can be computed using finitely many arithmetic operations and comparisons and the relevant set of evaluation functions . A simple application of the triangle inequality implies that
[TABLE]
where the last term arises due to the piecewise linear interpolant. The bound clearly converges to zero as required. ∎
5 Computing Spectra as Sets
We now turn to computing the different types of spectra as sets in the complex plane. Specifically, define the problem functions for or . Note also that , the closure of the set of eigenvalues. Recalling the definition of a computational problem in Appendix A, we compute these quantities in a metric space with metric . Since we wish to include unbounded operators, we use the Attouch–Wets metric defined by
[TABLE]
for where denotes the set of closed non-empty subsets of . When considering bounded , whose spectrum is necessarily a compact subset of , we let be the set of all non-empty compact subsets of provided with the Hausdorff metric :
[TABLE]
where is the usual Euclidean distance. Note that for compact sets (and hence for bounded operators), the topological notions of convergence according to and coincide. To allow the possibility that the different spectral sets are empty, we add the empty set to our metric space as an isolated point (the space remains metrisable).777This simply means that if and only if eventually.
The main theorem of this section is the following:
Theorem 5.1**.**
Given the above setup and that in §1.5 and §1.6, for it holds that
[TABLE]
If , then also holds.
In order to prove Theorem 5.1, we only need to prove the lower bounds for and the upper bounds for (recall that are defined in (1.18)). These results show that despite the results of §§2– 4, in general it is very hard to compute the decomposition of the spectrum in the sense of (1.17). We also answer the question posed in §2.2 and prove that the spectral measures, while computable in one limit, cannot, in general, be computed with error control (see Theorem 5.2), unless one has additional regularity assumptions such as in [39] (computation with error control is made precise in [33, Ch. 4]).
5.1 Proof for point spectra
Proof that .
To prove this, it is enough to consider bounded Schrödinger operators acting on (defined in §3.2.2), which are clearly a subclass of for . Note that since the evaluation functions in can be recovered from those in in this special case, we can assume that we are dealing with . Suppose for a contradiction that there does exist a sequence of general algorithms, , with
[TABLE]
We will construct a potential such that does not converge. To do this, choose for some constant such that the conditions of Theorem 3.3 hold. We will use Theorem 3.3 and the following well-known facts:
If there exists such that is [math] for , then [114], but (the potential acts as a compact perturbation so the essential spectrum is ). 2. 2.
If we are in the setting of Theorem 3.3, then the spectrum of is pure point almost surely. Moreover, if for some constant , then almost surely.
We will define the potential inductively as follows. Let be a potential of the form (with density ) such that and is pure point. Such a exists by Theorem 3.3 and fact (2) above. Then for large enough there exists such that . Fix such that this holds. Then only depends on for some integer by (i) of Definition A.2. Define the potential by for all and otherwise. Then by fact (1) above, for large , say for . But then only depends on for some integer .
We repeat this process inductively switching between potentials which induce for even and potentials which induce for odd. Explicitly, if is even then define a potential by for all and (with the density ) otherwise such that and is pure point. Such a exists from Theorem 3.3 and fact (2) above applied with the perturbation to match the potential for . If is odd then we define by for all and otherwise. We can then choose such that the above intersections hold and such that only depends on . Finally set for . It is clear from (iii) of Definition A.2, that . But then this implies that cannot converge, the required contradiction. ∎
A similar argument gives the following theorem, where is used to denote bounded real-valued potentials on and denotes the pointwise evaluations of such potentials.
Theorem 5.2** (Impossibility of computing spectral measures with error control).**
Consider the problem function
[TABLE]
Then but . In other words, can be computed in one limit, but it cannot be computed with error control.
Proof.
The result follows directly from the remarks after Theorem 3.1 and Theorem 2.1. Suppose for a contradiction that and that is a sequence of general algorithms solving the problem with error control. It follows that for each , there exists a sequence of general algorithms such that
[TABLE]
Informally, these are described as follows. Fix and consider the lower bound on computed by . If this is greater than [math] then set , otherwise set . It follows that also converges from below. It holds that if and only if for some . Now define
[TABLE]
It is clear that this is a general algorithm using . Furthermore,
[TABLE]
with convergence from below.
Now we may choose a such that (this can be achieved for example by taking a potential which induces pure point spectrum and shifting the operator accordingly). It follows that for large , we have . But the computation of is only dependent on for for some . Define by if and otherwise. It follows that . But since the potential has compact support, and hence , the required contradiction. ∎
We now prove that can be computed using a height two arithmetical tower. The first step is the following technical lemma, whose proof will also be used later when considering .
Lemma 5.3**.**
Let with and consider the decision problem
[TABLE]
Then there exists a height two arithmetical tower (with evaluation functions ) for . Furthermore, the final limit is from below in the sense that .
Proof.
Step 1 of the proof of Theorem 3.2 yields a height two arithmetical tower for the computation of . Note that the final limit is from above and using the fact that , we obtain a height two tower for . We can then use the height one tower for constructed in §2.2, denoted by , and define
[TABLE]
This provides a height two arithmetical tower for with the final limit from below. Without loss of generality (by taking successive maxima), we can assume that these towers are non-decreasing in . Now set
[TABLE]
Then it is clear that the limit exists. Furthermore, the monotonicity of in implies that
[TABLE]
with monotonic convergence from below. This limiting value is zero if , otherwise it is a positive finite number.
To convert this to a height two tower for the decision problem , that maps to the discrete space , we use the following trick. Consider the intervals and Let be maximal such that . If no such exists or then set . Otherwise set . These can be computed using finitely many arithmetic operations and comparisons using . The point of the intervals and is that we can show exists. This is because exists and hence we cannot oscillate infinitely often between the separated intervals and . Now suppose that , then and hence for all . Now suppose that , then for large enough we must have that and hence . Together, these prove the convergence and that . ∎
Proof that .
To construct a height two arithmetical tower for , we will use Lemma 5.3 repeatedly. Let denote the height two tower constructed in the proof of Lemma 5.3 for the closed interval (), where without loss of generality by taking successive maxima in , we can assume that this tower is non-decreasing in (this is where we use convergence from below in the final limit in the statement of the lemma). For a given and , we construct as follows (we will use some basic terminology from graph theory).
Define the intervals for so that these cover the interval . Now suppose that are defined for . Compute each and if this is 1, bisect via its midpoint into two equal halves consisting of closed intervals. We then take all these bisected intervals and label them as for . This is repeated until we have no further bisections or the intervals have been computed. By adding the interval as a root with children , this creates a finite tree structure where a non-root interval is a parent of two intervals precisely if those two intervals are formed from its bisection and . We then prune this tree by discarding all leaves which have to form the tree . Finally, we let be the union of all the leaves of . Clearly this can be computed using finitely many arithmetic operations and comparisons using . The construction is shown visually in Figure 3.
In the above construction, the number of intervals considered (including those not in the tree ) for a fixed is and hence independent of . It follows that and are constant for large (due to the convergence of the in ). We denote these limiting values by and respectively and also denote the corresponding intervals in the construction at the th level of this limit by . Note also that if then .
Now suppose that , then there exists a sequence of nested intervals containing for , where these intervals are independent of . Fix , then for large we must have that for . It follows that has a descendent interval contained in and hence we must have
[TABLE]
Since was arbitrary it follows that converges to [math] as .
Conversely, suppose that with , then we must show that all limit points of lie in . Suppose this were false, then by taking a subsequence if necessary, we can assume that and for some . We claim that it is sufficient to prove that the maximum length of the leaves of intersecting a fixed compact subset of , converges to zero as . Suppose this has been shown, then for some leaf of . It follows that and . But this contradicts being positively separated from .
We are thus left with proving the claim regarding the lengths of leaves. Suppose this were false, then there exists a compact set and leaves in such that the lengths of do not converge to zero and intersect . By taking subsequences if necessary, we can assume that the lengths of each are constant. Then by the compactness of and taking subsequences if necessary again, we can assume that each of the are equal to a common interval . It follows that but that since is a leaf, where and form the bisection of . Taking , this implies that but which is absurd. Hence we have shown the required contradiction, and we have finished the proof. ∎
5.2 Proof for absolutely continuous spectra
To prove the lower bound (that one limit will not suffice), our strategy will be to reduce a certain decision problem to the computation of . Let be the discrete space , let denote the collection of all infinite sequence with entries and consider the problem function
[TABLE]
that maps to . In Appendix A, it is shown that (where the evaluation functions consist of component-wise evaluation of the array ).
Proof that .
We are done if we prove the result for and . In this case and are equivalent so we can restrict the argument to . Suppose for a contradiction that is a height one tower of general algorithms solving . We will gain a contradiction by using the supposed tower to solve .
Given , consider the operator , where the potential is of the following form:
[TABLE]
Then by Theorem 3.4, if (that is, if ) and otherwise. Given we can evaluate any matrix value of using only finitely many evaluations of and hence the evaluation functions can be computed using component-wise evaluations of the sequence . We now set
[TABLE]
The above comments show that each of these is a general algorithm, and it is clear that it converges to as , the required contradiction. ∎
To construct the height two (arithmetical) tower for , we require the following lemma.
Lemma 5.4**.**
Let with and consider the decision problem
[TABLE]
Then there exists a height two arithmetical tower (with evaluation functions ) for . Furthermore, the final limit is from below with .
Proof.
Fix such an and and let be a sequence of non-negative, continuous piecewise affine functions on , bounded by and of compact support such that converge pointwise monotonically up to the constant function . Define also the function
[TABLE]
and set
[TABLE]
Since each is continuous and has compact support (which implies that the integrand is bounded for fixed ), and since converges almost everywhere to (the Radon–Nikodym derivative of the absolutely continuous part of the measure ), it follows by the dominated convergence theorem that
[TABLE]
We now use the fact that the are increasing and the dominated convergence theorem again (with bounding integrable function ) to deduce that
[TABLE]
with monotonic convergence from below.
Using Corollary 2.2 (and the now standard argument of Lipschitz continuity of the resolvent), we can compute approximations of to accuracy in finitely many arithmetic operations and comparisons. Call these approximations and set
[TABLE]
The proof now follows that of Lemma 5.3 exactly. ∎
Proof that .
This is exactly the same construction as in the above proof of the inclusion . We simply replace the tower constructed in the proof of Lemma 5.3 by the tower constructed in the proof of Lemma 5.4. ∎
5.3 Proof for singular continuous spectra
We first prove the lower bound for the singular continuous spectrum via Theorem 3.4. Note that the impossibility result follows from the same argument that was used to show . To show that two limits will not suffice for , our strategy will be to again reduce a certain decision problem to the computation of . Let be the discrete space , let denote the collection of all infinite matrices with entries and consider the problem function
[TABLE]
that maps to . In [12], a Baire category argument was used to prove that (where the evaluation functions consist in component-wise evaluation of the array ).
Proof that if .
Assume that the function satisfies . The proof will use a direct sum construction. Given , consider the operators , where the potential is of the following form:
[TABLE]
Using Theorem 3.4, if (that is, if the -th column has infinitely many s) and otherwise. Now consider an effective bijection (with effective inverse) between the canonical bases of and :
[TABLE]
Set . Then through , we view as a self-adjoint operator acting on . Explicitly, we consider the matrix
[TABLE]
We choose the following bijection (where lists the canonical basis in each Hilbert space):
{j=1}$${j=2}$${j=3}$${\cdots}$${m=1}$${\phi(1)}$${\phi(3)}$${\phi(6)}$${\cdots}$${m=2}$${\phi(2)}$${\phi(5)}$${m=3}$${\phi(4)}$${\cdots}$${\cdots}
A straightforward computation shows that . We also observe that if then , otherwise .
Suppose for a contradiction that is a height two tower of general algorithms that solves . We will gain a contradiction by using the supposed height two tower to solve . We now set
[TABLE]
where we use the convention . The comments above show that each of these is a general algorithm. Furthermore, the convergence of implies that
[TABLE]
We are not quite done since the convergence here takes place on the interval with the usual metric as opposed to with the discrete metric. To get round this, we use the following, now familiar, trick.
Consider the intervals and Let be maximal such that . If no such exists or then set . Otherwise set . As in the proof of Lemma 5.3, we can show exists. If , then for large , and hence . Similarly, if , then for large we must have and hence . Hence is a height two tower of general algorithms solving , a contradiction. ∎
Finally, we will use the following lemma to prove that the singular continuous spectrum can be computed in three limits.
Lemma 5.5**.**
Let with and consider the decision problem
[TABLE]
Then there exists a height three arithmetical tower (with evaluation functions ) for . Furthermore, the final limit is from below with .
Once this is proven, we can use the same construction that was used to prove and to show that , but with an additional limit. Namely, we replace by in the proof and use the tower constructed in the proof of Lemma 5.4 instead of for an interval . We still gain the required convergence, since the only change is an additional limit in the finite number of decision problems that decide the appropriate tree.
Proof of Lemma 5.5.
Note that we can write
[TABLE]
From this and the proofs of Lemmas 5.3 and 5.4, it is clear that we can construct a height two arithmetical tower, , for , where the final limit is from above. Now set
[TABLE]
We see that each successive limit converges, with the second from above and the final from below. By taking successive maxima, minima of our base algorithms, we can assume that the second and final limits are monotonic and that is monotonic in both and . Define , and . Then is zero if , otherwise it is a positive finite number.
With a slight change to the previous argument (the monotonicity in and is crucial for this to work), consider the intervals and Let be maximal such that . If no such exists or then set . Otherwise set . We then define
[TABLE]
These can be computed using finitely many arithmetic operations and comparisons using , and, as before, the first limit exists with
[TABLE]
Note also that the second and third sequential limits exist through the use of maxima and minima.
Now suppose that and fix . Then for large , we must have that for all due to the monotonic convergence of as . It follows in this case that
[TABLE]
Now suppose that . It follows in this case that there exists such that if then . Due to the monotonic convergence of as it follows that for all we must have and hence there exists such that if then we must have . It follows that if then we must have for all and hence that
[TABLE]
The conclusion of the lemma now follows. ∎
6 Numerical Examples
We now demonstrate the applicability of the new algorithms. In particular, these are the first algorithms that compute their respective spectral properties for the whole class , and even for the restricted case of tridiagonal self-adjoint matrices. The algorithms are also implicitly parallelisable, allowing large scale computations. We focus on discrete operators and the numerical implementation of the algorithms for ODEs, PDEs and integral operators will be the focus of a future software package.888Since writing the initial version of this paper, our algorithms have been implemented in the software package SpecSolve of [39], which treats general discrete, differential and integral operators.
6.1 Jacobi matrices and orthogonal polynomials
For our first set of examples, we consider the natural link between the spectral measures of Jacobi operators and orthogonal polynomials on . Let be a Jacobi matrix
[TABLE]
with and . In this case, under suitable conditions, the probability measure is the probability measure associated with the orthonormal polynomials defined by
[TABLE]
and the spectral measure that appears in the multiplicative version of the spectral theorem (see, for example, [143, 45, 137]). Classically, one usually first considers the measure and then constructs the orthogonal polynomials and the corresponding . In some sense, the algorithms constructed in this paper, and in particular §4, compute the inverse problem (note that ). In other words, we compute the measure given the recurrence coefficients defining the orthogonal polynomials. This is a very difficult problem to study theoretically, and, until now, there has been no numerical method able to tackle the problem in this generality (see §1.7 for comments on methods that tackle compact perturbations of Toeplitz operators). To verify our method, we will consider problems where the measure is known analytically.
We begin with the well-known class of Jacobi polynomials defined for which have
[TABLE]
and measure on the interval given by
[TABLE]
where is a normalising constant, ensuring the measure is a probability measure. To assess the convergence of the algorithm in §4.2 that approximates the Radon–Nikodym derivative , in this section we will plot various errors as a function of , the distance from the points at which we compute the resolvents to the real axis.
Figure 4 (left) shows a typical error plot for and . We plot both the error (computed using a large number of discrete points), and the pointwise errors at and . The procedure of Theorem 2.1 is used to determine adaptively how large our (rectangular) matrix truncations should be for a given . We see that both the error and error at [math] appear to decrease as ,999This can be proven, though there is an additional factor. We shall omit such terms in the ensuing discussion. whereas the errors at and decrease as and respectively, shown in the plot. This suggests using Richardson extrapolation to accelerate convergence [115]. This is shown in the right of Figure 4, where the extrapolation was computed at distances and from the real axis. Now the error at [math] decreases as , whereas the error appears to decrease as . We found similar results for different and . In general, interior points decrease at the rate and then after extrapolation. The left end point error decreases as and then after extrapolation. The right end point error decreases as and then after extrapolation. Finally, the error decreases as and then after extrapolation. These rates for pointwise and errors reflect the local Hölder exponent and integrability of the density and its first derivative respectively, and can be proven using a Taylor series argument for general measures.101010These results can be proven using the theory of high-order rational kernels developed in [39]. Moreover, we found that increased rates of convergence could be obtained (and again proven) locally near smoother parts of the measure by using further iterates of extrapolation. Note also that we took a uniform value over the whole interval. However, could just have easily been a function of the position , allowing it to be smaller for points where the resolvent is estimated more accurately for a given matrix size.
To demonstrate the algorithm on unbounded operators, we next consider the class of generalised Laguerre polynomials for which have
[TABLE]
and measure on the interval given by
[TABLE]
Results are shown in Figure 5 for , where we have plotted the (relative) error over the interval , as well as pointwise errors at [math] and . Similar conclusions can be drawn as before. Pointwise errors are also shown for this example and the Jacobi operator, but now using the th iterate of Richardson extrapolation, in Figure 6. The errors decay at the expected rates (also shown), with convergence at smooth parts of the measure. Near singular points (namely at and for the Jacobi and Laguerre cases, respectively), the prefactor in front of the term is larger, and smaller is needed before the expected rate kicks in.
Finally, we demonstrate the computation of measures for a Jacobi operator with non-empty discrete spectrum. The Charlier polynomials are generated by
[TABLE]
for , and have measure
[TABLE]
where denotes a Dirac measure located at the point . Figure 7 shows plots of for , computed using an matrix with . The peaks clearly coincide with the atoms of the measure. The difference between the peak values and the weight was of the order for both examples. This demonstrates that an effective way to compute eigenvalues (particularly the challenging case of those in gaps of the essential spectrum, where spectral pollution occurs, or even those embedded in the essential spectrum) and projections onto eigenspaces may be to find local maxima or spikes of . Such a routine would only require the solution of shifted linear systems (the resolvent), without diagonalisation, and could be executed rapidly in parallel.
6.2 A global collocation approach
Typically, the size of the linear system needed to approximate the resolvent accurately (Theorem 2.1) grows as and we approach the spectrum. It is therefore beneficial to increase the rate of convergence of approximating the measures as . One local (in terms of ) approach, Richardson extrapolation, was used in §6.1. Here we briefly outline a different, more global approach.
Suppose that we know the spectral measure of an operator has support included in and is absolutely continuous. Alternatively, we may analytically know, or be able to estimate, the singular part of the measure and subtract this from what follows. In this case, a natural way to approximate the Radon–Nikodym derivative is through a formal basis expansion
[TABLE]
where are functions with support whose Cauchy’s transforms are easy to compute. To approximate the coefficients , we collocate in the complex plane as follows. Let be a finite collection of complex points in the upper half-plane and truncate the approximation of to terms. To generate a linear system for , we evaluate the Cauchy transform at points . The Cauchy transform satisfies
[TABLE]
which can be computed with error control using the results of §2.1. Call this approximation and define
[TABLE]
Then for each , an approximate linear relation can be written as
[TABLE]
Evaluating this relation at points in gives rise to a linear system, which can be inverted in the least-squares sense for the approximation of the coefficients . If , and the basis functions are real, then the coefficients are real. Hence, in this case, taking real and imaginary parts of the linear system gives further linear relations without having to compute further resolvents.
If our basis functions satisfy recursion relations of the form
[TABLE]
then
[TABLE]
Hence, given the values of the integrals
[TABLE]
we can compute for all . The integrals in (6.4) have simple forms for all the bases used in this paper. This method of computation of is fast, meaning that the most expensive part of the collocation method is the computation of the right hand side of the linear system, that is, computing the resolvent.
Figure 8 (left) revisits the Jacobi polynomials example in §6.1 and shows the collocation method in the case of using Chebyshev polynomials as the basis functions (taking the first ). For collocation points, we took Chebyshev nodes offset by an additional to lie just above the interval in the complex plane. Note that the rate of convergence is faster than achieved with the methods of §4 after extrapolation. There are at least two prices to pay, though. First, there is no current proof that collocation converges and, second, global regularity of the measure is needed. At the very least, we need to be able to subtract off the singular part of the measure. In practice, even if the measure is absolutely continuous, a large number of basis functions may be needed to capture the Radon–Nikodym derivative. Examples are given in §6.3, where collocation performs worse than the techniques of §4 due to either of these regularity conditions. Figure 8 (right) revisits the (generalised) Laguerre polynomials example in §6.1 and shows the collocation method in the case of using Laguerre functions (the polynomials multiplied by the square root of the weight function) as the basis functions with . The collocation points were . Again, this method converges with faster rates than that in §6.1.
6.3 CMV matrices and extensions to unitary operators
We now demonstrate that the algorithms extend to the unitary case through use of the functions , namely, the convolution with the Poisson kernel of the unit disk. We will consider the class of CMV matrices (named after Cantero, Moral and Velázquez [28]) linked with orthogonal polynomials on the unit circle. A full discussion of this subject is beyond the scope of this paper, and we refer the reader to the monographs of Simon [130, 131]. However, the background for this example is as follows. Given a probability measure on the unit circle , whose support is not a finite set, we can define a system of orthogonal polynomials by applying the Gram–Schmidt process to . Given a polynomial of degree , we define the reversed polynomial via . Szegő’s recurrence relation [139] is given by
[TABLE]
where the are known as Verblunsky coefficients [148] and satisfy . Verblunsky’s theorem [147] sets up a one-to-one correspondence between and the coefficients . Define also
[TABLE]
The CMV matrix associated with is
[TABLE]
This matrix is unitary and banded (and lies in ). This last property does not hold for the so-called GGT representation [62, 68, 142], which has infinitely many non-zero entries in each row. The GGT representation uses the basis , whereas the CMV representation obtains a basis via applying Gram–Schmidt to . The key result is that is precisely the measure on the unit circle. Hence our new algorithms can be considered as a computational tool for the correspondence
[TABLE]
in much the same way as for orthogonal polynomials on the real line in §6.1.
The first example we consider are the Rogers–Szegő polynomials [117] given by
[TABLE]
where . In this case,
[TABLE]
which can be expressed in terms of the theta function. Figure 9 (left) shows the convergence of the new algorithm for various and we see algebraic convergence as before, with rates and before and after extrapolation respectively (here is such that we evaluate the convolutions with the Poisson kernel at radius ). Radon–Nikodym derivatives for larger values of (shown in the right of Figure 9) have larger derivatives and hence larger pre-factor in front of these rates. We can use a similar collocation method as in §6.2, using the standard Fourier basis . Note that the relevant Cauchy transforms can be computed explicitly using Cauchy’s residue theorem. Collocation points inside and outside the unit disk are needed (collocating inside the unit disk causes the Cauchy transforms of the basis functions with negative to vanish). This achieved machine precision using just basis functions and collocating at distance from .
The next example we consider are the Geronimus polynomials [63], which have with . In this case, for ,
[TABLE]
where , and . Figure 10 (right) shows some typical examples, and note that these density functions are not smooth. When , there is also a singular part of the measure (see [130] for the exact formula).
In the cases shown in Figure 10, the collocation method struggles to gain an accuracy beyond owing to discontinuity in the derivative of the Radon–Nikodym derivative and the algorithm based on convolutions is able to gain much more accurate results. Finally, a typical example is shown in Figure 11 (left) for (there is now a singular part located at ), where we have shown the output of the algorithm and the exact convolution with the Poisson kernel for , as well as the collocation method using basis functions and collocation points . Here, we see an exact agreement between the algorithm and convolution. Unsurprisingly in the presence of point spectra, the collocation method is unstable. Consistent with Theorem 4.2, the algorithm in §4.2 converges to the density over the portion of the spectrum, which is purely absolutely continuous. This is shown in the right of Figure 11.
6.4 Fractional diffusion on a 2D quasicrystal
In this example, we demonstrate computation of the functional calculus and consider operators acting on the graph of a Penrose tile - the canonical model of a two-dimensional quasicrystal [146, 140, 47] (aperiodic crystals which typically have anomalous spectra/transport properties). Quasicrystals were discovered in 1982 by Shechtman [125] who was awarded the 2011 Nobel Prize in Chemistry for his discovery. Since then, quasicrystals have generated considerable interest due to their often exotic physical properties [135], with a vast literature on the physics and spectral properties of such aperiodic systems.111111Recently, there has been renewed interest in aperiodic systems connected to graphene in the field of twistronics [30, 97]. Unlike the one-dimensional case, little is known about the spectral properties of two-dimensional quasicrystals. A finite portion of the infinite tile is shown in Figure 12, and we consider the natural graph whose vertices are the vertices of the tiling and edges correspond to the edges of the rhombi. Such a graph posses no periodic structure, and it is generically impossible to study its spectral properties analytically with current methods. The free Hamiltonian (Laplacian) is given by
[TABLE]
with summation over nearest neighbour sites (vertices). The first rigorous computation of the spectrum of (also with additional error control) was performed in [40]. We chose a natural ordering of the vertices as in Figure 12, which leads to an operator acting on . The local bandwidth grows for this operator (our ordering is asymptotically optimal) and hence computation of powers is infeasible for , rendering polynomial approximations of the functional calculus intractable. In the above notation, with , and so this example provides a demonstration of the algorithm for a non-banded matrix. Throughout, we take , though different initial conditions are handled in the same manner.
The ability to compute the functional calculus allows the solution of linear evolution equations. Given , a function (continuous and bounded on ) and , consider the evolution equation
[TABLE]
The solution of this equation is
[TABLE]
and can be computed via the algorithm outlined in §4.1.
We consider fractional diffusion governed by
[TABLE]
for . If is an integer, then the solution can be represented via contour deformation as
[TABLE]
where is a closed contour looping once around the spectrum. Typically we took the rectangular contour shown in Figure 12 and approximated the integral via Gaussian quadrature. This allows us to compute the solution with error control (we known the minimal distance between and so can bound the Lipschitz constant of the resolvent) and clearly, this holds for other functions , holomorphic on a neighbourhood of . Note that other methods, such as direct diagonalisation of finite square truncations or discrete time stepping (which is difficult if ), do not give error control and are slower. In fact, for this example, direct diagonalisation was impractical. When , we can still deform the contour, but not at [math] since . Hence we deform the contour to that shown in Figure 12. For a discussion of contour methods applied to finite matrices (in the case that the spectrum is strictly positive), we refer the reader to [74]. Unfortunately, such methods cannot be applied here since . Moreover, [math] appears to not be an isolated point of the spectrum, meaning that dealing with this point separately is also impossible.
Figure 13 shows the convergence of the algorithm for and . For , error control is not given by our algorithm, so we computed an error by comparing to a “converged” solution using larger . The error refers to the error in . The method converges algebraically for (owing to the contour touching the spectrum at [math]) but converges exponentially for with similar convergence observed over a large range of times . Figure 14 shows the magnitude (log scale) of the computed solution for various times. Note that the techniques presented here can be applied to any evolution equation of the form (6.8) on infinite-dimensional Hilbert spaces. They may also be useful for splitting methods/exponential integrators, which require fast computation of matrix/operator exponentials (see [83, 100] and the references therein) and more generally in the field of infinite-dimensional ODE/PDE systems. For methods that compute general semigroups on infinite-dimensional separable Hilbert spaces with error control, see [35].
Acknowledgments
This work was supported by EPSRC grant EP/L016516/1. I wish to thank Arieh Iserles, Andrew Horning, Sheehan Olver, Christian Remling and Marcus Webb for engaging and helpful discussions during the completion of this work. I also wish to thank the anonymous referees whose suggestions led to an improvement in the structure of the paper and in the clarity of some of the proofs.
Appendix A The SCI Hierarchy - a Framework for Computation
Cornerstones in the SCI hierarchy are the definitions of a computational problem, a general algorithm and towers of algorithms. The basic objects in a computational problem are as follows:
- (i)
is some set, called the domain.
- (ii)
is a set of complex-valued functions on called the evaluation set.
- (iii)
is a metric space with metric .
- (iv)
is called the problem function.
The set is the set of objects that give rise to our computational problems. The problem function is what we are interested in computing. Moreover, the set is the collection of functions that provide us with the information we are allowed to read.
Remark 7**.**
Throughout the paper we have relaxed the condition that maps into by considering evaluation functions consisting of intervals exhausting a set, piecewise constant functions of compact support etc. These seemingly more complicated objects can be effectively encoded by functions that map into . For example, when considering the decomposition (3.1):
[TABLE]
of an open set , we consider with and . For the sake of clarity of presentation of the proofs, such encodings are used implicitly throughout the paper.
This leads to the following definition.
Definition A.1** (Computational Problem).**
Given a primary set , an evaluation set , a metric space and a problem function we call the collection a computational problem.
The goal is to find algorithms that approximate the function . More generally, we need the concept of a tower of algorithms, which is needed to describe problems that need several limits in the computation. However, first one needs the definition of a general algorithm.
Definition A.2** (General Algorithm).**
Given a computational problem , a general algorithm is a mapping such that for each
- (i)
There exists a finite non-empty subset of evaluations ,
- (ii)
The action of on only depends on where
- (iii)
For every such that for every , it holds that .
Note that the definition of a general algorithm is more general than the definition of a Turing machine or a Blum–Shub–Smale (BSS) machine. A general algorithm has no restrictions on the operations allowed. The only restriction is that it can only take a finite amount of information, though it is allowed to adaptively choose the finite amount of information it reads depending on the input. Condition (iii) assures that the algorithm consistently reads the information. Note that the purpose of such a general definition is to get strong lower bounds. In particular, the more general the definition is, the stronger a lower bound will be.
With a definition of a general algorithm, we can define the concept of towers of algorithms.
Definition A.3** (Tower of Algorithms).**
Given a computational problem , a tower of algorithms of height for is a family of sequences of functions
[TABLE]
where and the functions at the “lowest level” of the tower are general algorithms in the sense of Definition A.2. Moreover, for every ,
[TABLE]
In addition to a general tower of algorithms (defined above), we will focus on arithmetic towers. The definition of a general algorithm allows for strong lower bounds; however, to produce upper bounds we must add structure to the algorithm and towers of algorithms. An arithmetic tower allows for arithmetic operations and comparisons.
Definition A.4** (Arithmetic towers).**
Given a computational problem , where is countable, we define the following: An arithmetic tower of algorithms of height for is a tower of algorithms where the lowest functions satisfy the following: For each the mapping is recursive, the action of on consists of only finitely many arithmetic operations and comparisons on , and is a finite string of complex numbers that can be identified with an element in .
Remark 8** (Recursiveness).**
By recursive we mean the following. If for all , , and is countable, then can be executed by a Turing machine [145], that takes as input, and that has an oracle tape consisting of . If (or ) for all , then can be executed by a Blum–Shub–Smale machine [17] that takes , as input, and that has an oracle that can access any for .
Given the above definitions, we can now define the Solvability Complexity Index:
Definition A.5** (Solvability Complexity Index).**
A computational problem is said to have Solvability Complexity Index , with respect to a tower of algorithms of type , if is the smallest integer for which there exists a tower of algorithms of type of height . If no such tower exists then If there exists a tower of type and height one such that for some , then we define . We may sometimes write to simplify notation when and are obvious.
The definition of the SCI immediately induces the SCI hierarchy:
Definition A.6** (The Solvability Complexity Index Hierarchy).**
Consider a collection of computational problems and let be the collection of all towers of algorithms of type for the computational problems in . Define
[TABLE]
as well as
[TABLE]
In certain cases, the SCI hierarchy can also be refined with notions of error control - see [12, 33, 37, 36]. We also need the following result.
Proposition A.7**.**
Given a matrix and a number one can test with finitely many arithmetic operations on the entries of whether the smallest singular value of is greater than .
Proof.
The matrix is self-adjoint and positive semidefinite, hence has its eigenvalues in . The singular values of are the square roots of these eigenvalues of . The smallest singular value is greater than if and only if the smallest eigenvalue of is greater than , which is the case if and only if is positive definite. The matrix is positive definite if and only if the pivots left after Gaussian elimination (without row exchange) are all positive. Thus, if is positive definite, Gaussian elimination leads to pivots that are all positive, and this requires finitely many arithmetic operations. If is not positive definite, then at some point a pivot is zero or negative, at this point the algorithm aborts. An alternative is the Cholesky decomposition. Although forming the lower triangular (if it exists) such that requires the use of radicals, the existence of can be determined using finitely many arithmetic operations. This follows from the standard Cholesky algorithm, and we omit the details. ∎
Finally, we also need the following result.
Proposition A.8**.**
Let be the discrete space , let denote the collection of all infinite sequence with entries , let consist of pointwise evaluations of the and consider the problem function
[TABLE]
Then
Proof.
Consider the arithmetic tower of algorithms defined by
[TABLE]
This provides a height two arithmetic tower for and hence .
To prove the lower bound, suppose for a contradiction that is a sequence of general algorithms, using , such that
[TABLE]
We will construct a sequence such that does not converge, providing the required contradiction.
Set , then there exists such that . Moreover, for some integer by (i) of Definition A.2. We choose such that for and otherwise. Then there exists such that and . Moreover, for some integer by (i) of Definition A.2. We now repeat this inductively. Explicitly, given the construction up to the th step, we define by for all and otherwise. Then there exists such that and . Moreover, for some integer by (i) of Definition A.2.
Finally set for . It is clear from (iii) of Definition A.2, that and this implies that cannot converge, the required contradiction. ∎
Appendix B Partial Differential Operators - Proof of Theorem 1.1
Before stating and proving a more mathematically precise version of Theorem 1.1, we need to be precise about the computational problems involved. Recall that we consider formally defined on by
[TABLE]
with the class consisting of self-adjoint satisfying certain conditions given in §1.2.1. We take to consist of
[TABLE]
where for all , together with
[TABLE]
such that
[TABLE]
We also implicitly assume that for any given , the dimension and integer (order) are known. As well as this, we need to consider the pairs of vectors (members of ) with which we compute the spectral properties. By the polarisation identity, we can consider equal functions of norm . We let consist of all of norm such that
- (1)
There exists a positive constant and an integer (both possibly unknown) such that
[TABLE]
almost everywhere on , that is, is polynomially bounded. 2. (2)
The restrictions for all .
We then add to the evaluation functions
[TABLE]
where for all , together with
[TABLE]
such that
[TABLE]
With an abuse of notation, we can consider the computational problem from Theorem 3.1
[TABLE]
Recall that is the collection of non-trivial open sets and we have access to a finite or countable collection such that can be written as a disjoint union
[TABLE]
Similarly, from Theorem 4.1 we consider
[TABLE]
We assume that given , we have access to piecewise constant functions supported in such that . Finally, from Theorem 4.2 we consider
[TABLE]
We restrict this map to the quadruples such that is strictly separated from and denote this subclass by .
We can now state the precise form of Theorem 1.1.
Theorem B.1** (Precise form of Theorem 1.1).**
Given the above set-up,
[TABLE]
In other words, we can construct a convergent sequence of arithmetic algorithms for each problem.
Remark 9**.**
The proof will make clear that we can assume different conditions on the operator and function . We simply choose an appropriate basis so that we can apply Theorem B.2. We can also extend this to scalar measures (through inner products) and also to the towers of algorithms (of height ) used to compute the decompositions into pure point, absolutely continuous and singular continuous parts of measures and spectra.
To prove Theorem B.1, we need the following theorem, which is similar to the results of §2.1.
Theorem B.2**.**
Consider the class , where denotes the unit sphere (vectors of norm ). Assume that for each we have access to evaluation functions with
[TABLE]
where the hidden constant depends only on and . Then there exists a sequence of arithmetic algorithms using
[TABLE]
with the following properties:
For all , has finite support with respect to the canonical basis and converges to in as . 2. 2.
For any , there exists a constant such that for all ,
[TABLE]
Proof.
The proof is similar to that of Theorem 2.1. Let . We have that for large since (recall that ). Hence we can define
[TABLE]
Suppose that is large enough so that . Then is a least-squares solution of the optimisation problem . The linear space forms a core of and hence also of . It follows by invertibility of that given any , there exists an and a with such that
[TABLE]
It follows that for all , and hence that
[TABLE]
Since was arbitrary, we see that converges to .
For , define the finite matrices
[TABLE]
Given the evaluation functions in , we have access to the entries of these matrices to asymptotic accuracy (i.e. for a given diverging subsequence , to precision ). It follows that we have access to approximations of and denoted and respectively with
[TABLE]
Recall that the notation also means independently of and other parameters (though it may depend on and ). Note that can be computed using finitely many arithmetic operations and comparisons and the resolvent identity implies that
[TABLE]
From the proof of Proposition A.7 and a simple search routine, we can also compute to accuracy using finitely many arithmetic operations and comparisons. Denote the approximation via . We then define
[TABLE]
where is an approximation of to accuracy . It follows that can be computed using finitely many arithmetic operations. We also have that
[TABLE]
so that converges to as . By construction, has finite support with respect to the canonical basis. Furthermore, since , the following error bound holds for any
[TABLE]
Since we have access to both (norms of the columns of ) and , we can estimate to asymptotic accuracy . It follows that we can can compute, in finitely many arithmetic operations and comparisons, such that
[TABLE]
Similarly, we can estimate to accuracy and call this approximation , and estimate to accuracy and call this approximation . It follows that we have
[TABLE]
It follows that
[TABLE]
For a fixed , and as . It follows that we can compute (again in finitely many arithmetic operations and comparisons) such that
[TABLE]
We know that has norm and hence we must have
[TABLE]
However, we can compute , which converges to zero as . For a given , it follows that we can compute such that
[TABLE]
This implies that and hence by setting
[TABLE]
we see that (B.2) implies (B.1). ∎
Proof of Theorem B.1.
We choose an orthonormal basis of so that we can carry over the results for proven in this paper. In [37] it was shown that (the orthonormal basis of) tensor products of Hermite functions form a core for any . Namely for we choose the Hermite functions
[TABLE]
where
[TABLE]
For we abuse notation and write . The point of this is that by a suitable ordering of , any can be represented by and by with the inner products
[TABLE]
In [37] it was shown, using the theory of quasi-Monte Carlo numerical integration, that the inner products in (B.3)–(B.5) can be computed using to asymptotic error control. In other words, that we can compute any of the evaluation functions in in the statement of Theorem B.2 in finitely many arithmetic operations and comparisons. The result now follows by using Theorem B.2 instead of Corollary 2.2 in simple adaptations of the proofs of Theorems 3.1, 4.1 and 4.2. ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Naum I. Akhiezer. The classical moment problem and some related questions in analysis . Translated by N. Kemmer. Hafner Publishing Co., New York, 1965.
- 2[2] W.O. Amrein and V. Georgescu. On the characterization of bound states and scattering states in quantum mechanics. Helv. Phys. Acta , 46:635–658, 1973/74.
- 3[3] Philip W. Anderson. Absence of diffusion in certain random lattices. Physical Review , 109(5):1492, 1958.
- 4[4] Vegard Antun, Matthew J Colbrook, and Anders C Hansen. Can stable and accurate neural networks be computed? - On the barriers of deep learning and Smale’s 18th problem. ar Xiv preprint ar Xiv:2101.08286 , 2021.
- 5[5] N. Aronszajn. Approximation methods for eigenvalues of completely continuous symmetric operators. In Proceedings of the Symposium on Spectral Theory and Differential Problems , pages 179–202. Oklahoma Agricultural and Mechanical College, Stillwater, Okla., 1951.
- 6[6] William Arveson. Improper filtrations for C ∗ superscript 𝐶 C^{*} -algebras: spectra of unilateral tridiagonal operators. Acta Sci. Math. (Szeged) , 57(1-4):11–24, 1993.
- 7[7] William Arveson. C ∗ superscript 𝐶 C^{*} -algebras and numerical linear algebra. Journal of Functional Analysis , 122(2):333–360, 1994.
- 8[8] William Arveson. The role of C ∗ superscript 𝐶 ∗ C^{\ast} -algebras in infinite-dimensional numerical linear algebra. In C ∗ superscript 𝐶 ∗ C^{\ast} -algebras: 1943–1993 (San Antonio, TX, 1993) , volume 167 of Contemp. Math. , pages 114–129. Amer. Math. Soc., Providence, RI, 1994.
