Fast logarithmic Fourier-Laplace transform of nonintegrable functions
Johannes Lang, Bernhard Frank

TL;DR
This paper introduces a fast, flexible numerical Fourier-Laplace transform method that efficiently handles nonintegrable functions with power-law tails, demonstrating exponential convergence and broad applicability in physical models.
Contribution
It extends the logarithmic Fourier transform to nonintegrable functions, providing a method with proven exponential convergence and practical guidelines for applications involving power-law tails.
Findings
Achieves exponential convergence for a broad class of functions.
Effectively handles functions with power-law asymptotic behavior.
Demonstrates applicability in physical models near criticality.
Abstract
We present an efficient and very flexible numerical fast Fourier-Laplace transform, that extends the logarithmic Fourier transform (LFT) introduced by Haines and Jones [Geophys. J. Int. 92(1):171 (1988)] for functions varying over many scales to nonintegrable functions. In particular, these include cases of the asymptotic form and with arbitrary real . Furthermore, we prove that the numerical transform converges exponentially fast in the number of data points, provided that the function is analytic in a cone with a finite opening angle around the real axis and satisfies as with a positive constant , which is the case for the class of functions with power-law tails. Based on these properties we derive ideal transformation parameters and discuss how the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Fast logarithmic Fourier-Laplace transform of nonintegrable functions
Johannes Lang
Physik Department, Technische Universität München, 85747 Garching, Germany
Bernhard Frank
Physik Department, Technische Universität München, 85747 Garching, Germany
Max-Planck-Institut für Physik komplexer Systeme, 01187 Dresden, Germany
(March 17, 2024)
Abstract
We present an efficient and very flexible numerical fast Fourier-Laplace transform, that extends the logarithmic Fourier transform (LFT) introduced by Haines and Jones [Geophys. J. Int. 92(1):171 (1988)] for functions varying over many scales to nonintegrable functions. In particular, these include cases of the asymptotic form and with arbitrary real . Furthermore, we prove that the numerical transform converges exponentially fast in the number of data points, provided that the function is analytic in a cone with a finite opening angle around the real axis and satisfies as with a positive constant , which is the case for the class of functions with power-law tails. Based on these properties we derive ideal transformation parameters and discuss how the logarithmic Fourier transform can be applied to convolutions. The ability of the logarithmic Fourier transform to perform these operations on multiscale (non-integrable) functions with power-law tails with exponentially small errors makes it the method of choice for many physical applications, which we demonstrate on typical examples. These include benchmarks against known analytical results inaccessible to other numerical methods, as well as physical models near criticality.
I Introduction
In physics, one is often confronted with the need to Fourier transform or convolve functions that are either only numerically available or whose exact transformation is not known. Since the reinvention of the fast Fourier transform (FFT) by Cooley and Tukey FFT1965 , which reduces the numerical cost for both of these operations from to , where denotes the number of grid points, the FFT has been established as the standard method for most situations. However, it necessarily requires an equidistant grid, which is quite inconvenient for many applications in theoretical physics. There, one frequently has to deal with slowly (i.e. algebraically) decaying functions, while the opposite limit of small arguments contains a lot of physical information. An example is provided by Green’s functions in many-body problems with short-range interactions zwer14varenna . To implement an FFT under such circumstances, it is necessary to use a fine grid for small arguments that extends to very high frequencies, which is of course not very practicable due to the huge number of required data points. Consequently, a number of alternative methods have been introduced in the literature: Sometimes, sufficient knowledge about the asymptotic behavior at large arguments can be gained, subtracted and treated separately, such that the remainder of the function under consideration decays fast enough to be amenable to the application of an FFT BDMC2011 ; BDMC2013a ; BDMC2013b . More often, however, it is necessary to waive the advantages of the FFT in favor of a more flexible sampling, specifically adapted to the problem. This, however requires to apply a discrete Fourier transform (DFT) with numerical complexity Num_recipes .
A combination of the best of both worlds, i.e. an scaling on a logarithmic grid, which is able to cover all physically relevant orders of magnitude, has first been proposed by Haines and Jones in form of the logarithmic Fourier transform (LFT), which they have applied in a geophysical context LFT1988 . In its original form however, the LFT is only applicable under very restrictive assumptions on the properties of the function under consideration (e.g. ) and on the allowed range of the trade-off parameter, which is necessary to adjust the LFT according to the asymptotics of .
The aim of this work is to present a generalized version of the logarithmic Fourier-Laplace transformation that in particular applies to functions with nonintegrable power-law tails. We give the corresponding definition in section II and show how the original restrictions can be lifted to extend to generalized functions GelfandBook . Moreover, in section III we give a proof that the LFT converges exponentially fast in the number of grid points used for the numerical evaluation, provided the function satisfies certain analyticity conditions. Furthermore, we discuss how the theorem can be applied for practical purposes and in particular show that functions with algebraic tails are perfectly amenable to the LFT. In section IV, we find an ideal set of the trade-off parameters, based on the asymptotic behavior of the input data and extend the excellent performance of the LFT to convolutions in section V. In section VI we provide several classes of mathematical examples highlighting the advantages of LFTs over FFTs and discuss possible optimizations. Finally, we show in section VII how the LFT can be applied to typical multiscale problems in physics on the example of a density-density correlation function and a simple variant of mode-coupling theory. We conclude in section VIII.
II Definition
II.1 Mathematical Formulation
Following the standard convention in the physics literature, we define the Fourier transform of a function in the time domain as
[TABLE]
while the inverse transform to frequency is given by
[TABLE]
for both . In the following, we utilize the LFT to extend the set of argument functions to include certain distributions, the precise properties of which we state below. We introduce the logarithmic frequency and time coordinates and via
[TABLE]
where are necessary to distinguish between the positive and negative real axis, while the prefactors and are required for dimensional purposes and will be set to unity in the remainder of this paper. With these definitions, the inverse Fourier transform (2) can be written as a convolution for every :
[TABLE]
where denotes the trade-off parameter LFT1988 . By the help of the convolution theorem of Fourier analysis (see also Eq. (39) below), the integral in (4) can be reformulated in terms of the product of two Fourier transforms
[TABLE]
provided that is chosen such that each of the three Fourier integrals converges, the conditions for which we will detail now.
Since we ultimately aim for a numerical implementation, the LFT can in general only be applied if
[TABLE]
such that the Fourier transformation
[TABLE]
exists in the integral sense of Eq. (1). Regarding the original function this statement is equivalent to
[TABLE]
In the particular case of a power-law behavior, i.e. for and for , the trade-off parameter has to be chosen according to
[TABLE]
As a result, for theses functions the LFT even admits a pole of located at the origin or a branch cut beginning just there, as well as nonintegrable, algebraically growing asymptotics, provided that they can be controlled by an appropriate value of .
Applying the definition of the function the -independent inverse Fourier transform in Eq. (5) can be formally rewritten as
[TABLE]
for , where the exclusion of nonpositive integers is due to the poles of the Gamma function . We point out that this result has to be considered as the analytic continuation of the integral representation
[TABLE]
that, indeed, only holds if , as emphasized by Haines and Jones LFT1988 .
Finally, we have to consider the transformation from the auxiliary variable to in Eq. (5). Since in any practical implementation the factor will only be known in an approximate, discretized form, no analytic continuation can be applied and we have to demand that . Given the asymptotics of the product frei05book
[TABLE]
we conclude that requires to satisfy . According to the lemma of Riemann-Lebesgue for differentiable functions koer89book , the latter condition is fulfilled if is at least
[TABLE]
times differentiable with the derivatives F^{({\color[rgb]{0,0,1}l})}_{\sigma}(\omega)\in L_{1}, for . With respect to the original function this implies that exists, while the integrability condition on reduces to Eq. (8), as can be shown by partial integration.
All in all, the logarithmic Fourier transform reads
[TABLE]
which can be applied with a given value of the trade-off parameter to all functions , that satisfy the summability criterion (8) and are times differentiable, with set by Eq. (13).
The computation of the Fourier transformation via the LFT follows analogously, with the same conditions on . It yields the same result as in Eq. (14), yet, with the replacements , , and , as well as an additional factor of on the right-hand side of Eq. (14).
We remark that the LFT can readily be generalized to Fourier-Laplace transforms of the form
[TABLE]
with . The result in (14) still holds, merely with the factor substituted by . Half-sided transforms, which correspond to the standard definition in case of the Laplace transformation, are simply obtained by restricting the outermost sum of Eq. (14) to . Clearly, in most applications Laplace transforms, that is , involve quickly converging integrals. Therefore we will focus on the most critical case of Fourier transforms () and inverse Fourier transforms (), where the transformation kernel entails no exponential suppression of large arguments. Nonetheless, we stress, that even for exponentially decaying integrals the logarithmic transforms are orders of magnitude faster than equidistant grids as is highlighted by the trivial example in section VI.
After having discussed the mathematical framework of the LFT let us briefly comment on the role of (see also Ref. LFT1988 ). The term trade-off parameter refers to the fact that () suppresses both the integrand of the Fourier transformation in the definition (14) (cf. also Eq. (8)) for large (small ) and the result in the () limit, which corresponds to (), due to the overall prefactor. Simultaneously, the convergence in the opposite limits is diminished. This dependence on can be utilized to tune the properties of the LFT to suit the asymptotics of .
A different perspective on the LFT is opened by the interpretation of the trade-off parameter as a shift of the final integration over to a contour in the complex plane. The discussion of the LFT in terms of contour integrals, which are sensitive to the analytic structure of , is crucial to understand the convergence properties of the LFT detailed in section III
II.2 Numerical implementation
So far, we have only utilized exact analytical reformulations of the problem. However, upon introducing exponential grids with index in both frequency and time
[TABLE]
and discretizing the auxiliary space via , the usefulness of the form (14) is immediately revealed: The equidistant grids in and make it possible to take advantage of the efficient FFT algorithm – even for Laplace transforms, where fast algorithms otherwise require more elaborate methods from approximation theory Rokhlin1988 ; Strain1992 – while covering low frequencies and short times with a high density of points, as opposed to a reduced sampling density at large arguments. Since in many physical applications the high-energy or frequency range shows an algebraic behavior, this covering of the frequency (momentum) and time (position) domain will be very favorable under many circumstances. Important physical examples include generic correlation functions in frequency and momentum space, while in a critical theory algebraic tails appear in the position and time argument. For instance the momentum distribution of ultracold Fermions in the vicinity of an open-channel dominated Feshbach resonance chin10Feshbach obeys the Tan energy theorem Tan08energy : For momenta that exceed any intrinsic inverse length scale decays like , where is the observable Tan contact density kuhn11contact ; hoin13contact . On the other hand, the phase transition to the superfluid is signaled by an instability of the pair propagator in the low-momentum limit. In this system, the LFT has been applied to study the phase diagram in the presence of a finite spin imbalance Frank2018 . Furthermore, similar challenges arise in the efficient simulation of analog low/high pass filters Christensen1990 , in the context of signal processing as well as in the numerical solution of differential equations Boyd2001 .
In addition to the convenient distribution of points, the grid (16) acquires a high degree of flexibility as the step sizes and and the linear shifts and , that play the role of the prefactors and , together with can be chosen at will. This allows to adjust the method to the asymptotics of various functions as is shown in section VI. The standard choice for all the shifts is in order to cover positive and negative exponents equally. We will return to the question of how to determine the ideal transformation parameters in section IV.
Before continuing, we remark however, that functions with important features on intermediate scales which cannot be considered as part of the asymptotics of small or large arguments (not even by using the entire set of parameters available in Def. (16)), will yield no advantage over an ordinary FFT. Such cases appear for double-peak structures whose centers are too far apart to be scaled to the high grid-density at without including an impractically large . Similarly, functions that oscillate uniformly on all scales with a fixed frequency will be inevitably undersampled by the given grid at frequencies .
III Convergence properties
III.1 Theoretical perspective
Now we address the issue of how efficiently a function that obeys the properties stated below Eq. (14) can be sampled and then Fourier transformed on the exponential grid. This requires to answer the question of how quickly the sum
[TABLE]
representing the numerical, discrete approximation on the grids defined in Eq. (16) converges towards the exact integral (14) as . First of all, we note that Eq. (17) indeed approaches the LFT from Eq. (14). To see this one has to consider the limits of the largest values at vanishing stepsizes Taking the latter limit yields well-defined integrals on finite intervals, since all terms represent measurable functions. In particular, the sum in the second line can be interpreted as Fourier coefficient of the periodic function with period . The differentiability of then implies the asymptotic behavior with a positive constant koer89book , such that the limit exists and by its uniqueness we recover the definition of the LFT.
Beyond the mere existence, we now show that under conditions satisfied in many relevant application, the LFT converges exponentially fast in the number of grid points.
Theorem: Let be a function that is analytic in a closed strip of width around , i.e. the affinely extended real axis of the logarithmic argument , and whose asymptotic behavior can be controlled by a suitable choice of the trade-off parameter , such that , where denotes the space of Schwartz functions GelfandBook . Then the deviation of the approximation Eq. (17) from the exact expression Eq. (14) vanishes exponentially in the number of grid points .
Proof: The rate of this convergence will not depend on the exact values of the centers of the grids , and . To keep the notation simple, we will in the following assume them to be given by integers.
Obviously, and the Schwartz functions satisfy the differentiability condition (13) by definition. Furthermore, the integral
[TABLE]
is finite and itself a Schwartz function since the integrand is an element of . By virtue of the Paley-Wiener theorem titc75book is analytic in a strip around the real -axis, whose width is determined by the asymptotic decrease of , which at least is exponential. Furthermore, the truncation error due to the finite summation interval, scales like and thus in any case merely gives rise to exponential corrections. Therefore, we consider right away the infinite sum. The latter can be replaced by a contour integral around the imaginary axis in the mathematically positive direction, which reads 111This method of rewriting sums in terms of contour integrals is also used to evaluate Matsubara sums in the context of finite temperature quantum field theory abri75 ; altl2010book ; fett71
[TABLE]
Here is the Bose-Einstein distribution with ”inverse temperature” , whose simple poles at make sure that one recovers the original series with the help of the residue theorem. Subtracting the exact integral , which is also taken along the imaginary axis, one obtains for the difference
[TABLE]
where we have made use of Cauchy’s theorem to deform the integration contour such that it remains within boundary of the analytic domain of (cf. Fig. 1).
Extracting the dominant exponential behavior we can write for the error
[TABLE]
The function arises from the remaining integrals and is the Fourier transformation of an integrable function, which in particular implies that the exponential prefactor indeed yields the leading asymptotic behavior for due to the lemma of Riemann and Lebesgue. Moreover, by increasing the error becomes exponentially small in the number of grid points, provided . From a theoretical perspective, we can take the limit and achieve exponential convergence uniformly in .
Next, one has to investigate the convergence properties of the remaining sum over the auxiliary variable in (17). First, we focus on the properties of the exact integral
[TABLE]
The asymptotics of the product (12) gives at most rise to an algebraic growth, while for the integral decays exponentially fast, thus rendering well-defined. To estimate the error arising from replacing the analytic expression in Eq. (14) by a discretized numerical approximation we consider the difference
[TABLE]
Since the difference becomes exponentially small with decreasing , we can replace the sum by the exact integral . Furthermore, the sum can be extended to because the truncation to neglects only terms that are exponentially suppressed due to the asymptotics of that, provided are large enough, determines the exponential tails of . Then, the error can be treated analogously to Eq. (20) in terms of complex contour integrals by introducing the Bose distribution , which now involves the inverse temperature . In this step we have to analytically continue the integral , which is in general not known in closed form for genuine complex arguments . Yet, performing this continuation numerically is not required as we need the expression only on a formal level to determine the error. Like above, we shift the contour integrals into the complex plane to the fixed finite real parts within the width of the analytic domain of , but have to take into account the simple poles of the function located at the nonpositive integers enclosed by the modified contour. Altogether, we can estimate the error by
[TABLE]
Once again is the Fourier transform of an integrable function and does not overcome the leading exponential such that the first term vanishes exponentially for all in the limit . The second term summarizes the contributions from the residues for and reads
[TABLE]
Note that the Bose functions control the exponential function via in analogy to the first term in Eq. (24).
In total, we observe that both and decrease exponentially in the limit for all , while all intermediate steps do not violate this scaling.
Note that for , which includes the half-sided Laplace transform, convergence is even faster. This, however, takes its toll, when considering the inverse transform, where the exponential growth of in the case of the Laplace transform severely magnifies errors and limits the useful interval in and thereby the attainable precision. For the special case of , this has been analyzed in detail by Epstein and Schotland Epstein2008 , who, given a noise on the input, also derive a bound on the maximum resolution and precision of the numeric inverse Laplace transform:
[TABLE]
As we will see below, this bound can be significantly improved by the use of the theorem in Sec. III.1 in combination with the knowledge of .
III.2 Practical aspects
Regarding the implementation of the LFT for practical purposes, it is helpful to relate the analytic properties of the function in the logarithmic argument to the original argument , since corresponds to the form that is given in most applications. From this we find bounds for for some relevant classes of functions. First of all, the analyticity of implies that is also analytic for . Moreover, the exponential decay of requires that a constant exists, such that
[TABLE]
To connect the analyticity properties of with respect to the variables and , we first note that the analytic strip of width in is equivalent to the statement that for each there is an , such that the Taylor series of
[TABLE]
converges for all . The width of the strip is given by
[TABLE]
To estimate the minimal size of the analytic domain of , we first determine the image of the line , with centered around the real under the mapping (3). This yields circular sectors of radius that are symmetric around the real half-axis and centered at . The half opening angle is given by . The restriction of the angle arises from the separation of the variable with respect to . Taking the union over all , which yields the domain of analyticity of gives rise to an infinite cone with opening angle
[TABLE]
Note that for asymptotically large linear-frequency arguments the required width in space grows linearly, but admits nonanalyticities close to the origin. This is to be expected since nonsmooth variations of that are related to nonanalyticities are very well captured by the exponentially dense grid in the vicinity of the origin. On the other hand, the same behavior at large frequencies will cause deteriorated numerical results due to severe undersampling of sharp features.
In view of these arguments it becomes apparent that algebraic functions with the asymptotic behavior and with are ideal candidates for the application of the LFT, since they trivially satisfy condition (27) and the transformation removes any nonanalyticity located at the origin, which arises from any . We recall that the above considerations do not make any reference to the integrability properties of , which in case of algebraic functions can be controlled by the trade-off parameter.
Another class of asymptotic behavior is given by exponential functions, which we discuss with the help of the simple example of a single, dominant exponent for , with and to include oscillating functions. The prefactor is allowed to contain an arbitrary algebraic function to which the problem would be reduced for or . After the mapping to we have
[TABLE]
For real the limit requires , since otherwise the inner Fourier transform of the LFT in Eq. (14) is not defined. Note that the trade-off parameter cannot be used to remedy the super-exponential growth for , which is also beyond the scope of the notion of generalized Fourier transformations GelfandBook . Furthermore, we observe that even if , the boundary of the analytic strip cannot overcome the constraint
[TABLE]
because diverges exponentially for beyond that value if . Considering an oscillatory example , we obtain , irrespective of an integrable algebraic prefactor. Therefore, the convergence of the LFT is degraded to an algebraic one on a fundamental level as mentioned at the end of Sec. II.
More generally the width of the analytic strip can be determined from the positions of singularities of in the complex plane. Modeling in the vicinity of a nonanalyticity at , where , and , in the form
[TABLE]
with and , we find for the derivative
[TABLE]
This form can be used to extract and therefore and is accessible even for numerical data via finite difference approximations.
Regarding the application of the LFT in practice, we note that it can be implemented with any existing library of FFTs. However, one additionally has to evaluate the Gamma function for complex arguments. Fortunately, these do not depend on and can be tabulated if several transformations have to be performed. In any case, all modern programming languages include fast algorithms (e.g. Spouge’s approximation spou94 ) to compute and the LFT will, therefore, not be severely slowed down compared to an FFT with the same number of data points.
IV Optimal parameter choices
So far, we have shown that the LFT converges exponentially fast towards the exact Fourier transform if the analytic structure of satisfies the conditions of the above theorem. However, we have not yet made any rigorous statements regarding how many points have to be used to reach the desired precision or how the trade-off parameters should be adjusted to obtain an optimal convergence. As we have seen in section III.1, the differences between the exact Fourier transform and the LFT approximant are well known, such that generic statements about the ideal parameter choices, as well as significant improvements to the results, can be made.
In the following, we will focus mainly on algebraic functions, whose convergence properties can be influenced by the trade-off parameter in contrast to exponential functions. First, we recall that the only restriction on is given by the convergence of the inner integral in the LFT (14), thus the trade-off parameter has to be chosen according to and . From a numerical perspective one has to keep in mind that has to avoid nonpositive integers by a finite margin to bypass the poles of the function. In practice, a deviation of 0.01 turns out to be sufficient. Apart from this constraint it is desirable to choose close to that symmetrizes the asymptotic behavior of the integrand in (see Eq. (18)) on both ends of the -interval, such that the smallest truncation errors are achieved for the standard value for the centers of the grids (see Eq. (16)). With this trade-off parameter, using data points, a truncation error no larger than requires
[TABLE]
As argued below equation (12) the decay of the integrand in (22) is dominated by , the asymptotic behavior of which can be estimated from the contour integral (19), which gives rise to the asymptotic behavior . However, approximately at this function drops below the error from Eq. (21). To compute the remaining Fourier transform with truncation errors that are consistent with the previous steps one consequently demands, that from which one concludes
[TABLE]
Together with (35) this fixes the lower bound of points necessary for an absolute accuracy of roughly to
[TABLE]
Remarkably this scales only logarithmically with the desired precision. We emphasize that this statement holds in general, even if the optimal choice of the trade-off parameter is prohibited. In this case only the prefactor increases. However, one might suspect that will be drastically increased by the requirement in order to control the error , according to equation (24). Since the closest non-analyticity of to the real axis appears at a distance , we infer from the asymptotics and that it makes only sense to include values .Therefore, is possible.
In addition, the error due to the proximity between the integration contour and poles of the function does not influence and apart from a prefactor their -dependence is exactly known, as can be seen from Eq. (25). Thus, if the numerical error in the time domain is dominated by these contributions one can fit the residues in to the limits . In these regimes only numerical noise remains, because by virtue of the lemma by Riemann and Lebesgue the exact function has decreased below the desired precision threshold. This procedure works particularly well, since the exponential terms are known exactly (see also the examples in section VI). Moreover, depending on , only a few dominant terms have to be subtracted, while the remaining terms are negligible due to their strictly monotonically decreasing exponents.
Note that this discussion does not include round-off errors. These will give rise to an additional limitation of the attainable precision, since the finite accuracy of the internal numerical operations sets a bound to the possible precision of the LFT and in particular determines how well the decay of for can be resolved. Furthermore, the final multiplication with also affects the error estimate. For negative values of exceptional precision can be achieved in the regime of small . For strongly negative values of , however, these come at the price of enhanced errors at large arguments. As long as round-off errors are ignored, these are a minor problem, since the final Fourier transform in (3) will typically decay to zero at large arguments, which allows to remove the previously discussed systematic errors from (cf. section VI). In practice, round-off errors, unfortunately, dominate at large arguments, which sets a lower boundary to the useful interval of the trade-off parameter. Positive values of on the other hand, which are necessary to treat non-integrable functions, that is those with , will result in undesirably enhanced errors near the origin in the image space (here ). Removal of these errors will typically involve fitting the asymptotic behavior to the numerical data within the range of -values, where can be satisfied and extrapolating it towards . The dynamical compression, that is the diminishing length of this -interval as increases, is the price to pay for numerically Fourier transforming non-integrable functions.
If more than just the minimal number of data points necessary for a given precision are available, one can use them to compensate the enhanced truncation errors and perform several transformations with different trade-off parameters. Larger values of increase precision for , while smaller values enhance the accuracy at negative . If can be varied over a wide interval without creating too large truncation errors, this procedure can, for example, be used to mitigate the impact of dynamical compression (see section VI). To improve the results further one can use to shift the list of points to optimally sample the asymptotics of the function. For an arbitrary value of that is compatible with the convergence requirements the condition translates to
[TABLE]
which reduces to equation (37) and if . Similarly, can be used to find the best distribution of the auxiliary space points .
Finally, if a precision close to the round-off limit is required, cannot be orders of magnitude larger than but instead should stay as close as possible to in the range of arguments of interest.
In case of the inverse Laplace transform we can use the same procedure for the optimization of the transformation parameters on an input with multiplicative noise of amplitude . Given a good estimate of , which equals the width of the analytic strip of minus , this allows us to enhance the relative precision of the result near to , where, as opposed to Eq. (26), no constraint on is required. Note that only for one is struck by the dreaded exponential enhancement of errors.
V LFT Convolutions
One of the most important applications of Fourier transforms in theoretical physics relies on the efficient calculation of convolutions. Due to the convolution theorem
[TABLE]
the computational complexity of the direct discretized evaluation of the integral can be reduced to when using the FFT algorithm. There are, however, many situations, where the convolution theorem may not be utilized. For example, if one of the factors or decays too slowly to be integrable (that is no faster than ), its Fourier transform can no longer be understood as an integral and the identity (39) cannot be used to improve performance, since the FFT will fail to correctly determine either or . Despite these complications, the convolution may still be defined as an ordinary integral (at least as long as the product decays faster than ) and numerical evaluation is cumbersome but straightforward.
Here the LFT really excels. On the one hand, it can be evaluated much faster than any direct evaluation of the convolution (even if performed on an optimized grid) due to its superior scaling in the number of data points. On the other, it is able to cope with non-integrable functions as long as a suitable trade-off parameter exists. In other words, the LFT is much less plagued by convergence problems than the FFT. Slowly decaying functions, as we have already pointed out in the last section, can be numerically transformed with the LFT at the price of dynamical compression that inevitably reduces the signal-to-noise contrast at small arguments in the image space. However, for convolutions this problem is slightly less pronounced: If possible, setting the trade-off parameter of the final back-transform in (39) to , where and are the optimized parameters for the transforms of and , respectively, renders the result unaffected by any dynamical compression in because the noise level in the time domain stays constant at , as the problematic exponential prefactors cancel. In the exotic case of strongly divergent integrals, this value of may not be useful if becomes much larger than the expected result, in which case more data points and the less aggressive, symmetric choice are typically better suited (see last example in VI).
VI Examples and optimizations
To benchmark the LFT and to illustrate the role of the transformation parameters, in particular of , we compute the Fourier transforms for several examples and compare the results to the exact solutions. Without loss of generality, we focus on functions that are centered around the origin and that vary on a characteristic scale of unity. Deviations from that behavior can be remedied by preprocessing the function with a variable transformation which combines a shift of the original argument followed by rescaling it with a proper .
Let us begin with a benign example, a Lorentzian curve
[TABLE]
which could also be transformed with an ordinary fast Fourier transform. However, the slow convergence of the integral implies that reaching a global precision of with the FFT requires roughly data points, which exceeds numerical feasibility by several orders of magnitude. In contrast, to achieve the same accuracy with the LFT only a little more than 300 points suffice, as can be deduced from Eq. (37) with . Indeed, Fig. 2 has been obtained with 360 points and the (quasi-)optimal parameter , since is prohibited by the function. Setting up the LFT in this way, the precision is no longer limited by the finite resolution, but by double-precision floating point arithmetic and error-propagation therein. In addition, the interval in can be chosen arbitrarily by adjusting and with no influence on the error level. As discussed in Sec. IV, due to the proximity to the pole of the function the last point has to be subtracted which corresponds to the constant that arises from the leading contribution to , see Eq. (25). The same procedure, which amounts to nothing else than a trivial subtraction of a one-parameter fit has been used for all other plots (except Fig. 6) as well.
A significantly more demanding example (on the branch where ) is given by the function
[TABLE]
whose Fourier transform has to be understood in the sense of tempered distributions. For positive arguments it reads
[TABLE]
According to section IV, the optimized trade-off parameter is close to , which removes the divergent behavior from the numerical integrals at the price of reduced precision at very small values of . To demonstrate how the ideal choice of might depend on the data range of interest in the image space, Fig. 3 depicts the result for the ideal trade-off parameter and the suboptimal . In order to achieve errors of at in both cases, which requires roughly in the optimized setting, the grid size has been increased to . In agreement with the general discussion, values of larger than reduce errors at large arguments, while those smaller than unity increase precision close to .
The next example shows
[TABLE]
which transforms into
[TABLE]
and is again correctly described by the LFT on only 560 points (see Fig. 4). However, the divergence of as results in an even stronger dynamical suppression than before.
The well-behaved function , which in fact corresponds to the inverse transformation of the very first example (40), could also be treated by an FFT. However, the same accuracy as demonstrated in Fig. 5 with on the logarithmic grid would require more than a million data points on a linear grid, illustrating that even for the most benign functions the LFT can outperform the direct application of an FFT.
The convolution of
[TABLE]
with itself, that appears frequently in the evaluation of Feynman diagrams with non-relativistic propagators abri75 ; fett71 , cannot be treated by FFTs, as the integral over does not exist. Using the LFT remedies this issue by the help of the trade-off parameter. For instance, using the optimized value of given in section IV, a constant error of roughly , which is limited only by the internal floating point precision, is obtained with only points. In Fig. 6 the two leading contributions to from Eq. (25) for the transformation from to with were subtracted by fitting the two corresponding parameters to the high-frequency range near .
Encouraged by these results, one can try to convolve some more exotic functions, for example with itself. In this case neither the convolution as an integral, nor the product of the distributions in the time domain is in general well-defined GelfandBook . Nevertheless, employing a cutoff , with , in the logarithmic frequency space and sending to zero at the end one finds analytically
[TABLE]
As Fig. 7 demonstrates, this result is again very accurately recovered by means of an LFT with . Here, due to the large frequency interval used, round-off errors multiplied by are the limiting factor at large . This affects the choice of trade-off parameters for the forward and backward LFTs, which is expected on general grounds, as remarked at the end of section V on convolutions. Furthermore, the first sub-leading divergence due to the next pole of the function beyond the constant has been fitted with a single parameter against the raw result at and subtracted.
VII Application to physical examples
Following the purely mathematical discussion, we now provide physical examples to highlight the real-world advantages of the LFT. These demonstrations are deliberately chosen to be simple, yet of relevance to current research and with apparent generalizations to more challenging problems.
VII.1 Polarization function
The polarization function of the one-dimensional Bose gas is given by Mahan_book ; Kamenev_book
[TABLE]
with the Bose-Einstein distribution for the inverse temperature and the free dispersion with momentum , mass and chemical potential . describes density-density correlations and in general has no known closed expression. One therefore has to rely on a numerical evaluation of the integral. In case of the fugacity approaching unity from below, the density fluctuations in the regime of long wave lengths proliferate, which is reflected in the singular behavior . As a consequence, the direct evaluation of the polarization function becomes numerically expensive. However, precisely these low temperature correlation functions are a common ingredient in quantum many-body theories, in particular: quantum critical transport sach11 , response near phase transitions in ultracold atoms endr12 and Bose gases in optical cavities rits13 .
In the following, we will show that an efficient evaluation of with unrivaled precision is possible by means of the LFT. The integral in Eq. (47) can be rewritten as a convolution, which allows for an efficient treatment that requires only two one-dimensional (half-sided) Fourier transforms:
[TABLE]
The computation of the polarization function on a two-dimensional -grid of size therefore requires only operations for the evaluation of in contrast to for the direct approach. In fact, the actual fast Fourier transform in Eq. (48b) results only in subleading corrections to the overall complexity. The main advantage of the LFT over other Fourier transforms, however, lies in its accuracy. We highlight this in Fig. 8 by comparing the absolute error obtained for an ordinary FFT, the LFT and a discrete Fourier transform (DFT) in combination with a cubic spline interpolation. All algorithms use the same number of data points as well as optimized transformation parameters, with the DFT and LFT operating on a common grid. For all relevant values the LFT outperforms the other methods by several orders of magnitude, furthermore, in contrast to the FFT a much larger interval can be sampled.
VII.2 Glass transition
The glassy, mechanically rigid state of amorphous materials and its realization by supercooling liquids has been studied for a very long time debe01 . Nevertheless, a theoretical description of this state is difficult since one has to deal with density fluctuations on various length scales and very slow relaxation processes, as observed in experiments stef94 . One theoretical approach to this problem is mode coupling theory reic05 ; goet08 which is based on an effective equation of motion for the dynamical structure factor . In the following, we illustrate how the LFT, which by construction is capable of dealing with multi-scale problems, can be applied to these kinds of models. Here we focus on a simplified variant of mode-coupling theory due to Leutheusser leut84 and Bengtzelius et al. beng84 and remark on the advantageous properties of the LFT for more generic problems of this kind.
To study the relaxation of density distortions one introduces an effective temporal order-parameter , whose phenomenological time evolution is given by leut84
[TABLE]
The left side of the equation is a simple harmonic oscillator with damping rate and frequency . The correlations responsible for the glass transition are incorporated in the memory integral on the right-hand side and weighted by the dimensionless, positive coupling constant . The initial conditions and model the original deviation from the equilibrium state . Despite its simplicity, the above equation takes the basic properties of the glass transition into account which we briefly review before presenting the solution based on the LFT.
The physical order parameter distinguishes between two phases via the long-time limit : The ergodic phase is characterized by perfect relaxation corresponding to , in contrast to the glass phase where the initial distortion never disappears completely and thus . To gain further insight into the phase diagram we apply the half-sided Fourier transformation
[TABLE]
Furthermore, we reparametrize the function to obtain the asymptotics
[TABLE]
irrespective of the phase. The constant value gives rise to a term proportional to in the Fourier transform of Eq. (49) that has to be canceled to satisfy . This is the case if
[TABLE]
which not only determines the asymptotic value of the order parameter but also identifies the critical coupling for the glass transition . As has been shown in Refs. leut84 ; beng84 by analytic means, the approach to the phase boundary is characterized by a divergent low-frequency limit of that follows the power law
[TABLE]
In the ergodic phase the half-sided Fourier transform of Eq. (49) yields the self-consistent relation
[TABLE]
Similarly, in the glass phase one obtains a quadratic equation with the solution
[TABLE]
where in the first line one has to choose the branch that yields a positive , since this function represents a retarded, bosonic correlation function fett71 . The equations (54) or (55) can be solved in an iterative manner, which requires repeated Fourier transformations between the time and frequency spaces. To reliably compute the critical behavior in the vicinity of the glass transition, however, one has to include very long times, especially to capture the extremely slow relaxation when approaching the instability from the ergodic phase. Yet, this is exactly the scenario the LFT has been devised for.
Note that the formulation of Eq. (49) in terms of is not only helpful for analyzing the problem in further detail, but in order to apply the LFT it is also mandatory because satisfies the condition (9). Figure 9 shows at the values in the immediate vicinity of the glass transition. In the ergodic phase the plateau, which characterizes the so-called regime of -relaxation, reaches times of before the final -relaxation to sets in. In addition to the global features of the dynamics, the LFT reproduces the critical exponents from Eq. (53) with a numerical error on the order of (see inset of Fig. 9). To achieve such small errors one can profoundly benefit from the flexibility of the LFT: While the LFTs have to operate on identical and grids, irrespective of the direction of the transformation, the auxiliary space can be sampled for the two directions and independently. Moreover, one can introduce two LFTs for and separately without altering the overall computational cost. In total, the numerical effort to obtain at all times for a given scales like where denotes the number of iterations needed to reach convergence. Using optimized trade-off parameters and a grid of length suffices to produce the results shown in Fig. 9. The small number of data points used in the LFT allows to find the converged order parameter in a couple of seconds, even close to the phase transition, where .
A direct numerical solution of the integro-differential equation (49) on a discretized time axis requires step sizes independent of the magnitude of in order to compute the cancellations between the various terms with sufficient precision. These are responsible for the slow evolution and the formation of the plateau over six orders of magnitude in time. Larger would lead to an instability of the numerical solution that diverges away from the physical . Due to the scaling of a direct approach and limited step size it is numerically completely unfeasible to reach times of order . This, however, is necessary to reliably determine and consequently the critical exponents 222It is worth to mention, that in combination with a partially analytical solution, step sizes are possible. The implementation of such a method is, however, far more complicated and time-consuming than the simple, direct approach presented here Goetze1988 . .
Regarding more complicated versions of mode-coupling theory that resolve the dependence on the length scales, thereby considering the structure factor instead of , the grid size of used here is still small enough to incorporate a second argument without running into memory limitations. If the coupling between different wave vectors can be written in terms of convolutions, which usually is the case reic05 ; goet08 , the LFT can also be applied to simplify the spatial dependence. Very similar problems appear in the context of approximate equations of motions of correlation functions in quantum field theory, which typically include algebraic decays in frequency and momentum space. As mentioned earlier, an example of the application of the LFT in the context of ultracold Fermi gases can be found in Ref. Frank2018 .
VIII Conlcusion
We have shown rigorously that the LFT can be used to numerically transform nonintegrable functions, as long as their asymptotics can be controlled by the trade-off parameter. Furthermore, we have proven that one can achieve exponential convergence in the number of data points if the function is analytic in a cone with finite opening angle around the real axis in the original argument. Finally, we have given several examples that benchmark the superior convergence of the LFT compared to the FFT including functions that have to be considered within the concept of generalized Fourier transformations.
Acknowledgments The authors thank Wilhelm Zwerger for fruitful discussions and comments on the manuscript and Christian Johansen for pointing out erroneous factors of . This work has been supported by the Nanosystems Initiative Munich (NIM).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] James Cooley and John Tukey. An Algorithm for the Machine Calculation of Complex Fourier Series. Mathematics of Computation , 19(90):297–301, 1965.
- 2[2] W. Zwerger. Strongly interacting Fermi gases. In M. Inguscio, W. Ketterle, S. Stringari, and G. Roati, editors, Quantum matter at ultralow temperatures, Proceedings of the International School of Physics ”Enrico Fermi”, Course 191, Varenna, 7-15 July 2014 , pages 63–141. IOS Press, Amsterdam, 2016.
- 3[3] K. Van Houcke, F. Werner, E. Kozik, N. Prokof’ev, B. Svistunov, M. J. H. Ku, A. T. Sommer, L. W. Cheuk, A. Schirotzek, and M. W. Zwierlein. Feynman diagrams versus Fermi-gas Feynman emulator. Nature Physics , 8:366–, March 2012.
- 4[4] R. Rossi, T. Ohgoe, E. Kozik, N. Prokof’ev, B. Svistunov, K. Van Houcke, and F. Werner. Contact and momentum distribution of the unitary fermi gas. Phys. Rev. Lett. , 121:130406, Sep 2018.
- 5[5] K. Van Houcke, F. Werner, T. Ohgoe, N. V. Prokof’ev, and B. V. Svistunov. Diagrammatic monte carlo algorithm for the resonant fermi gas. Phys. Rev. B , 99:035140, Jan 2019.
- 6[6] W.H. Press and W.T. Vetterling. Numerical Recipes in C: The Art of Scientific Computing . Number bk. 4. Cambridge University Press, 1992.
- 7[7] G. V. Haines and Alan G. Jones. Logarithmic Fourier transformation. Geophysical Journal International , 92(1):171–178, 1988.
- 8[8] I.M. Gel’fand and G.E. Shilov. Generalized Functions: Properties and operations, by I. M. Gelf́and and G. E. Shilov, translated by E. Saletan . Generalized Functions. Academic Press, 1964.
