Sparse phase retrieval of one-dimensional signals by Prony's method
Robert Beinert, Gerlind Plonka

TL;DR
This paper demonstrates that sparse signals composed of spikes or B-splines can be almost surely recovered from Fourier intensity measurements using Prony's method, providing a constructive approach and numerical algorithms.
Contribution
It introduces a novel application of Prony's method for sparse phase retrieval from Fourier intensities, including an explicit algorithm for signal reconstruction.
Findings
Recovery is possible from O(N^2) measurements.
The method applies to signals with arbitrary real spike locations or B-spline knots.
Numerical examples validate the proposed algorithm.
Abstract
In this paper, we show that sparse signals f representable as a linear combination of a finite number N of spikes at arbitrary real locations or as a finite linear combination of B-splines of order m with arbitrary real knots can be almost surely recovered from O(N^2) Fourier intensity measurements up to trivial ambiguities. The constructive proof consists of two steps, where in the first step the Prony method is applied to recover all parameters of the autocorrelation function and in the second step the parameters of f are derived. Moreover, we present an algorithm to evaluate f from its Fourier intensities and illustrate it at different numerical examples.
| 1 | -53.5895 | 4.910 + 0.000i | 6 | -28.1475 | 0.278 + 0.598i | 11 | 1.3755 | 2.887 + 3.828i |
|---|---|---|---|---|---|---|---|---|
| 2 | -50.2765 | -0.165 + 0.814i | 7 | -22.6005 | -1.450 + 3.246i | 12 | 20.0945 | -1.423 + 0.397i |
| 3 | -49.3765 | -2.368 – 1.314i | 8 | -19.6495 | 0.508 + 0.243i | 13 | 33.4525 | 0.023 – 2.039i |
| 4 | -42.6915 | -0.293 + 0.541i | 9 | -6.1705 | 0.073 – 0.528i | 14 | 34.8415 | -2.997 + 3.767i |
| 5 | -28.3915 | -1.841 + 2.589i | 10 | -3.8985 | 3.135 + 0.339i | 15 | 53.5895 | -0.064 – 0.368i |
| 1 | -17.022 | 5.342 + 0.000i | 5 | -7.745 | 3.597 – 0.334i | 8 | 2.309 | — |
| 2 | -13.921 | -3.569 + 0.132i | 6 | -4.313 | 0.554 – 2.251i | 9 | 9.318 | — |
| 3 | -9.536 | 0.440 – 1.413i | 7 | -0.336 | -4.072 + 1.433i | 10 | 17.022 | — |
| 4 | -8.301 | -4.685 – 0.499i |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
**Sparse phase retrieval of one-dimensional signals by Prony’s method
** Robert Beinert1 and Gerlind Plonka2
1Institut für Mathematik und Wissenschaftliches Rechnen
Karl-Franzens-Universität Graz
2Institut für Numerische und Angewandte Mathematik
Georg-August-Universität Göttingen
Abstract: In this paper, we show that sparse signals representable as a linear combination of a finite number of spikes at arbitrary real locations or as a finite linear combination of B-splines of order with arbitrary real knots can be almost surely recovered from intensity measurements up to trivial ambiguities. The constructive proof consists of two steps, where in the first step the Prony method is applied to recover all parameters of the autocorrelation function and in the second step the parameters of are derived. Moreover, we present an algorithm to evaluate from its Fourier intensities and illustrate it at different numerical examples.
Key words: Sparse phase retrieval; sparse signals, non-uniform spline functions; finite support; Prony’s method
AMS Subject classifications: 42A05, 94A08, 94A12
1 Introduction
Phase retrieval problems occur in many scientific fields, particularly in optics and communications. They have a long history with rich literature regarding uniqueness of solutions and existence of reliable algorithms for signal reconstruction, see e.g. [SEC*+*15] and references therein. Usually, the challenge in solving one-dimensional phase retrieval problems is to overcome the strong ambiguousness by determining appropriate further information on the solution signal. Previous literature on characterization of ambiguities of the phase retrieval problem with given Fourier intensities is often concerned with the discrete problem, where a signal in or has to be recovered. For an overview on the complete characterization of nontrivial ambiguities is this discrete case as well as on appropriate additional signal information we refer to our survey [BP15a] and further recent results in [BP17, Bei17a, Bei17b].
Contribution of this paper. In this paper, we consider the continuous one-dimensional sparse phase retrieval problem to reconstruct a complex-valued signal from the modulus of its Fourier transform. Applications of this problem occur in electron microscopy, wave front sensing, laser optics [SST04, SSD*+*06] as well as in X-ray crystallography and speckle imaging [RCLV13]. For the posed problem, we will show that for sparse signals the given Fourier intensities are already sufficient for an almost sure unique recovery, and we will give a construction algorithm to recover .
We assume that the sparse signal is either of the form
[TABLE]
or, for ,
[TABLE]
with , for , where denotes the Delta distribution, and is the B-spline of order being determined by the (real) knots . We want to recover these signals from the Fourier intensities and will show that only samples are needed to recover , i.e. all coefficients , and knots , , almost surely up to trivial ambiguities. The proposed procedure is constructive and consists in two steps. In a first step, we employ Prony’s method in oder to recover all parameters of the (squared) Fourier intensity function . In a second step, we recover the parameters and the complex coefficients that determine the desired signal.
Related work on sparse phase retrieval. While the general phase retrieval problem has been extensively studied for a long tome, the special case of sparse phase retrieval grew to a strongly emerging field of research only recently, particularly often connected with ideas from compressed sensing. Most of the papers consider a discrete setting, where the -dimensional real or complex -sparse vector has to be reconstructed from measurements of the more general form with vectors forming the rows of a measurement matrix . The needed number of measurements depends on the sparsity .
If presents rows of a Fourier matrix, this setting is close to the sparse phase retrieval problem considered in optics, see e.g. [JOH13]. Here the problem is first rewritten as (non-convex) rank minimization problem, then a tight convex relaxation is applied and the optimization problem is solved by a re-weighted -minimization method. The related approach in [ESM*+*15] employs the magnitudes of the short-time Fourier transform and applies the occurring redundancy for unique recovery of the desired signal. A corresponding reconstruction algorithm is then based on an adaptation of the GESPAR algorithm in [SBE14].
In [LV13], the measurement matrix is taken with random rows and the PhaseLift approach [CSV13] leads to a convex optimization problem that recovers the sparse solution with high probability. Employing a thresholded gradient descent algorithm to a non-convex empirical risk minimization problem that is derived from the phase retrieval problem, Cai et al. [CLM16] have established the minimax optimal rates of convergence for noisy sparse phase retrieval under sub-exponential noise.
Other papers rely on the compressed sensing approach to construct special frame vectors to ensure uniqueness of the phase retrieval problem with high probability, where the number of needed vectors is , see e.g. [WX14, OE14, IVW17].
We would like to emphasize that all approaches employing general or random measurement matrices in phase retrieval are quite different in nature from our phase retrieval problem based on Fourier intensity measurements. In this paper, we want to stick on considering Fourier intensity measurements because of their particular relevance in practice.
Early attempts to exploit sparsity of a discrete signal for unique recovery using Fourier intensities go back to unpublished manuscripts by Yagle [Yaga, Yagb], where a variation of Prony’s method is applied in a non-iterative algorithm to sparse signal and image reconstruction. Unfortunately, the algorithm proposed there not always determines the signal support correctly.
The continuous one-dimensional phase retrieval problem has been rarely discussed in the literature, see [Wal63, Hof64, RCLV13, Bei17b, BP15b]. In the preprint [RCLV13], the authors also considered the recovery of sparse continuous signals of the form (1.1). However, in that paper the sparse phase retrieval problem is in turn transferred into a turnpike problem that is computationally expensive to solve. Moreover there exist cases, where a unique solution cannot be found, see [Blo75]. Our method circumvents this problem by proposing an iterative procedure to fix the signal support (resp. the knots of the signal represented as a B-spline function) where the corresponding signal coefficients are evaluated simultaneously.
Organization of this paper. In Section 2, we shortly recall the mathematical formulation of the considered sparse phase retrieval problem and the notion of trivial ambiguities of the phase retrieval problem that always occur.
Section 3 is devoted to the special case of phase retrieval for signals of the form (1.1). Using Prony’s method, we give a constructive proof for the unique recovery of the -sparse signal up to trivial ambiguities using Fourier intensity measurements. Here we have to assume that the knot differences are pairwise different.
In Section 4, the ansatz is generalized to the unique recovery of spline functions of the form (1.2) where we need to employ Fourier intensity measurements. In Section 5, we present an explicit algorithm for the considered sparse phase retrieval problem and illustrate it at different examples.
2 Trivial ambiguities of the phase retrieval problem
We wish to recover an unknown complex-valued signal of the form (1.1) or (1.2) with compact support from its Fourier intensity given by
[TABLE]
Unfortunately, the recovery of the signal is complicated because of the well-known ambiguousness of the phase retrieval problem. Transferring [BP15a, Proposition 2.1] to our setting, we can recover only up to the following ambiguities.
Proposition 2.1**.**
Let be of a signal of the form (1.1) or a non-uniform spline function of the form (1.2). Then
- \edefitn(i)
the rotated signal for , 2. \edefitn(ii)
the time shifted signal for , 3. \edefitn(iii)
and the conjugated and reflected signal
have the same Fourier intensity .
Proof 1**.**
Applying the properties of the Fourier transform, we have
- (i)
** 2. (ii)
** 3. (iii)
**
Considering the absolute value of each equation yields the assertion.
Although the ambiguities in Proposition 2.1 always occur, they are of minor interest because of their close relation to the original signal. For this reason, we call ambiguities caused by rotation, time shift, conjugation and reflection, or by combinations of these trivial. In the following, we will show that for the considered sparse signals the remaining non-trivial ambiguities only occur in rare cases.
3 Phase retrieval for distributions with discrete support
Initially, we restrict ourselves to the recovery of signals of the form (1.1) with complex-valued coefficients and spike locations .
[TABLE]
and the known squared Fourier intensity can be represented by
[TABLE]
Thus, in order to recover being determined by the coefficients and the knots , , we will recover all parameters of the exponential sum in (3.1) in a first step and then derive the desired parameters of in a second step.
3.1 First step: Parameter recovery by Prony’s method
Assuming that the non-zero knot differences with are pairwise different, and denoting the distinct frequencies in increasing order by with , we can rewrite (3.1) as
[TABLE]
with the related coefficients for the non-zero frequencies and for the zero frequency. Since , the coefficients in (3.2) fulfill the conjugated symmetry .
In order to recover the parameters and the unknown coefficients from the exponential sum (3.2) we employ Prony’s method [Hil87, PT14]. Let be chosen such that for all .
Using the intensity values , , the unknown parameters and in (3.2) can be determined by exploiting the algebraic Prony polynomial defined by
[TABLE]
where denote the coefficients in the monomial representation of . Obviously, is always a monic polynomial, which means that .
Using the definition of the Prony polynomial in (3.3), we observe that
[TABLE]
for . Consequently, the vector of remaining coefficients of the Prony polynomial can be determined by solving the linear equation system
[TABLE]
with and . Since the Hankel matrix can be written as
[TABLE]
with the Vandemonde matrix , the linear equation system (3.4) possesses a unique solution if and only if the unimodular values differ pairwise for . This assumption has been ensured by choosing an such that , since the had been supposed to be pairwise different.
Knowing the coefficients of , we can determine the unknown frequencies by evaluating the roots of the Prony polynomial (3.3). The coefficients can now be computed by solving the over-determined equation system
[TABLE]
with a Vandermonde-type system matrix.
The procedure summarized above is the usual Prony method, adapted to the non-negative exponential sum in (3.2). In the numerical experiments in Section 5, we will apply the approximate Prony method (APM) in [PT10]. APM is based on the above considerations but it is numerically more stable and exploits the special properties and for .
Let us now investigate the question, how many intensity values are at least necessary for the recovery of in (3.2). Counting the number of unknowns of in (3.2), we only need to recover the real values and , , , for . We will show now that using the special structure of the real polynomial in (3.2) and of the Prony polynomial in (3.3), we indeed need only exact equidistant real measurements , to recover all parameters determining . This can be seen as follows.
Reconsidering in (3.3) with and , we obtain
[TABLE]
where all occurring coefficients are real. Moreover, since
[TABLE]
is antisymmetric, it follows that
[TABLE]
and particularly . In order to determine the unknown coefficients , of
[TABLE]
we employ (3.2) and observe that for ,
[TABLE]
Therefore, the vector of unknown coefficients can be already evaluated from the system
[TABLE]
The parameters are then extracted from the zeros of , and the coefficients , , are computed as in (3.5) but with .
3.2 Second step: Unique signal recovery
Having determined the parameters as well as the corresponding coefficients of (3.2), we want to reconstruct the parameters and , , of in (1.1) in a second step.
Theorem 3.1**.**
*Let be a signal of the form (1.1), whose knot differences differ pairwise for with , and whose coefficients satisfy . Further, let be a step size such that for all . Then can be uniquely recovered from its Fourier intensities with up to trivial ambiguities. *
Proof 2**.**
Applying Prony’s method to the given data , we can compute the frequencies and the related coefficients of the squared Fourier intensity (3.2). Again, we assume that the frequencies occur in increasing order and, further, denote the list of positive frequencies by .
Obviously, the maximal distance now corresponds to the length of the unknown in (1.1). Due to the trivial shift ambiguity, we can assume without loss of generality that and . Further, the second largest distance corresponds either to or to . Due to the trivial reflection and conjugation ambiguity, we can assume that . By definition, there exists a in our sequence of parameters such that , and hence corresponds to the knot difference . Thus, we obtain
[TABLE]
These equations lead us to
[TABLE]
and thus to
[TABLE]
Since can only be recovered up to a global rotation, we can assume that is real and non-negative, which allows us to determine the coefficients , , and in a unique way.
To determine the remaining coefficients and support knots of , we notice that the third largest distance corresponds either to or to . As before, we always find a frequency such that .
Case 1: If , then we have
[TABLE]
with the related coefficient . Moreover, we have such that
[TABLE]
Case 2: If , then we have
[TABLE]
with the related coefficient and . Thus,
[TABLE]
However, only one of the two equalities in (3.6) and (3.7) can be true, since if both were true then and lead to
[TABLE]
*contradicting the assumption that . Consequently, either the equation in (3.6) or the equation in (3.7) holds true and we can either determine with or with . Removing all parameters from the sequence of distances that correspond to the differences of the recovered knots, we can repeat this approach to find the remaining coefficients and knots of inductively. *
If we identify the space of complex-valued signals of the form (1.1) with the real space , the condition that two knot differences and are equal for fixed indices , , , and defines a hyper plane with Lebesgue measure zero. An analogous observation follows for the condition . The signals excluded in Theorem 3.1 hence form a negligible null set.
Corollary 3.2**.**
*Almost all signals in (1.1) can be uniquely recovered from their Fourier intensities up to trivial ambiguities. *
Remark 3.3**.**
1. Since the proof of Theorem 3.1 is constructive, it can be used to recover an unknown signal (1.1) analytically and numerically. If the number of spikes is known beforehand then the assumption of Theorem 3.1 can be simply checked during the computation. If the assumption regarding pairwise different distances is not satisfied, then the application of Prony’s method in the first step yields less than pairwise distinct parameters . The second assumption can be verified in the second step, where , , and are evaluated.
*2. A similar phase retrieval problem had been transferred to a turnpike problem in [RCLV13]. The turnpike problem deals with the recovery of the knots from an unlabeled set of distances. Although this problem is solvable under certain conditions, a backtracing algorithm can have exponential complexity in the worst case, see [LSS03]. *
4 Retrieval of spline functions with arbitrary knots
In this section, we generalize our findings to spline functions of order . Let us recall that the B-splines in (1.2) being generated by the knot sequence are recursively defined by
[TABLE]
with
[TABLE]
see for instance [Boo78, p. 131]. Further, we notice that for the th derivative of the spline in (1.2) is given by
[TABLE]
where the coefficients are recursively defined by
[TABLE]
with the convention that , see [Boo78, p. 139]. For , equation (4.1) coincides with a step function, i.e., with the right derivative of the linear spline . Further, in a distributional manner, the th derivative of is given by
[TABLE]
with the coefficients
[TABLE]
and the Dirac delta distribution .
Applying the Fourier transform to (4.2), we now obtain
[TABLE]
and thus
[TABLE]
Since the exponential sum on the right-hand side of (4.4) has exactly the same structure as the exponential sum in (3.2), we can immediately generalize Theorem 3.1 by considering
[TABLE]
Theorem 4.1**.**
*Let be a spline function of the form (1.2) of order , whose knot distances differ pairwise for with , and whose coefficients satisfy . Further, let be a step size such that for all . Then can be uniquely recovered from its Fourier intensities with up to trivial ambiguities. *
Proof 3**.**
The statement can be established by proceeding in the same manner as in Section 3. First we apply Prony’s method to the given samples with in order to determine the coefficients and frequencies of in (4.5). In a second step, the values and in (4.3) can be determined analytically as discussed in Theorem 3.1. Reversing the definition of , we can finally compute the unknown coefficients by
[TABLE]
with and , which finishes the proof.
Corollary 4.2**.**
*Almost all spline functions of order in (1.2) can be uniquely recovered from their Fourier intensities up to trivial ambiguities. *
5 Numerical experiments
Since the proofs of Theorem 3.1 and Theorem 4.1 are constructive, they can be straightforwardly transferred to numerical algorithms to recover a spline function from its Fourier intensity. However, the classical Prony method introduced in Section 3.1 is numerically unstable with respect to inexact measurements and to frequencies lying close together. For this reason, there are numerous approaches to improve the classical method. In order to verify Theorem 3.1 and Theorem 4.1 numerically, we apply the so-called approximate Prony method (APM) proposed by Potts and Tasche in [PT10, Algorithm 4.7] for recovery of parameters of an exponential sum of the form
[TABLE]
with and . The algorithm can be summarized as follows, where the exact number of the occurring frequencies in (5.1) needs not be known beforehand.
Algorithm 5.1** (Approximate Prony method [PT10]).**
Input: upper bound of the number of exponentials; measurements with and ; accuracies , , and .
Compute a right singular vector corresponding to the smallest singular value of the rectangular Hankel matrix . 2. 2.
Evaluate the roots of the polynomial with and . 3. 3.
Compute a right singular vector corresponding to the second smallest singular value of the rectangular Hankel matrix . 4. 4.
Evaluate the roots of the polynomial with and . 5. 5.
Determine all frequencies of the form if there exist indices and with , and denote the number of found frequencies by . 6. 6.
Compute the coefficients as least squares solution of the over-determined linear system
[TABLE]
with by using the diagonal preconditioner
[TABLE] 7. 7.
Delete all pairs with . 8. 8.
Repeat step 6 with respect to the remaining frequencies .
Output: coefficients and frequencies .
A second adaption of the proof of Theorem 4.1 concerns the reconstruction of the coefficients from the recovered coefficients . In order to describe the relation between the coefficients as linear equation system, we define the rectangular matrices for elementwise by
[TABLE]
Then, the recursion between the coefficients and can be stated as
[TABLE]
where we use the coefficient vectors . Instead of computing the coefficients stepwise from left to right, we can determine the coefficients by solving the over-determined linear equation system
[TABLE]
With these modifications, we recover a spline function of order from its Fourier intensity by the following algorithm.
Algorithm 5.2** (Phase retrieval).**
Input: Fourier intensities with , step size , order of the spline function, upper bound of the number of knots with , accuracy .
Compute the squared Fourier intensity of the th derivative of the spline at the given points by
[TABLE] 2. 2.
Apply the approximate Prony method (Theorem 5.1) to determine the knot distances with in increasing order and the corresponding coefficients . 3. 3.
Update the reconstructed distances and coefficients by
[TABLE]
for . 4. 4.
Set , , and ; find the index with ; and compute the corresponding coefficients by
[TABLE]
as well as
[TABLE]
Initialize the lists of recovered knots and coefficients by
[TABLE]
and remove the used knot distances from the set . 5. 5.
For the maximal remaining distance in , determine the index with .
- (a)
If , the knot distance corresponds to the centre of the interval . Thus append by and by . 2. (b)
Otherwise, compute the values and . If
[TABLE]
then assume that (3.7) with , , instead of , , holds true and append by and by , else assume that (3.6) with , , instead of , , holds true and append by and by .
Remove all distances between the new knot and the already recovered knots from and repeat step 5 until the set is empty. 6. 6.
Determine the coefficients by solving the over-determined equation system (5.2).
Output: knots and coefficients of the signal (1.1) or the spline function in (1.2) .
Example 5.3**.**
In the first numerical example, we consider a spike function as in (1.1) with 15 spikes. More precisely, the locations and the coefficients of the true spike function are given in Table 1. In order to recover from the Fourier intensity measurements with and with , we apply Algorithm 5.2 with the accuracies , , , and . The results of the phase retrieval algorithm and the absolute errors of the knots and coefficients of the recovered spike function are shown in Figure 1. Although the approximate Prony method has to recover 211 knot differences, the knots and coefficients of are reconstructed very accurately.
Example 5.4**.**
In the second example, we apply Algorithm 5.2 to recover the piecewise quadratic spline function () in (1.2) with the knots and coefficients in Table 2 from the Fourier intensity measurements with and with . As accuracies for the phase retrieval algorithm and the approximate Prony method, we choose , , , and . In Figure 2, the recovered function is compared with the true signal. Again, the reconstructed knots and coefficients have only very small absolute errors.
Acknowledgements
The first author gratefully acknowledges the funding of this work by the Austrian Science Fund (FWF) within the project P 28858, and the second author the funding by the German Research Foundation (DFG) within the project PL 170/16-1. The Institute of Mathematics and Scientific Computing of the University of Graz, with which the first author is affiliated, is a member of NAWI Graz (http://www.nawigraz.at/).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1]
- 2[Bei 17a] Beinert , Robert: Non-negativity constraints in the one-dimensional discrete-time phase retrieval problem . 2017. – to appear, DOI 10.1093/imaiai/iaw 018, ar Xiv:1605.05482
- 3[Bei 17b] Beinert , Robert: One-dimensional phase retrieval with additional interference measurements . 2017. – to appear, DOI 10.1007/s 00025-016-0633-9, ar Xiv:1604.04489 v 1
- 4[Blo 75] Bloom , G.S.: A counterexample to a theorem of S. Piccard. In: J. Comb. Theory A 22 (1975), No. 3, pp. 378–379
- 5[Boo 78] Boor , Carl de: A Practical Guide to Splines . New York : Springer-Verlag, 1978 (Applied Mathematical Sciences 27)
- 6[BP 15a] Beinert , Robert ; Plonka , Gerlind: Ambiguities in one-dimensional discrete phase retrieval from Fourier magnitudes. In: Journal of Fourier Analysis and Applications 21 (2015), December, No. 6, pp. 1169–1198
- 7[BP 15b] Beinert , Robert ; Plonka , Gerlind: Ambiguities in one-dimensional phase retrieval of structured functions. In: PAMM, Proceedings in Applied Mathematics and Mechanics 15 (2015), October, No. 1, pp. 653–654
- 8[BP 17] Beinert , Robert ; Plonka , Gerlind: Enforcing uniqueness in one-dimensional phase retrieval by additional signal information in time domain . 2017. – to appear, ar Xiv:1604.04493 v 1
