Phaseless compressive sensing using partial support information
Zhiyong Zhou, Jun Yu

TL;DR
This paper investigates conditions for accurately recovering real signals from phaseless measurements using weighted minimization, especially when partial support info is available, and introduces new theoretical guarantees.
Contribution
It provides a strong restricted isometry property condition and a weighted null space property for successful phaseless signal recovery with partial support information.
Findings
Established a strong restricted isometry property condition.
Derived the weighted null space property as a necessary and sufficient condition.
Numerical experiments validate the theoretical results.
Abstract
We study the recovery conditions of weighted minimization for real-valued signal reconstruction from phaseless compressive sensing measurements when partial support information is available. A strong restricted isometry property condition is provided to ensure the stable recovery. Moreover, we present the weighted null space property as the sufficient and necessary condition for the success of -sparse phaseless recovery via weighted minimization. Numerical experiments are conducted to illustrate our results.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSparse and Compressive Sensing Techniques · Photoacoustic and Ultrasonic Imaging · Electrical and Bioimpedance Tomography
Phaseless compressive sensing using partial support information
Zhiyong Zhou111Corresponding author, [email protected]., Jun Yu
Department of Mathematics and Mathematical Statistics, Umeå University,
Umeå, 901 87, Sweden
: We study the recovery conditions of weighted minimization for real-valued signal reconstruction from phaseless compressive sensing measurements when partial support information is available. A strong restricted isometry property condition is provided to ensure the stable recovery. Moreover, we present the weighted null space property as the sufficient and necessary condition for the success of -sparse phaseless recovery via weighted minimization. Numerical experiments are conducted to illustrate our results.
: Phaseless compressive sensing; Partial support information; Strong restricted isometry property; Weighted null space property.
1 Introduction
Compressive sensing aims to recover an unknown signal from the underdetermined linear measurements (see [8, 9] for a comprehensive view). It is known as phase retrieval or phaseless compressive sensing when there is no phase information. The phaseless compressive sensing problem has recently attracted considerable research interests and many algorithms have been proposed to solve this problem. Existing literature include [2, 3, 4, 7, 12, 14, 16], to name a few. Specifically, the goal of phaseless compressive sensing is to recover up to a unimodular scaling constant from noisy magnitude measurements with the measurement matrix , and the noise term . When is sparse or compressible, the stable recovery can be guaranteed by solving the following minimization problem
[TABLE]
provided that the measurement matrix satisfies the strong restricted isometry property (SRIP) [11, 17]. In the noiseless case, the first sufficient and necessary condition was presented in [18] by proposing a new version of null space property for the phase retrieval problem.
In this paper, we generalize the existing theoretical framework for phaseless compressive sensing to incorporate partial support information, where we consider the case that an estimate of the support of the signal is available. We follow the similar notations and arguments in [10, 20]. For an arbitrary signal , let be its best -term approximation, so that minimizes over all -sparse vectors . Let be the support of , where and . Let , the support estimate, be a subset of with cardinality , where and with . Here the parameter determines the ratio of the size of the estimated support to the size of the actual support of (or the support of if is -sparse), while the parameter determines the ratio of the number of indices in the support of that are accurately estimated in to the size of , i.e., . To incorporate prior support information , we adopt the weighted minimization
[TABLE]
We present the SRIP condition and weighted null space property condition to guarantee the success of the recovery via the weighted minimization problem above.
The paper is organized as follows. In Section 2, we introduce the definition of SRIP and present the stable recovery condition with this tool. In Section 3, the sufficient and necessary weighted null space property condition for the real sparse noise free phase retrieval is given. In Section 4, some numerical experiments are presented to illustrate our theoretical results. Finally, Section 5 is devoted to the conclusion.
Throughout the paper, for any vector , we denote the norm by for and the weighted norm as . For any matrix , denotes the entry-wise norm. For any set , we denote its cardinality as . The vector is called -sparse if at most of its entries are nonzero, i.e., if , where denotes the index set of the nonzero entries. We denote the index set . For a matrix and an index set , we denote the sub-matrix of where only rows with indices in are kept, i.e., .
2 SRIP
To recover sparse signals via minimization in the classical compressive sensing setting, [5] introduced the notion of restricted isometry property (RIP) and established a sufficient condition. We say a matrix satisfies the RIP of order if there exists a constant such that for all -sparse vectors we have
[TABLE]
Cai and Zhang [1] proved that the RIP of order with where can guarantee the exact recovery in the noiseless case and stable recovery in the noisy case via minimization. This condition is sharp when , see [1] for details. Very recently, Chen and Li [6] generalized this sharp RIP condition to the weighted minimization problem when partial support information was incorporated. We first present the following useful lemma, which is an extension of the result in [6].
Lemma 1
Let with , and . Suppose that satisfies RIP of order with for some , where and
[TABLE]
with . Then for any
[TABLE]
we have
[TABLE]
where
[TABLE]
Remark 1 Note that if is the solution of the weighted minimization problem:
[TABLE]
then with . Therefore, this lemma is an extension of Theorem 3.1 in [6] by letting and . The proof follows from almost the same procedure for the proof of Theorem 3.1 in Section 4 of [6] via replacing the with , and letting . In order not to repeat, we leave out all the details. In addition, this result also generalizes the Lemma 2.1 in [11], which is the special case with the noise term , and . This lemma will play a crucial role in establishing the stable phaseless recovery result via weighted minimization later on.
To address the phaseless compressive sensing problem (2), a stronger version of RIP is needed. Its definition is provided as follows.
Definition 1
(SRIP [11, 17]) We say a matrix has the Strong Restricted Isometry Property (SRIP) of order with bounds if
[TABLE]
*holds for all -sparse vectors , where . We say has the Strong Lower Restricted Isometry Property of order with bound if the lower bound in (6) holds. Similarly, we say has the Strong Upper Restricted Isometry Property of order with bound if the upper bound in (6) holds.
Next, we present the conditions for the stable recovery via weighted minimization by using SRIP.
Theorem 1
Let with . Adopt the notations in Lemma 1 and assume that satisfies the SRIP of order with bounds such that
[TABLE]
Then any solution of (2) satisfies
[TABLE]
*where and are constants defined in Lemma 1.
Remark 2 As it has been proved in [17] that Gaussian matrices with satisfy SRIP of order with high probability, thus the stable recovery result (8) can be achieved by using Gaussian measurement matrix with appropriate number of measurements .
Remark 3 Note that when the weight , we have . Then, by assuming and is exactly -sparse, our theorem reduces to Theorem 2.2 in [17]. That is, if satisfies the SRIP of order with bounds and , then for any -sparse signal we have . Similarly, if we let the noise term , and , this theorem goes to Theorem 3.1 in [11].
Remark 4 If , we have . The sufficient condition (7) of Theorem 1 is identical to that of Theorem 2.2 in [17] and that of Theorem 3.1 in [11]. And the constants (see Theorem 3.1 in [11]). In addition, if and , then and . The sufficient condition (7) in Theorem 1 is weaker than that of Theorem 2.2 in [17] and that of Theorem 3.1 in [11]. In this case, the constants .
Set . We illustrate how the constants , and change with for different values of in Figure 1. In all the plots, we set . In the plot of , we set and , then . In the plots of and , we fix and . Note that if or , then , and . And it shows that decreases as increases, which means that the sufficient condition (7) becomes weaker as increases. For each , the sufficient condition becomes stronger ( increases) as increases. For instance, if of the support estimate is accurate () and , we have , while for standard minimization (). The opposite conclusion holds for the case . In addition, as increases, the constant decreases with and . Meanwhile, the constant with is smaller than that with .
Proof of Theorem 1. For any solution of (2), we have
[TABLE]
and
[TABLE]
If we divide the index set into two subsets
[TABLE]
then it implies that
[TABLE]
Here either or . If , we use the fact that
[TABLE]
Then, we obtain
[TABLE]
Since satisfies SRIP of order with bounds and
[TABLE]
therefore, the definition of SRIP implies that satisfies the RIP of order with
[TABLE]
Thus, by using Lemma 1 with , we have
[TABLE]
Similarly, if , we obtain the other corresponding result
[TABLE]
The proof of Theorem 1 is now completed.
3 Weighted Null Space Property
In this section, we consider the noiseless weighted minimization problem, i.e.,
[TABLE]
We denote the kernel space of by and denote the -sparse vector space .
Definition 2
The matrix satisfies the -weighted null space property of order if for any nonzero and any with it holds that
[TABLE]
*where is the complementary index set of and is the restriction of to .
Remark 5 Obviously, when the weight , the weighted null space property reduces to the classical null space property. And according to the specific setting of , the expression (13) is equivalent to
[TABLE]
where (see [13] for more arguments).
It is known that a signal can be recovered via the weighted minimization problem if and only if the measurement matrix has the weighted null space property of order . We state it as follows (see [19]):
Lemma 2
Given , for every -sparse vector it holds that
[TABLE]
*if and only if satisfies the -weighted null space property of order .
Next, we extend Lemma 2 to the following theorem on phaseless compressive sensing for the real-valued signal reconstruction.
Theorem 2
*The following statements are equivalent:
(a) For any -sparse , we have*
[TABLE]
(b) For every , it holds
[TABLE]
*for all nonzero and satisfying .
Remark 6 If , then Theorem 2 reduces to Theorem 3.2 in [18]. Since when , and otherwise, the expression (15) is equivalent to
[TABLE]
Proof of Theorem 2. The proof follows from the proof of Theorem 3.2 in [18] with minor modifications. First we show . Assume (b) is false, that is, there exist nonzero and such that
[TABLE]
and . Now set , obviously for , we have
[TABLE]
since either or . In other words . Note that , for otherwise we would have , which is a contradiction. Then, it follows from (a) that we obtain
[TABLE]
This is a contradiction. Thus, (b) holds.
Next we prove . Let where . For a fixed , we set . We now consider the following weighted minimization problem:
[TABLE]
Its solution is denoted as . Then, we claim that for any , if exists (it may not exist), we have
[TABLE]
and the equality holds if and only if .
To prove the claim, we assume such that . First note that the statement (b) implies the classical weighted null space property of order . To see this, for any nonzero and with , we set , and . Then, we have and . Therefore, the statement (b) now implies
[TABLE]
As a consequence, we have by Lemma 2. And, similarly we have . Next, for any , if doesn't exist then we have nothing to prove. Assume it does exist, set . Then
[TABLE]
Set and . Obviously, and . Furthermore, . Then, by the statement (b), we have
[TABLE]
This proves (a) and the proof is completed.
4 Simulations
In this section, we present some simple numerical experiments to illustrate the benefits of using weighted minimization to recover sparse and compressible signals when partial prior support information is available in the phaseless compressive sensing case. In order to facilitate the computation, we follow a non-standard noise model:
[TABLE]
where is a noise term with . Then the weighted minimization goes to
[TABLE]
Here we adopt the compressive phase retrieval via lifting (CPRL) algorithm developed in [15] to solve this phaseless recovery problem. By using a lifting technique, this problem can be rewritten as a semidefinite program (SDP). More specifically, given the ground truth signal , let be an induced rank-1 semidefinite matrix. We further denote , a linear operator of as
[TABLE]
and the weight matrix . Then the phaseless vector recovery problem (18) can be cast as the following rank-1 matrix recovery problem:
[TABLE]
This is of course still a non-convex problem due to the rank constraint. The lifting approach addresses this issue by replacing with . This leads to an SDP:
[TABLE]
where is a design parameter. Then the estimate of can be finally be found by computing the rank-1 decomposition of the recovered matrix via singular value decomposition.
The recovery performance is assessed by the average reconstruction signal to noise ratio (SNR) over 10 experiments. The SNR is measured in dB and it is given by
[TABLE]
where is the true signal and is the recovered signal. For all the experiments, we fix the parameter . In the experiments where the measurements are noisy, we set the noise with and .
4.1 Sparse Case
We first consider the case that is exactly sparse with an ambient dimension and fixed sparsity . The sparse signals are generated by choosing nonzero positions uniformly at random, and then choosing the nonzero values from the standard normal distribution for these k nonzero positions. The recovery is done via (19) using a support estimate of size (i.e., ).
Figure 2 shows the recovery performances for different and with an increasing number of measurements , both in the noise free and noisy cases. It can be observed that when , the best recovery is achieved for very small whereas a results in the lowest SNR for both cases. On the other hand, when , the performance of the recovery algorithms is better for large than that for small . The case results in the lowest SNR. When , the performance gaps for different are not particularly large and it seems that a medium () achieves the best recovery. In the noise free case, a perfect recovery can be achieved as long as the number of measurements is large enough. As is also expected that in all settings, comparing to the noise free case, we have a lower SNR in the noisy case. These findings are largely consistent with the theoretical results provided in Section 2.
4.2 Compressible Case
Here we generate a signal whose coefficients decay like where and . This kind of signal itself is not sparse, but can be well approximated by an exactly sparse signal. For this experiment, we set , i.e., we use the best 4-term approximation. We fix as in the sparse case. The phaseless recovery results are presented in Figure 3. It shows that on average a mediate value of () results in the best recovery. In general, when , smaller favours better reconstruction results. The opposite conclusion holds for the case that . Therefore, as is expected that the behaviors that occur in the exactly sparse case also occur in the compressible case.
5 Conclusion
In this paper, we established the sufficient SRIP condition and the sufficient and necessary weighted null space property condition for phaseless compressive sensing using partial support information via weighted minimization, and we conducted some numerical experiments to illustrate the theoretical results.
Some further problems are left for future work. As we only consider the real-valued signal reconstruction case, it will be challenging to generalize the present results to the complex-valued signal case. Besides it will be very interesting to construct the measurement matrix satisfying the weighted null space property given in (15) directly.
Acknowledgements
This work is supported by the Swedish Research Council grant (Reg.No. 340-2013-5342).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Cai, T. T. and Zhang, A. (2014). Sparse representation of a polytope and recovery of sparse signals and low-rank matrices. IEEE Transactions on Information Theory 60 (1) 122–132.
- 2[2] Candes, E. J., Eldar, Y. C., Strohmer, T. and Voroninski, V. (2015). Phase retrieval via matrix completion. SIAM review 57 (2) 225–251.
- 3[3] Candes, E. J., Li, X. and Soltanolkotabi, M. (2015). Phase retrieval via Wirtinger flow: Theory and algorithms. IEEE Transactions on Information Theory 61 (4) 1985–2007.
- 4[4] Candes, E. J., Strohmer, T. and Voroninski, V. (2013). Phaselift: Exact and stable signal recovery from magnitude measurements via convex programming. Communications on Pure and Applied Mathematics 66 (8) 1241–1274.
- 5[5] Candes, E. J. and Tao, T. (2005). Decoding by linear programming. IEEE Transactions on Information Theory 51 (12) 4203–4215.
- 6[6] Chen, W. and Li, Y. (2016). Recovery of signals under the high order RIP condition via prior support information. ar Xiv preprint ar Xiv:1603.03464.
- 7[7] Chen, Y. and Candes, E. (2015). Solving random quadratic systems of equations is nearly as easy as solving linear systems. In Advances in Neural Information Processing Systems (pp. 739–747).
- 8[8] Eldar, Y. C. and Kutyniok, G. (2012). Compressed Sensing: Theory and Applications. Cambridge University Press.
