Sparse Bayesian mass-mapping with uncertainties: hypothesis testing of structure
Matthew A. Price, Jason D. McEwen, Xiaohao Cai, Thomas D. Kitching,, Christopher G. R. Wallis (for the LSST Dark Energy Science Collaboration)

TL;DR
This paper introduces a Bayesian mass-mapping method that quantifies uncertainties and enables hypothesis testing of structures, improving the reliability of weak lensing reconstructions without assuming Gaussianity.
Contribution
The authors develop a convex optimization-based Bayesian framework for mass-mapping that provides conservative uncertainty estimates and hypothesis testing capabilities for structures.
Findings
Method successfully applied to simulations and observational data.
Neither dataset conclusively confirms the dark core hypothesis at 99% confidence.
Reconstructed maps are consistent with observational data.
Abstract
A crucial aspect of mass-mapping, via weak lensing, is quantification of the uncertainty introduced during the reconstruction process. Properly accounting for these errors has been largely ignored to date. We present a new method to reconstruct maximum a posteriori (MAP) convergence maps by formulating an unconstrained Bayesian inference problem with Laplace-type l1-norm sparsity-promoting priors, which we solve via convex optimization. Approaching mass-mapping in this manner allows us to exploit recent developments in probability concentration theory to infer theoretically conservative uncertainties for our MAP reconstructions, without relying on assumptions of Gaussianity. For the first time these methods allow us to perform hypothesis testing of structure, from which it is possible to distinguish between physical objects and artifacts of the reconstruction. Here we present this newâŠ
| Input | KS | KS | Sparse | Difference |
|---|---|---|---|---|
| Smooth | ||||
| SNR (dB) | ||||
| 500 | 2.917 | 6.276 | 27.506 | + 21.230 |
| 100 | -4.497 | 5.774 | 21.955 | + 16.181 |
| 30 | -10.400 | 5.340 | 21.462 | + 16.122 |
| 10 | -15.970 | 5.041 | 14.409 | + 9.368 |
| Pearson Correlation | ||||
| 500 | 0.166 | 0.902 | 0.977 | + 0.075 |
| 100 | 0.076 | 0.796 | 0.970 | + 0.174 |
| 30 | 0.039 | 0.689 | 0.955 | + 0.266 |
| 10 | 0.029 | 0.716 | 0.949 | + 0.233 |
| Test | Initial | Threshold | Surrogate | Reject |
| ? | ||||
| Bolshoi-1 | ||||
| H1 | 95426 | 163408 | 805513 | â |
| H2 | 95426 | 163408 | 134080 | |
| H3 | 95426 | 163408 | 100582 | |
| Bolshoi-2 | ||||
| H1 | 97121 | 165103 | 824260 | â |
| H2 | 97121 | 165103 | 221492 | â |
| H3 | 97121 | 165103 | 366981 | â |
| Bolshoi-3 | ||||
| H1 | 83419 | 151401 | 369939 | â |
| H2 | 83419 | 151401 | 234305 | â |
| H3 | 83419 | 151401 | 314089 | â |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Sparse Bayesian mass-mapping with uncertainties: hypothesis testing of structure
M. A. Price1, J. D. McEwen1, X. Cai1, T. D. Kitching1, C. G. R. Wallis1 (for the LSST Dark Energy Science Collaboration)
1Mullard Space Science Laboratory, University College London, RH5 6NT, UK. E-mail: [email protected]
(Accepted XXX. Received YYY; in original form ZZZ)
Abstract
A crucial aspect of mass-mapping, via weak lensing, is quantification of the uncertainty introduced during the reconstruction process. Properly accounting for these errors has been largely ignored to date. We present a new method to reconstruct maximum a posteriori (MAP) convergence maps by formulating an unconstrained Bayesian inference problem with Laplace-type -norm sparsity-promoting priors, which we solve via convex optimization. Approaching mass-mapping in this manner allows us to exploit recent developments in probability concentration theory to infer theoretically conservative uncertainties for our MAP reconstructions, without relying on assumptions of Gaussianity. For the first time these methods allow us to perform hypothesis testing of structure, from which it is possible to distinguish between physical objects and artifacts of the reconstruction. Here we present this new formalism, demonstrate the method on simulations, before applying the developed formalism to two observational datasets of the Abel-520 cluster. Initial reconstructions of the Abel-520 catalogs reported the detection of an anomalous âdark coreâ â an over dense region with no optical counterpart â which was taken to be evidence for self-interacting dark-matter. In our Bayesian framework it is found that neither Abel-520 dataset can conclusively determine the physicality of such dark cores at confidence. However, in both cases the recovered MAP estimators are consistent with both sets of data.
keywords:
gravitational lensing: weak â (Cosmology:) dark matter â methods: statistical â methods: data analysis â techniques: image processing
â â pubyear: 2018â â pagerange: Sparse Bayesian mass-mapping with uncertainties: hypothesis testing of structureâReferences
1 Introduction
Gravitational lensing is an astrophysical phenomenon, that can be observed on galactic to cosmic spatial scales, through which distant images are distorted by the intervening mass density field. Due to its nature, lensing is sensitive to the total mass distribution (both visible and invisible) along a line of sight (Bartelmann & Schneider, 2001; Schneider, 2005; Munshi et al., 2008; Heavens, 2009). Therefore, as the majority of massive structures in the universe are predominantly dark matter, lensing provides a novel way to probe the nature of dark matter itself. Weak gravitational lensing (WL) is a regime in which one makes the approximation that lensed sources have (at no time) come radially closer than an Einstein radius to the intervening mass concentrations ââwhich ensures that sources are not multiply imaged. The effect of weak lensing on distant source galaxies is two-fold: the galaxy size is magnified by a convergence field ; and the galaxy ellipticity (third-flattening) is perturbed from an underlying intrinsic value by a shearing field .
Due to the mass-sheet degeneracy the weak lensing convergence field is not directly observable. In the weak lensing regime, the shearing field does not suffer such degeneracies and can accurately be modelled from observed ellipticities. Therefore, observations of are typically inverted to recover estimators of . Such estimators are colloquially named dark matter mass-maps, and constitute one of the principle observables for cosmology (Clowe et al., 2006). Standard cosmological protocol is to extract weak lensing information in the form of second order statistics (Alsing et al., 2016; Taylor et al., 2018; Kilbinger, 2015) which are then compared to theory. In this approach mass-maps are not required. However, as two-point global statistics are by definition sensitive only to Gaussian contributions, and weak lensing is inherently non-Gaussian, it is informative to consider higher-order statistics (Munshi & Coles, 2017; Coles & Chiang, 2000). Many higher-order statistical techniques can be performed directly on mass-maps (-fields), which motivates investigation into alternate mass-map reconstruction methodologies.
Reconstructing mass-maps from shear observations requires solving an ill-posed (often seriously) inverse problem. Many approaches to solving this lensing inverse problem have been developed (e.g. VanderPlas et al., 2011; Kaiser & Squires, 1993; Lanusse et al., 2016; Wallis et al., 2017; Jeffrey et al., 2018; Chang et al., 2018), with the industry standard being Kaiser-Squires (KS, Kaiser & Squires, 1993). Although these approaches often produce reliable convergence estimators, they lack principled statistical approaches to uncertainty quantification and often assume Gaussianty during the reconstruction process, or post-process by Gaussian smoothing, which is sub-optimal when one wishes to analyze small-scale non-Gaussian structure.
Most methods refrain from quantifying uncertainties in reconstructions, but those that do often do so by assuming Gaussian priors and adopting Markov-chain Monte-Carlo (MCMC) techniques (Corless et al., 2009; Alsing et al., 2016; Schneider et al., 2015).The computational cost of MCMC approaches is large. Recent developments in probability concentration theory have led to advancements in fast approximate uncertainty quantification techniques (Pereyra, 2017; Cai et al., 2017a, b).
In this article we present a new mass-mapping formalism. We formulate the lensing inverse problem as a sparse hierarchical Bayesian inference problem from which we derive an unconstrained convex optimization problem. We solve this optimization problem in the analysis setting, with a wavelet-based, sparsity-promoting, -norm prior ââsimilar priors have been shown to be effective in the weak lensing setting (Jeffrey et al., 2018; Lanusse et al., 2016; Peel et al., 2017; Leonard et al., 2014). Formulating the problem in this way allows us, for the first time, to recover maximum a posteriori (MAP) estimators, from which we can exploit analytic methods (Pereyra, 2017; Cai et al., 2017b) to recover approximate highest posterior density (HPD) credible regions, and perform hypothesis testing of structure in a variety of ways. We apply our algorithm to a range of catalogs drawn from N-body simulations ââBolshoi cluster catalogues (Klypin et al., 2011) ââand the debated A520 cluster catalogs (Clowe et al., 2012; Jee et al., 2014). We then demonstrate the aforementioned uncertainty quantification techniques on our MAP reconstructions from these catalogs.
The structure of this article is as follows. In section 2 we provide a brief overview of the weak lensing paradigm and motivate a sparsity-based approach. In section 3 we provide the details of our algorithm, as well as some updates to super-resolution image recovery. In section 4 we present the uncertainty quantification techniques, both mathematically and mechanistically. In sections 5 and 6 we apply both our reconstruction algorithm and the uncertainty quantification techniques to the aforementioned datasets and analyze the results. Finally, in section 7 we draw conclusions from this work and propose future avenues of research.
Section 3 relies on a moderate level of understanding in the fields of proximal calculus and compressed sensing, and section 4 relies on a general understanding of Bayesian inference. As such, for the reader solely interested in practical application of these techniques we recommend sections 5 onwards.
2 Weak Gravitational Lensing
The following section presents a brief review of the mathematical background relevant to the weak lensing formalism, though a deeper description can be found in popular review articles (Bartelmann & Schneider, 2001; Schneider, 2005).
2.1 Weak lensing regime
Gravitational lensing refers to the deflection of distant photons as they propagate from their origin to us, the observer. This deflection is caused by local Newtonian potentials which are, in turn, sourced by the total local matter over or under density. As such, weak lensing is sensitive to both the visible and invisible matter distribution ââmaking it an ideal probe of dark matter in the Universe.
The weak gravitational lensing regime is satisfied when propagating photons (from a distant source) have an angular position on the source plane (relative to the line-of-sight from observer through the lensing mass) greater than the Einstein radius of the intervening mass. This assertion ensures that the solution of the first order lens equation is singular:
[TABLE]
Where the Einstein radius is defined to be:
[TABLE]
where is the angular diameter distance in a cosmology with curvature , is the speed of light in a vacuum, is the gravitational constant and is the lensing mass. Perhaps more generally the weak lensing regime can be defined as convergence fields for which â ensuring that the shear signal remains linear.
Due to the sparse nature of the distribution of galaxies across the sky, most sources are (to a good approximation) within the weak gravitational lensing regime. The weak gravitational lensing effect is best expressed in terms of a lensing potential , defined to be the integral of the Newtonian potential along a given line of sight:
[TABLE]
where and are co-moving distances, and are angular spherical co-ordinates. The local Newtonian potential must satisfy the Poisson equation and as such is related to the matter over-density field:
[TABLE]
where is the matter density parameter, is the current Hubble constant, is the scale factor, and is the fractional over-density.
To first order, there are two primary ways in which light from distant sources is distorted by this lensing potential. Images are magnified by a spin-0 convergence field and sheared by a spin-2 shear field . These quantities can be shown (Bartelmann & Schneider, 2001) to be related to the lensing potential by:
[TABLE]
where and are the spin raising and lowering operators respectively and are in general defined to be,
[TABLE]
Where we have omitted spin subscripts for clarity.
2.2 Standard mass-mapping techniques
Typically we wish to make inferences about the projected matter over-density which is most directly accessible by inverting the integral equation (Schneider, 2005)
[TABLE]
This poses a difficulty as the convergence is only determined to the degeneracy and is therefore not directly observable â this degeneracy is often referred to as the mass-sheet degeneracy. However, as the intrinsic ellipticity distribution of galaxies has zero mean, if one averages many galaxy ellipticities within a given pixel the true shear can be recovered â which makes an observable field. As such one typically collects observations of which are and subsequently used to construct estimators of .
For small sky fractions we can approximate the field of view as a plane (though this approximation degrades quickly with sky fraction; Wallis et al. 2017). In this planar approximation and reduce to (Bunn et al., 2003a):
[TABLE]
Combining equations (5) and (6) we find the planar forward model in Fourier space:
[TABLE]
with the mapping operator being,
[TABLE]
Hereafter we drop the subscripts for clarity. It is informative to note that this forward model is undefined at the origin () ââwhich corresponds to the mass-sheet degeneracy (Bartelmann & Schneider, 2001)
The most naive inversion of this forward model is Kaiser-squires (KS) inversion,
[TABLE]
which is direct inversion in Fourier space (Kaiser & Squires, 1993). KS inversion of the forward model, given by equation (11), performs adequately, provided the space over which it is defined is complete, and the sky fraction is small. However, masking and survey boundaries are inherent in typical weak gravitational lensing surveys, leading to significant contamination of the KS estimator. Often maps recovered with the KS estimator are convolved with a Gaussian kernel to reduce the impact of these contaminations but this is sub-optimal. This smooths away a large fraction of the small-scale non-Gaussian information, which cosmologists are increasingly interested in extracting from weak gravitational lensing surveys.
3 Sparse MAP Estimators
Several alternate approaches for solving the inverse problem between convergence and shear which do not assume or impose Gaussianity have been proposed, some of which are based on the concept of wavelets and sparsity (Lanusse et al., 2016; Pires et al., 2009; Jullo et al., 2014; Peel et al., 2017).
We propose a mass-mapping algorithm that relies on sparsity in a given wavelet dictionary. Moreover, we formulate the problem such that we can exploit recent developments in the theory of probability concentration, which have been developed further to produce novel uncertainty quantification techniques (Pereyra, 2017). Crucially, this allows us to recover principled statistical uncertainties on our MAP reconstructions (as in Cai et al., 2017a, b) as will be discussed in detail in the following section.
As mentioned previously, galaxies have an intrinsic ellipticity. To mitigate the effect of intrinsic ellipticity we choose to project the ellipticity measurements onto a grid and average. If we assume that galaxies have no preferential orientation in the absence of lensing effects, then the average intrinsic ellipticity tends to zero. This is a good approximation for the purposes of this paper, but weak correlation between the intrinsic alignments of galaxies has been observed (Troxel & Ishak, 2015; Piras et al., 2018).
3.1 Hierarchical Bayesian Framework
Hierarchical Bayesian inference provides a rigorous mathematical framework through which theoretically optimal solutions can be recovered. Moreover it allows one to construct measures of the uncertainty on recovered point estimates.
As is common for hierarchical Bayesian models, we begin from Bayesâ theorem for the posterior distribution,
[TABLE]
where is the likelihood function representing data fidelity, is the dimensionality of and is a prior on the statistical nature of . The denominator is called the Bayesian evidence which is constant and so can be dropped for our purposes. Typically the Bayesian evidence is used for model comparison, which we will not be considering within the context of this paper. Given Bayesâ theorem, and the monotonicity of the logarithm function, we can easily show that the maximum posterior solution is defined by,
[TABLE]
This step is crucial, as it allows us to solve the more straightforward problem of minimizing the log-posterior rather than maximizing the full posterior. Conveniently, in most physical situations the operators associated with the log-posterior are convex. Drawing from the field of convex optimization, the optimal solution for the posterior can be recovered extremely quickly ââeven in high dimensional settings.
3.2 Sparsity and Inverse problems
Let be the discretized complex shear field extracted from an underlying discretized convergence field by a measurement operator . In the planar setting can be modeled by,
[TABLE]
Here is the discrete fast Fourier transform (FFT), is the inverse discrete fast Fourier transform (IFFT), is a standard masking operator, and is a diagonal matrix applying the scaling of the forward model in Fourier space as defined in equation (12). In the case of independent and identically distributed i.i.d. Gaussian noise, measurement of will be contaminated such that:
[TABLE]
where is additive i.i.d. Gaussian noise of variance for pixel . Often in weak gravitational lensing experiments the total number of binned measurements is less than the number of pixels to be recovered, , and the inverse problem becomes ill-posed.
In such a setting the Bayesian likelihood function (data fidelity term) is given by the product of Gaussian likelihoods defined on each pixel with pixel noise variance , which is to say an overall multivariate Gaussian likelihood of known covariance . Let be the value of at pixel , then the overall likelihood is then defined as,
[TABLE]
where is the -norm and is a composition of the measurement operator and an inverse covariance weighting. Effectively this covariance weighting leads to measurements which whiten the typically non-uniform noise variance in the observational data .
This likelihood function allows one to map from the number count of observations per pixel to a corresponding noise variance (assuming an intrinsic ellipticity dispersion of ), from which the noise (under and central limit theory argument of Gaussianity) may be correctly incorporated into the reconstruction. In practice this requires only the number density of observations per pixel, which is trivially inferred from raw observational data catalogues.
To regularize this inverse problem, we then define a sparsity promoting Laplace-type prior:
[TABLE]
where is an appropriately selected wavelet dictionary, and is a regularization parameter ââeffectively a weighting between likelihood and prior. Note that one may choose any convex log-prior within this formalism e.g. an -norm prior from which one essentially recovers Weiner filtering (see Padmanabhan et al., 2003; Horowitz et al., 2018, for alternate iterative Weiner filtering approaches). From equations (14) and (15) the unconstrained optimization problem which minimizes the log-posterior is,
[TABLE]
where the bracketed term is called the objective function. To solve this convex optimization problem we adopt a forward-backward splitting algorithm (e.g. Combettes & Pesquet, 2009). A full description of this algorithm applied in the current context is outlined in Cai et al. (2017b).
Let denote our prior term, and denote our data fidelity term. Then our optimization problem can be re-written compactly as,
[TABLE]
The forward-backward iteration step is then defined to be,
[TABLE]
for iteration , with gradient,
[TABLE]
If the wavelet dictionary is a tight frame (i.e. ) the proximity operator is given by,
[TABLE]
where is the point-wise soft-thresholding operator (Combettes & Pesquet, 2009) and is a parameter related to the step-size (which is in turn related to the Lipschitz differentiability of the log-prior) which should be set according to Cai et al. (2017b). The iterative algorithm is given explicitly in the primary iterations of algorithm 1. Adaptations for frames which are not tight can be found in Cai et al. (2017b) and are readily available within our framework.
Our algorithm has distinct similarities to the GLIMPSE algorithm presented by Lanusse et al. (2016), but crucially differs in several aspects. Most importantly we formulate the problem in a hierarchical Bayesian framework which allows us to recover principled statistical uncertainties. In addition to this we include Bayesian inference of the regularization parameter, a robust estimate of the noise-level (which can be folded into the hierarchical model), and we use super-resolution operators instead of non-discrete fast Fourier transforms.
3.3 Reduced Shear
Due to a degeneracy between and the true observable quantity is in fact the reduced shear (Bartelmann & Schneider, 2001),
[TABLE]
Deep in the weak lensing regime one can safely approximate which ensures that the optimization problem remains linear. However, when reconstructing regions close to massive structures (galaxy clusters) this approximation is no longer strictly valid and we must unravel this additional factor. We adopt the procedure outlined in Wallis et al. (2017), which we also outline schematically in Figure 1 ââthis method can be found in detail in Mediavilla et al., pg 153. We find that these corrections typically converge after 5-10 iterations.
3.4 Regularization Parameter Selection
One key issue of sparsity-based reconstruction methods is the selection of the regularization parameter . Several methodologies have arisen (Lanusse et al., 2016; Peel et al., 2017; Paykari et al., 2014; Jeffrey et al., 2018) for selecting , though often the regularization parameter is chosen somewhat arbitrarily ââas the integrity of the MAP solution is assumed to be weakly dependent on the choice of . However, to extract principled statistical uncertainties on the recovered images, one must select this parameter in a principled statistical manner.
We apply the hierarchical Bayesian formalism developed by Pereyra et al. (2015) ââthe details of which are elegantly presented by the authors. Though we will outline roughly the underlying argument here.
First define a sufficient statistic to be -homogeneous if such that,
[TABLE]
All norms, composite norms and composition of norms with linear operators are 1-homogeneous ââand so our -norm has of 1. If a sufficient statistic is -homogeneous, then the normalization factor of is given by (Pereyra et al., 2015),
[TABLE]
where is a constant independent from . The proposed Bayesian inference model then implements a gamma-type hyper-prior ââwhich is a typical hyper-prior for scale-parameters,
[TABLE]
where without loss of generality . The result is effectively insensitive to their value (in numerical experiments values of produced essentially no difference in ).
Now, let us extend the inference problem of the log-posterior to the case where is an additionally unknown parameter. In this context we compute the joint MAP estimator which maximizes such that,
[TABLE]
where is the -dimensional null vector and is the set of sub-gradients of function at . This in turn implies both that,
[TABLE]
and
[TABLE]
From equation (30) we recover the optimization problem with known regularization parameter given in equation (20). However, from equations (27, 28, 31) it follows that the MAP regularization parameter is given by (Pereyra et al., 2015),
[TABLE]
where we recall that is the total dimension of our convergence space.
It is precisely this optimal value which we wish to use in our hierarchical Bayesian model. Hereafter we drop the map superscript from for clarity. To calculate we perform preliminary iterations defined by:
[TABLE]
where is our likelihood term and,
[TABLE]
Typically we find that these preliminary iterations take 5-10 iterations to converge, and recover close to optimal parameter selection for a range of test cases â note that here the optimal selection of is that which maximizes the SNR of a recovered image.
Another factor which can influence the quality of reconstructions is the selection of wavelet dictionary. In this paper we consider Daubechies (8 levels) and SARA dictionaries (Carrillo et al., 2012; Carrillo et al., 2013), though a wide variety of wavelet dictionaries exist, see e.g. starlets (Starck et al., 2015). The 8-level SARA dictionary is a combination of the Dirac and Daubechies 1 to 8 wavelet dictionaries. It is important to note that we use the SARA dictionary, not the complete SARA scheme (Carrillo et al., 2012; Carrillo et al., 2013), which involves an iterative re-weighting scheme that is not considered here.
3.5 Super-Resolution Image Recovery
Gridding of weak lensing data is advantageous in that it can provide a good understanding of the noise properties ââa necessary feature for principled uncertainty quantification. However, an inherent drawback of projecting data into a grid is the possibility of creating an incomplete space due to low sampling density â often referred to as masking. Decomposition of spin signals on bounded manifolds is inherently degenerate (Bunn et al., 2003b); specifically the orthogonality of eigenfunctions is locally lost at the manifold boundaries, leading to signal leakage between Fourier (or on the sphere, harmonic) modes.
One approach to mitigate this problem is to avoid the necessity of gridding by substituting a non-uniform discrete Fourier transform (NFFT) into the RHS of equation (16) as presented by Lanusse et al. (2016). A downside of this NFFT approach is that the noise is more difficult to handle, leading to complications when considering uncertainty quantification. Another approach is to perform super-resolution image recovery, which we present in the context of our algorithm.
Suppose the dimension of our gridded measurement space is , as before, and the desired dimension of our solution space is , where . In this setting we have shear measurements and recovered convergence . Let us now define a super-resolution (subscript SR) measurement operator to be,
[TABLE]
where is a high resolution (dimension ) fast Fourier transform, is a Fourier space down-sampling which maps on to , where tilde represents Fourier coefficients, is the planar forward model given by equation (11), and is a standard masking operator. Finally, is a low resolution (dimension ) inverse fast Fourier transform. For completeness the super-resolution adjoint measurement operator is given by,
[TABLE]
where is adjoint masking (gridding), is the adjoint of (which is self-adjoint hence ), and is zero padding in Fourier space which acts by mapping to . Note that when considering the KS estimate in the super-resolution setting a rescaling function to account for the different Fourier normalization factors must be introduced (which we absorb into the Fourier operators). As before, this super-resolution measurement operator is concatenated with the inverse covariance weighting to form an analogous composite operator which is used throughout the following analysis.
Conceptually super-resolution allows partial inpainting of higher resolution Fourier modes. In this way one is able to recover high resolution structure for images from comparatively low resolution datasets. Such high resolution structure is of course dependent on the prior information injected when solving the inverse problem. Interestingly this raises another consideration: in scenarios where the pixel-level observation count is very low the noise level dilutes high frequency components and can limit the efficacy of reconstruction algorithms. In such a setting gridding observational data onto a lower resolution map, with inherently lower pixel-level noise, and performing a super-resolution reconstruction can recover far better estimates of the high frequency modes, and thus often recovers greater reconstruction fidelity.
4 Bayesian Uncertainty Quantification
Estimators recovered from algorithms of the form presented in the previous section are MAP solutions to, in general, ill-conditioned inverse problems, and as such have significant intrinsic uncertainty. Theoretically, MCMC techniques could be applied to recover the complete posterior in the context of Gaussian (Alsing et al., 2016; Schneider et al., 2015) and sparsity-promoting (Cai et al., 2017a; Pereyra, 2013) priors but these approaches are computationally demanding for high dimensional problems where is large. As can easily be larger than (e.g. when considering resolution images), MCMC approaches are often not feasible.
In Pereyra (2017) a methodology based on probability concentration is presented, which uses MAP estimators to estimate theoretically conservative approximate Bayesian credible regions (specifically highest posterior density credible regions) of the posterior, . As this approach requires only knowledge of the MAP solution and the objective function, the Bayesian credible regions can be approximated efficiently in high dimensional settings.
4.1 Highest Posterior Density Regions
A posterior credible region at confidence level is a sub-set which satisfies the integral,
[TABLE]
where is the set indicator function for defined by and [math] elsewhere. One possible region which satisfies this property is the Highest Posterior Density (HPD) region defined by,
[TABLE]
where defines an iso-contour (i.e. level-set) of the log-posterior set such that the integral in (37) is satisfied. This region can be shown (Robert, 2001) to have minimum volume and is thus decision-theoretically optimal. However, due to the dimensionality of the integral in (37) calculation of the HPD credible region is difficult. A conservative approximation of was recently proposed (Pereyra, 2017) and shown to be effective in the inverse imaging setting of radio interferometric imaging (Cai et al., 2017b). This approximate HPD is defined by
[TABLE]
where the approximate threshold is given by
[TABLE]
with constant . For a detailed derivation of this approximation see Pereyra (2017). Provided \alpha\in\big{(}4\exp(-N/3)\;,1\big{)} the deviation of this adapted threshold is bounded and grows at most linearly with respect to . The error of this approximate threshold is bounded by
[TABLE]
where . In high dimensional settings ( large) this error may naively appear large, however in practice the error is relatively small.
4.2 Hypothesis Testing
Extending the concept of HPD credible regions, one can perform knock-out hypothesis testing of the posterior to determine the physicality of recovered structure (Cai et al., 2017b).
To perform such tests one first creates a surrogate image by masking a feature of interest in the MAP estimator . It is then sufficient to check if,
[TABLE]
If this inequality holds, we interpret that the physicality of is undetermined and so no strong statistical statement can be made. Should the objective function evaluated at be larger than then it no longer belongs to the approximate credible set and therefore (as is conservative) it cannot belong to the HPD credible set . Therefore, for which do not satisfy the above inequality we determine the structure to be strictly physical at confidence level. A schematic of hypothesis testing is provided in Figure 2.
In pixel-space we begin by masking out a feature of interest, creating a rough surrogate image ââsetting the pixels associated with a selected structure to 0 ââthis rough surrogate is then passed through an appropriate wavelet filter as part of segmentation-inpainting to replace generic background structure into the masked region. Mathematically, this amounts to the iterations,
[TABLE]
where is the sub-set of masked pixels, is the set indicator function and is a thresholding parameter which should be chosen appropriately for the image.
A second straightforward method for generating surrogate images is to blur local pixel substructure into one collective structure ââin a process called segmentation-smoothing. This approach provides a simple way to determine if the substructure in a given region is physical or likely to be an artifact of the reconstruction process.
For example, if several massive peaks are located near one another, one can blur these structures into a single cohesive peak. This would be useful when considering peak statistics on convergence maps ââwhich is often used to constrain the cosmological parameters associated with dark matter.
One can conduct such blurring of structure by: specifying a a subset of the reconstructed pixels ; convolving with a Gaussian smoothing kernel; and replacing pixels that belong to with their smoothed counterparts. This can be displayed algorithmically as,
[TABLE]
where is a chosen Gaussian smoothing kernel and is a trivially extended 2D version of the the usual 1D Fourier convolution operator,
In the scope of this paper we focus primarily on pixel-space features, but it is important to stress that knock-out approach is entirely general and can be applied to any well defined feature of a MAP estimator ââi.e. masking certain Fourier space features, removal of global small scale structure etc.
5 Illustration on simulations
We now consider a selection of realistic simulations to illustrate our sparse reconstruction method on cluster scales which are particularly challenging for myriad factors. Further to this, we showcase the aforementioned uncertainty quantification methods in a variety of idealized cluster scale MAP reconstructions. We place emphasis on uncertainty quantification rather that the reconstruction fidelity.
5.1 Datasets
In this paper we focus primarily on 4 large clusters (those with significant friends-of-friends, i.e. significant substructure) extracted from the Bolshoi N-body simulation (Klypin et al., 2011). On the cluster scale we showcase our formalism on a variety of Bolshoi N-body simulation data sets. The Bolshoi N-body cluster simulation catalogs we work with in this paper are those used in Lanusse et al. (2016), which were extracted using the CosmoSim web-tool111https://www.cosmosim.org. Construction of these weak lensing realisations assumed a redshift of , with a arcmin2 field of view, and have convergence normalized with respect to lensing sources at infinity. Explicitly this results in pixel-dimensions of arcseconds. Due to the relatively low particle density, these images were subsequently denoised by a multi-scale Poisson denoising algorithm.
5.2 Methodology
Typically, we begin by creating an artificial shear field from a known ground-truth convergence field , that is extracted from a given dataset. This is a common approach in the imaging community and presents a closed scenario in which the true input is known. These fields are created by,
[TABLE]
where (i.e. the noise covariance) is determined entirely from a pre-defined number density of observations per arcminute2, an assumed intrinsic ellipticity dispersion of , and the resolution of the images (in this case arcminutes). In this way the noise can be tuned to directly mimic that present in practical settings. Using the simulated noise covariance (which in practice would be provided by the observation team) we then utilize the SOPT222A highly optimized sparse optimization solver, https://github.com/astro-informatics/SOPT framework to perform our reconstruction algorithm on such that we recover a MAP estimator of the convergence . From this reconstructed convergence field a recovered SNR is computed and a selection of hypothesis tests are conducted to showcase the power of this formalism.
In the case where the underlying clean are unavailable (i.e. application to A520 data) we conduct the same analysis as before but instead of creating artificial noisy maps we used the real noisy observational data.
Throughout our analysis the recovered SNR (dB) is defined to be,
[TABLE]
when the ground-truth convergence is known. Furthermore we quantify the topological similarity between the true convergence and the estimator via the Pearson correlation coefficient which is defined to be
[TABLE]
where . The correlation coefficient quantifies the structural similarity between two datasets: 1 indicates maximal positive correlation, 0 indicates no correlation, and -1 indicates maximal negative correlation.
5.3 Bolshoi Cluster Catalogs
The Bolshoi cluster data used consists of 4 large clusters extracted from the Bolshoi N-body simulation (Klypin et al., 2011; Lanusse et al., 2016). These images were then multi-scale Poisson denoised to create suitable ground truth simulations. We choose to analyze the same clusters considered in Lanusse et al. (2016), as they showcase a wide variety of structure on all scales. Hereafter, we restrict ourselves to the SARA dictionary (Carrillo et al., 2012) truncated at the Daubechies wavelet (DB4) for simplicity ââi.e. the combination of the Dirac, and DB1 to DB4 wavelet dictionaries only.
To investigate the SNR gain of our formalism over KS in the cluster scale setting, we created realizations of noisy pseudo-shear maps for assumed number density of galaxy observations from one Bolshoi cluster map, upon which we applied our reconstruction algorithm pipeline. The results of which are presented in Table 1. It should be noted that for comparisons sake the KS estimate without convolution with a Gaussian smoothing kernel is provided in addition to an optimally smoothed KS estimator. This has been done to highlight the difference in reconstruction fidelity between the raw KS estimator and the KS estimator after post-processing (Gaussian smoothing), a discrepancy often not addressed by the community. As this post-processing convolution is known to degrade the quality of non-Gaussian information (which cosmologists are becoming increasingly interested in) such plots demonstrate the trade-off between non-Gaussian information and reconstruction fidelity.
As can be seen in Figure 3 and Table 1, sparse approaches significantly outperform the smoothed (and non-smoothed) KS approach in all cases, over all metrics tracked. Importantly sparse approaches are able to recover reasonable results even when the noise level entirely dilutes the true signal, as in the setting, making such approaches on (at least) cluster data very attractive for future studies.
5.3.1 Hypothesis Testing: Bolshoi Clusters
Perhaps more interestingly, we now perform a series of hypothesis tests as discussed in Section 4.2. For each of the remaining 3 Bolshoi cluster we construct three possible example hypothesis tests which one may wish to perform. In this case these hypotheses were either: structure removal followed by segmentation-inpainting; or Gaussian smoothing of certain structures (i.e. smoothing multiple peaks into a single larger peak which may be of interest when conducting peak-count analysis). Though these are both extremely useful considerations, it is important to stress the generality of our approach such that any well defined operation on the reconstructed image, with a clear understandable hypothesis, is applicable.
To ensure the method behind hypothesis testing is clear, we will walk through a typical application. The top row of Figure 4 displays the hypothesis tests applied to the first Bolshoi cluster. Conceptually, the correct way to interpret Hypothesis 1 (H1, red) is: âThe central dark core is likely just an artifact of the reconstructionâ.
This structure is then removed from the image by segmentation-inpainting (lower left image), and the objective function is then recalculated. It is found that the objective function is now larger than the approximate level-set threshold , the surrogate segmentation-inpainted image falls outside of the HPD credible region, and so the hypothesis is rejected. This implies that the structure is not simply an artifact, but is necessary to the integrity of the reconstruction, i.e. this structure is now determined to be physical at confidence. However, had removing this region not raised the objective function above , then the conclusion is that their is insufficient evidence to reject the hypothesis (which is not equivalent to saying that the region is strictly not physical).
An identical thought process can be applied to H2 and H3 of the top row in Figure 4, H1 in the second row of Figure 4, and all three hypothesis tests presented in the final row. In each case a substructure of the is removed via segmentation-inpainting and it is queried whether the resulting surrogate solution . Each of the large substructures on the final row, and H2 of the second row, are determined to be physical at confidence. Conversely, the comparatively smaller substructures considered in H2 and H3 of the top row do not saturate the level-set threshold, and are therefore undetermined. All numerical data related to hypothesis testing of the Bolshoi cluster reconstructions can be found in Table 2.
H2 and H3 of the middle row of Figure 4 have a different interpretation. In these cases the central region has been blurred by segmentation-smoothing (convolution with a Gaussian smoothing kernel) ââthe difference between these two cases being simply the degree of smoothing. Here the hypothesis is: âThe central region is likely to be just a single peak, rather than twoâ. As in the previous example, the objective function is recalculated and is now greater than and so the hypothesis is rejected. The natural conclusion is thus that the data is sufficient to determine that at least two peaks are physically present at confidence.
6 Application to Abel-520 Observational Catalogs
We perform an application of our entire reconstruction pipeline to real observational datasets. We select two observational datasets of the A520 cluster (Jee et al., 2014; Clowe et al., 2012) ââhereafter for clarity we refer to them as C12 and J14 (as in Peel et al., 2017)333http://www.cosmostat.org/software/glimpse. For a full description of the datasets, how they were constructed, and how they account for different systematics we recommend the reader look to the respective papers. These initial investigations claim to have detected several over dense regions within the merging A520 system, the most peculiar of which was a so called âdark coreâ (location 2 in Figure 5) for which multi-wavelength observations could not determine an optical counterpart. Such a dark core would provide a contradiction to the currently understood model of collisionless dark matter â the idea being that during the collision of two massive clusters, dark matter was stripped from each cluster through self-interactions, forming an over dense residual between the two clusters, which would naturally not exhibit an optical counterpart.
The J14 catalog contains approximately twice the number of galaxies than C12, though both are derived from the same ACS (four pointings) and Magellan images. In addition, J14 combines these images with the CFHT catalog used in the authors previous work (Jee et al., 2012). The C12 observing area extends over a larger angular surface than the J14 so for this analysis we limit both datasets to the region spanned by both sets. Due to the number density of measurements being very low we are forced to project the measurements into a grid ââto ensures that the average number of galaxies in each grid pixel is at least above 1, though ideally we want many galaxies in each pixel to minimize the noise contribution from intrinsic ellipticity. In fact, even in this resolution the space is incomplete in several pixels, but we draw a compromise between the completeness of the space and the resolution of the data.
The data covariance was constructed directly from the number density of observations per pixel (directly inferred during catalogue gridding), with an assumed intrinsic ellipticity dispersion of . Combining this data covariance, the associated gridded datasets, and the associated mask, MAP reconstructions of the C12 and J14 convergence maps were recovered at a super-resolution magnification of 8. Reconstructions are presented in Figure 5.
6.1 Hypothesis Testing of Local Structure: A520 Datasets
We conducted hypothesis tests on the three primary over dense regions, in addition to the contested dark core, in both the C12 and J14 datasets. In the absence of an optical counterpart, detection at high confidence of the dark core (location 2 in Figure 5) would provide a contradiction to the collisionless model of dark matter â indicating potential self-interaction of dark matter. Due to the high estimated noise-level present in the data, and the limited data resolution, only the two largest peaks in both datasets (peaks 1 and 3 of Figure 5) sufficiently raised the objective function to reject the hypothesis at any meaningful confidence. This is to say that; given the limited, noisy data and using the measurement operator and prior (-term) presented in this paper we can say that the data is insufficient to statistically determine the physicality of local small scale substructure (such as the dark core) in both the C12 and J14 datasets. The initial conflict between C12 and J14 was over the existence and position of a dark core (location 2 in Figure 5), with a notably large mass-to-light ratio, indicated the possibility of self-interacting dark matter. A subsequent inquiry was conducted (Peel et al., 2017) using the GLIMPSE reconstruction algorithm (Lanusse et al., 2016) and concluded that this peculiar peak existed in the J14 dataset but not in the C12 dataset.
As such, our conclusions agree well with Peel et al. (and generally with those drawn in both C12 and J14). However, within our Bayesian hierarchical formalism (which constitutes a principled statistical framework) we push this conclusion further to say that the data are insufficient to determine the physicality of these peaks.
6.2 Hypothesis Testing of Global Structure: A520 Datasets
Interestingly we can perform a final novel hypothesis test of global structure. This hypothesis is as follows: âThe two MAP estimates are consistent with both sets of dataâ, i.e. the MAP convergence estimate recovered from the J14 (C12) data is within the credible-set (at confidence) of the C12 (J14) objective function. We find that the J14 (C12) MAP reconstruction is an acceptable solution to the C12 (J14) inverse problem and so the MAP solutions do not disagree âânumerically this is shown in Table 3.
Given the inherent limitations of the data we are forced to conclude: âThe data are insufficient to determine the existence of individual substructures at high confidence ââthough the two largest over dense regions are found to be globally physical at confidence. The two MAP estimates are also found to be consistent at confidence.â
7 Conclusions
We have presented a sparse hierarchical Bayesian mass-mapping algorithm which provides a principled statistical framework through which, for the first time, we can conduct uncertainty quantification on recovered convergence maps without relying on any assumptions of Gaussianity. Moreover, the presented formalism draws on ideas from convex optimization (rather than MCMC techniques) which makes it notably fast and allows it to scale well to big data, i.e. high resolution and wide-field convergence reconstructions (which will be essential for future stage @slowromancapiv@ surveys, such as LSST and Euclid).
Additionally, we demonstrate a hierarchical Bayesian inference approach to automatically approximate the regularization parameter, and show that it produces near optimal results in a variety of cases. We however note that this approach does not work generally, and can be unstable in extreme settings.
We showcase our Bayesian inference approach (with emphasis on the application of the uncertainty quantification techniques) on both simulation datasets and observational data (the A520 merging cluster dataset). Our mass-mapping formalism is shown to produce significantly more accurate convergence reconstruction than the Kaiser-Squires estimator on all simulations considered. Hypothesis tests of substructure are demonstrated.
It is found that neither of the two A520 datasets considered could provide sufficient evidence to determine the physicality of any contested substructure (i.e. the existence of so called âdark coresâ) at significant confidence. It is informative to note that our methods were, in fact, sufficiently sensitive to detect the largest peaks in both datasets at confidence. Nonetheless, global hypothesis tests indicate a good agreement between the two sets of data. These conclusions are roughly in agreement with those drawn previously but go further to demonstrate just how uncertain these types of cluster-scale weak lensing reconstruction inherently are (typically as a limitation of the relative information content of low-resolution, noisy datasets).
It is now natural to extend this formalism to the entire celestial sphere ââa necessity of large-scale reconstruction techniques which aim to fully utilize the forthcoming Euclid and LSST444https://www.lsst.org survey data.
Acknowledgements
Author contributions are summarized as follows. MAP: methodology, data curation, investigation, software, visualization, writing - original draft; JDM: conceptualization, methodology, project administration, supervision, writing - review & editing; XC: methodology, investigation, writing - review & editing; TDK: methodology, supervision, writing - review & editing; CGRW: methodology.
This paper has undergone internal review in the LSST Dark Energy Science Collaboration. The internal reviewers were Chihway Chang, Tim Eifler, and François Lanusse. The authors would like to thank Luke Pratley for an introduction to the C++ SOPT framework and the internal reviewers for valuable discussions. MAP is supported by the Science and Technology Facilities Council (STFC). TDK is supported by a Royal Society University Research Fellowship (URF). This work was also supported by the Engineering and Physical Sciences Research Council (EPSRC) through grant EP/M0110891 and by the Leverhulme Trust. The DESC acknowledges ongoing support from the Institut National de Physique NuclĂ©aire et de Physique des Particules in France; the Science & Technology Facilities Council in the United Kingdom; and the Department of Energy, the National Science Foundation, and the LSST Corporation in the United States. DESC uses resources of the IN2P3 Computing Center (CC-IN2P3âLyon/Villeurbanne - France) funded by the Centre National de la Recherche Scientifique; the National Energy Research Scientific Computing Center, a DOE Office of Science User Facility supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231; STFC DiRAC HPC Facilities, funded by UK BIS National E-infrastructure capital grants; and the UK particle physics grid, supported by the GridPP Collaboration. This work was performed in part under DOE Contract DE-AC02-76SF00515.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Alsing et al. (2016) Alsing J., Heavens A., Jaffe A. H., Kiessling A., Wandelt B., Hoffmann T., 2016, MNRAS , 455, 4452 · doi â
- 2Bartelmann & Schneider (2001) Bartelmann M., Schneider P., 2001, Phys. Rep. , 340, 291 · doi â
- 3Bunn et al. (2003 a) Bunn E. F., Zaldarriaga M., Tegmark M., de Oliveira-Costa A., 2003 a, Phys. Rev. D , 67, 023501 · doi â
- 4Bunn et al. (2003 b) Bunn E. F., Zaldarriaga M., Tegmark M., de Oliveira-Costa A., 2003 b, Phys. Rev. D , 67, 023501 · doi â
- 5Cai et al. (2017 a) Cai X., Pereyra M., Mc Ewen J. D., 2017 a, preprint, ( ar Xiv:1711.04818 )
- 6Cai et al. (2017 b) Cai X., Pereyra M., Mc Ewen J. D., 2017 b, preprint, ( ar Xiv:1711.04819 )
- 7Carrillo et al. (2012) Carrillo R. E., Mc Ewen J. D., Wiaux Y., 2012, MNRAS , 426, 1223 · doi â
- 8Carrillo et al. (2013) Carrillo R. E., Mc Ewen J. D., Van De Ville D., Thiran J.-P., Wiaux Y., 2013, IEEE Signal Processing Letters , 20, 591 · doi â
