Data Compression and Covariance Matrix Inspection: Cosmic Shear
Tassia Ferreira, Tianqing Zhang, Nianyi Chen, Scott Dodelson (for the, LSST Dark Energy Science Collaboration)

TL;DR
This paper explores various data compression techniques to reduce the size of covariance matrices in cosmic shear analyses, identifying the most effective method (MOPED) for preserving parameter constraints in large cosmological datasets.
Contribution
The study evaluates multiple covariance matrix compression methods and demonstrates that MOPED best maintains parameter estimation accuracy in cosmic shear analysis.
Findings
Simple compression methods lose information on IA and S8 parameters.
MOPED accurately reproduces original constraints in a 16-parameter space.
IA parameter A_IA is most sensitive to covariance matrix inaccuracies.
Abstract
Covariance matrices are among the most difficult pieces of end-to-end cosmological analyses. In principle, for two-point functions, each component involves a four-point function, and the resulting covariance often has hundreds of thousands of elements. We investigate various compression mechanisms capable of vastly reducing the size of the covariance matrix in the context of cosmic shear statistics. This helps identify which of its parts are most crucial to parameter estimation. We start with simple compression methods, by isolating and "removing" 200 modes associated with the lowest eigenvalues, then those with the lowest signal-to-noise ratio, before moving on to more sophisticated schemes like compression at the tomographic level and, finally, with the Massively Optimized Parameter Estimation and Data compression (MOPED). We find that, while most of these approaches prove useful for…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
