How to evaluate the sufficiency and complementarity of summary statistics for cosmic fields: an information-theoretic perspective

TL;DR

This paper introduces mutual information as a framework to evaluate the sufficiency and complementarity of summary statistics in cosmic field analysis, demonstrated through cosmic microwave background and 21cm brightness temperature maps.

Contribution

It applies an information-theoretic approach using mutual information to assess and compare the informativeness of different summary statistics in cosmology.

Findings

Power spectrum captures almost all information in Gaussian fields.

Scattering transform extracts non-Gaussian information and complements traditional statistics.

Mutual information provides a robust foundation for evaluating summary statistics.

Abstract

The advent of increasingly advanced surveys and cosmic tracers has motivated the development of new inference techniques and novel approaches to extracting information from cosmic fields. A central challenge in this endeavor is to quantify the information content carried by these summary statistics in cosmic fields. In particular, how should we assess which statistics are more informative than others and assess the exact degree of complementarity of the information from each statistic? Here, we introduce mutual information (MI) that provides, from an information-theoretic perspective, a natural framework for assessing the sufficiency and complementarity of summary statistics in cosmological data. We demonstrate how MI can be applied to typical inference tasks to make information-theoretic evaluations, using two representative examples: the cosmic microwave background map, from which the power spectrum extracts almost all information as is expected for a Gaussian random field, and the 21~cm brightness temperature map, from which the scattering transform extracts the most non-Gaussian information but is complementary to power spectrum and bispectrum. Our results suggest that MI offers a robust theoretical foundation for evaluating and improving summaries, thereby enabling a deeper understanding of cosmic fields from an information-theoretic perspective.