KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects

TL;DR

This paper presents a machine learning approach to correct complex selection effects in galaxy clustering measurements from deep surveys, enabling unbiased cosmological analysis from the KiDS-Legacy data.

Contribution

The paper introduces a novel unsupervised machine learning method combining self-organising maps and hierarchical clustering to recover selection effects in galaxy surveys.

Findings

Complex selection effects can cause over-estimation of the 2PCF by an order of magnitude.

The SOM+HC method effectively recovers unbiased 2PCF measurements in mock data.

Corrected 2PCF on real data is robust and suitable for cosmological analysis.

Abstract

Photometric galaxy surveys, despite their limited resolution along the line of sight, encode rich information about the large-scale structure (LSS) of the Universe thanks to the high number density and extensive depth of the data. However, the complicated selection effects in wide and deep surveys can potentially cause significant bias in the angular two-point correlation function (2PCF) measured from those surveys. In this paper, we measure the 2PCF from the newly published KiDS-Legacy sample. Given an $r$-band $5\sigma$ magnitude limit of $24.8$ and survey footprint of $1347$ deg$^2$, it achieves an excellent combination of sky coverage and depth for such a measurement. We find that complex selection effects, primarily induced by varying seeing, introduce over-estimation of the 2PCF by approximately an order of magnitude. To correct for such effects, we apply a machine learning-based method to recover an organised random (OR) that presents the same selection pattern as the galaxy sample. The basic idea is to find the selection-induced clustering of galaxies using a combination of self-organising maps (SOMs) and hierarchical clustering (HC). This unsupervised machine learning method is able to recover complicated selection effects without specifying their functional forms. We validate this SOM+HC method on mock deep galaxy samples with realistic systematics and selections derived from the KiDS-Legacy catalogue. Using mock data, we demonstrate that the OR delivers unbiased 2PCF cosmological parameter constraints, removing the $27\sigma$ offset in the galaxy bias parameter that is recovered when adopting uniform randoms. Blinded measurements on the real KiDS-Legacy data show that the corrected 2PCF is robust to the SOM+HC configuration near the optimal set-up suggested by the mock tests.