Identifying and Repairing Catastrophic Errors in Galaxy Properties Using Dimensionality Reduction

TL;DR

This paper introduces a new method combining galaxy property inference with t-SNE dimensionality reduction to identify and correct catastrophic errors in galaxy surveys, improving data quality for astrophysical studies.

Contribution

The authors develop a novel approach that uses t-SNE to detect and repair catastrophic errors in galaxy property catalogs, enhancing the reliability of large survey data.

Findings

Improved identification of catastrophic errors in galaxy catalogs.

Enhanced accuracy of galaxy property measurements.

Better data quality for galaxy evolution studies.

Abstract

Our understanding of galaxy evolution is derived from large surveys designed to maximize efficiency by only observing the minimum amount needed to infer properties for a typical galaxy. However, for a few percent of galaxies in every survey, these observations are insufficient and derived properties can be catastrophically wrong. Further, it is currently difficult or impossible to determine which objects have failed, so that these contaminate every study of galaxy properties. We develop a novel method to identify these objects by combining the astronomical codes which infer galaxy properties with the dimensionality reduction algorithm t-SNE, which groups similar objects to determine which inferred properties are out of place. This method provides an improvement for the COSMOS catalog, which already uses existing techniques for catastrophic error removal, and therefore should improve the quality of large catalogs and any studies which are sensitive to large redshift errors.