Gold after Randomized Sand: Model-X Split Knockoffs for Controlled Transformation Selection

TL;DR

This paper extends the Split Knockoff method to random designs, enabling controlled variable transformation selection with finite-sample FDR control in broader models, demonstrated through simulations and real-world data.

Contribution

We introduce Model-X Split Knockoffs, a novel approach that achieves FDR control in random designs by using an auxiliary randomized design to handle the interaction between randomness and deterministic transformations.

Findings

Achieves robust FDR control in simulations and real data.

Provides at least as much power as standard Model-X Knockoffs.

Demonstrates applicability to complex real-world problems like Alzheimer's imaging.

Abstract

Controlling the False Discovery Rate (FDR) is critical for reproducible variable selection, especially given the prevalence of complex predictive modeling. The recent Split Knockoff method, an extension of the canonical Knockoffs framework, offers finite-sample FDR control for selecting sparse transformations but is limited to linear models with fixed designs. Extending this framework to random designs, which would accommodate a much broader range of models, is challenged by the fundamental difficulty of reconciling a random covariate design with a deterministic linear transformation. To bridge this gap, we introduce Model-X Split Knockoffs. Our method achieves robust FDR control for transformation selection in random designs by introducing a novel auxiliary randomized design. This key innovation effectively mediates the interaction between the random design and the deterministic transformation, enabling the construction of valid knockoffs. Like the classical Model-X framework, our approach provides provable, finite-sample FDR control under known or accurately estimated covariate distributions, regardless of the response's conditional distribution. Importantly, it guarantees at least the same, and often superior, selection power as standard Model-X Knockoffs when both are applicable. Empirical studies, including simulations and real-world applications to Alzheimer's disease imaging and university ranking analysis, demonstrate robust FDR control and improved statistical power.