More powerful multiple testing under dependence via randomization
Ziyu Xu, Aaditya Ramdas

TL;DR
This paper introduces a simple randomization technique to enhance the power of multiple testing procedures under dependence, applicable to FDR control, confidence intervals, and post-selection inference, with demonstrated improvements.
Contribution
The paper presents a novel randomization framework that improves existing multiple testing procedures under dependence, ensuring higher power without sacrificing validity.
Findings
Randomization improves power of FDR procedures under dependence.
Enhanced procedures outperform original methods in simulations.
Randomized methods are never worse and often strictly better.
Abstract
We develop a technique to improve the power of any e-value by a simple randomization involving one independent uniform random variable. Using this framework, we show that two procedures for false discovery rate (FDR) control -- the Benjamini-Yekutieli procedure for dependent p-values, and the e-Benjamini-Hochberg procedure for dependent e-values -- can be improved through randomization. We also improve the Hommel test under dependence, and post-selection inference procedures for confidence intervals with false coverage rate (FCR) that allow for arbitrary selection rules and dependence. Importantly, our randomized improvements are never worse than the originals and are typically strictly more powerful, with marked improvements in simulations.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Methods in Clinical Trials · VLSI and Analog Circuit Testing · Optimal Experimental Design Methods
