Multistage tests of multiple hypotheses
Jay Bartroff, Tze Leung Lai

TL;DR
This paper introduces a multistage step-down testing procedure for multiple hypotheses that combines adaptive sampling with error rate control, significantly reducing sample size in sequential experiments.
Contribution
It extends Holm's step-down method to sequential settings, enabling efficient, adaptive multiple hypothesis testing with controlled family-wise error rate.
Findings
Preserves family-wise error rate in sequential testing
Reduces sample size substantially compared to traditional methods
Extends Holm's procedure to adaptive, multistage contexts
Abstract
Conventional multiple hypothesis tests use step-up, step-down, or closed testing methods to control the overall error rates. We will discuss marrying these methods with adaptive multistage sampling rules and stopping rules to perform efficient multiple hypothesis testing in sequential experimental designs. The result is a multistage step-down procedure that adaptively tests multiple hypotheses while preserving the family-wise error rate, and extends Holm's (1979) step-down procedure to the sequential setting, yielding substantial savings in sample size with small loss in power.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Methods in Clinical Trials · Optimal Experimental Design Methods · Advanced Statistical Process Monitoring
