Simultaneous directional inference
Ruth Heller, Aldo Solari

TL;DR
This paper introduces a method for providing simultaneous post-hoc confidence bounds on the number of positive and negative parameters, improving inference accuracy in multiple hypothesis testing scenarios.
Contribution
It proposes a new approach for simultaneous inference on parameter signs using adjusted p-values, offering tighter bounds and computational efficiency compared to existing methods.
Findings
Bounds are often significantly tighter than existing methods.
Method is computationally feasible with polynomial time complexity.
Useful in evaluating treatment effects across multiple studies or subgroups.
Abstract
We consider the problem of inference on the signs of parameters. We aim to provide post-hoc confidence bounds on the number of positive and negative (or non-positive) parameters. The guarantee is simultaneous, for all subsets of parameters. Our suggestion is as follows: start by using the data to select the direction of the hypothesis test for each parameter; then, adjust the -values of the one-sided hypotheses for the selection, and use the adjusted -values for simultaneous inference on the selected one-sided hypotheses. The adjustment is straightforward assuming that the -values of one-sided hypotheses have densities with monotone likelihood ratio, and are mutually independent. We show that the bounds we provide are tighter (often by a great margin) than existing alternatives, and that they can be obtained by at most a polynomial time. We demonstrate the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Methods in Clinical Trials · Advanced Causal Inference Techniques · Health Systems, Economic Evaluations, Quality of Life
