The Adequate Bootstrap
Toby Kenney, Hong Gu

TL;DR
This paper proposes a new method for assessing model adequacy by focusing on the usefulness of the model despite its known imperfections, using bootstrap techniques to evaluate parameter uncertainty at a suitable sample size.
Contribution
It introduces a bootstrap-based approach to evaluate model adequacy from a practical perspective, emphasizing usefulness over strict correctness.
Findings
The method effectively measures parameter uncertainty caused by model limitations.
It allows inference based on a sample size where the model is not rejected.
The approach provides a more relevant assessment of model usefulness.
Abstract
There is a fundamental disconnect between what is tested in a model adequacy test, and what we would like to test. The usual approach is to test the null hypothesis "Model M is the true model." However, Model M is never the true model. A model might still be useful even if we have enough data to reject it. In this paper, we present a technique to assess the adequacy of a model from the philosophical standpoint that we know the model is not true, but we want to know if it is useful. Our solution to this problem is to measure the parameter uncertainty in our estimates caused by the model uncertainty. We use bootstrap inference on samples of a smaller size, for which the model cannot be rejected. We use a model adequacy test to choose a bootstrap size with limited probability of rejecting the model and perform inference for samples of this size based on a nonparametric bootstrap. Our…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsExplainable Artificial Intelligence (XAI) · Bayesian Modeling and Causal Inference · Data Analysis with R
