PERMUTOOLS: A MATLAB Package for Multivariate Permutation Testing
Michael J. Crosse, John J. Foxe, Sophie Molholm

TL;DR
PERMUTOOLS is a MATLAB package that facilitates multivariate permutation testing and effect size measurement, offering a distribution-free alternative to traditional parametric methods, with advantages in multiple comparison correction and confidence interval estimation.
Contribution
This paper introduces PERMUTOOLS, a MATLAB package that implements efficient multivariate permutation testing and effect size measurement, filling a gap in available software tools.
Findings
Provides a MATLAB tool for permutation testing
Enables empirical confidence interval estimation
Supports multiple comparison correction
Abstract
Statistical hypothesis testing and effect size measurement are routine parts of quantitative research. Advancements in computer processing power have greatly improved the capability of statistical inference through the availability of resampling methods. However, many of the statistical practices used today are based on traditional, parametric methods that rely on assumptions about the underlying population. These assumptions may not always be valid, leading to inaccurate results and misleading interpretations. Permutation testing, on the other hand, generates the sampling distribution empirically by permuting the observed data, providing distribution-free hypothesis testing. Furthermore, this approach lends itself to a powerful method for multiple comparison correction - known as max correction - which is less prone to type II errors than conventional correction methods. Parametric…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Methods in Clinical Trials · Statistical Methods and Bayesian Inference · Meta-analysis and systematic reviews
