Hypothesis testing at the extremes: fast and robust association for high-throughput data

TL;DR

This paper introduces a fast, accurate approximation method for exact association tests in high-throughput biomedical data, improving reliability and computational efficiency over traditional parametric tests.

Contribution

The authors develop a novel approximation to exact permutation tests that is both accurate and computationally efficient, applicable to various models including linear and generalized linear models.

Findings

The method provides accurate p-values comparable to permutation tests.

It is computationally faster than traditional exact testing methods.

The approach is versatile across different statistical models.

Abstract

A number of biomedical problems require performing many hypothesis tests, with an attendant need to apply stringent thresholds. Often the data take the form of a series of predictor vectors, each of which must be compared with a single response vector, perhaps with nuisance covariates. Parametric tests of association are often used, but can result in inaccurate type I error at the extreme thresholds, even for large sample sizes. Furthermore, standard two-sided testing can reduce power compared to the doubled $p$-value, due to asymmetry in the null distribution. Exact (permutation) testing is attractive, but can be computationally intensive and cumbersome. We present an approximation to exact association tests of trend that is accurate and fast enough for standard use in high-throughput settings, and can easily provide standard two-sided or doubled $p$-values. The approach is shown to be equivalent under permutation to likelihood ratio tests for the most commonly used generalized linear models. For linear regression, covariates are handled by working with covariate-residualized responses and predictors. For generalized linear models, stratified covariates can be handled in a manner similar to exact conditional testing. Simulations and examples illustrate the wide applicability of the approach.