Multivariate Adjustments for Average Equivalence Testing

TL;DR

This paper introduces a finite-sample adjustment to the multivariate TOST procedure for average equivalence testing, improving power by accounting for outcome dependence and variances.

Contribution

It proposes the multivariate α-TOST, a correction method that enhances the traditional TOST by adjusting significance levels based on outcome dependence.

Findings

The multivariate α-TOST is more powerful than the conventional TOST.

Simulation studies show improved finite-sample properties.

Application to pharmacokinetic data demonstrates practical benefits.

Abstract

Multivariate (average) equivalence testing is widely used to assess whether the means of two conditions of interest are `equivalent' for different outcomes simultaneously. The multivariate Two One-Sided Tests (TOST) procedure is typically used in this context by checking if, outcome by outcome, the marginal $100(1-2\alpha$)\% confidence intervals for the difference in means between the two conditions of interest lie within pre-defined lower and upper equivalence limits. This procedure, known to be conservative in the univariate case, leads to a rapid power loss when the number of outcomes increases, especially when one or more outcome variances are relatively large. In this work, we propose a finite-sample adjustment for this procedure, the multivariate $\alpha$-TOST, that consists in a correction of $\alpha$, the significance level, taking the (arbitrary) dependence between the outcomes of interest into account and making it uniformly more powerful than the conventional multivariate TOST. We present an iterative algorithm allowing to efficiently define $\alpha^{\star}$, the corrected significance level, a task that proves challenging in the multivariate setting due to the inter-relationship between $\alpha^{\star}$ and the sets of values belonging to the null hypothesis space and defining the test size. We study the operating characteristics of the multivariate $\alpha$-TOST both theoretically and via an extensive simulation study considering cases relevant for real-world analyses -- i.e.,~relatively small sample sizes, unknown and heterogeneous variances, and different correlation structures -- and show the superior finite-sample properties of the multivariate $\alpha$-TOST compared to its conventional counterpart. We finally re-visit a case study on ticlopidine hydrochloride and compare both methods when simultaneously assessing bioequivalence for multiple pharmacokinetic parameters.