Control Group Selection in Preclinical Rat Bone Defect Models: A Systematic Review

TL;DR

This study reviews how control groups are used in rat bone defect experiments to test new biomaterials, highlighting inconsistencies that could affect research reliability.

Contribution

The paper systematically analyzes control group usage in rat bone defect studies, revealing variability and suggesting standardization for better translational outcomes.

Findings

Only 56% of studies included a negative control group, and 34% included a positive control group.

25% of studies lacked any control group, potentially leading to unreliable efficacy assessments.

Most studies showed better healing with test items compared to negative controls but not always compared to positive controls.

Abstract

Large bone defects and loss present major orthopedic challenges. In preclinical research, femoral bone defects in rats are commonly used as in vivo models to evaluate new osteoregenerative biomaterials. These test items are typically compared to negative and positive controls. This review aims to summarize the different control groups used to evaluate new osteoregenerative test items in preclinical rat femoral defect models and to identify potential pitfalls related to these controls, ultimately to enhance the future translational success. The protocol for this review was registered in PROSPERO, and no specific funding was received for this work. The systematic search comprised publications between January 2001 and January 2023. 436 studies were included for analysis. The choice of control groups was inconsistent across studies. A negative (e.g., empty defects or inert carriers) and positive (e.g., bone grafts or commercially available bone substitutes) control group was included in 56% (n = 245/436) and 34% (n = 149/436) of the included studies, respectively. Notably, 25% (n = 109/436) of the studies did not include any control group. Bone grafts were used as positive controls in 50% of the studies that included positive controls (n = 74/149), mainly of allogeneic origin (45%, n = 33/74). The control groups used to evaluate the test item impacted the healing comparison, with 81% of studies showing better healing of their test items compared to negative control (n = 198/245) versus 54% compared to positive control (n = 80/149). A qualitative risk-of-bias and reporting assessment was performed using an integrated ARRIVE–SYRCLE framework. Most studies demonstrated moderate concern in several domains, with frequent absence of randomization (67%, high concern) and blinding (84%, high concern), incomplete reporting of inclusion/exclusion criteria (74%, moderate concern), and variable clarity regarding animal characteristics and statistical methodology. The variability in the choice of control groups appears to influence study outcomes. Inadequate control group selection can lead to misleading conclusions regarding the efficacy of new biomaterials. Therefore, standardizing control group selection is crucial to enhance the reliability and comparability of preclinical research findings.

Figures