Including random centre effects in design, analysis and presentation of multi-centre trials

Kate Edgar, Ian Roberts, Linda Sharples, Kate Edgar, Ian Roberts, Linda Sharples

Abstract

Background: In large multicentre trials in diverse settings, there is uncertainty about the need to adjust for centre variation in design and analysis. A key distinction is the difference between variation in outcome (independent of treatment) and variation in treatment effect. Through re-analysis of the CRASH-2 trial (2010), this study clarifies when and how to use multi-level models for multicentre studies with binary outcomes.

Methods: CRASH-2 randomised 20,127 trauma patients across 271 centres and 40 countries to either single-dose tranexamic acid or identical placebo, with all-cause death at 4 weeks the primary outcome. The trial data had a hierarchical structure, with patients nested in hospitals which in turn are nested within countries. Reanalysis of CRASH-2 trial data assessed treatment effect and both patient and centre level baseline covariates as fixed effects in logistic regression models. Random effects were included to assess where there was variation between countries, and between centres within countries, both in underlying risk of death and in treatment effect.

Results: In CRASH-2, there was significant variation between countries and between centres in death at 4 weeks, but absolutely no differences between countries or centres in the effect of treatment. Average treatment effect was not altered after accounting for centre and country variation in this study.

Conclusions: It is important to distinguish between underlying variation in outcomes and variation in treatment effects; the former is common but the latter is not. Stratifying randomisation by centre overcomes many statistical problems and including random intercepts in analysis may increase power and decrease bias in mean and standard error estimates.

Trial registration: Current Controlled Trials ISRCTN86750102 , ClinicalTrials.gov NCT00375258 , and South African Clinical Trial Register DOH-27-0607-1919.

Keywords: Heterogeneity; Multi-centre trials; Random effects.

Conflict of interest statement

The authors have no conflicting interests to declare.

Figures

Fig. 1
Fig. 1
Percentage of patients in CRASH-2 countries that died within 4 weeks of randomisation; the number of patients randomised in each country is provided
Fig. 2
Fig. 2
CRASH-2 centre-specific odds ratios (95% confidence intervals) for death in 4 weeks, relative to the average (top panel) and centre-specific treatment effects (95% confidence intervals), relative to the average (lower panel)
Fig. 3
Fig. 3
CRASH-2 country-specific odds ratios for death in 4 weeks, relative to the average (top panel) and country-specific treatment effects (95% confidence intervals), relative to the average (lower panel)

References

    1. Papachristofi O, Klein A A, Mackay J, Nashef S A M, Fletcher S N, Sharples L D, on behalf of the Association of Cardiothoracic Anaesthetists (ACTA). The impact of centre, surgeon and anaesthetist on risk-adjusted length of stay in hospital after cardiac surgery: Association of Cardiothoracic Anaesthetists (ACTA) consecutive cases series study of ten UK specialist centres. BMJ Open. 2017;7:e016947.
    1. Kahan BC, Morris TP. Analysis of multicentre trials with continuous outcomes: when and how should we account for centre effects? Stat Med. 2013;32(7):1136–1149. doi: 10.1002/sim.5667.
    1. Karrison T, Kocherginsky M. Restricted mean survival time: does covariate adjustment improve precision in randomized clinical trials? Clin Trials. 2018;15(2):178–188. doi: 10.1177/1740774518759281.
    1. Kahan BC, Morris TP. Assessing potential sources of clustering in individually randomised trials. BMC Med Res Methodol. 2013;13(1):58. doi: 10.1186/1471-2288-13-58.
    1. Roberts I, Shakur H, Coats T, Hunt B, Balogun E, Barnetson L, et al. The CRASH-2 trial: a randomised controlled trial and economic evaluation of the effects of tranexamic acid on death, vascular occlusive events and transfusion requirement in bleeding trauma patients. Health Technol Assess (Winchester, England) 2013;17(10):1.
    1. Gruen RL, Jacobs IG, Reade MC. Trauma and tranexamic acid. Med J Aust. 2013;199(5):310–311. doi: 10.5694/mja13.10747.
    1. Yau KK, Ng AS. Long-term survivor mixture model with random effects: application to a multi-centre clinical trial of carcinoma. Stat Med. 2001;20(11):1591–1607. doi: 10.1002/sim.932.
    1. Lingsma HF, Roozenbeek B, Perel P, Roberts I, Maas AI, Steyerberg EW. Between-centre differences and treatment effects in randomized controlled trials: a case study in traumatic brain injury. Trials. 2011;12(1):201. doi: 10.1186/1745-6215-12-201.
    1. CRASH Trial Collaborators Final results of MRC CRASH, a randomised placebo-controlled trial of intravenous corticosteroid in adults with head injury—outcomes at 6 months. Lancet. 2005;365(9475):1957–1959. doi: 10.1016/S0140-6736(05)66552-X.
    1. Roberts I, Prieto-Merino D. Applying results from clinical trials: tranexamic acid in trauma patients. J Intensive Care. 2014;2(1):56. doi: 10.1186/s40560-014-0056-1.
    1. Senn SS. Statistical issues in drug development: Second edition. Chichester: Wiley; 2007.
    1. Wiebe S, Blume WT, Girvin JP, Eliasziw M. A randomized, controlled trial of surgery for temporal-lobe epilepsy. N Engl J Med. 2001;345(5):311–318. doi: 10.1056/NEJM200108023450501.
    1. Sharples L, Everett C, Singh J, Mills C, Spyt T, Abu-Omar Y, Fynn S, Thorpe B, Stoneman V, Goddard H, Fox-Rushby J. Amaze: a double-blind, multicentre randomised controlled trial to investigate the clinical effectiveness and cost-effectiveness of adding an ablation device-based maze procedure as an adjunct to routine cardiac surgery for patients with pre-existing atrial fibrillation. Health Technol Assess (Winchester, England) 2018;22(19):1–32. doi: 10.3310/hta22190.
    1. ICH E9 Expert working group Statistical principles for clinical trials: ICH harmonised tripartite guideline. Stat Med. 1999;18:1905–1942.
    1. Rabe-Hesketh S, Skrondal A. Multilevel and longitudinal modeling using Stata: STATA press; Third edition: Texas, USA 2008.
    1. Kahan BC. Accounting for centre-effects in multicentre trials with a binary outcome–when, why, and how? BMC Med Res Methodol. 2014;14(1):1–1. doi: 10.1186/1471-2288-14-20.

Source: PubMed

3
Suscribir