Multi-arm multi-stage trials can improve the efficiency of finding effective treatments for stroke: a case study
Thomas Jaki, James M S Wason, Thomas Jaki, James M S Wason
Abstract
Background: Many recent Stroke trials fail to show a beneficial effect of the intervention late in the development. Currently a large number of new treatment options are being developed. Multi-arm multi-stage (MAMS) designs offer one potential strategy to avoid lengthy studies of treatments without beneficial effects while at the same time allowing evaluation of several novel treatments. In this paper we provide a review of what MAMS designs are and argue that they are of particular value for Stroke trials. We illustrate this benefit through a case study based on previous published trials of endovascular treatment for acute ischemic stroke. We show in this case study that MAMS trials provide additional power for the same sample size compared to alternative trial designs. This level of additional power depends on the recruitment length of the trial, with most efficiency gained when recruitment is relatively slow. We conclude with a discussion of additional considerations required when starting a MAMS trial.
Conclusion: MAMS trial designs are potentially very useful for stroke trials due to their improved statistical power compared to the traditional approach.
Keywords: Adaptive design; Clinical trial design; Multi-arm multi-stage trials; Multi-arm trials.
Conflict of interest statement
Ethics approval and consent to participateNot applicable.
Consent for publicationNot applicable.
Competing interestsThe authors declare that they have no competing interests.
Publisher’s NoteSpringer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figures
References
- DiMasi JA, Hansen RW, Grabowski HG. The price of innovation: new estimates of drug development costs. J Health Econ. 2003;22(2):151–185. doi: 10.1016/S0167-6296(02)00126-1.
- Arrowsmith J. Trial watch: phase II failures: 2008-2010. Nat Rev Drug Discov. 2011;10(5):328–329. doi: 10.1038/nrd3439.
- watch AJT. Phase III and submission failures: 2007-2010. Nat Rev Drug Discov. 2011;10(2):87. doi: 10.1038/nrd3375.
- Kidwell CS, Jahan R, Gornbein J, Alger JR, Nenov V, Ajani Z, et al. A trial of imaging selection and endovascular treatment for ischemic stroke. N Engl J Med. 2013;368(10):914–923. doi: 10.1056/NEJMoa1212793.
- Ciccone A, Valvassori L, Nichelatti M, Sgoifo A, Ponzio M, Sterzi R, et al. Endovascular treatment for acute ischemic stroke. N Engl J Med. 2013;368(10):904–913. doi: 10.1056/NEJMoa1213701.
- Broderick JP, Palesch YY, Demchuk AM, Yeatts SD, Khatri P, Hill MD, et al. Endovascular therapy after intravenous t-PA versus t-PA alone for stroke. N Engl J Med. 2013;368(10):893–903. doi: 10.1056/NEJMoa1214300.
- PhRMA. Medicines in Development - Heart Disease and Stroke 2013.
- Parmar MK, Carpenter J, Sydes MR. More multiarm randomised trials of superiority are needed. Lancet. 2014;384(9940):283–284. doi: 10.1016/S0140-6736(14)61122-3.
- Halpern SD, Karlawish JH, Casarett D, Berlin JA, Townsend RR, Asch DA. Hypertensive patients' willingness to participate in placebo-controlled trials: implications for recruitment efficiency. Am Heart J. 2003;146(6):985–992. doi: 10.1016/S0002-8703(03)00507-6.
- Jennison Christopher, Turnbull Bruce. Group Sequential Methods. 1999.
- Magirr D, Jaki T, Whitehead J. A generalized Dunnett test for multi-arm multi-stage clinical studies with treatment selection. Biometrika. 2012;99(2):494–501. doi: 10.1093/biomet/ass002.
- Stallard N, Friede T. A group-sequential design for clinical trials with treatment selection. Statist Med. 2008;27(29):6209–6227. doi: 10.1002/sim.3436.
- Sydes MR, Parmar MK, Mason MD, Clarke NW, Amos C, Anderson J, et al. Flexible trial design in practice-stopping arms for lack-of-benefit and adding research arms mid-trial in STAMPEDE: a multi-arm multi-stage randomized controlled trial. Trials. 2012;13(1):168. doi: 10.1186/1745-6215-13-168.
- Sydes M, Parmar M, James N, Clarke N, Dearnaley D, Mason M, et al. Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial. Trials. 2009;10(1):39. doi: 10.1186/1745-6215-10-39.
- Anisimov V. Predictive modelling of recruitment and drug supply in multicenter. clinical trials. 2009:1248–59.
- . 2014.
- . 2014.
- . 2014.
- . 2014.
- . 2014.
- Krams M, Lees KR, Hacke W, Grieve AP, Orgogozo JM, Ford GA. Acute stroke therapy by inhibition of neutrophils (ASTIN) an adaptive dose-response study of UK-279,276 in acute ischemic stroke. Stroke. 2003;34(11):2543–2548. doi: 10.1161/01.STR.0000092527.33910.89.
- . 2014.
- . 2014.
- Rankin J. Cerebral vascular accidents in patients over the age of 60. II. Prognosis. Scott Med J. 1957;2(5):200–215. doi: 10.1177/003693305700200504.
- Mahoney FI. Functional evaluation: the Barthel index. Md State Med J. 1965;14:61–65.
- Minnerup J, Wersching H, Schilling M, Schabitz WR. Analysis of early phase and subsequent phase III stroke studies of neuroprotectants: outcomes and predictors for success. Exp Transll Stroke Med. 2014;6(1):2. doi: 10.1186/2040-7378-6-2.
- Whitehead John, Stratton Irene. Group Sequential Clinical Trials with Triangular Continuation Regions. Biometrics. 1983;39(1):227. doi: 10.2307/2530822.
- Wason J, Jaki T. Optimal design of multi-arm multi-stage trials. Statist Med. 2012;31(30):4269–4279. doi: 10.1002/sim.5513.
- Wason J, Magirr D, Law M, Jaki T. Some recommendations for multi-arm multi-stage trials. Stat Methods Med Res. 2016;25(2):716–727. doi: 10.1177/0962280212465498.
- Wason J, Stecher L, Mander A. Correcting for multiple-testing in multi-arm trials: is it necessary and is it done? Trials. 2014;15(1):364. doi: 10.1186/1745-6215-15-364.
- Wason James M. S., Trippa Lorenzo. A comparison of Bayesian adaptive randomization and multi-stage designs for multi-arm clinical trials. Statistics in Medicine. 2014;33(13):2206–2221. doi: 10.1002/sim.6086.
- Wason J, Stallard N, Bowden J, Jennison C. A multi-stage drop-the-losers design for multi-arm clinical trials. Stat Methods Med Res. 2017;26(1):508–524. doi: 10.1177/0962280214550759.
Source: PubMed