Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency

Amelie Elsäßer, Jan Regnstrom, Thorsten Vetter, Franz Koenig, Robert James Hemmings, Martina Greco, Marisa Papaluca-Amati, Martin Posch, Amelie Elsäßer, Jan Regnstrom, Thorsten Vetter, Franz Koenig, Robert James Hemmings, Martina Greco, Marisa Papaluca-Amati, Martin Posch

Abstract

Background: Since the first methodological publications on adaptive study design approaches in the 1990s, the application of these approaches in drug development has raised increasing interest among academia, industry and regulators. The European Medicines Agency (EMA) as well as the Food and Drug Administration (FDA) have published guidance documents addressing the potentials and limitations of adaptive designs in the regulatory context. Since there is limited experience in the implementation and interpretation of adaptive clinical trials, early interaction with regulators is recommended. The EMA offers such interactions through scientific advice and protocol assistance procedures.

Methods: We performed a text search of scientific advice letters issued between 1 January 2007 and 8 May 2012 that contained relevant key terms. Letters containing questions related to adaptive clinical trials in phases II or III were selected for further analysis. From the selected letters, important characteristics of the proposed design and its context in the drug development program, as well as the responses of the Committee for Human Medicinal Products (CHMP)/Scientific Advice Working Party (SAWP), were extracted and categorized. For 41 more recent procedures (1 January 2009 to 8 May 2012), additional details of the trial design and the CHMP/SAWP responses were assessed. In addition, case studies are presented as examples.

Results: Over a range of 5½ years, 59 scientific advices were identified that address adaptive study designs in phase II and phase III clinical trials. Almost all were proposed as confirmatory phase III or phase II/III studies. The most frequently proposed adaptation was sample size reassessment, followed by dropping of treatment arms and population enrichment. While 12 (20%) of the 59 proposals for an adaptive clinical trial were not accepted, the great majority of proposals were accepted (15, 25%) or conditionally accepted (32, 54%). In the more recent 41 procedures, the most frequent concerns raised by CHMP/SAWP were insufficient justifications of the adaptation strategy, type I error rate control and bias.

Conclusions: For the majority of proposed adaptive clinical trials, an overall positive opinion was given albeit with critical comments. Type I error rate control, bias and the justification of the design are common issues raised by the CHMP/SAWP.

Figures

Figure 1
Figure 1
Number of identified scientific advice (SA) and protocol assistance (PA) procedures per year. The projection for 2012 (light gray) is based on linear extrapolation of the number of submissions received in 2012 until May 8, assuming the submission rate stays constant.

References

    1. Bauer P, Kohne K. Evaluation of experiments with adaptive interim analyses. Biometrics. 1994;50:1029–1041. doi: 10.2307/2533441.
    1. Proschan MA, Hunsberger SA. Designed extension of studies based on conditional power. Biometrics. 1995;51:1315–1324. doi: 10.2307/2533262.
    1. European Medicines Agency . Reflection Paper on Methodological Issues in Confirmatory Clinical Trials Planned with an Adaptive Design (CHMP/EWP/2459/02) 2007.
    1. U.S. Food and Drug Administration . Guidance for Industry – Adaptive Design Clinical Trials for Drugs and Biologics (Draft Guidance) 2010.
    1. Regnstrom J, Koenig F, Aronsson B, Reimer T, Svendsen K, Tsigkos S, Flamion B, Eichler H-G, Vamvakas S. Factors associated with success of market authorisation applications for pharmaceutical drugs submitted to the European Medicines Agency. Eur J Clin Pharmacol. 2010;66:39–48. doi: 10.1007/s00228-009-0756-y.
    1. Morgan CC, Huyck S, Jenkins M, Chen L, Bedding A, Christopher SC, Gaydos B, Wathen JK. Adaptive Design: Results of 2012 Survey on Perception and Use. Ther Innov Regul Sci. 2014;48:473–481. doi: 10.1177/2168479014522468.
    1. Gaydos B, Koch A, Miller F, Posch M, Vandemeulenbroecke M, Wang S-J. Perspective on adaptive designs: 4 years European Medicines Agency reflection paper, 1 year draft US FDA guidance – where are we now? Clin Invest. 2012;2:235–240. doi: 10.4155/cli.12.5.
    1. European Medicines Agency . Points to Consider on Multiplicity Issues in Clinical Trials (CPMP/EWP/908/99) 2002.
    1. European Medicines Agency . Guideline on Data Monitoring Committees (EMEA/CHMP/EWP/5872/03) 2005.
    1. European Medicines Agency . Guideline on Clinical Trials in Small Populations (CHMP/EWP/83561/2005) 2006.
    1. Müller HH, Schäfer H. Adaptive group sequential designs for clinical trials: combining the advantages of adaptive and of classical group sequential approaches. Biometrics. 2001;57:886–891. doi: 10.1111/j.0006-341X.2001.00886.x.
    1. Posch M, Bauer P. Adaptive two stage designs and the conditional error function. Biom J. 1999;41:689–696. doi: 10.1002/(SICI)1521-4036(199910)41:6<689::AID-BIMJ689>;2-P.
    1. Koenig F, Hemmings R. Minutes of the European Medicines Agency/European Federation of Pharmaceutical Industries and Associations second workshop on adaptive design in confirmatory trials. 2009. How We View The Changes In Submitted Adaptive Designs Since 2007; pp. 11–12.
    1. Lehmacher W, Wassmer G. Adaptive sample size calculations in group sequential trials. Biometrics. 1999;55:1286–1290. doi: 10.1111/j.0006-341X.1999.01286.x.
    1. Chi L, Hung HM, Wang SJ. Modification of sample size in group sequential clinical trials. Biometrics. 1999;55:853–857. doi: 10.1111/j.0006-341X.1999.00853.x.
    1. Chen YH, DeMets DL, Gordon Lan KK. Increasing the sample size when the unblinded interim result is promising. Stat Med. 2004;23:1023–1038. doi: 10.1002/sim.1688.
    1. Mehta CR, Pocock SJ. Adaptive increase in sample size when interim results are promising: a practical guide with examples. Stat Med. 2011;30:3267–3284. doi: 10.1002/sim.4102.
    1. Bauer P, Posch M. Modification of the sample size and the schedule of interim analyses in survival trials based on data inspections by H. Schäfer and H.‒H. Müller, Statistics in Medicine 2001; 20:3741–3751. Stat Med. 2004;23:1333–1334. doi: 10.1002/sim.1759.
    1. Jenkins M, Stone A, Jennison C. An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints. Pharm Stat. 2011;10:347–356. doi: 10.1002/pst.472.
    1. Irle S, Schäfer H. Interim design modifications in time-to-event studies. J Am Stat Assoc. 2012;107:341–348. doi: 10.1080/01621459.2011.644141.
    1. Hommel G. Adaptive modifications of hypotheses after an interim analysis. Biom J. 2001;43:581–589. doi: 10.1002/1521-4036(200109)43:5<581::AID-BIMJ581>;2-J.
    1. Posch M, Koenig F, Branson M, Brannath W, Dunger‒Baldauf C, Bauer P. Testing and estimation in flexible group sequential designs with adaptive treatment selection. Stat Med. 2005;24:3697–3714. doi: 10.1002/sim.2389.
    1. Bretz F, Koenig F, Brannath W, Glimm E, Posch M. Adaptive designs for confirmatory clinical trials. Stat Med. 2009;28:1181–1217. doi: 10.1002/sim.3538.
    1. Koenig F, Brannath W, Bretz F, Posch M. Adaptive Dunnett tests for treatment selection. Stat Med. 2008;27:1612–1625. doi: 10.1002/sim.3048.
    1. European Medicines Agency . Qualification Of Novel Methodologies For Drug Development: Guidance To Applicants (CHMP/SAWP/72894/2008 R) 2008.
    1. Bauer P, Koenig F, Brannath W, Posch M. Selection and bias - Two hostile brothers. Stat Med. 2010;29:1–13.
    1. Wang SJ, James Hung HM, O’Neill RT. Impacts on type I error rate with inappropriate use of learn and confirm in confirmatory adaptive design trials. Biom J. 2010;52:798–810. doi: 10.1002/bimj.200900207.

Source: PubMed

3
구독하다