Defining the noninferiority margin and analysing noninferiority: An overview

Turki A Althunian, Anthonius de Boer, Rolf H H Groenwold, Olaf H Klungel, Turki A Althunian, Anthonius de Boer, Rolf H H Groenwold, Olaf H Klungel

Abstract

Noninferiority trials are used to assess whether the effect of a new drug is not worse than an active comparator by more than a noninferiority margin. If the difference between the new drug and the active comparator does not exceed this prespecified margin, noninferiority can be concluded. This margin must be specified based on clinical and statistical reasoning; however, it is considered as one of the most challenging steps in the design of noninferiority trials. Regulators recommend that the margin should be defined based on the historical evidence of the active comparator (the latter is often the well-established standard treatment of the disease), which can be performed by different approaches. There are several factors and assumptions that need to be accounted for during the process of defining the margin and during the analysis of noninferiority. Three methods are commonly used to analyse noninferiority trials: the fixed-margin method; the point-estimate method; and the synthesis method. This article provides an overview of analysing noninferiority and choosing the noninferiority margin.

Keywords: biostatistics; clinical trials; drug regulation; methodology; randomized controlled trials.

© 2017 The Authors. British Journal of Clinical Pharmacology published by John Wiley & Sons Ltd on behalf of British Pharmacological Society.

Figures

Figure 1
Figure 1
Analysing noninferiority by comparing the confidence interval (CI) of the relative risk to a predefined margin. (1) and (2) Noninferiority was not demonstrated because the upper limit of the CI exceeded the margin. (A), (B), (C) Noninferiority was demonstrated because the upper limits of the CI did not exceed the margin
Figure 2
Figure 2
Analysing noninferiority of ximelagatran to warfarin using the relative risk. (1) Noninferiority margin for the fixed margin method. (2) Noninferiority margin for the point‐estimate and synthesis method. (*) The original confidence interval (CI) from SPORTIF V trial that was used to analyse noninferiority with the fixed‐margin and the point‐estimate methods. Noninferiority was not demonstrated with the fixed‐margin method and with the point‐estimate methods because the upper limit of the CI exceeded both margins (1.38 and 1.66). (&) The adjusted CI of SPORTIF V trial in the synthesis method. Noninferiority was not demonstrated because the upper limit of the CI is > the margin (1.66). (A), (B), (C) Noninferiority would have been demonstrated for all methods if the CI lies in one of the three positions in A, B or C
Figure 3
Figure 3
Analysing noninferiority of ximelagatran to warfarin using the risk difference. (1) Noninferiority margin for the fixed margin method. (2) Noninferiority margin for the point‐estimate and the synthesis method. (*) The original confidence interval (CI) from SPORTIF V trial that was used to analyse noninferiority with the fixed‐margin and the point‐estimate methods. Noninferiority was not demonstrated with the fixed‐margin method because the upper limit of the CI was > the margin (0.98%), whereas it was demonstrated with the point‐estimate because the upper limit of the confidence was the margin (1.88%). (A), (B), (C) Noninferiority would have been demonstrated for all methods if the CI lies in one of the three positions in A, B or C

References

    1. ICH Expert Working Group . ICH harmonised tripartite guideline: choice of control group in clinical trials (E 10) [online]. 2000. Available from: URL: (last accessed 01 February 2016).
    1. Center for Biologics Evaluation and Research (CBER) , Center for Drug Evaluation and Research (CDER) , Food and Drug Administration, U.S. Department of Health and Human Services . Guidance for industry non‐inferiority clinical trials [online]. 2010; Available from: URL: (last accessed 01 February 2016).
    1. Rothmann MD, Wiens BL, Chan IS. Design and analysis of non‐inferiority trials. Boca Raton, Florida: Chapman & Hall/CRC, 2012.
    1. Fleming TR, Odem‐Davis K, Rothmann MD, Li Shen Y. Some essential considerations in the design and conduct of non‐inferiority trials. Clin Trials 2011; 8: 432–439.
    1. Kaul S, Diamond GA. Good enough: a primer on the analysis and interpretation of noninferiority trials. Ann Intern Med 2006; 145: 62–69 doi: 145/1/62 [pii].
    1. ICH Expert Working Group . ICH harmonised tripartite guideline: statistical principles for clinical trials (E9) [online]. 1998; Available from: URL: (last accessed 01 Feb 2016).
    1. Committee for Medicinal Products for Human Use, the European Medicines Agency . Guideline on the choice of the non‐inferiority margin [online]. 2005; Available from: URL: (last accessed 01 Feb 2016).
    1. Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG, CONSORT Group . Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA 2012; 308: 2594–2604.
    1. Holmgren EB. Establishing equivalence by showing that a specified percentage of the effect of the active control over placebo is maintained. J Biopharm Stat 1999; 9: 651–659.
    1. Rothmann M, Li N, Chen G, Chi GY, Temple R, Tsou HH. Design and analysis of non‐inferiority mortality trials in oncology. Stat Med 2003. Jan 30; 22: 239–264.
    1. Snapinn S, Jiang Q. Preservation of effect and the regulatory approval of new treatments on the basis of non‐inferiority trials. Stat Med 2008; 27: 382–391.
    1. Wangge G, Klungel OH, Roes KC, de Boer A, Hoes AW, Knol MJ. Room for improvement in conducting and reporting non‐inferiority randomized controlled trials on drugs: a systematic review. PLoS One 2010. Oct 27; 5: e13550.
    1. Schiller P, Burchardi N, Niestroj M, Kieser M. Quality of reporting of clinical non‐inferiority and equivalence randomised trials – update and extension. Trials 2012. Nov 16; 13: 214.
    1. Hernandez AV, Pasupuleti V, Deshpande A, Thota P, Collins JA, Vidal JE. Deficient reporting and interpretation of non‐inferiority randomized clinical trials in HIV patients: a systematic review. PLoS One 2013. May 3; 8: e63272.
    1. Donken R, de Melker HE, Rots NY, Berbers G, Knol MJ. Comparing vaccines: a systematic review of the use of the non‐inferiority margin in vaccine trials. Vaccine 2015. Mar 17; 33: 1426–1432.
    1. Le Henanff A, Giraudeau B, Baron G, Ravaud P. Quality of reporting of noninferiority and equivalence randomized trials. JAMA 2006; 295: 1147–1151.
    1. Lange S, Freitag G. Choice of delta: requirements and reality – results of a systematic review. Biom J 2005. Feb; 47: 12–27; discussion 99‐107.
    1. Parienti JJ, Verdon R, Massari V. Methodological standards in non‐inferiority AIDS trials: moving from adherence to compliance. BMC Med Res Methodol 2006; 6: 46.
    1. Snapinn SM. Alternatives for discounting in the analysis of noninferiority trials. J Biopharm Stat 2004; 14: 263–273. .
    1. Wangge G, Roes KC, de Boer A, Hoes AW, Knol MJ. The challenges of determining noninferiority margins: a case study of noninferiority randomized controlled trials of novel oral anticoagulants. CMAJ 2013; 185: 222–227.
    1. Julious SA. The ABC of non‐inferiority margin setting from indirect comparisons. Pharm Stat 2011; 10: 448–453.
    1. Sacco RL, Diener HC, Yusuf S, Cotton D, Ôunpuu S, Lawton WA, et al. Aspirin and extended‐release dipyridamole versus clopidogrel for recurrent stroke. N Engl J Med 2008; 359: 1238–1251.
    1. SPORTIF executive steering committee for the SPORTIF V investigators . Ximelagatran vs warfarin for stroke prevention in patients with nonvalvular atrial fibrillation: a randomized trial. JAMA 2005; 293: 690–698.
    1. Kakkar AK, Agnelli G, Fisher W, George D, Lassen MR, Mismetti P, et al. Preoperative enoxaparin versus postoperative semuloparin thromboprophylaxis in major abdominal surgery: a randomized controlled trial. Ann Surg 2014; 259: 1073–1079.
    1. Natale RB, Thongprasert S, Greco FA, Thongprasert S, Greco FA, Thomas M, et al. Phase III trial of vandetanib compared with erlotinib in patients with previously treated advanced non‐small‐cell lung cancer. J Clin Oncol 2011; 29: 1059–1066.
    1. Carbonell‐Estrany X, Simoes EA, Dagan R, Hall CB, Harris B, Hultquist M, et al. Motavizumab for prophylaxis of respiratory syncytial virus in high‐risk children: a noninferiority trial. Pediatrics 2010; 125: e35–e51.
    1. Schulman S, Kearon C, Kakkar AK, Mismetti P, Schellong S, Eriksson H, et al. Dabigatran versus warfarin in the treatment of acute venous thromboembolism. N Engl J Med 2009; 361: 2342–2352.
    1. Loebel A, Cucchiaro J, Xu J, Sarma K, Pikalov A, Kane JM. Effectiveness of lurasidone vs. quetiapine XR for relapse prevention in schizophrenia: a 12‐month, double‐blind, noninferiority study. Schizophr Res 2013; 147: 95–102.

Source: PubMed

3
Abonner