Assessment of the End Point Adjudication Process on the Results of the Platelet-Oriented Inhibition in New TIA and Minor Ischemic Stroke (POINT) Trial: A Secondary Analysis

Mary Farrant, J Donald Easton, Eric E Adelman, Brett L Cucchiara, William G Barsan, Holly J Tillman, Jordan J Elm, Anthony S Kim, Anne S Lindblad, Yuko Y Palesch, Wenle Zhao, Keith Pauls, Kyle B Walsh, Joan Martí-Fàbregas, Richard A Bernstein, S Claiborne Johnston, Mary Farrant, J Donald Easton, Eric E Adelman, Brett L Cucchiara, William G Barsan, Holly J Tillman, Jordan J Elm, Anthony S Kim, Anne S Lindblad, Yuko Y Palesch, Wenle Zhao, Keith Pauls, Kyle B Walsh, Joan Martí-Fàbregas, Richard A Bernstein, S Claiborne Johnston

Abstract

Importance: Debate continues about the value of event adjudication in clinical trials and whether independent centralized assessments improve reliability and validity of study results in masked randomized trials compared with local, investigator-assessed end points.

Objective: To assess the results of the adjudicated end point process in the Platelet-Oriented Inhibition in New TIA and Minor Ischemic Stroke (POINT) trial by comparing end points assessed by local site investigators with centrally adjudicated end points.

Design, setting, and participants: This is an ad hoc secondary analysis of a randomized, double-blind clinical trial comparing safety and effectiveness of clopidogrel bisulphate plus aspirin vs placebo plus aspirin. Patients received either 600 mg of clopidogrel bisulphate on day 1, then 75 mg per day through day 90 plus 50 to 325 mg of aspirin per day, or the same range of dosages of placebo plus aspirin. Investigators reported all potential end points; independent masked adjudicators were randomly assigned to review using definitions specified in the study protocol. This was a multicenter study; 269 international sites in 10 countries enrolled from May 28, 2010, to December 19, 2017. The study enrolled 4881 patients 18 years or older with transient ischemic attack or minor acute ischemic stroke within 12 hours of symptom onset and followed for 90 days from randomization; last follow-up was completed in March 2018.

Main outcomes and measures: Independent adjudicators external to the study and masked to study treatment assignment adjudicated 467 primary and secondary effectiveness outcomes and major and minor bleeding events, including the primary composite end point, which was the risk of a composite of major ischemic events at 90 days, defined as ischemic stroke, myocardial infarction, or death from an ischemic vascular event. The primary safety end point was major hemorrhage. All components of the primary and safety outcomes were adjudicated.

Results: In this secondary analysis of an international randomized clinical trial, a total of 269 sites worldwide randomized 4881 patients (median age, 65.0 years; interquartile range, 55-74 years); 55.0% were male. The primary results have been published previously. The hazard ratios for clopidogrel plus aspirin vs placebo plus aspirin for the primary composite end point were 0.75 (95% CI, 0.59-0.95) for adjudicator-assessed events and 0.76 (95% CI, 0.60-0.95) for investigator-assessed events. Agreement between adjudicator and investigator assessments was 90.7%. The hazard ratios for clopidogrel plus aspirin vs placebo plus aspirin for the primary safety end point were 2.32 (95% CI, 1.10-4.87) for adjudicator-assessed events and 2.58 (95% CI, 1.19-5.58) for investigator-assessed events, with an agreement rate of 77.5%.

Conclusions and relevance: Independent end point adjudication did not substantially alter estimates of the primary treatment effectiveness in the POINT trial.

Trial registration: ClinicalTrials.gov identifier: NCT00991029.

Conflict of interest statement

Conflict of Interest Disclosures: Ms Farrant reported receiving research grant support from the National Institutes of Health (NIH)/National Institute of Neurological Disorders and Stroke (NINDS) for the Platelet-Oriented Inhibition in New TIA and Minor Ischemic Stroke (POINT) trial and from AstraZeneca for conducting the SOCRATES trial. Dr Easton reported receiving research grant support from the NIH/NINDS as coprincipal investigator for the POINT trial; receiving support from Boehringer Ingelheim as a consultant for the planning, conduct, and publication of the results of the RE-SPECT ESUS trial; participating in planning and conduct of the SOCRATES trial; that his institution received research grant support from AstraZeneca; receiving nonfinancial support from Sanofi; and serving as a consultant for Sanofi at an advisory board meeting. Dr Adelman reported receiving research grant support from the NIH/NINDS for the POINT trial, receiving funding as an adjudicator for the SOCRATES trial, receiving salary support as the chair of the adjudications committee for the POINT trial, receiving grants from the NIH, and receiving personal fees from the University of California, San Francisco. Dr Cucchiara reported receiving research grant support from the NIH/NINDS for the POINT trial, receiving funding as an adjudicator for the SOCRATES trial, and receiving grants from the NINDS. Dr Barsan reported receiving salary support from the NIH/NINDS for the POINT trial and receiving salary support from the NIH/NINDS as principal investigator for the Neurologic Emergencies Treatment Trials (NETT) network, as coinvestigator for the SHINE trial, and as coinvestigator for the ESETT trial. Ms Tillman reported receiving grants from the Medical University of South Carolina. Dr Elm reported receiving research grant support from the NIH/NINDS for the POINT trial. Dr Kim reported receiving research grant support from the NIH/NINDS as coprincipal investigator for the POINT trial, support from Neuravi as a member of the data and safety monitoring board for the ARISE-2 trial, and grants from SanBio. Dr Lindblad reported serving as president and CEO of The Emmes Corporation (a for-profit contract research organization) and receiving research grant support from the NIH/NINDS for the POINT trial. Dr Palesch reported receiving grant support from the NIH/NINDS for the POINT trial. Dr Zhao reported receiving salary support from the NIH/NINDS for the POINT trial. Mr Pauls reported receiving salary support from the NIH/NINDS for the POINT trial. Dr Walsh reported receiving salary support from the NIH/NINDS for the POINT trial. Dr Martí-Fàbregas reported receiving salary support from the NIH/NINDS for the POINT trial. Dr Bernstein reported receiving salary support from the NIH/NINDS for the POINT trial and receiving grants or personal fees from Boehringer Ingleheim, Bristol-Myers Squibb, Medtronic, Pfizer, Abbott, AbbVie, and Amgen. Dr Johnston reported receiving research grant support from the NIH/NINDS as principal investigator for the POINT trial, serving as a consultant to AstraZeneca during planning of the SOCRATES and THALES trials (his institution received research support for their conduct), and receiving nonfinancial support from Sanofi and AstraZeneca.

Figures

Figure.. Six-Step Outcome Adjudication Module
Figure.. Six-Step Outcome Adjudication Module
The web-based clinical trial management system for the Platelet-Oriented Inhibition in New TIA and Minor Ischemic Stroke (POINT) trial automates the coordination of adjudication activities by controlling workflows, in real time, based on data collected. ACC indicates adjudication committee chair; ADJ, adjudicator; CEC, clinician event monitor; CRF, case report form; PM, project manager; Q, question; S, step; and SAE, serious adverse event.

References

    1. Seltzer JH, Heise T, Carson P, et al. . Use of endpoint adjudication to improve the quality and validity of endpoint assessment for medical device development and post marketing evaluation: rationale and best practices: a report from the cardiac safety research consortium. Am Heart J. 2017;190:-. doi:10.1016/j.ahj.2017.05.009
    1. Dechartres A, Boutron I, Roy C, Ravaud P. Inadequate planning and reporting of adjudication committees in clinical trials: recommendation proposal. J Clin Epidemiol. 2009;62(7):695-702. doi:10.1016/j.jclinepi.2008.09.011
    1. Ndounga Diakou LA, Trinquart L, Hróbjartsson A, et al. . Comparison of central adjudication of outcomes and onsite outcome assessment on treatment effect estimates. Cochrane Database Syst Rev. 2016;3(3):MR000043. doi:10.1002/14651858.MR000043.pub2
    1. Hróbjartsson A, Thomsen AS, Emanuelsson F, et al. . Observer bias in randomised clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors. BMJ. 2012;344:e1119. doi:10.1136/bmj.e1119
    1. Calvo G, McMurray JJV, Granger CB, et al. . Large streamlined trials in cardiovascular disease. Eur Heart J. 2014;35(9):544-548. doi:10.1093/eurheartj/eht535
    1. Pogue J, Walter SD, Yusuf S. Evaluating the benefit of event adjudication of cardiovascular outcomes in large simple RCTs. Clin Trials. 2009;6(3):239-251. doi:10.1177/1740774509105223
    1. Granger CB, Vogel V, Cummings SR, et al. . Do we need to adjudicate major clinical events? Clin Trials. 2008;5(1):56-60. doi:10.1177/1740774507087972
    1. Farb A, Zuckerman BD. Clinical event adjudication in cardiovascular device trials: a Food and Drug Administration perspective. Am Heart J. 2017;191:62-64. doi:10.1016/j.ahj.2017.05.010
    1. US Food and Drug Administration Guidance for clinical trial sponsors: establishment and operation of clinical trial data monitoring committees; availability. Fed Regist. 2006;71:15421-15422. . Published March 28, 2006. Accessed August 14, 2019.
    1. European Medicines Agency Committee for Medicinal Products for Human Use (CHMP). . Published May 2004. Accessed November 29, 2018.
    1. US Food and Drug Administration Multiple endpoints in clinical trials: guidance for industry. . Published January 2017. Accessed November 29, 2018.
    1. Zhao W, Pauls K. Architecture design of a generic centralized adjudication module integrated in a web-based clinical trial management system. Clin Trials. 2016;13(2):223-233. doi:10.1177/1740774515611889
    1. Johnston SC, Easton JD, Farrant M, et al. . Platelet-Oriented Inhibition in New TIA and Minor Ischemic Stroke (POINT) trial: rationale and design. Int J Stroke. 2013;8(6):479-483. doi:10.1111/ijs.12129
    1. Johnston SC, Easton JD, Farrant M, et al. ; Clinical Research Collaboration, Neurological Emergencies Treatment Trials Network, and the POINT Investigators . Clopidogrel and aspirin in acute ischemic stroke and high-risk TIA. N Engl J Med. 2018;379(3):215-225. doi:10.1056/NEJMoa1800410
    1. Hata J, Arima H, Zoungas S, et al. ; ADVANCE Collaborative Group . Effects of the endpoint adjudication process on the results of a randomised controlled trial: the ADVANCE trial. PLoS One. 2013;8(2):e55807. doi:10.1371/journal.pone.0055807
    1. Godolphin PJ, Montgomery AA, Woodhouse LJ, et al. ; ENOS Investigators . Central adjudication of serious adverse events did not affect trial’s safety results: data from the Efficacy of Nitric Oxide in Stroke (ENOS) trial. PLoS One. 2018;13(11):e0208142. doi:10.1371/journal.pone.0208142
    1. Girard P, Penaloza A, Parent F, et al. . Reproducibility of clinical events adjudications in a trial of venous thromboembolism prevention. J Thromb Haemost. 2017;15(4):662-669. doi:10.1111/jth.13626
    1. Held C, White HD, Stewart RAH, et al. ; STABILITY Investigators . Characterization of cardiovascular clinical events and impact of event adjudication on the treatment effect of darapladib versus placebo in patients with stable coronary heart disease: Insights from the STABILITY trial. Am Heart J. 2019;208:65-73. doi:10.1016/j.ahj.2018.10.010
    1. Ninomiya T, Donnan G, Anderson N, et al. ; PROGRESS Collaborative Group . Effects of the end point adjudication process on the results of the Perindopril Protection Against Recurrent Stroke Study (PROGRESS). Stroke. 2009;40(6):2111-2115. doi:10.1161/STROKEAHA.108.539601
    1. Kirwan BA, Lubsen J, de Brouwer S, et al. ; ACTION (A Coronary Disease Trial Investigating Outcome With Nifedipine GITS) Investigators. Diagnostic criteria and adjudication process both determine published event-rates: the ACTION trial experience. Contemp Clin Trials. 2007;28(6):720-729. doi:10.1016/j.cct.2007.04.001
    1. Sepehrvand N, Zheng Y, Armstrong PW, et al. . Alignment of site versus adjudication committee–based diagnosis with patient outcomes: insights from the Providing Rapid Out of Hospital Acute Cardiovascular Treatment 3 trial. Clin Trials. 2016;13(2):140-148. doi:10.1177/1740774515601437
    1. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276-282. doi:10.11613/BM.2012.031
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-174. doi:10.2307/2529310

Source: PubMed

3
Iratkozz fel