Statistical analysis plan for the Steppedwedge Cluster Randomized trial of Electronic Early Notification of sepsis in hospitalized ward patients (SCREEN)

Yaseen M Arabi, Ramesh Kumar Vishwakarma, Hasan M Al-Dorzi, Eman Al Qasim, Sheryl Ann Abdukahil, Fawaz K Al-Rabeah, Huda Al Ghamdi, Ebtisam Al Ghamdi, SCREEN Trial Group, Yaseen M Arabi, Abdulmohsen Alsaawi, Ali M Al Khathaami, Raed H AlHazme, Abdullah Al Mutrafy, Eman Al Qasim, Sheryl Ann Abdukahil, Fawaz K Al-Rabeah, Huda Al Ghamdi, Ebtisam Al Ghamdi, Khadega A Abuelgasim, Abdulaleem Alatassi, Georges Nammour, Angela Caswell, John Alchin, Hasan M Al-Dorzi, Mufareh Edah AlKatheri, Ahmad Alharbi, Raed Al Almoodi, Joan Jones, Saad Al-Qahtani, Salih Bin Salih, Nahar Alselaim, Nabiha Tashkandi, Ramesh Kumar Vishwakarma, Zeyad Alyousef, Mohamed S Al Moammary, Soud Rasheed, Amal Matroud, Rasha Ebeid Al Anazi, Haifa Al Shammari, Majid M Alshamrani, Saleh Qasim, Saeed Obbed, Mohammed Al Qarni, Abdul Rahman Jazieh, Mohammed Al Zahrani, Fahad Al-Hameed, Adnan A Munshi, Wasil Jastaniah, Hassan AlMarhabi, Emad AlWafi, Ali H Alyami, Arwa O Yamani, Hadia Al Tabsh, Basem R Banat, Omar Abuskout, Anna Liza Marcelo, Mayadah M Alhabshi, Abdullah Al Hamdan, Ali Al Qarni, Ahmed Al Arfaj, Hani T Mustafa, Mohammad Shahin, Abdulaziz A Ghamdi, Jamielah Yaakob, Jamal Chalabi, Johanna E Greyvenstein, Abdulaziz Al Qasem, Hattan Esilan, Sami Musalam Aliyyen, Christa Myumi Sian, Turki Alwasaidi, Amar M Alhasani, Ibrahim J Jaber, Noha Omaish, Mohammad Abdrabo, Ahmad S Qureshi, Azura Abdrahim, Naif Almughamisi, Azurahazri Abd Rahim, Ahmed Al Shouabi, Shaher Qahtani, Mariam Alansari, Hanan Al Somali, Clara Masala, Gaber Madram, Wafa Nasser, Fatimah Talaqof, Maryam Almulhim, Yaseen M Arabi, Ramesh Kumar Vishwakarma, Hasan M Al-Dorzi, Eman Al Qasim, Sheryl Ann Abdukahil, Fawaz K Al-Rabeah, Huda Al Ghamdi, Ebtisam Al Ghamdi, SCREEN Trial Group, Yaseen M Arabi, Abdulmohsen Alsaawi, Ali M Al Khathaami, Raed H AlHazme, Abdullah Al Mutrafy, Eman Al Qasim, Sheryl Ann Abdukahil, Fawaz K Al-Rabeah, Huda Al Ghamdi, Ebtisam Al Ghamdi, Khadega A Abuelgasim, Abdulaleem Alatassi, Georges Nammour, Angela Caswell, John Alchin, Hasan M Al-Dorzi, Mufareh Edah AlKatheri, Ahmad Alharbi, Raed Al Almoodi, Joan Jones, Saad Al-Qahtani, Salih Bin Salih, Nahar Alselaim, Nabiha Tashkandi, Ramesh Kumar Vishwakarma, Zeyad Alyousef, Mohamed S Al Moammary, Soud Rasheed, Amal Matroud, Rasha Ebeid Al Anazi, Haifa Al Shammari, Majid M Alshamrani, Saleh Qasim, Saeed Obbed, Mohammed Al Qarni, Abdul Rahman Jazieh, Mohammed Al Zahrani, Fahad Al-Hameed, Adnan A Munshi, Wasil Jastaniah, Hassan AlMarhabi, Emad AlWafi, Ali H Alyami, Arwa O Yamani, Hadia Al Tabsh, Basem R Banat, Omar Abuskout, Anna Liza Marcelo, Mayadah M Alhabshi, Abdullah Al Hamdan, Ali Al Qarni, Ahmed Al Arfaj, Hani T Mustafa, Mohammad Shahin, Abdulaziz A Ghamdi, Jamielah Yaakob, Jamal Chalabi, Johanna E Greyvenstein, Abdulaziz Al Qasem, Hattan Esilan, Sami Musalam Aliyyen, Christa Myumi Sian, Turki Alwasaidi, Amar M Alhasani, Ibrahim J Jaber, Noha Omaish, Mohammad Abdrabo, Ahmad S Qureshi, Azura Abdrahim, Naif Almughamisi, Azurahazri Abd Rahim, Ahmed Al Shouabi, Shaher Qahtani, Mariam Alansari, Hanan Al Somali, Clara Masala, Gaber Madram, Wafa Nasser, Fatimah Talaqof, Maryam Almulhim

Abstract

Background: It is unclear whether screening for sepsis using an electronic alert in hospitalized ward patients improves outcomes. The objective of the Stepped-wedge Cluster Randomized Trial of Electronic Early Notification of Sepsis in Hospitalized Ward Patients (SCREEN) trial is to evaluate whether an electronic screening for sepsis compared to no screening among hospitalized ward patients reduces all-cause 90-day in-hospital mortality.

Methods and design: This study is designed as a stepped-wedge cluster randomized trial in which the unit of randomization or cluster is the hospital ward. An electronic alert for sepsis was developed in the electronic medical record (EMR), with the feature of being active (visible to treating team) or masked (inactive in EMR frontend for the treating team but active in the backend of the EMR). Forty-five clusters in 5 hospitals are randomized into 9 sequences of 5 clusters each to receive the intervention (active alert) over 10 periods, 2 months each, the first being the baseline period. Data are extracted from EMR and are compared between the intervention (active alert) and control group (masked alert). During the study period, some of the hospital wards were allocated to manage patients with COVID-19. The primary outcome of all-cause hospital mortality by day 90 will be compared using a generalized linear mixed model with a binary distribution and a log-link function to estimate the relative risk as a measure of effect. We will include two levels of random effects to account for nested clustering within wards and periods and two levels of fixed effects: hospitals and COVID-19 ward status in addition to the intervention. Results will be expressed as relative risk with a 95% confidence interval.

Conclusion: The SCREEN trial provides an opportunity for a novel trial design and analysis of routinely collected and entered data to evaluate the effectiveness of an intervention (alert) for a common medical problem (sepsis in ward patients). In this statistical analysis plan, we outline details of the planned analyses in advance of trial completion. Prior specification of the statistical methods and outcome analysis will facilitate unbiased analyses of these important clinical data.

Trial registration: ClinicalTrials.gov NCT04078594 . Registered on September 6, 2019.

Keywords: Alert; Electronic medical records; Mortality; Screening; Sepsis; qSOFA.

Conflict of interest statement

The authors declare that they have no competing interests.

© 2021. The Author(s).

Figures

Fig. 1
Fig. 1
Patient flow according to the CONSORT flowchart

References

    1. Evans L, Rhodes A, Alhazzani W, Antonelli M, Coopersmith CM, French C, et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021. Intensive Care Med. 2021;47(11):1181-247.
    1. Levy MM, Evans LE, Rhodes A. The surviving sepsis campaign bundle: 2018 update. Intensive Care Med. 2018;44(6):925–928. doi: 10.1007/s00134-018-5085-0.
    1. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M. Early goal-directed therapy in the treatment of severe sepsis and septic shock. New Engl J Med. 2001;345(19):1368–1377. doi: 10.1056/NEJMoa010307.
    1. Makam AN, Nguyen OK, Auerbach AD. Diagnostic accuracy and effectiveness of automated electronic sepsis alert systems: a systematic review. J Hosp Med. 2015;10(6):396–402. doi: 10.1002/jhm.2347.
    1. Arabi YM, Alsaawi A, Al Zahrani M, Al Khathaami AM, AlHazme RH, Al Mutrafy A, et al. Electronic early notification of sepsis in hospitalized ward patients: a study protocol for a stepped-wedge cluster randomized controlled trial. Trials. 2021;22(1):695. doi: 10.1186/s13063-021-05562-5.
    1. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, Hotchkiss RS, Levy MM, Marshall JC, Martin GS, Opal SM, Rubenfeld GD, van der Poll T, Vincent JL, Angus DC. The third international consensus definitions for sepsis and septic shock (Sepsis-3) JAMA. 2016;315(8):801–810. doi: 10.1001/jama.2016.0287.
    1. ICH. The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH): statistical principles for clinical trials 5 February 1998 [Available from: .
    1. ICH. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use: E3 - structure and content of clinical study reports 30 November 1995 [Available from: .
    1. Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340(mar23 1):c869. doi: 10.1136/bmj.c869.
    1. Schulz KF, Altman DG, Moher D, Group C CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340(mar23 1):c332. doi: 10.1136/bmj.c332.
    1. Hemming K, Taljaard M, McKenzie JE, Hooper R, Copas A, Thompson JA, et al. Reporting of stepped wedge cluster randomised trials: extension of the CONSORT 2010 statement with explanation and elaboration. BMJ. 2018;363:k1614. doi: 10.1136/bmj.k1614.
    1. Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, Kumar A, Sevransky JE, Sprung CL, Nunnally ME, Rochwerg B, Rubenfeld GD, Angus DC, Annane D, Beale RJ, Bellinghan GJ, Bernard GR, Chiche JD, Coopersmith C, de Backer DP, French CJ, Fujishima S, Gerlach H, Hidalgo JL, Hollenberg SM, Jones AE, Karnad DR, Kleinpell RM, Koh Y, Lisboa TC, Machado FR, Marini JJ, Marshall JC, Mazuski JE, McIntyre LA, McLean AS, Mehta S, Moreno RP, Myburgh J, Navalesi P, Nishida O, Osborn TM, Perner A, Plunkett CM, Ranieri M, Schorr CA, Seckel MA, Seymour CW, Shieh L, Shukri KA, Simpson SQ, Singer M, Thompson BT, Townsend SR, van der Poll T, Vincent JL, Wiersinga WJ, Zimmerman JL, Dellinger RP. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock: 2016. Intensive Care Med. 2017;43(3):304–377. doi: 10.1007/s00134-017-4683-6.
    1. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–191. doi: 10.1016/j.cct.2006.05.007.
    1. Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350(feb06 1):h391. doi: 10.1136/bmj.h391.
    1. Al-Dorzi HM, Aldawood AS, Almatrood A, Burrows V, Naidu B, Alchin JD, et al. Managing critical care during COVID-19 pandemic: the experience of an ICU of a tertiary care hospital. J Infect Public Health. 2021;14(11):1635–1641. doi: 10.1016/j.jiph.2021.09.018.
    1. Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, and the Northwell COVID-19 Research Consortium. Barnaby DP, Becker LB, Chelico JD, Cohen SL, Cookingham J, Coppa K, Diefenbach MA, Dominello AJ, Duer-Hefele J, Falzon L, Gitlin J, Hajizadeh N, Harvin TG, Hirschwerk DA, Kim EJ, Kozel ZM, Marrast LM, Mogavero JN, Osorio GA, Qiu M, Zanos TP. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area. Jama. 2020;323(20):2052–2059. doi: 10.1001/jama.2020.6775.
    1. Shakeshaft A, Doran C, Petrie D, Breen C, Havard A, Abudeen A, Harwood E, Clifford A, D'Este C, Gilmour S, Sanson-Fisher R. The effectiveness of community action in reducing risky alcohol consumption and harm: a cluster randomised controlled trial. PLoS Med. 2014;11(3):e1001617. doi: 10.1371/journal.pmed.1001617.
    1. Thompson JA, Hemming K, Forbes A, Fielding K, Hayes R. Comparison of small-sample standard-error corrections for generalised estimating equations in stepped wedge cluster randomised trials with a binary outcome: a simulation study. Stat Methods Med Res. 2021;30(2):425–439. doi: 10.1177/0962280220958735.
    1. Kenward MG, Roger JH. Small sample inference for fixed effects from restricted maximum likelihood. Biometrics. 1997;53(3):983–997. doi: 10.2307/2533558.
    1. LITTLE, RJA, and D B RUBIN . Statistical analysis with missing data. New York: John Wiley & Sons; 1987.
    1. Thijs H, Molenberghs G, Michiels B, Verbeke G, Curran D. Strategies to fit pattern-mixture models. Biostatistics. 2002;3(2):245–265. doi: 10.1093/biostatistics/3.2.245.
    1. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B (Methodological) 1995;57(1):289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x.
    1. Benjamini Y, Yekutieli D, Edwards D, Shaffer JP, Tamhane AC, Westfall PH, et al. False discovery rate: adjusted multiple confidence intervals for selected parameters [with comments, Rejoinder] J Am Stat Assoc. 2005;100(469):71–93. doi: 10.1198/016214504000001907.
    1. Beard E, Lewis JJ, Copas A, Davey C, Osrin D, Baio G, Thompson JA, Fielding KL, Omar RZ, Ononge S, Hargreaves J, Prost A. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16(1):353. doi: 10.1186/s13063-015-0839-2.
    1. Lloyd M, Karahalios A, Janus E, Skinner EH, Haines T, De Silva A, et al. Effectiveness of a bundled intervention including adjunctive corticosteroids on outcomes of hospitalized patients with community-acquired pneumonia: a stepped-wedge randomized clinical trial. JAMA Intern Med. 2019;179(8):1052–1060. doi: 10.1001/jamainternmed.2019.1438.
    1. Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–948. doi: 10.1016/j.jclinepi.2010.12.003.
    1. Kadri SS, Sun J, Lawandi A, Strich JR, Busch LM, Keller M, et al. Association Between Caseload Surge and COVID-19 Survival in 558 U.S. Hospitals, March to August 2020. Annals of Internal Medicine. 2021;174(9):1240-51.

Source: PubMed

3
订阅