Early recognition and response to increases in surgical site infections using optimised statistical process control charts-The early 2RIS trial: A multicentre stepped wedge cluster randomised controlled trial

Arthur W Baker, Iulian Ilieş, James C Benneyan, Yuliya Lokhnygina, Katherine R Foy, Sarah S Lewis, Brittain Wood, Esther Baker, Linda Crane, Kathryn L Crawford, Andrea L Cromer, Polly Padgette, Linda Roach, Linda Adcock, Nicole Nehls, Joseph Salem, Dale Bratzler, E Patchen Dellinger, Linda R Greene, Susan S Huang, Christopher R Mantyh, Deverick J Anderson, Arthur W Baker, Iulian Ilieş, James C Benneyan, Yuliya Lokhnygina, Katherine R Foy, Sarah S Lewis, Brittain Wood, Esther Baker, Linda Crane, Kathryn L Crawford, Andrea L Cromer, Polly Padgette, Linda Roach, Linda Adcock, Nicole Nehls, Joseph Salem, Dale Bratzler, E Patchen Dellinger, Linda R Greene, Susan S Huang, Christopher R Mantyh, Deverick J Anderson

Abstract

Background: Traditional approaches for surgical site infection (SSI) surveillance have deficiencies that delay detection of SSI outbreaks and other clinically important increases in SSI rates. We investigated whether use of optimised statistical process control (SPC) methods and feedback for SSI surveillance would decrease rates of SSI in a network of US community hospitals.

Methods: We conducted a stepped wedge cluster randomised trial of patients who underwent any of 13 types of common surgical procedures across 29 community hospitals in the Southeastern United States. We divided the 13 procedures into six clusters; a cluster of procedures at a single hospital was the unit of randomisation and analysis. In total, 105 clusters were randomised to 12 groups of 8-10 clusters. All participating clusters began the trial in a 12-month baseline period of control or "traditional" SSI surveillance, including prospective analysis of SSI rates and consultative support for SSI outbreaks and investigations. Thereafter, a group of clusters transitioned from control to intervention surveillance every three months until all clusters received the intervention. Electronic randomisation by the study statistician determined the sequence by which clusters crossed over from control to intervention surveillance. The intervention was the addition of weekly application of optimised SPC methods and feedback to existing traditional SSI surveillance methods. Epidemiologists were blinded to hospital identity and randomisation status while adjudicating SPC signals of increased SSI rates, but blinding was not possible during SSI investigations. The primary outcome was the overall SSI prevalence rate (PR=SSIs/100 procedures), evaluated via generalised estimating equations with a Poisson regression model. Secondary outcomes compared traditional and optimised SPC signals that identified SSI rate increases, including the number of formal SSI investigations generated and deficiencies identified in best practices for SSI prevention. This trial was registered at ClinicalTrials.gov, NCT03075813.

Findings: Between Mar 1, 2016, and Feb 29, 2020, 204,233 unique patients underwent 237,704 surgical procedures. 148,365 procedures received traditional SSI surveillance and feedback alone, and 89,339 procedures additionally received the intervention of optimised SPC surveillance. The primary outcome of SSI was assessed for all procedures performed within participating clusters. SSIs occurred after 1171 procedures assigned control surveillance (prevalence rate [PR] 0.79 per 100 procedures), compared to 781 procedures that received the intervention (PR 0·87 per 100 procedures; model-based PR ratio 1.10, 95% CI 0.94-1.30, p=0.25). Traditional surveillance generated 24 formal SSI investigations that identified 120 SSIs with deficiencies in two or more perioperative best practices for SSI prevention. In comparison, optimised SPC surveillance generated 74 formal investigations that identified 458 SSIs with multiple best practice deficiencies.

Interpretation: The addition of optimised SPC methods and feedback to traditional methods for SSI surveillance led to greater detection of important SSI rate increases and best practice deficiencies but did not decrease SSI rates. Additional research is needed to determine how to best utilise SPC methods and feedback to improve adherence to SSI quality measures and prevent SSIs.

Funding: Agency for Healthcare Research and Quality.

Keywords: Healthcare-associated infection surveillance; Randomised controlled trial; Statistical process control; Surgical site infection.

Conflict of interest statement

AWB reports grant funding from the Agency for Healthcare Research and Quality, National Institute of Allergy and Infectious Diseases of the National Institutes of Health, and the Centers for Disease Control and Prevention Epicenters Program; and participation on the Advisory Board for Medincell. DJA reports grant funding from the Agency for Healthcare Research and Quality, National Institute of Allergy and Infectious Diseases of the National Institutes of Health, and the Centers for Disease Control and Prevention Epicenters Program; royalties from UpToDate; and co-ownership of Infection Control Education for Major Sports, LLC. EPD reports participation on the Advisory Board for Crely, Inc. and board membership of the Surgical Infection Society Foundation. II, JCB, KRF, YL, and NN report grant funding from the Agency for Healthcare Research and Quality.

© 2022 The Author(s).

Figures

Figure 1
Figure 1
Schematic for stepped wedge design.
Figure 2
Figure 2
Trial profile. SSI = surgical site infection.
Figure 3
Figure 3
Flowcharts detailing all traditional signals (Panel A) and SPC signals on the intervention arm (Panel B) requiring adjudication. SPC = statistical process control; SSI = surgical site infection.

References

    1. World Health Organization; Geneva: 2018. Global guidelines for the prevention of surgical site infection. Accessed 21 February 2022.
    1. Ban KA, Minei JP, Laronga C, et al. American college of surgeons and surgical infection society: surgical site infection guidelines, 2016 update. J Am Coll Surg. 2017;224(1):59–74.
    1. Magill SS, Edwards JR, Bamberg W, et al. Multistate point-prevalence survey of health care-associated infections. N Engl J Med. 2014;370(13):1198–1208.
    1. Anderson DJ, Podgorny K, Berrios-Torres SI, et al. Strategies to prevent surgical site infections in acute care hospitals: 2014 update. Infect Control Hosp Epidemiol. 2014;35(Suppl 2):S66–S88.
    1. Scott RD. The direct medical costs of healthcare-associated infections in U.S. hospitals and the benefits of prevention. Centers for Disease Control and Prevention (CDC). . Accessed 1 February 2022.
    1. Zimlichman E, Henderson D, Tamir O, et al. Health care-associated infections: a meta-analysis of costs and financial impact on the US health care system. JAMA Intern Med. 2013;173(22):2039–2046.
    1. Ademuyiwa AO, Hardy P, Runigamugabo E, et al. Reducing surgical site infections in low-income and middle-income countries (FALCON): a pragmatic, multicentre, stratified, randomised controlled trial. Lancet. 2021;398(10312):1687–1699.
    1. Monahan M, Jowett S, Pinkney T, et al. Surgical site infection and costs in low- and middle-income countries: a systematic review of the economic burden. PloS one. 2020;15(6):e0232960. –e.
    1. Kirkland KB, Briggs JP, Trivette SL, Wilkinson WE, Sexton DJ. The impact of surgical-site infections in the 1990s: attributable mortality, excess length of hospitalization, and extra costs. Infect Control Hosp Epidemiol. 1999;20(11):725–730.
    1. Berrios-Torres SI, Umscheid CA, Bratzler DW, et al. Centers for disease control and prevention guideline for the prevention of surgical site infection, 2017. JAMA Surg. 2017;152(8):784–791.
    1. Hawn MT, Vick CC, Richman J, et al. Surgical site infection prevention: time to move beyond the surgical care improvement program. Ann Surg. 2011;254(3):494–499. discussion 9-501.
    1. Hawn MT, Richman JS, Vick CC, et al. Timing of surgical antibiotic prophylaxis and the risk of surgical site infection. JAMA Surg. 2013;148(7):649–657.
    1. Haley RW, Culver DH, White JW, et al. The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals. Am J Epidemiol. 1985;121(2):182–205.
    1. Gaynes R, Richards C, Edwards J, et al. Feeding back surveillance data to prevent hospital-acquired infections. Emerg Infect Dis. 2001;7(2):295–298.
    1. Richards C, Emori TG, Peavy G, Gaynes R. Promoting quality through measurement of performance and response: prevention success stories. Emerg Infect Dis. 2001;7(2):299–301.
    1. Benneyan JC, Lloyd RC, Plsek PE. Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care. 2003;12(6):458–464.
    1. Levett JM, Carey RG. Measuring for improvement: from Toyota to thoracic surgery. Ann Thorac Surg. 1999;68(2):353–358. discussion 74-6.
    1. Edwards JR, Peterson KD, Mu Y, et al. National Healthcare Safety Network (NHSN) report: data summary for 2006 through 2008, issued December 2009. Am J Infect Control. 2009;37(10):783–805.
    1. Centers for Disease Control and Prevention. Current HAI progress report. 2018 national and state healthcare-associated infections progress report. . Accessed 16 February 2022.
    1. Rosenthal VD, Richtmann R, Singh S, et al. Surgical site infections, International Nosocomial Infection Control Consortium (INICC) report, data summary of 30 countries, 2005-2010. Infect Control Hosp Epidemiol. 2013;34(6):597–604.
    1. Baker AW, Haridy S, Salem J, et al. Performance of statistical process control methods for regional surgical site infection surveillance: a 10-year multicentre pilot study. BMJ Qual Saf. 2018;27(8):600–610.
    1. Baker AW, Nehls N, Ilies I, Benneyan JC, Anderson DJ. Use of optimised dual statistical process control charts for early detection of surgical site infection outbreaks. BMJ Qual Saf. 2020;29(6):517–520.
    1. Curran E, Harper P, Loveday H, et al. Results of a multicentre randomised controlled trial of statistical process control charts and structured diagnostic tools to reduce ward-acquired meticillin-resistant Staphylococcus aureus: the CHART project. J Hosp Infect. 2008;70(2):127–135.
    1. Dyrkorn OA, Kristoffersen M, Walberg M. Reducing post-caesarean surgical wound infection rate: an improvement project in a Norwegian maternity clinic. BMJ Qual Saf. 2012;21(3):206–210.
    1. Benneyan JC. Use and interpretation of statistical quality control charts. Int J Qual Health Care. 1998;10(1):69–73.
    1. Ilies I, Anderson DJ, Salem J, Baker AW, Jacobsen M, Benneyan JC. Large-scale empirical optimisation of statistical control charts to detect clinically relevant increases in surgical site infection rates. BMJ Qual Saf. 2020;29(6):472–481.
    1. Anderson DJ, Miller BA, Chen LF, et al. The network approach for prevention of healthcare-associated infections: long-term effect of participation in the Duke infection control outreach network. Infect Control Hosp Epidemiol. 2011;32(4):315–322.
    1. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54.
    1. Mdege ND, Kanaan M. Response to Keriel-Gascou et al. Addressing assumptions on the stepped wedge randomized trial design. J Clin Epidemiol. 2014;67(7):833–834.
    1. Hemming K, Taljaard M. Sample size calculations for stepped wedge and cluster randomised trials: a unified approach. J Clin Epidemiol. 2016;69:137–146.
    1. Hemming K, Lilford R, Girling AJ. Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs. Stat Med. 2015;34(2):181–196.
    1. Anderson DJ, Ilies I, Foy K, et al. Early recognition and response to increases in surgical site infections using optimized statistical process control charts-the Early 2RIS Trial: a multicenter cluster randomized controlled trial with stepped wedge design. Trials. 2020;21(1):894.
    1. Centers for Disease Control and Prevention (CDC). Procedure associated module: Surgical Site Infection (SSI) event. . Accessed 8 February 2022.
    1. Seidelman JL, Lewis SS, Baker AW, et al. Mayhall's Hospital Epidemiology and Infection Prevention. Fifth Edition. Wolters Kluwer; 2020. Surgical Site Infections. Webber D and Talbot T (eds) ISBN: 978-1-9751-2458-8.
    1. Bratzler DW, Dellinger EP, Olsen KM, et al. Clinical practice guidelines for antimicrobial prophylaxis in surgery. Am J Health Syst Pharm. 2013;70(3):195–283.
    1. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381.
    1. Duclos A, Chollet F, Pascal L, et al. Effect of monitoring surgical outcomes using control charts to reduce major adverse events in patients: cluster randomised trial. Bmj. 2020;371:m3840.
    1. Groseclose SL, Buckeridge DL. Public health surveillance systems: recent advances in their use and evaluation. Annu Rev Public Health. 2017;38(1):57–79.
    1. Dellinger EP, Villaflor-Camagong D, Whimbey E. Gradually increasing surgical site infection prevention bundle with monitoring of potentially preventable infections resulting in decreasing overall surgical site infection rate. Surg Infect (Larchmt) 2021;22(10):1072–1076.
    1. Baker AW, Dicks KV, Durkin MJ, et al. Epidemiology of surgical site infection in a community hospital network. Infect Control Hosp Epidemiol. 2016;37(5):519–526.
    1. Williams V, Leis JA. Applying rigour to the interpretation of surgical site infection rates. BMJ Qual Saf. 2020;29(6):446–448.

Source: PubMed

3
Abonner