Sustainable deimplementation of continuous pulse oximetry monitoring in children hospitalized with bronchiolitis: study protocol for the Eliminating Monitor Overuse (EMO) type III effectiveness-deimplementation cluster-randomized trial

Christopher P Bonafide, Rui Xiao, Amanda C Schondelmeyer, Amy R Pettit, Patrick W Brady, Christopher P Landrigan, Courtney Benjamin Wolk, Zuleyha Cidav, Halley Ruppel, Naveen Muthu, Nathaniel J Williams, Enrique Schisterman, Canita R Brent, Kimberly Albanowski, Rinad S Beidas, Pediatric Research in Inpatient Settings (PRIS) Network, Prabi Rajbhandari, Emily Knuth, Michelle Bailey, Kate Lucey, Patty Stoeck, Samantha House, Alyssa Silver, Monique Naifeh, Michael Tchou, Amy Tyler, Vivian Lee, Erin Cummings, Clifton Lee, Kyrie Shomaker, Alexandra Mihalek, Courtney Solomon, Raymond Parlar-Chun, Kathleen Berg, Nick Ryan, Tina Halley, Mary Orr, Tracey Liljestrom, Erin Preloger, Padmavathy Parthasarathy, Rashida Shakir, Andrew Chu, Morgan Greenfield, Julianne Prasto, Ann Le, Kimberly Monroe, Andrea Lauffer, Meredith Carter, Kamilah Halmon, Glen Huff, Kiran Gadani Patel, Jennie Ono, Alan Schroeder, Gregory Greg Plemmons, Michael Perry, Sumeet Banker, Jennifer Lee, Robert Willer, Begem Lee, Kyung Rhee, Richelle Baker, Polina Frolova Gregory, Vipul Parikh, Mini Wallace, Stephen Edwards, Lisa Beckner, Michelle Hamline, Lauren Solan, Leigh-Anne Cioffredi, Scarlett Johnson, John Andrake, Nicole Webb, Adam Berkwitt, Christopher P Bonafide, Rui Xiao, Amanda C Schondelmeyer, Amy R Pettit, Patrick W Brady, Christopher P Landrigan, Courtney Benjamin Wolk, Zuleyha Cidav, Halley Ruppel, Naveen Muthu, Nathaniel J Williams, Enrique Schisterman, Canita R Brent, Kimberly Albanowski, Rinad S Beidas, Pediatric Research in Inpatient Settings (PRIS) Network, Prabi Rajbhandari, Emily Knuth, Michelle Bailey, Kate Lucey, Patty Stoeck, Samantha House, Alyssa Silver, Monique Naifeh, Michael Tchou, Amy Tyler, Vivian Lee, Erin Cummings, Clifton Lee, Kyrie Shomaker, Alexandra Mihalek, Courtney Solomon, Raymond Parlar-Chun, Kathleen Berg, Nick Ryan, Tina Halley, Mary Orr, Tracey Liljestrom, Erin Preloger, Padmavathy Parthasarathy, Rashida Shakir, Andrew Chu, Morgan Greenfield, Julianne Prasto, Ann Le, Kimberly Monroe, Andrea Lauffer, Meredith Carter, Kamilah Halmon, Glen Huff, Kiran Gadani Patel, Jennie Ono, Alan Schroeder, Gregory Greg Plemmons, Michael Perry, Sumeet Banker, Jennifer Lee, Robert Willer, Begem Lee, Kyung Rhee, Richelle Baker, Polina Frolova Gregory, Vipul Parikh, Mini Wallace, Stephen Edwards, Lisa Beckner, Michelle Hamline, Lauren Solan, Leigh-Anne Cioffredi, Scarlett Johnson, John Andrake, Nicole Webb, Adam Berkwitt

Abstract

Background: Methods of sustaining the deimplementation of overused medical practices (i.e., practices not supported by evidence) are understudied. In pediatric hospital medicine, continuous pulse oximetry monitoring of children with the common viral respiratory illness bronchiolitis is recommended only under specific circumstances. Three national guidelines discourage its use for children who are not receiving supplemental oxygen, but guideline-discordant practice (i.e., overuse) remains prevalent. A 6-hospital pilot of educational outreach with audit and feedback resulted in immediate reductions in overuse; however, the best strategies to optimize sustainment of deimplementation success are unknown.

Methods: The Eliminating Monitor Overuse (EMO) trial will compare two deimplementation strategies in a hybrid type III effectiveness-deimplementation trial. This longitudinal cluster-randomized design will be conducted in Pediatric Research in Inpatient Settings (PRIS) Network hospitals and will include baseline measurement, active deimplementation, and sustainment phases. After a baseline measurement period, 16-19 hospitals will be randomized to a deimplementation strategy that targets unlearning (educational outreach with audit and feedback), and the other 16-19 will be randomized to a strategy that targets unlearning and substitution (adding an EHR-integrated clinical pathway decision support tool). The primary outcome is the sustainment of deimplementation in bronchiolitis patients who are not receiving any supplemental oxygen, analyzed as a longitudinal difference-in-differences comparison of overuse rates across study arms. Secondary outcomes include equity of deimplementation and the fidelity to, and cost of, each deimplementation strategy. To understand how the deimplementation strategies work, we will test hypothesized mechanisms of routinization (clinicians developing new routines supporting practice change) and institutionalization (embedding of practice change into existing organizational systems).

Discussion: The EMO trial will advance the science of deimplementation by providing new insights into the processes, mechanisms, costs, and likelihood of sustained practice change using rigorously designed deimplementation strategies. The trial will also advance care for a high-incidence, costly pediatric lung disease.

Trial registration: ClinicalTrials.gov, NCT05132322 . Registered on November 10, 2021.

Keywords: Bronchiolitis; Children; Deimplementation; Hospital; Infants; Lung; Nursing; Overuse; Pediatrics; Pulse oximetry.

Conflict of interest statement

RSB is an Associate Editor of Implementation Science; all decisions on this paper were made by other editors. RSB is the principal at Implementation Science & Practice, LLC. She receives royalties from Oxford University Press, consulting fees from United Behavioral Health and OptumLabs, and serves on the advisory boards for Optum Behavioral Health, AIM Youth Mental Health Foundation, and the Klingenstein Third Generation Foundation, outside of the submitted work. The other authors declare that they have no competing interests.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Trial diagram
Fig. 2
Fig. 2
CONSORT diagram
Fig. 3
Fig. 3
Mediation model

References

    1. Norton WE, Chambers DA. Unpacking the complexities of de-implementing inappropriate health interventions. Implement Sci. 2020;15(1):2.
    1. Nilsen P, Ingvarsson S, Hasson H, von Thiele SU, Augustsson H. Theories, models, and frameworks for de-implementation of low-value care: a scoping review of the literature. Implement Res Pract. 2020;1:2633489520953762.
    1. Morgan DJ, Brownlee S, Leppin AL, Kressin N, Dhruva SS, Levin L, et al. Setting a research agenda for medical overuse. BMJ. 2015;351:h4534.
    1. Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390(10090):156–168.
    1. Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9:1.
    1. Parsons Leigh J, Niven DJ, Boyd JM, Stelfox HT. Developing a framework to guide the de-adoption of low-value clinical practices in acute care medicine: a study protocol. BMC Health Serv Res. 2017;17(1):54.
    1. Wolf ER, Krist AH, Schroeder AR. Deimplementation in pediatrics: past, present, and future. JAMA Pediatr. 2021;175(3):230–232.
    1. Grimshaw JM, Patey AM, Kirkham KR, Hall A, Dowling SK, Rodondi N, et al. De-implementing wisely: developing the evidence base to reduce low-value care. BMJ Qual Saf. 2020;29:409–17.
    1. Hasegawa K, Tsugawa Y, Brown DFM, Mansbach JM, Camargo CA. Trends in bronchiolitis hospitalizations in the United States, 2000-2009. Pediatrics. 2013;132(1):28–36.
    1. Keren R, Luan X, Localio R, Hall M, McLeod L, Dai D, et al. Prioritization of comparative effectiveness research topics in hospital pediatrics. Arch Pediatr Adolesc Med. 2012;166(12):1155–1164.
    1. Ralston SL, Lieberthal AS, Meissner HC, Alverson BK, Baley JE, Gadomski AM, et al. Clinical practice guideline: the diagnosis, management, and prevention of bronchiolitis. Pediatrics. 2014;134(5):e1474–e1502.
    1. Fujiogi M, Goto T, Yasunaga H, Fujishiro J, Mansbach JM, Camargo CA, et al. Trends in bronchiolitis hospitalizations in the United States: 2000–2016. Pediatrics. 2019;144(6):e20192614.
    1. Haynes AK, Prill MM, Iwane MK, Gerber SI. Respiratory syncytial virus — United States, July 2012–June 2014. MMWR Morb Mortal Wkly Rep. 2014;63(48):1133–1136.
    1. Bonafide CP, Xiao R, Brady PW, Landrigan CP, Brent C, Wolk CB, et al. Prevalence of continuous pulse oximetry monitoring in hospitalized children with bronchiolitis not requiring supplemental oxygen. JAMA. 2020;323(15):1467–1477.
    1. Quinonez RA, Coon ER, Schroeder AR, Moyer VA. When technology creates uncertainty: pulse oximetry and overdiagnosis of hypoxaemia in bronchiolitis. BMJ. 2017;358:j3850.
    1. Schroeder AR, Marmor AK, Pantell RH, Newman TB. Impact of pulse oximetry and oxygen therapy on length of stay in bronchiolitis hospitalizations. Arch Pediatr Adolesc Med. 2004;158(6):527.
    1. Unger S, Cunningham S. Effect of oxygen supplementation on length of stay for infants hospitalized with acute viral bronchiolitis. Pediatrics. 2008;121(3):470–475.
    1. Rasooly IR, Makeneni S, Khan AN, Luo B, Muthu N, Bonafide CP. The alarm burden of excess continuous pulse oximetry monitoring among patients with bronchiolitis. J Hosp Med. 2021;16(12):727–729.
    1. McCulloh R, Koster M, Ralston S, Johnson M, Hill V, Koehn K, et al. Use of intermittent vs. continuous pulse oximetry for nonhypoxemic infants and young children hospitalized for bronchiolitis: a randomized clinical trial. JAMA Pediatr. 2015;169(10):898–904.
    1. Mahant S, Wahi G, Bayliss A, Giglia L, Kanani R, Pound CM, et al. Intermittent vs. continuous pulse oximetry in hospitalized infants with bronchiolitis: a randomized clinical trial. JAMA Pediatr. 2021;175(5):466–474.
    1. Quinonez RA, Garber MD, Schroeder AR, Alverson BK, Nickel W, Goldstein J, et al. Choosing wisely in pediatric hospital medicine: five opportunities for improved healthcare value. J Hosp Med. 2013;8(9):479–485.
    1. Schondelmeyer AC, Dewan ML, Brady PW, Timmons KM, Cable R, Britto MT, et al. Cardiorespiratory and pulse oximetry monitoring in hospitalized children: a Delphi process. Pediatrics. 2020;146(2):e20193336.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.
    1. Wolk CB, Schondelmeyer AC, Barg FK, Beidas R, Bettencourt A, Brady PW, et al. Barriers and facilitators to guideline-adherent pulse oximetry use in bronchiolitis. J Hosp Med. 2021;16(1):23–30.
    1. Fernandez ME, ten Hoor GA, van Lieshout S, Rodriguez SA, Beidas RS, Parcel G, et al. Implementation Mapping: using Intervention Mapping to develop implementation strategies. Front Public Health. 2019;7:158.
    1. Helfrich CD, Rose AJ, Hartmann CW, van Bodegom-Vos L, Graham ID, Wood SJ, et al. How the Dual Process Model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: a preliminary model of unlearning and substitution. J Eval Clin Pract. 2018;24(1):198–205.
    1. Schondelmeyer AC, Bettencourt AP, Xiao R, Beidas RS, Wolk CB, Landrigan CP, et al. Evaluation of an educational outreach and audit and feedback program to reduce continuous pulse oximetry use in hospitalized infants with stable bronchiolitis: a nonrandomized clinical trial. JAMA Netw Open. 2021;4(9):e2122826.
    1. Ament SMC, de Groot JJA, Maessen JMC, Dirksen CD, van der Weijden T, Kleijnen J. Sustainability of professionals’ adherence to clinical practice guidelines in medical care: a systematic review. BMJ Open. 2015;5(12):e008073.
    1. Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(1):17.
    1. Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–207.
    1. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.
    1. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–381.
    1. Slaghuis SS, Strating MM, Bal RA, Nieboer AP. A framework and a measurement instrument for sustainability of work practices in long-term care. BMC Health Serv Res. 2011;11(1):314.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226.
    1. Agha R, Avner JR. Delayed seasonal RSV surge observed during the COVID-19 pandemic. Pediatrics. 2021;148(3):e2021052089.
    1. Simon TD, Starmer AJ, Conway PH, Landrigan CP, Shah SS, Shen MW, et al. Quality improvement research in pediatric hospital medicine and the role of the Pediatric Research in Inpatient Settings (PRIS) network. Acad Pediatr. 2013;13(6 Suppl):S54–S60.
    1. Starmer AJ, Spector ND, Srivastava R, West DC, Rosenbluth G, Allen AD, et al. Changes in medical errors after implementation of a handoff program. N Engl J Med. 2014;371(19):1803–1812.
    1. Khan A, Coffey M, Litterer KP, Baird JD, Furtak SL, Garcia BM, et al. Families as partners in hospital error and adverse event surveillance. JAMA Pediatr. 2017;171(4):372–381.
    1. Landrigan CP, Stockwell D, Toomey SL, Loren S, Tracy M, Jang J, et al. Performance of the Global Assessment of Pediatric Patient Safety (GAPPS) tool. Pediatrics. 2016;137(6):e20154076.
    1. Keren R, Shah SS, Srivastava R, Rangel S, Bendel-Stenzel M, Harik N, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomyelitis in children. JAMA Pediatr. 2015;169(2):120–128.
    1. Croskerry P. A universal model of diagnostic reasoning. Acad Med. 2009;84(8):1022–1028.
    1. Croskerry P. Clinical cognition and diagnostic error: applications of a dual process model of reasoning. Adv Health Sci Educ Theory Pract. 2009;14(Suppl 1):27–35.
    1. Brehm SS, Brehm JW. Psychological reactance: a theory of freedom and control. New York: Academic Press; 2013.
    1. Chi KW, Coon ER, Destino L, Schroeder AR. Parental perspectives on continuous pulse oximetry use in bronchiolitis hospitalizations. Pediatrics. 2020;146(2):e20200130.
    1. Kinsman L, Rotter T, James E, Snow P, Willis J. What is a clinical pathway? Development of a definition to inform the debate. BMC Med. 2010;8:31.
    1. Osherhoff JA. Improving medication use and outcomes with clinical decision support: a step-by-step guide. Chicago: Healthcare Information and Management Systems Society; 2009.
    1. Campbell R. The five “rights” of clinical decision support. J AHIMA. 2013;84(10):42–47.
    1. Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328(7455):1561–1563.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
    1. Pediatric CDS Collaborative. Pediatric CDS Collaborative. Available from: . [cited 19 Jul 2022].
    1. Moulton LH. Covariate-based constrained randomization of group-randomized trials. Clin Trials. 2004;1(3):297–305.
    1. Helfrich CD, Hartmann CW, Parikh TJ, Au DH. Promoting health equity through de-implementation research. Ethn Dis. 2019;29(Suppl 1):93–96.
    1. Prusaczyk B, Swindle T, Curran G. Defining and conceptualizing outcomes for de-implementation: key distinctions from implementation outcomes. Implement Sci Commun. 2020;1:43.
    1. Brady PW, Schondelmeyer AC, Landrigan CP, Xiao R, Brent C, Bonafide CP, et al. Validity of continuous pulse oximetry orders for identification of actual monitoring status in bronchiolitis. J Hosp Med. 2020;15(11):665–668.
    1. Hayes RJ, Bennett S. Simple sample size calculation for cluster-randomized trials. Int J Epidemiol. 1999;28(2):319–326.
    1. Hayes RJ, Moulton LH. Cluster randomised trials. 2. Boca Raton: CRC Press; 2017. Sample size for unmatched trials; pp. 128–139.
    1. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108.
    1. Cidav Z, Mandell D, Pyne J, Beidas R, Curran G, Marcus S. A pragmatic method for costing implementation strategies using time-driven activity-based costing. Implement Sci. 2020;15(1):28.
    1. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS) Implement Sci. 2014;9(1):157.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):45.
    1. Dillard JP, Shen L. On the nature of reactance and its role in persuasive health communication. Commun Monogr. 2005;72(2):144–168.
    1. Silvia PJ. Reactance and the dynamics of disagreement: multiple paths from threatened freedom to resistance to persuasion. Eur J Soc Psychol. 2006;36(5):673–685.
    1. Reynolds-Tylus T, Bigsby E, Quick BL. A comparison of three approaches for measuring negative cognitions for psychological reactance. Commun Methods Meas. 2021;15(1):43–59.
    1. Robins JM, Greenland S. Identifiability and exchangeability for direct and indirect effects. Epidemiology. 1992;3(2):143–155.
    1. Krull JL, MacKinnon DP. Multilevel modeling of individual and group level mediated effects. Multivar Behav Res. 2001;36(2):249–277.
    1. Pituch KA, Murphy DL, Tate RL. Three-level models for indirect effects in school- and class-randomized experiments in education. J Exp Educ. 2009;78(1):60–95.
    1. Zhang Z, Zyphur MJ, Preacher KJ. Testing multilevel mediation using hierarchical linear models: problems and solutions. Organ Res Methods. 2009;12(4):695–719.
    1. Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC organizational strategy: increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Admin Pol Ment Health. 2017;44(2):269–283.
    1. Glisson C, Williams NJ, Hemmelgarn A, Proctor E, Green P. Aligning organizational priorities with ARC to improve youth mental health service outcomes. J Consult Clin Psychol. 2016;84(8):713–725.
    1. Williams NJ, Becker-Haimes EM, Schriger SH, Beidas RS. Linking organizational climate for evidence-based practice implementation to observed clinician behavior in patient encounters: a lagged analysis. Implement Sci Commun. 2022;3(1):64.
    1. Marsh DR, Schroeder DG, Dearden KA, Sternin J, Sternin M. The power of positive deviance. BMJ. 2004;329(7475):1177–1179.
    1. Lawton R, Taylor N, Clay-Williams R, Braithwaite J. Positive deviance: a different approach to achieving patient safety. BMJ Qual Saf. 2014;23(11):880–883.
    1. Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–1772.
    1. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Admin Pol Ment Health. 2011;38(1):44–53.
    1. Aron DC, Tseng CL, Soroka O, Pogach LM. Balancing measures: identifying unintended consequences of diabetes quality performance measures in patients at high risk for hypoglycemia. Int J Qual Health Care. 2019;31(4):246–251.
    1. Hayes RJ, Moulton LH. Cluster randomised trials. 2. Boca Raton: CRC Press; 2017. Regression analysis based on individual-level data; pp. 245–279.
    1. Biondi EA, McCulloh R, Staggs VS, Garber M, Hall M, Arana J, et al. Reducing Variability in the Infant Sepsis Evaluation (REVISE): a national quality initiative. Pediatrics. 2019;144(3):e20182201.
    1. Kaiser SV, Jennings B, Rodean J, Cabana MD, Garber MD, Ralston SL, et al. Pathways for Improving Inpatient Pediatric Asthma Care (PIPA): a multicenter, national study. Pediatrics. 2020;145:e20193026.
    1. Ralston SL, Garber MD, Rice-Conboy E, Mussman GM, Shadman KA, Walley SC, et al. A multicenter collaborative to reduce unnecessary care in inpatient bronchiolitis. Pediatrics. 2016;137(1):e20150851.
    1. Chan WV, Pearson TA, Bennett GC, Castillo G, Cushman WC, Gaziano TA, et al. ACC/AHA special report: Clinical practice guideline implementation strategies: a summary of systematic reviews by the NHLBI Implementation Science Work Group: a report of the American College of Cardiology/American Heart Association Task Force on clinical practice guidelines. Circulation. 2017;135(9):e122–e137.
    1. Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016;388(10044):547–548.
    1. Grimshaw JM, Ivers N, Linklater S, Foy R, Francis JJ, Gude WT, et al. Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback. BMJ Qual Saf. 2019;28(5):416–423.
    1. Soong C, Shojania KG. Education as a low-value improvement intervention: often necessary but rarely sufficient. BMJ Qual Saf. 2020;29(5):353–357.
    1. Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden N. Interventions aimed at reducing use of low-value health services: a systematic review. Med Care Res Rev. 2017;74(5):507–550.
    1. Kwan JL, Lo L, Ferguson J, Goldberg H, Diaz-Martinez JP, Tomlinson G, et al. Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials. BMJ. 2020;370:m3216.

Source: PubMed

3
Prenumerera