Implementation of a stepped wedge cluster randomized trial to evaluate a hospital mobility program

Susan N Hastings, Karen M Stechuchak, Ashley Choate, Elizabeth P Mahanna, Courtney Van Houtven, Kelli D Allen, Virginia Wang, Nina Sperber, Leah Zullig, Hayden B Bosworth, Cynthia J Coffman, Susan N Hastings, Karen M Stechuchak, Ashley Choate, Elizabeth P Mahanna, Courtney Van Houtven, Kelli D Allen, Virginia Wang, Nina Sperber, Leah Zullig, Hayden B Bosworth, Cynthia J Coffman

Abstract

Background: Stepped wedge cluster randomized trials (SW-CRT) are increasingly used to evaluate new clinical programs, yet there is limited guidance on practical aspects of applying this design. We report our early experiences conducting a SW-CRT to examine an inpatient mobility program (STRIDE) in the Veterans Health Administration (VHA). We provide recommendations for future research using this design to evaluate clinical programs.

Methods: Based on data from study records and reflections from the investigator team, we describe and assess the design and initial stages of a SW-CRT, from site recruitment to program launch in 8 VHA hospitals.

Results: Site recruitment consisted of thirty 1-h conference calls with representatives from 22 individual VAs who expressed interest in implementing STRIDE. Of these, 8 hospitals were enrolled and randomly assigned in two stratified blocks (4 hospitals per block) to a STRIDE launch date. Block 1 randomization occurred in July 2017 with first STRIDE launch in December 2017; block 2 randomization occurred in April 2018 with first STRIDE launch in January 2019. The primary study outcome of discharge destination will be assessed using routinely collected data in the electronic health record (EHR). Within randomized blocks, two hospitals per sequence launched STRIDE approximately every 3 months with primary outcome assessment paused during the 3-month time period of program launch. All sites received 6-8 implementation support calls, according to a pre-specified schedule, from the time of recruitment to program launch, and all 8 sites successfully launched within their assigned 3-month window. Seven of the eight sites initially started with a limited roll out (for example on one ward) or modified version of STRIDE (for example, using existing staff to conduct walks until new positions were filled).

Conclusions: Future studies should incorporate sufficient time for site recruitment and carefully consider the following to inform design of SW-CRTs to evaluate rollout of a new clinical program: (1) whether a blocked randomization fits study needs, (2) the amount of time and implementation support sites will need to start their programs, and (3) whether clinical programs are likely to include a "ramp-up" period. Successful execution of SW-CRT designs requires both adherence to rigorous design principles and also careful consideration of logistical requirements for timing of program roll out.

Trial registration: ClinicalsTrials.gov NCT03300336 . Prospectively registered on 3 October 2017.

Keywords: Mobility; Pragmatic trials; Stepped wedge.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Originally proposed blocked SW-CRT design for Function QUERI STRIDE. “0” indicates pre-implementation period, “.” indicates implementation period (STRIDE launch), “1” indicates post-implementation period, and “0” in shaded gray indicates prior to VA hospital recruitment for block 2 where primary outcome data for control time periods can still be collected via EHR (but not patient-reported data in these blocks because the sites have not enrolled in the study during this time period)
Fig. 2
Fig. 2
Function QUERI STRIDE SW-CRT site recruitment and enrollment
Fig. 3
Fig. 3
Implemented blocked SW-CRT design for Function QUERI STRIDE with 6-month delay in recruitment of block 2 sites. “0” indicates pre-implementation period, “.” indicates implementation period (STRIDE launch), “1” indicates post-implementation period, and “0” in shaded gray indicates prior to VA hospital recruitment for block 2 where primary outcome data for control time periods can still be collected via EHR (but not patient-reported data in these blocks because the sites have not enrolled in the study during this time period)

References

    1. Hemming K, Taljaard M, McKenzie JE, Hooper R, Copas A, Thompson JA, et al. Reporting of stepped wedge cluster randomised trials: extension of the CONSORT 2010 statement with explanation and elaboration. BMJ. 2018;363:k1614. doi: 10.1136/bmj.k1614.
    1. Atkins D, Kilbourne AM, Shulkin D. Moving from discovery to system-wide change: the role of research in a learning health care system: experience from three decades of health systems research in the Veterans Health Administration. Annu Rev Public Health. 2017;38(1):467–487. doi: 10.1146/annurev-publhealth-031816-044255.
    1. Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–948. doi: 10.1016/j.jclinepi.2010.12.003.
    1. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2(1):42. doi: 10.1186/1748-5908-2-42.
    1. Brown CJ, Foley KT, Lowman JD, MacLennan PA, Razjouyan J, Najafi B, et al. Comparison of posthospitalization function and community mobility in hospital mobility program and usual care patients: a randomized clinical trial. JAMA Intern Med. 2016;176(7):921–927. doi: 10.1001/jamainternmed.2016.1870.
    1. Fisher SR, Kuo Y, Graham JE, Ottenbacher KJ, Ostir GV. Early ambulation and length of stay in older adults hospitalized for acute illness. Arch Intern Med. 2010;170(21):1942–1943. doi: 10.1001/archinternmed.2010.422.
    1. Growdon ME, Shorr RI, Inouye SK. The tension between promoting mobility and preventing falls in the hospital. JAMA Intern Med. 2017;177(6):759–760. doi: 10.1001/jamainternmed.2017.0840.
    1. Kalisch BJ, Lee S, Dabney BW. Outcomes of inpatient mobilization: a literature review. J Clin Nurs. 2014;23(11–12):1486–1501. doi: 10.1111/jocn.12315.
    1. Liu B, Moore JE, Almaawiy U, Chan W-H, Khan S, Ewusie J, et al. Outcomes of Mobilisation of Vulnerable Elders in Ontario (MOVE ON): a multisite interrupted time series evaluation of an implementation intervention to increase patient mobilisation. Age Ageing. 2018;47:112–119. doi: 10.1093/ageing/afx128.
    1. Kristunas CA, Hemming K, Eborall H, Eldridge S, Gray LJ. The current use of feasibility studies in the assessment of feasibility for stepped-wedge cluster randomised trials: a systematic review. BMC Med Res Methodol. 2019;19(1):12. doi: 10.1186/s12874-019-0658-3.
    1. Wang V, Allen K, Van Houtven CH, et al. Supporting teams to optimize function and independence in Veterans: a multi-study program and mixed methods protocol. Implement Sci. 2018;13(1):58. doi: 10.1186/s13012-018-0748-3.
    1. Hastings SN, Sloane R, Morey MC, Pavon JM, Hoenig H. Assisted early mobility for hospitalized older veterans: preliminary data from the STRIDE program. J Am Geriatr Soc. 2014;62(11):2180–2184. doi: 10.1111/jgs.13095.
    1. Hastings SN, Choate AL, Mahanna EP, et al. Early mobility in the hospital: lessons learned from the STRIDE Program. Geriatrics. 2018;3(4):61. doi: 10.3390/geriatrics3040061.
    1. Covinsky KE, Palmer RM, Fortinsky RH, et al. Loss of independence in activities of daily living in older adults hospitalized with medical illnesses: increased vulnerability with age. J Am Geriatr Soc. 2003;51(4):451–458. doi: 10.1046/j.1532-5415.2003.51152.x.
    1. Mundy LM. Early mobilization of patients hospitalized with community-acquired pneumonia. Chest. 2003;124(3):883–889. doi: 10.1378/chest.124.3.883.
    1. Hemming K, Lilford R, Girling AJ. Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs. Stat Med. 2015;34(2):181–196. doi: 10.1002/sim.6325.
    1. US Department of Veterans Affairs [Internet]. End of year hospital star rating (FY2017) - quality of care; 2018 [cited 2020 Mar 23];[about 2 screens]. Available from: .
    1. VHA Office of Productivity, Efficiency and Satffing (OPES) [Internet]. US Department of Veterans Affairs. Facility complexity model; [cited 2020 Mar 23];[about 1 screen]. Available from: .
    1. Taljaard M, Teerenstra S, Ivers NM, Fergusson DA. Substantial risks associated with few clusters in cluster randomized and stepped wedge designs. Clin Trials. 2016;13(4):459–463. doi: 10.1177/1740774516634316.
    1. CDC . Replicating effective programs. 2019.
    1. Waxmonsky J, Kilbourne AM, Goodrich DE, Nord KM, Lai Z, Laird C, et al. Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. Psychiatr Serv. 2014;65:81–90. doi: 10.1176/appi.ps.201300039.
    1. Kelly JA, Somlai AM, DiFranceisco WJ, Otto-Salaj LL, McAuliffe TL, Hackl KL, et al. Bridging the gap between the science and service of HIV prevention: transferring effective research-based HIV prevention interventions to community AIDS service providers. Am J Public Health. 2000;90(7):1082–1088. doi: 10.2105/AJPH.90.7.1082.
    1. Baier RR, Jutkowitz E, Mitchell SL, McCreedy E, Mor V. Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial. BMC Med Res Methodol. 2019;19(1):156. doi: 10.1186/s12874-019-0794-9.
    1. Hargreaves JR, Copas AJ, Beard E, Osrin D, Lewis JJ, Davey C, et al. Five questions to consider before conducting a stepped wedge trial. Trials. 2015;16:350. doi: 10.1186/s13063-015-0841-8.
    1. Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391. doi: 10.1136/bmj.h391.
    1. Copas AJ, Lewis JJ, Thompson JA, Davey C, Baio G, Hargreaves JR. Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches. Trials. 2015;16(1):352. doi: 10.1186/s13063-015-0842-7.
    1. Lobb R, Colditz GA. Implementation science and its application to population health. Annu Rev Public Health. 2013;34:235–251. doi: 10.1146/annurev-publhealth-031912-114444.
    1. Bersani K, Fuller TE, Garabedian P, Espares J, Mlaver E, Businger A, et al. Use, perceived usability, and barriers to implementation of a patient safety dashboard integrated within a vendor EHR. Appl Clin Inform. 2020;11(1):34–45. doi: 10.1055/s-0039-3402756.
    1. McIntosh N, Meterko M, Burgess JFJ, Restuccia JD, Kartha A, Kaboli P, et al. Organizational predictors of coordination in inpatient medicine. Health Care Manag Rev. 2014;39(4):279–292. doi: 10.1097/HMR.0000000000000004.
    1. Hooper R, Copas A. Stepped wedge trials with continuous recruitment require new ways of thinking. J Clin Epidemiol. 2019;116:161–166. doi: 10.1016/j.jclinepi.2019.05.037.

Source: PubMed

3
購読する