Testing implementation facilitation for uptake of an evidence-based psychosocial intervention in VA homeless programs: A hybrid type III trial

David A Smelson, Vera Yakovchenko, Thomas Byrne, Megan B McCullough, Jeffrey L Smith, Kathryn E Bruzios, Sonya Gabrielian, David A Smelson, Vera Yakovchenko, Thomas Byrne, Megan B McCullough, Jeffrey L Smith, Kathryn E Bruzios, Sonya Gabrielian

Abstract

Background: Healthcare systems face difficulty implementing evidence-based practices, particularly multicomponent interventions. Additional challenges occur in settings serving vulnerable populations such as homeless Veterans, given the population's acuity, multiple service needs, and organizational barriers. Implementation Facilitation (IF) is a strategy to support the uptake of evidence-based practices. This study's aim was to simultaneously examine IF on the uptake of Maintaining Independence and Sobriety Through Systems Integration, Outreach and Networking-Veterans Edition (MISSION-Vet), an evidence-based multicomponent treatment engagement intervention for homeless Veterans with co-occurring mental health and substance abuse, and clinical outcomes among Veterans receiving MISSION-Vet.

Methods: This multi-site hybrid III modified stepped-wedge trial involved seven programs at two Veterans Affairs Medical Centers comparing Implementation as Usual (IU; training and educational materials) to IF (IU + internal and external facilitation).

Results: A total of 110 facilitation events averaging 27 minutes were conducted, of which 85% were virtual. Staff (case managers and peer specialists; n = 108) were trained in MISSION-Vet and completed organizational readiness assessments (n = 77). Although both sites reported being willing to innovate and a desire to improve outcomes, implementation climate significantly differed. Following IU, no staff at either site conducted MISSION-Vet. Following IF, there was a significant MISSION-Vet implementation difference between sites (53% vs. 14%, p = .002). Among the 93 Veterans that received any MISSION-Vet services, they received an average of six sessions. Significant positive associations were found between number of MISSION-Vet sessions and outpatient treatment engagement measured by the number of outpatient visits attended.

Conclusions: While staff were interested in improving patient outcomes, MISSION-Vet was not implemented with IU. IF supported MISSION-Vet uptake and increased outpatient service utilization, but MISSION-Vet still proved difficult to implement particularly in the larger healthcare system. Future studies might tailor implementation strategies to organizational readiness.

Trial registration: ClinicalTrials.gov, NCT02942979.

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1. Modified stepped-wedge trial design.
Fig 1. Modified stepped-wedge trial design.
Fig 2. Total number of MISSION-Vet sessions…
Fig 2. Total number of MISSION-Vet sessions delivered across 2 VAMCs by month relative to the start of facilitation.

References

    1. Bentley TGK, Effros RM, Palar K, Keeler EB. Waste in the U.S. health care system: a conceptual framework. Milbank Q. 2008;86(4):629–59. doi: 10.1111/j.1468-0009.2008.00537.x
    1. U.S. Department of Veterans Affairs Homeless Veterans Program. Employment Toolkit. 2017, July.
    1. Mechanic D, Tanner J. Vulnerable people, groups, and populations: societal view. Health Aff. 2007;26(5):1220–30.
    1. Goetz MB, Hoang T, Knapp H, Burgess J, Fletcher MD, Gifford AL, et al.. QUERI-HIV/Hepatitis Program. Central implementation strategies outperform local ones in improving HIV testing in Veterans Healthcare Administration facilities. J Gen Intern Med. 2013;28(10):1311–7. doi: 10.1007/s11606-013-2420-6
    1. Smelson D, Losonczy M, Ziedonis D, Castles-Fonseca K, Kaune M. Six month outcomes from a booster case management program for individuals with a cooccurring substance abuse and a persistent psychiatric disorder. Eur J Psychiatry Clin Neurosci. 2007;21:143–52.
    1. Szymkowiak D, Montgomery AE, Johnson EE, Manning T, O’Toole TP. Persistent super-utilization of acute care services among subgroups of veterans experiencing homelessness. Med Care. 2017;55(10):893–900. doi: 10.1097/MLR.0000000000000796
    1. Smelson DA, Sawh L, Kane V, Kuhn J, Ziedonis DM. MISSION-VET Treatment Manual. Worcester: University of Massachusetts Medical School; 2011.
    1. Durbin A, Kapustianyk G, Nisenbaum R, Wang R, Aratangy T, Khan B, et al.. Recovery education for people experiencing housing instability: an evaluation protocol. Int J Soc Psychiatry. 2019;65(6):468–78. doi: 10.1177/0020764019858650
    1. Ellison ML, Schutt RK, Yuan LH, Mitchell-Miland C, Glickman ME, McCarthy S, et al.. Impact of peer specialist services on residential stability and behavioral health status among formerly homeless veterans with cooccurring mental health and substance use conditions. Med Care. 2020;58(4):307–13. doi: 10.1097/MLR.0000000000001284
    1. Smelson D, Losonczy M, Castles-Fonseca K, Sussner B, Rodrigues S, Kaune M, et al.. Preliminary outcomes from a community linkage intervention for individuals with co-occurring substance abuse and serious mental illness. J Dual Diagn. 2005;1(3):47–59.
    1. Smelson D, Kalman D, Losonczy M, Kline A, St. Hill L, Castles-Fonseca K, et al.. A brief treatment engagement intervention for individuals with co-occurring mental illness and substance use disorders: Results of a randomized clinical trial. Community Ment Health J. 2012;48(2):127–32. doi: 10.1007/s10597-010-9346-9
    1. Smelson D, Kline A, Kuhn J, Rodrigues S, O’Connor K, Fisher W, et al.. A wraparound treatment engagement intervention for homeless veterans with co-occurring disorders. Psychol Serv. 2013;10(2):161–7. doi: 10.1037/a0030948
    1. Smelson DA, Pinals DA, Sawh L, Fulwiler C, Singer S, Guevremont N, et al.. An alternative to incarceration: co-occurring disorders treatment intervention for justice-involved veterans. World Med Health Policy. 2015;7(4):329–48.
    1. Smelson D, Farquhar I, Fisher W, Pressman K, Pinals DA, Samek B, et al.. Integrating a co-occurring disorders intervention in drug courts: an open pilot trial. Community Ment Health J. 2018;55(2).
    1. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al.. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350. doi: 10.1136/bmj.h1258
    1. Hasson H. Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5(1):1–9. doi: 10.1186/1748-5908-5-67
    1. Horton TJ, Illingworth JH, Warburton WH. Overcoming challenges in codifying and replicating complex health care interventions. Health Aff. 2018;37(2):191–7. doi: 10.1377/hlthaff.2017.1161
    1. Chinman M, McCarthy S, Hannah G, Byrne TH, Smelson DA. Using Getting To Outcomes to facilitate the use of an evidence-based practice in VA homeless programs: a cluster-randomized trial of an implementation support strategy. Implement Sci. 2017;12(1):34. doi: 10.1186/s13012-017-0565-0
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al.. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21. doi: 10.1186/s13012-015-0209-1
    1. Harvey G, Kitson A. Implementing evidence-based practice in healthcare: Taylor & Francis; 2015.
    1. Kirchner JE, Kearney LK, Ritchie MJ, Dollar KM, Swensen AB, Schohn M. Research & services partnerships: lessons learned through a national partnership between clinical leaders and researchers. Psychiatr Serv. 2014;65(5):577–9. doi: 10.1176/appi.ps.201400054
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217. doi: 10.1097/MLR.0b013e3182408812
    1. Unni RR, Lee SF, Thabane L, Connolly S, Van Spall HG. Variations in stepped-wedge cluster randomized trial design: Insights from the Patient-Centered Care Transitions in Heart Failure trial. American heart journal. 2020;220:116–26. doi: 10.1016/j.ahj.2019.08.017
    1. Hemming K, Lilford R, Girling AJ. Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs. Statistics in medicine. 2015;34(2):181–96. doi: 10.1002/sim.6325
    1. Department of Veterans Affairs. Office of Research and Development Program Guide: 1200.21. VHA Operations Activities That May Constitute Research. Washington, DC: Department of Veterans Affairs; 2019.
    1. Simmons MM, Gabrielian S, Byrne T, McCullough MB, Smith JL, Taylor TJ, et al.. A hybrid III stepped wedge cluster randomized trial testing an implementation strategy to facilitate the use of an evidence-based practice in VA Homeless Primary Care Treatment Programs. Implement Sci. 2017;12(1):46. doi: 10.1186/s13012-017-0563-2
    1. Susser E, Valencia E, Conover S, Felix A, Tsai WY, Wyatt RJ. Preventing recurrent homelessness among mentally ill men: a "critical time" intervention after discharge from a shelter. Am J Public Health. 1997;87(2):256–62. doi: 10.2105/ajph.87.2.256
    1. Ziedonis DM, Stern R. Dual recovery therapy for schizophrenia and substance abuse. Psychiatr Ann. 2001;31(4):255.
    1. Chinman M, Shoai R, Cohen A. Using organizational change strategies to guide peer support technician implementation in the Veterans Administration. Psychiatr Rehabil J. 2010;33(4):269. doi: 10.2975/33.4.2010.269.277
    1. Bond GR, McHugo GJ, Becker DR, Rapp CA, Whitley R. Fidelity of supported employment: lessons learned from the National Evidence-Based Practice Project. Psychiatr Rehabil J. 2008;31(4):300. doi: 10.2975/31.4.2008.300.305
    1. Najavits LM. Expanding the boundaries of PTSD treatment. JAMA. 2012;308(7):714–6. doi: 10.1001/2012.jama.10368
    1. Tsemberis S, Gulcur L, Nakae M. Housing first, consumer choice, and harm reduction for homeless individuals with a dual diagnosis. Am J Public Health. 2004;94(4):651–6. doi: 10.2105/ajph.94.4.651
    1. Smelson DA, Sawh L, Rodrigues S, Munoz EC, Marzilli A, Tripp J, et al.. The MISSION-VET Consumer Workbook. Worcester: University of Massachusetts Medical School; 2011.
    1. Department of Veterans Affairs. VA 25 Cities Initiative 2014, March [.
    1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5). Arlington, VA: American Psychiatric Publishing; 2013.
    1. World Health Organization. International statistical classification of diseases and health related problems (The) ICD-10: World Health Organization; 2004.
    1. Smelson DA, Zaykowski H, Guevermont N, Siegfriedt J, Sawh L, Modzelewski D, et al.. Integrating permanent supportive housing and co-occurring disorders treatment for individuals who are homeless. J Dual Diagn. 2016;12(2):193–201. doi: 10.1080/15504263.2016.1174010
    1. Chinman M, Hunter SB, Ebener P, Paddock SM, Stillman L, Imm P, et al.. The getting to outcomes demonstration and evaluation: an illustration of the prevention support system. Am J Community Psychol. 2008;41(3–4):206–24. doi: 10.1007/s10464-008-9163-2
    1. Fritz J, Wallin L, Söderlund A, Almqvist L, Sandborgh M. Implementation of a behavioral medicine approach in physiotherapy: a process evaluation of facilitation methods. Implement Sci. 2019;14(1):94. doi: 10.1186/s13012-019-0942-y
    1. Parchman M, Hsu C, Fagnan L, van Borkulo N, Tuzzio L. Building a learning health care organization: external facilitation tailors support to the learning capacity of primary care settings. J Patient Cent Res Rev. 2017;4(3):187.
    1. Stetler CB, McQueen L, Demakis J, Mittman BS. An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series. Implement Sci. 2008;3:30. doi: 10.1186/1748-5908-3-30
    1. Ajzen I, Fishbein M. Attitude-behavior relations: a theoretical analysis and review of empirical research. Psychol Bull. 1977;84(5):31.
    1. Rosenheck RA. Organizational process: a missing link between research and practice. Psychiatr Serv. 2001;52(12):6. doi: 10.1176/appi.ps.52.12.1607
    1. Helfrich CD, Li Y-F, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009;4(1):38. doi: 10.1186/1748-5908-4-38
    1. Jacobs SR, Weiner BJ, Bunger AC. Context matters: measuring implementation climate among individuals and groups. Implement Sci. 2014;9(1):46. doi: 10.1186/1748-5908-9-46
    1. Ritchie MJ, Kirchner JE, Townsend JC, Pitcock JA, Dollar KM, Liu CF. Time and organizational cost for facilitating implementation of primary care mental health integration. J Gen Intern Med. 2019;35(4):1001–10. doi: 10.1007/s11606-019-05537-y
    1. The White House. Ending Veteran Homelessness [.
    1. Powell BJ, Mandell DS, Hadley TR, Rubin RM, Evans AC, Hurford MO, et al.. Are general and strategic measures of organizational context and leadership associated with knowledge and attitudes toward evidence-based practices in public behavioral health settings? A cross-sectional observational study. Implement Sci. 2017;12(1):64. doi: 10.1186/s13012-017-0593-9
    1. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2015;11(1):33.
    1. Brunette MF, Asher D, Whitley R, Lutz WJ, Wieder BL, Jones AM, et al.. Implementation of integrated dual disorders treatment: a qualitative analysis of facilitators and barriers. Psychiatr Serv. 2008;59(9):989–95. doi: 10.1176/ps.2008.59.9.989
    1. Drake RE, Bond GR. Implementing integrated mental health and substance abuse services. J Dual Diagn. 2010;6(3–4):251–62.
    1. Kauth MR, Sullivan G, Blevins D, Cully JA, Landes RD, Said Q, et al.. Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study. Implement Sci. 2010;5:75. doi: 10.1186/1748-5908-5-75
    1. Garner B, Gotham H, Chaple M, Martino S, Ford J, Roosa M, et al.. The implementation & sustainment facilitation strategy improved implementation effectiveness and intervention effectiveness: results from a cluster-randomized type 2 hybrid trial. 2020.
    1. Smelson DA, Perez CK, Farquhar I, Byrne T, Colegrove A. Permanent supportive housing and specialized co-occurring disorders wraparound services for homeless individuals. J Dual Diagn. 2019:1–10.
    1. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care-mental health. J Gen Intern Med. 2014;29 Suppl 4:904–12. doi: 10.1007/s11606-014-3027-2

Source: PubMed

Спонсоры и соавторы

Заболевания

Медикаментозные вмешательства

Подписаться