Protocol: examining the effectiveness of an adaptive implementation intervention to improve uptake of the VA suicide risk identification strategy: a sequential multiple assignment randomized trial

Nazanin H Bahraini, Bridget B Matarazzo, Catherine N Barry, Edward P Post, Jeri E Forster, Katherine M Dollar, Steven K Dobscha, Lisa A Brenner, Nazanin H Bahraini, Bridget B Matarazzo, Catherine N Barry, Edward P Post, Jeri E Forster, Katherine M Dollar, Steven K Dobscha, Lisa A Brenner

Abstract

Background: In 2018, the Veterans Health Administration (VHA) mandated implementation of a national suicide risk identification strategy (Risk ID). The goal of Risk ID is to improve the detection and management of suicide risk by standardizing suicide risk screening and evaluation enterprise-wide. In order to ensure continuous quality improvement (QI), ongoing evaluation and targeted interventions to improve implementation of Risk ID are needed. Moreover, given that facilities will vary with respect to implementation needs and barriers, the dose and type of intervention needed may vary across facilities. Thus, the objective of this study is to examine the effectiveness of an adaptive implementation strategy to improve the uptake of suicide risk screening and evaluation in VHA ambulatory care settings. In addition, this study will examine specific factors that may impact the uptake of suicide risk screening and evaluation and the adoption of different implementation strategies. This protocol describes the stepped implementation approach and proposed evaluation plan.

Methods: Using a sequential multiple assignment randomized trial (SMART) design, two evidence-based implementation strategies will be evaluated: (1) audit and feedback (A&F); (2) A&F plus external facilitation (A&F + EF). Implementation outcomes of interest include uptake of secondary suicide risk screening and uptake of comprehensive suicide risk evaluation (stages 2 and 3 of Risk ID). Secondary outcomes include rates of other clinical outcomes (i.e., safety planning) and organizational factors that may impact Risk ID implementation (i.e., leadership climate and leadership support).

Discussion: This national QI study will use a SMART design to evaluate whether an adaptive implementation strategy is effective in improving uptake of a mandated VHA-wide suicide risk screening and evaluation initiative. If this study finds that the proposed stepped implementation strategy is effective at increasing uptake and maintaining performance improvements, this approach may be used as an overarching QI strategy for other national suicide prevention programs.

Trial registration: ClinicalTrials.gov NCT04243330 . Registered 28 January 2020.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Stages of VA Risk ID for veterans eligible for annual depression and as required PTSD screening
Fig. 2
Fig. 2
SMART design and intervention phases. Asterisk indicates adequate implementation = completion of secondary screening and CSRE for 80% or more of eligible patients (Note: this benchmark is subject to change based on program office’s determination); R, randomization

References

    1. Luoma JB, Martin CE, Pearson JL. Contact with mental health and primary care providers before suicide: a review of the evidence. Am J Psychiatry. 2002. 10.1176/appi.ajp.159.6.909.
    1. Gairin I, House A, Owens D. Attendance at the accident and emergency department in the year before suicide: retrospective study. Br J Psychiatry. 2003. 10.1192/bjp.183.1.28.
    1. Denneson LM, Kovas A-E, Britton PC, Kaplan MS, McFarland BH, Dobscha SK. Suicide risk documented during veterans’ last veterans affairs health care contacts prior to suicide. Suicide Life Threat Beh. 2016. 10.1111/sltb.12226.
    1. United States of Veterans Affairs. National strategy for preventing veteran suicide 2018-2028. . (2018). Accessed 27 Mar 2020.
    1. U.S. Department of Veterans Affairs. Memorandum re: suicide risk screening and assessment requirements. 2018. Washington, DC: U.S. Government Printing Office.
    1. Jamtvedt G, Young JM, Kristofferson DT, O’Brien, Oxman Ad. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006; doi:10.1002/14651858.CD000259.pub2.
    1. Gould NJ, Lorencatto F, Stanworth S, Michie S, Prior M, Glidewell L, et al. Application of theory to enhance audit and feedback interventions to increase the uptake of evidence-based transfusion practice: an intervention development protocol. Implement Sci. 2014. 10.1186/s13012-014-0092-1.
    1. Hysong SJ, Best RG, Pugh JA. Audit and feedback and clinical practice guideline adherence: making feedback actionable. Implement Sci. 2006. 10.1186/1748-5908-1-9.
    1. Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;119:254–284. doi: 10.1037/0033-2909.119.2.254.
    1. Hysong SJ. Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009. 10.1097/mlr.0b013e3181893f6b.
    1. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, Grimshaw JM. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014. 10.1186/1748-5908-9-14.
    1. Ritchie MJ, Dollar KM, Miller CJ, Oliver KA, Smith JL, Lindsay JA, Kirchner JE. Using implementation facilitation to improve care in the Veterans Health Administration (Version 2): Veterans Health Administration, Quality Enhancement Research Initiative (QUERI) for Team-Based Behavioral Health; 2017.
    1. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016. 10.1186/s13012-016-0398-2.
    1. Forman J, Heisler M, Damschroder LJ, Kaselitz E, Kerr EA. Development and application of the RE-AIM QuEST mixed methods framework for program evaluation. Prev Med Rep. 2017. 10.1016/j.pmedr.2017.04.002.
    1. Kidwell KM, Hyde LW. Adaptive interventions and SMART designs: application to child behavior research in a community setting. Am J Eval. 2016;37:344–363. doi: 10.1177/1098214015617013.
    1. Department of Veterans Affairs Workforce Committee . Memorandum: FY17 facility complexity level model. 2017.
    1. Wandersman A, Chien VH, Katz J. Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Am J Comm Psycholo. 2012. 10.1007/s10464-012-9509-7.
    1. Ray ML, Wilson MM, Wandersman A, Meyers DC, Katz J. Using a training-of-trainers approach and proactive technical assistance to bring evidence based programs to scale: an operationalization of the interactive systems frameworks support system. Am J Comm Psycholo. 2012. 10.1007/s10464-012-9526-6.
    1. Kilbourne AM, Neumann MS, Pincus HA, Mark BS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007. 10.1186/1748-5908-2-42.
    1. Stetler CB, Legro M, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006. 10.1186/1748-5908-1-23.
    1. Ritchie MJ, Dollar KM, Miller CJ, Oliver KA, Smith JL, Lindsay JA, & Kirchner JE. Using implementation facilitation to improve care in the Veterans Health Administration (Version 2). Veterans Health Administration, Quality Enhancement Research Initiative (QUERI) for Team-Based Behavioral Health. 2017. Available at: .
    1. Department of Veterans Affairs. Quality assurance external peer review program (EPRP): VHA Directive 2000–030 9-25-2000; 2006.
    1. Smith J, Saunders R, Stuckhardt L, et al. Scoping review to identify the spectrum of activities applied in implementation facilitation strategies. Seattle: Poster presentation at the Academy Health Annual Research Meeting; 2018.
    1. Ehrhart MG, Aarons GA, Farahnak L. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014. 10.1186/s13012-014-0157-1.
    1. Ehrhart MG, Torres EM, Hwang J, Sklar M, Aarons G. Validation of the Implementation Climate Scale (ICS) in substance use disorder treatment organizations. Subs Abuse Treat Protect Policy. 2019. 10.1186/s13011-019-0222-5.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014. 10.1186/1748-5908-9-45.
    1. Shuman CJ, Ehrhart MG, Torres EM, Veliz P, Kath LM, VanAntwerp K, et al. EBP implementation leadership of frontline nurse managers: validation of the implementation leadership scale in acute care. Worldviews Evid-Based Nurs. 2020. 10.1111/wvn.12402.
    1. Aarons GA, Ehrhart MG, Torres EM, Finn NK, Roesch SC. Validation of the Implementation Leadership Scale (ILS) in substance use disorder treatment organizations. J Subst Abus Treat. 2016. 10.1016/j.jsat.2016.05.004.
    1. Hill JE, Stephani A, Sapple P, Clegg AJ. The effectiveness of continuous quality improvement for developing professional practice and improving health care outcomes: a systematic review. Implement Sci. 2020. 10.1186/s13012-020-0975-2.
    1. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, et al. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9:132. doi: 10.1186/s13012-014-0132-x.
    1. Johnson JE, Wiltsey-Stirman S, Sikorskii A, Miller T, King A, Blume JL, et al. Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women. Implement Sci. 2018. 10.1186/s13012-018-0807-9.

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa