Assessing fidelity of cognitive behavioral therapy in rural VA clinics: design of a randomized implementation effectiveness (hybrid type III) trial

Michael A Cucciare, Geoffrey M Curran, Michelle G Craske, Traci Abraham, Michael B McCarthur, Kathy Marchant-Miros, Jan A Lindsay, Michael R Kauth, Sara J Landes, Greer Sullivan, Michael A Cucciare, Geoffrey M Curran, Michelle G Craske, Traci Abraham, Michael B McCarthur, Kathy Marchant-Miros, Jan A Lindsay, Michael R Kauth, Sara J Landes, Greer Sullivan

Abstract

Background: Broadly disseminating and implementing evidence-based psychotherapies with high fidelity, particularly cognitive behavioral therapy (CBT), has proved challenging for many health-care systems, including the Department of Veterans Affairs, especially in primary care settings such as small or remote clinics. A computer-based tool (based on the coordinated anxiety learning and management (CALM) program) was designed to support primary care-based mental health providers in delivering CBT. The objectives of this study are to modify the CALM tool to meet the needs of mental health clinicians in veterans affairs (VA) community-based outpatient clinics (CBOCs) and rural "veterans", use external facilitation to implement CBT and determine the effect of the CALM tool versus a manualized version of CALM to improve fidelity to the CBT treatment model, and conduct a needs assessment to understand how best to support future implementation of the CALM tool in routine care.

Methods/design: Focus groups will inform the redesign of the CALM tool. Mental health providers at regional VA CBOCs; CBT experts; VA experts in implementation of evidence-based mental health practices; and veterans with generalized anxiety disorder, panic disorder, social anxiety disorder, posttraumatic stress disorder, "with or without" depression will be recruited. A hybrid type III design will be used to examine the effect of receiving CBT training plus either the CALM tool or a manual version of CALM on treatment fidelity. External facilitation will be used as the overarching strategy to implement both CBT delivery methods. Data will also be collected on symptoms of the targeted disorders. To help prepare for the future implementation of the CALM tool in VA CBOCs, we will perform an implementation need assessment with mental health providers participating in the clinical trial and their CBOC directors.

Discussion: This project will help inform strategies for delivering CBT with high fidelity in VA CBOCs to veterans with anxiety disorders and PTSD with or without depression. If successful, results of this study could be used to inform a national rollout of the CALM tool in VA CBOCs including providing recommendations for optimizing the adoption and sustained use of the computerized CALM tool among mental health providers in this setting.

Trial registration: ClinicalTrials.gov, NCT02488551.

Keywords: Cognitive behavioral therapy; Evidence-based practices; Rural; Treatment fidelity; Veterans.

References

    1. Cape J, Whittington C, Buszewicz M, Wallace P, Underwood L. Brief psychological therapies for anxiety and depression in primary care: meta-analysis and meta-regression. BMC Med. 2010;8:38. doi: 10.1186/1741-7015-8-38.
    1. Hoifodt RS, Strom C, Kolstrup N, Eisemann M, Waterloo K. Effectiveness of cognitive behavioural therapy in primary health care: a review. Fam Pract. 2011;28:489–504. doi: 10.1093/fampra/cmr017.
    1. Leon AC, Olfson M, Broadhead WE, Barrett JE, Blacklow RS, Keller MB, Higgins ES, Weissman MM. Prevalence of mental disorders in primary care. Implications for screening. Arch Fam Med. 1995;4:857–861. doi: 10.1001/archfami.4.10.857.
    1. Ansseau M, Dierick M, Buntinkx F, Cnockaert P, De Smedt J, Van Den Haute M, Vander MD. High prevalence of mental disorders in primary care. J Affect Disord. 2004;78:49–55. doi: 10.1016/S0165-0327(02)00219-7.
    1. Kroenke K, Spitzer RL, Williams JB, Monahan PO, Lowe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146:317–325. doi: 10.7326/0003-4819-146-5-200703060-00004.
    1. US Department of Veterans Affairs: Veterans Health Administration: VHA handbook 1160.01: uniform mental health services in VA medical centers and clinics. Washington, DC: US Department of Veterans Affairs, Veterans Health Administration; 2008.
    1. Hepner KA, Azocar F, Greenwood GL, Miranda J, Burnam MA. Development of a clinician report measure to assess psychotherapy for depression in usual care settings. Adm Policy Ment Health. 2010;37:221–229. doi: 10.1007/s10488-009-0249-4.
    1. Bidassie B, Williams LS, Woodward-Hagg H, Matthias MS, Damush TM. Key components of external facilitation in an acute stroke quality improvement collaborative in the Veterans Health Administration. Implement Sci. 2015;10:69. doi: 10.1186/s13012-015-0252-y.
    1. Waxmonsky J, Kilbourne AM, Goodrich DE, Nord KM, Lai Z, Laird C, Clogston J, Kim HM, Miller C, Bauer MS. Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. Psychiatr Serv. 2014;65:81–90. doi: 10.1176/appi.ps.201300039.
    1. Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, Kimmel B, Sharp ND, Smith JL. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21(2):S1–S8. doi: 10.1007/s11606-006-0267-9.
    1. Cully JA, Jameson JP, Phillips LL, Kunik ME, Fortney JC. Use of psychotherapy by rural and urban veterans. J Rural Health. 2010;26:225–233. doi: 10.1111/j.1748-0361.2010.00294.x.
    1. Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, Bystritsky A, Welch SS, Chavira DA, Golinelli D, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA. 2010;303:1921–1928. doi: 10.1001/jama.2010.608.
    1. Craske MG, Stein MB, Sullivan G, Sherbourne C, Bystritsky A, Rose RD, Lang AJ, Welch S, Campbell-Sills L, Golinelli D, Roy-Byrne P. Disorder-specific impact of coordinated anxiety learning and management treatment for anxiety disorders in primary care. Arch Gen Psychiatry. 2011;68:378–388. doi: 10.1001/archgenpsychiatry.2011.25.
    1. Sullivan G, Craske MG, Sherbourne C, Edlund MJ, Rose RD, Golinelli D, Chavira DA, Bystritsky A, Stein MB, Roy-Byrne PP. Design of the coordinated anxiety learning and management (CALM) study: innovations in collaborative care for anxiety disorders. Gen Hosp Psychiatry. 2007;29(5):379–387. doi: 10.1016/j.genhosppsych.2007.04.005.
    1. Craske MG, Rose RD, Lang A, Welch SS, Campbell-Sills L, Sullivan G, Sherbourne C, Bystritsky A, Stein MB, Roy-Byrne PP. Computer-assisted delivery of cognitive behavioral therapy for anxiety disorders in primary-care settings. Depress Anxiety. 2009;26:235–242. doi: 10.1002/da.20542.
    1. Proudfoot J, Ryden C, Everitt B, Shapiro DA, Goldberg D, Mann A, Tylee A, Marks I, Gray JA. Clinical efficacy of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry. 2004;185:46–54. doi: 10.1192/bjp.185.1.46.
    1. Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev. 2011;31:89–103. doi: 10.1016/j.cpr.2010.09.008.
    1. Sullivan G, Blevins D, Kauth MR. Translating clinical training into practice in complex mental health systems: toward opening the ‘black box’ of implementation. Implement Sci. 2008;3:33. doi: 10.1186/1748-5908-3-33.
    1. Rycroft-Malone J. The PARIHS framework—a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19:297–304. doi: 10.1097/00001786-200410000-00002.
    1. Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ. A guide for applying a revised version of the PARIHS framework for implementation. Implement Sci. 2011;6:99. doi: 10.1186/1748-5908-6-99.
    1. Kauth MR, Sullivan G, Blevins D, Cully JA, Landes RD, Said Q, Teasdale TA. Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study. Implement Sci. 2010;5:75. doi: 10.1186/1748-5908-5-75.
    1. Kirchner J, Edlund CN, Henderson K, Daily L, Parker LE, Fortney JC. Using a multi-level approach to implement a primary care mental health (PCMH) program. Fam Syst Health. 2010;28:161–174. doi: 10.1037/a0020250.
    1. Lindsay JA, Kauth MR, Hudson S, Martin LA, Ramsey DJ, Daily L, Rader J. Implementation of video telehealth to improve access to evidence-based psychotherapy for posttraumatic stress disorder. Telemed J E Health. 2015;21:467–472. doi: 10.1089/tmj.2014.0114.
    1. Reiser RA, Dempsey JA. Trends and issues in instructional design and technology. Upper Saddle River: Merrill/Prentice Hall; 2002.
    1. Dick W, Carey L. The systemic design of instruction. 4. New York: Harper Collins; 1996.
    1. Gagne RM, Briggs LJ, Wagner WW. Principles of instructional design. 4. New York: Harcourt Brace Jovanovich College Publishers; 1992.
    1. Kemp J, Morrison G, Ross S. Designing effective instruction. 2. Upper Saddle River: Prentice-Hall, Inc; 1998.
    1. Curran GM, Mukherjee S, Allee E, Owen RR. A process for developing an implementation intervention: QUERI series. Implement Sci. 2008;3:17. doi: 10.1186/1748-5908-3-17.
    1. Langford J, McDonagh D. Focus group tools. London: Taylor & Francis; 2003.
    1. Bruseberg A, McDonagh D. Organising and conducting effective focus group: the logistics. In: Langford J, McDonagh D, editors. Focus groups: supporting effective product development. New York: Taylor and Francis Inc; 2003. pp. 21–45.
    1. Rubin HP, Rubin I. Qualitative interviewing: the art of hearing data. Thousand Oaks: Sage; 1995.
    1. Spradley JP. The ethnographic interview. New York: International Thomson Publishing; 1979.
    1. Sobo EJ, Billman G, Lim L, Murdock JW, Romero E, Donoghue D, Roberts W, Kurtin PS. A rapid interview protocol supporting patient-centered quality improvement: hearing the parent’s voice in a pediatric cancer unit. Jt Comm J Qual Improv. 2002;28:498–509.
    1. Sobo EJ, Seid M, Reyes GL. Parent-identified barriers to pediatric health care: a process-oriented model. Health Serv Res. 2006;41:148–172. doi: 10.1111/j.1475-6773.2005.00455.x.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50:217–226. doi: 10.1097/MLR.0b013e3182408812.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. doi: 10.1186/s13012-015-0209-1.
    1. Karlin BE, Ruzek JI, Chard KM, Eftekhari A, Monson CM, Hembree EA, Resick PA, Foa EB. Dissemination of evidence-based psychological treatments for posttraumatic stress disorder in the Veterans Health Administration. J Trauma Stress. 2010;23:663–673. doi: 10.1002/jts.20588.
    1. Miller WR, Yahne CE, Moyers TB, Martinez J, Pirritano M. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72:1050–1062. doi: 10.1037/0022-006X.72.6.1050.
    1. Sharpless BA, Barber JP. A conceptual and empirical review of the meaning, measurement, development, and teaching of intervention competence in clinical psychology. Clin Psychol Rev. 2009;29:47–56. doi: 10.1016/j.cpr.2008.09.008.
    1. Luborsky L, McLellan AT, Woody GE, O’Brien CP, Auerbach A. Therapist success and its determinants. Arch Gen Psychiatry. 1985;42:602–611. doi: 10.1001/archpsyc.1985.01790290084010.
    1. Crits-Christoph P, Baranackie K, Kurcias J, Beck A, Carroll K, Perry K, Luborsky L, McLellan A, Woody G, Thompson L, et al. Meta-analysis of therapist effects in psychotherapy outcomes studies. Psychother Res. 1991;1:81–91. doi: 10.1080/10503309112331335511.
    1. Donner A, Birkett N, Buck C. Randomization by cluster. Sample size requirements and analysis. Am J Epidemiol. 1981;114:906–914.
    1. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–1288. doi: 10.1177/1049732305276687.
    1. Patton MQ. Qualitative research and evaluation methods. Thousand Oaks: Sage; 2002.
    1. Parker LE, Kirchner JE, Bonner LM, Fickel JJ, Ritchie MJ, Simons CE, Yano EM. Creating a quality improvement dialogue: utilizing knowledge from frontline staff, managers, and experts to foster healthcare quality improvement. Qual Health Res. 2009;19:229–242. doi: 10.1177/1049732308329481.
    1. Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. 2. Thousand Oaks: Sage; 1994.
    1. Strauss A, Corbin J. Grounded theory methodology: an overview. In: Denzin NK, Lincoln YS, editors. Strategies of qualitative inquiry. Thousand Oaks: Sage Publications; 1988.
    1. Huberman AM, Miles MB. The qualitative researcher’s companion. Thousand Oaks: Sage Publications; 2002.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera