Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics
John Fortney, Mark Enderle, Skye McDougall, Jeff Clothier, Jay Otero, Lisa Altman, Geoff Curran, John Fortney, Mark Enderle, Skye McDougall, Jeff Clothier, Jay Otero, Lisa Altman, Geoff Curran
Abstract
Background: Collaborative-care management is an evidence-based practice for improving depression outcomes in primary care. The Department of Veterans Affairs (VA) has mandated the implementation of collaborative-care management in its satellite clinics, known as Community Based Outpatient Clinics (CBOCs). However, the organizational characteristics of CBOCs present added challenges to implementation. The objective of this study was to evaluate the effectiveness of evidence-based quality improvement (EBQI) as a strategy to facilitate the adoption of collaborative-care management in CBOCs.
Methods: This nonrandomized, small-scale, multisite evaluation of EBQI was conducted at three VA Medical Centers and 11 of their affiliated CBOCs. The Plan phase of the EBQI process involved the localized tailoring of the collaborative-care management program to each CBOC. Researchers ensured that the adaptations were evidence based. Clinical and administrative staff were responsible for adapting the collaborative-care management program for local needs, priorities, preferences and resources. Plan-Do-Study-Act cycles were used to refine the program over time. The evaluation was based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Framework and used data from multiple sources: administrative records, web-based decision-support systems, surveys, and key-informant interviews.
Results: Adoption: 69.0% (58/84) of primary care providers referred patients to the program. Reach: 9.0% (298/3,296) of primary care patients diagnosed with depression who were not already receiving specialty care were enrolled in the program. Fidelity: During baseline care manager encounters, education/activation was provided to 100% (298/298) of patients, barriers were assessed and addressed for 100% (298/298) of patients, and depression severity was monitored for 100% (298/298) of patients. Less than half (42.5%, 681/1603) of follow-up encounters during the acute stage were completed within the timeframe specified. During the acute phase of treatment for all trials, the Patient Health Questionnaire (PHQ9) symptom-monitoring tool was used at 100% (681/681) of completed follow-up encounters, and self-management goals were discussed during 15.3% (104/681) of completed follow-up encounters. During the acute phase of treatment for pharmacotherapy and combination trials, medication adherence was assessed at 99.1% (575/580) of completed follow-up encounters, and side effects were assessed at 92.4% (536/580) of completed follow-up encounters. During the acute phase of treatment for psychotherapy and combination trials, counseling session adherence was assessed at 83.3% (239/287) of completed follow-up encounters. Effectiveness: 18.8% (56/298) of enrolled patients remitted (symptom free) and another 22.1% (66/298) responded to treatment (50% reduction in symptom severity). Maintenance: 91.9% (10/11) of the CBOCs chose to sustain the program after research funds were withdrawn.
Conclusions: Provider adoption was good, although reach into the target population was relatively low. Fidelity and maintenance were excellent, and clinical outcomes were comparable to those in randomized controlled trials. Despite the organizational barriers, these findings suggest that EBQI is an effective facilitation strategy for CBOCs.
Trial registration: Clinical trial # NCT00317018.
Figures
References
- Katon W, Von Korff M, Lin E, Simon G, Walker E, Unützer J. et al.Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial. Arch Gen Psychiatry. 1999;56(12):1109–1115. doi: 10.1001/archpsyc.56.12.1109.
- Katon W, Robinson P, Von Korff M, Lin E, Bush T, Ludman E. et al.A multifaceted intervention to improve treatment of depression in primary care. Arch Gen Psychiatry. 1996;53(10):924–932. doi: 10.1001/archpsyc.1996.01830100072009.
- Simon GE, VonKorff M, Rutter C, Wagner E. Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. Br Med J. 2000;320(7234):550–554. doi: 10.1136/bmj.320.7234.550.
- Rost K, Nutting P, Smith J, Werner J, Duan N. Improving depression outcomes in community primary care practice: a randomized trial of the QuEST intervention. J Gen Intern Med. 2001;16(3):143–149. doi: 10.1111/j.1525-1497.2001.00537.x.
- Wells KB, Sherbourne C, Schoenbaum M, Duan N, Meredith L, Unützer J. et al.Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. J Am Med Assoc. 2000;283(2):212–220. doi: 10.1001/jama.283.2.212.
- Finley PR, Rens HR, Pont JM, Gess SL, Louie C, Bull SA. et al.Impact of collaborative care model upon depression in primary care: a randomized controlled trial. Pharmacotherapy. 2003;23:1175–1185. doi: 10.1592/phco.23.10.1175.32760.
- Adler DA, Bungay KM, Wilson IB, Pei Y, Supran S, Peckham E. et al.The impact of a pharmacist intervention on 6-month outcomes in depressed primary care patients. Gen Hosp Psychiatry. 2004;26(3):199–209. doi: 10.1016/j.genhosppsych.2003.08.005.
- Unützer J, Katon W, Callahan CM, Williams JW Jr, Hunkeler E, Harpole L. et al.Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. J Am Med Assoc. 2002;288(22):2836–2845. doi: 10.1001/jama.288.22.2836.
- Hedrick SC, Chaney EF, Felker B, Liu CF, Hasenberg N, Heagerty P. et al.Effectiveness of collaborative care depression treatment in Veteran's Affairs primary care. J Gen Intern Med. 2003;18(1):9–16. doi: 10.1046/j.1525-1497.2003.11109.x.
- Badamgarav E, Weingarten SR, Henning JM, Knight K, Hasselblad V, Gano A Jr. et al.Effectiveness of disease management programs in depression: a systematic review. Am J Psychiatry. 2003;160(12):2080–2090. doi: 10.1176/appi.ajp.160.12.2080.
- Post EP, Metzger M, Dumas P, Lehmann L. Integrating mental health into primary care within the Veterans Health Administration. Fam Syst Health. 2010;28(2):83–90.
- Panangala SV, Mendez BHP. Veterans Health Administration: Community-Based Outpatient Clinics. Congressional Research Service. 2010. p. R41044. Ref Type: Report.
- Fortney JC, Borowsky SJ, Hedeen AN, Maciejewski ML, Chapko MK. VA community-based outpatient clinics: access and utilization performance measures. Med Care. 2002;40(7):561–569. doi: 10.1097/00005650-200207000-00002.
- Maciejewski ML, Perkins M, Li YF, Chapko M, Fortney JC, Liu CF. Utilization and expenditures of Veterans obtaining primary care in community clinics and VA medical centers: an observational cohort study. BMC Health Serv Res. 2007;7:56. doi: 10.1186/1472-6963-7-56.
- Liu CF, Chapko MK, Perkins MW, Fortney J, Maciejewski ML. The impact of contract primary care on health care expenditures and quality of care. Med Care Res Rev. 2008;65(3):300–314.
- Chapko M, Borowsky S, Fortney J, Hedeen A, Hoegle M, Maciejewski M. et al.Evaluation of the Department of Veterans Affairs Community-Based Outpatient Clinics. Med Care. 2002;40(7):555–560. doi: 10.1097/00005650-200207000-00001.
- Fortney J, Pyne JM, Edlund MJ, Williams DK, Robinson DE, Mittal D. et al.A randomized trial of telemedicine-based collaborative care for depression. J Gen Intern Med. 2007;22(8):1086–1093. doi: 10.1007/s11606-007-0201-9.
- Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7(3):149–158. doi: 10.1136/qshc.7.3.149.
- Greenhalgh T. Intuition and evidence-uneasy bedfellows? Br J Gen Pract. 2002;52:395–400.
- Haynes RB. What kind of evidence is it that Evidence-Based Medicine advocates want health care providers and consumers to pay attention to? BMC Health Serv Res. 2002;2:3. doi: 10.1186/1472-6963-2-3.
- Parker LE, Fickel JJ, Yano EM, Simon C, Bonner LM, Ritchie MJ, Organizational context and adoption of new clinical practices. 2009. Ref Type: Unpublished Work.
- Steckler A, Goodman RM, Kegler MC. In: Health Behavior and Health Education: Theory, Research and Practice. Glanz K, Rimmer BK, Lewis FM, editor. San Francisco, CA: Jossey-Bass; 2002. Mobilizing organizations for health enhancement: Theories of organizational change; pp. 335–360.
- Glisson C, Green P. The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Administration and Policy in Mental Health and Mental Health Services Research. 2006;33(4):433–448. doi: 10.1007/s10488-005-0016-0.
- Owen RR, Hudson T, Thrush C, Thapa P, Armitage T, Landes RD. The effectiveness of guideline implementation strategies on improving antipsychotic medication management for schizophrenia. Med Care. 2008;46(7):686–691. doi: 10.1097/MLR.0b013e3181653d43.
- Glisson C. The organizational context of children's mental health services. Clin Child Fam Psychol Rev. 2002;5(4):233–253. doi: 10.1023/A:1020972906177.
- Glisson C, James LR. The cross-level effects of culture and climate in human service teams. J Organ Behav. 2002;23:767–794. doi: 10.1002/job.162.
- Schutte K, Yano EM, Kilbourne AM, Wickrama B, Kirchner JE, Humphreys K. Organizational contexts of primary care approaches for managing problem drinking. J Subst Abuse Treat. 2009;36(4):435–445. doi: 10.1016/j.jsat.2008.09.002. Epub 2008 Nov 12.
- Rubenstein LV, Chaney EF, Ober S, Felker B, Sherman SE, Lanto A. et al.Using evidence-based quality improvement methods for translating depression collaborative care research into practice. Family, Systems & Health. 2010;28(2):91–113.
- Rost KM, Duan N, Rubenstein LV, Ford DE, Sherbourne CD, Meredith LS. et al.The Quality Improvement for Depression collaboration: general analytic strategies for a coordinated study of quality improvement in depression care. Gen Hosp Psychiatry. 2001;23(5):239–253. doi: 10.1016/S0163-8343(01)00157-8.
- Rubenstein LV, Parker LE, Meredith LS, Altschuler A, de Pillis E, Hernandez J. et al.Understanding Team-based Quality Improvement for Depression in Primary Care. Health Serv Res. 2002;37(4):1009–1029. doi: 10.1034/j.1600-0560.2002.63.x.
- Goldberg HI, Wagner EH, Fihn SD, Martin DP, Horowitz CR, Christensen DB. et al.A randomized controlled trial of CQI teams and academic detailing: can they alter compliance with guidelines? Jt Comm J Qual Improv. 1998;24(3):130–142.
- Solberg LI, Fischer LR, Wei F, Rush WA, Conboy KS, Davis TF. et al.A CQI intervention to change the care of depression: a controlled study. Eff Clin Pract. 2001;4(6):239–249.
- Parker LE, de Pillis E, Altschuler A, Rubenstein LV, Meredith LS. Balancing participation and expertise: A comparison of locally and centrally managed health care quality improvement within primary care practices. Qual Health Res. 2007;17(9):1268–1279. doi: 10.1177/1049732307307447.
- Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x.
- Ginsburg LR, Lewis S, Zackheim L, Casebeer A. Revisiting interaction in knowledge translation. Implementation Science. 2007;2:34. doi: 10.1186/1748-5908-2-34.
- Stange KC, Goodwin MA, Zyzanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. 2003;25:296–300. doi: 10.1016/S0749-3797(03)00219-8.
- Parker LE, Kirchner JE, Bonner LM, Fickel JJ, Ritchie MJ, Simons CE. et al.Creating a quality-improvement dialogue: utilizing knowledge from frontline staff, managers, and experts to foster health care quality improvement. Qual Health Res. 2009;19(2):229–242.
- Rubenstein LV, Mittman BS, Yano EM, Mulrow CD. From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative. Med Care. 2000;38(6 Suppl 1):I129–I141.
- Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Admin Policy Ment Health. 2008;35(1-2):21–37. doi: 10.1007/s10488-007-0144-9.
- Meredith LS, Mendel P, Pearson M, Wu S, Joyce G, Straus JB. et al.Implementation and maintenance of quality improvement for treating depression in primary care. Psychiatr Serv. 2006;57(1):48–55. doi: 10.1176/appi.ps.57.1.48.
- Rogers EM. Diffusion of Innovations. 5. New York, NY: The Free Press, A Division of Simon & Schuster, Inc.; 2003.
- Fortney JC, Pyne JM, Smith JL, Curran GM, Otero JM, Enderle MA. et al.Steps for implementing collaborative care programs for depression. Popul Health Manag. 2009;12(2):69–79. doi: 10.1089/pop.2008.0023.
- Fortney JC, Pyne JM, Steven CA, Williams JS, Hedrick RG, Lunsford AK. et al.A web-based clinical decision support system for depression care management. Am J Manag Care. 2010;16(11):849–854.
- Franx G, Meeuwissen JA, Sinnema H, Spijker J, Huyser J, Wensing M. et al.Quality improvement in depression care in the Netherlands: the depression breakthrough collaborative. A quality improvement report. International Journal of Integrated Care. 2009;9:e84.
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–1327. doi: 10.2105/AJPH.89.9.1322.
- Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns. 2001;44(2):119–127. doi: 10.1016/S0738-3991(00)00186-5.
- Glasgow RE. Translating research to practice: lessons learned, areas for improvement, and future directions. Diab Care. 2003;26(8):2451–2456. doi: 10.2337/diacare.26.8.2451.
- Glasgow RE, Lictenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93(8):1261–1267. doi: 10.2105/AJPH.93.8.1261.
- Hall G, Loucks S, Rutherford W, Newlove B. Levels of use of the innovation: a framework for analyzing innovation adoption. J Teach Educ. 1975;26(1):52–56. doi: 10.1177/002248717502600114.
- Goodman RM, McLeroy KR. Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993;20(2):161–179. doi: 10.1177/109019819302000208.
- Chaney EF, Rubenstein LV, Liu CF, Yano EM, Bolkan C, Lee M. et al.Implementing collaborative care for depression treatment in primary care: a cluster randomized evaluation of a quality improvement practice redesign. Implement Sci. 2011;6:121. doi: 10.1186/1748-5908-6-121.
- Rogers EM. Diffusion of Innovations. 3. New York: The Free Press, A Divison of Simon & Schuster, Inc.; 1983.
- Rogers EM. Diffusion of Innovations. 4. New York, NY: The Free Press; 1995.
- Fortney JC, Maciejewski M, Tripathi S, Deen TL, Pyne JM. A budget impact analysis of telemedicine-based collaborative care for depression. Med Care. in press .
- Smith JL, Williams JW Jr, Owen RR, Rubenstein LV, Chaney E. Developing a national dissemination plan for collaborative care for depression: QUERI series. Implement Sci. 2008;3:59. doi: 10.1186/1748-5908-3-59.
- Stetler CB, Mittman BS, Francis J. Overview of the VA Quality Enhancement Research Initiative (QUERI) and QUERI theme articles: QUERI Series. Implement Sci. 2008;3(8):1–9.
Source: PubMed