An implementation-focused process evaluation of an incentive intervention effectiveness trial in substance use disorders clinics at two Veterans Health Administration medical centers

Hildi J Hagedorn, Cheryl B Stetler, Ann Bangerter, Siamak Noorbaloochi, Maxine L Stitzer, Daniel Kivlahan, Hildi J Hagedorn, Cheryl B Stetler, Ann Bangerter, Siamak Noorbaloochi, Maxine L Stitzer, Daniel Kivlahan

Abstract

Background: One of the pressing concerns in health care today is the slow rate at which promising interventions, supported by research evidence, move into clinical practice. One potential way to speed this process is to conduct hybrid studies that simultaneously combine the collection of effectiveness and implementation relevant data. This paper presents implementation relevant data collected during a randomized effectiveness trial of an abstinence incentive intervention conducted in substance use disorders treatment clinics at two Veterans Health Administration (VHA) medical centers.

Methods: Participants included patients entering substance use disorders treatment with diagnoses of alcohol dependence and/or stimulant dependence that enrolled in the randomized trial, were assigned to the intervention arm, and completed a post intervention survey (n = 147). All staff and leadership from the participating clinics were eligible to participate. A descriptive process evaluation was used, focused on participant perceptions and contextual/feasibility issues. Data collection was guided by the RE-AIM and PARIHS implementation frameworks. Data collection methods included chart review, intervention cost tracking, patient and staff surveys, and qualitative interviews with staff and administrators.

Results: Results indicated that patients, staff and administrators held generally positive attitudes toward the incentive intervention. However, staff and administrators identified substantial barriers to routine implementation. Despite the documented low cost and modest staff time required for implementation of the intervention, securing funding for the incentives and freeing up any staff time for intervention administration were identified as primary barriers.

Conclusions: Recommendations to facilitate implementation are presented. Recommendations include: 1) solicit explicit support from the highest levels of the organization through, for example, performance measures or clinical practice guideline recommendations; 2) adopt the intervention incrementally starting within a specific treatment track or clinic to reduce staff and funding burden until local evidence of effectiveness and feasibility is available to support spread; and 3) educate staff about the process, goals, and value/effectiveness of the intervention and engage them in implementation planning from the start to enhance investment in the intervention.

Figures

Figure 1
Figure 1
Participant recruitment.

References

    1. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington D C: Institute of Medicine of the National Academics Press; 2001.
    1. Sung NS, Crowley WF Jr, Genel M, Salber P, Sandy L, Sherwood LM, Johnson SB, Catanese V, Tilson H, Getz K, Larson EL, Scheinberg D, Reece EA, Slavkin H, Dobs A, Grebb J, Martinez RA, Korn A, Rimoin D. Central challenges facing the national clinical research enterprise. JAMA. 2003;289:1278–1287.
    1. Rosenberg RN. Translating biomedical research to the bedside: a national crisis and a call to action. JAMA. 2003;289:1305–1306.
    1. Glasgow RE, Lictenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–1267.
    1. Grol R, Wensing M, Eccles M. Improving patient care: the implementation of change in clinical practice. Toronto: Elsevier; 2005.
    1. Stetler CB, McQueen L, Demakis J, Mittman BS. An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series. Implement Sci. 2008;3:30.
    1. March JS, Siva SG, Compton S, Shapiro M, Califf R, Krishnan R. The case for practical clinical trials in psychiatry. Am J Psychiatry. 2005;162:836–846.
    1. Rubenstein LV, Pugh J. Strategies for promoting organizational and practice change by advancing implementation research. J Gen Intern Med. 2006;21:S58–S64.
    1. Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, Kimmel B, Sharp ND, Smith JL. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21:S1–S8.
    1. Stetler CB, Mittman BS, Francis J. Overview of the VA quality enhancement research initiative (QUERI) and QUERI theme articles: QUERI series. Implement Sci. 2008;3:8.
    1. Hagedorn H, Hogan M, Smith JL, Bowman C, Curran GM, Espadas D, Kimmel B, Kochevar L, Legro MW, Sales AE. Lessons learned about implementing research evidence into clinical practice: experiences from VA QUERI. J Gen Intern Med. 2005;21:S21–S24.
    1. Wells KB. Treatment research at the crossroads: the scientific interface of clinical trials and effectiveness research. Am J Psychiatry. 1999;156:5–10.
    1. Tunis SR, Stryer DB, Clancey CM. Increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003;290:1624–1632.
    1. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36:24–34.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50:217–226.
    1. Oakley A, Strange V, Bonell C, Alleln E, Stephenson J. RIPPLE Study Team. Process evaluation in randomized controlled trials of complex interventions. BM J. 2006;332:413–416.
    1. Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–459.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:979–983.
    1. Hagedorn H, Noorbaloochi S, Baines Simon A, Bangerter A, Stitzer ML, Stetler CB, Kivlahan D. Rewarding early abstinence in veterans health administration addiction clinics. J Subst Abuse Treat. 2013;2013(45):109–117.
    1. Glasgow RE, Vogt TM, Boyles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–1327.
    1. Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Education & Counseling. 2001;44:119–127.
    1. Gaglio B, Glasgow RE. In: Dissemination and implementation research in health: translating science into practice. Brownson R, Colditz G, Proctor E, editor. New York: Oxford University Press; 2012. Evaluation approaches for dissemination and implementation research; pp. 327–356.
    1. Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C. Ingredients for change: revisiting a conceptual framework. Qual Saf Health Care. 2002;11:174–180.
    1. Rycroft-Malone J. The PARIHS framework: a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19:297–304.
    1. Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1.
    1. Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Bendeser RM, Peek CJ. What does it mean to “employ” the RE-AIM framework? Evaluation and the Health Professions. 2013;36:44–66.
    1. Greenhalgh T, Robert G, Macfarlene F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.
    1. Simpson DD, Dansereau DF. Assessing organizational functioning as a step toward innovation. NIDA Science & Practice Perspectives. 2007;3:20–28.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
    1. Helfrich CD, Li YF, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action of research in health services (PARIHS) framework. Implement Sci. 2009;4:38.
    1. Hagedorn HJ, Heideman PW. The relationship between baseline organizational readiness to change assessment subscale scores and implementation of hepatitis prevention services in substance use disorders treatment clinics. Implement Sci. 2010;5:46.
    1. Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. 2. Thousand Oaks, CA: Sage Publications; 1994.
    1. Katz EC, Robles-Sotelo E, Correia CJ, Silverman K, Stitzer ML, Bigelow G. The brief abstinence test: effects of continued incentive availability on cocaine abstinence. Experimental & Clinical Psychopharmacology. 2002;10:10–17.
    1. Petry NM, Martin B, Simcic F Jr. Prize reinforcement contingency management for cocaine dependence: integration with group therapy in a methadone clinic. Journal of Consulting & Clinical Psychology. 2005;73:354–359.
    1. Roll JM, Petry NM, Stitzer ML, Brecht ML, Peirce JM, McCann MJ, Blaine J, MacDonald M, DiMaria J, Lucero L, Kellogg S. Contingency management for the treatment of methamphetamine use disorders. Am J Psychiatr. 2006;163:1993–1999.
    1. Silverman K, Robles E, Mudric T, Bigelow GE, Stitzer ML. A randomized trial of long-term reinforcement of cocaine abstinence in methadone-maintained patients who inject drugs. Journal of Consulting & Clinical Psychology. 2004;72:839–854.
    1. Higgins ST, Wong CJ, Badger GJ, Ogden DE, Dantona RL. Contingent reinforcement increases cocaine abstinence during outpatient treatment and 1 year of follow-up. J Consult Clin Psychol. 2000;68:64–72.
    1. Petry NM, Alessi SM, Hanson T, Sierra S. Randomized trial of contingent prizes versus vouchers in cocaine-using methadone patients. J Consult Clin Psychol. 2007;75:983–991.
    1. Petry NM, Barry D, Alessi SM, Rounsaville BJ, Carroll KM. A randomized trial adapting contingency management targets based on initial abstinence status of cocaine-dependent patients. J Consult Clin Psychol. 2012;80:276–285.
    1. Olmstead TA, Sindelar JL, Petry NM. Cost-effectiveness of prize-based incentives for stimulant abusers in outpatient psychosocial treatment programs. Drug Alcohol Depend. 2007;87:175–182.
    1. Olmstead TA, Petry NM. The cost-effectiveness of prize-based and voucher-based contingency management in a population of cocaine- or opioid-dependent outpatients. Drug Alcohol Depend. 2009;102:108–115.
    1. National Quality Forum. National voluntary consensus standards for the treatment of substance use conditions: evidence-based treatment practices – a consensus report. Washington, D.C: National Quality Forum; 2007.
    1. Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ. A guide for applying a revised version of the PARIHS framework for implementation. Implement Sci. 2011;6:99.
    1. Kirby KC, Carpenedo CM, Stitzer ML, Dugosh KL, Petry NM, Roll JM, Saladin ME, Cohen AJ, Hamilton J, Reese K, Sillo GR, Stabile PQ, Sterling RC. Is exposure to an effective contingency management intervention associated with more positive provider beliefs? J Subst Abuse Treat. 2012;42:356–365.
    1. Rash CJ, Petry NM, Kirby KC, Martino S, Roll J, Stitzer ML. Identifying provider beliefs related to contingency management adoption using the contingency management beliefs questionnaire. Drug Alcohol Depend. 2012;121:205–212.
    1. Rash CJ, DePhilippis D, McKay JR, Drapkin M, Petry NM. Training workshops positively impact beliefs about contingency management in a nationwide dissemination effort. J Subst Abuse Treat. 2013;45(3):306–312.
    1. Ducharme LJ, Knudsen HK, Abraham AJ, Roman PM. Counselor attitudes toward the use of motivational incentives in addiction treatment. Am J Addict. 2010;19:496–503.

Source: PubMed

Sponsorzy i współpracownicy

Warunki medyczne

Interwencje lekowe

3
Subskrybuj