The implementation and sustainment facilitation strategy improved implementation effectiveness and intervention effectiveness: Results from a cluster-randomized, type 2 hybrid trial

Bryan R Garner, Heather J Gotham, Michael Chaple, Steve Martino, James H Ford Ii, Mathew R Roosa, Kathryn J Speck, Denna Vandersloot, Michael Bradshaw, Elizabeth L Ball, Alyssa K Toro, Christopher Griggs, Stephen J Tueller, Bryan R Garner, Heather J Gotham, Michael Chaple, Steve Martino, James H Ford Ii, Mathew R Roosa, Kathryn J Speck, Denna Vandersloot, Michael Bradshaw, Elizabeth L Ball, Alyssa K Toro, Christopher Griggs, Stephen J Tueller

Abstract

Background: Substance use disorders (SUDs) among people with HIV are both prevalent and problematic. The Substance Abuse Treatment to HIV care project was funded to test the Implementation and Sustainment Facilitation (ISF) strategy as an adjunct to the Addiction Technology Transfer Center (ATTC) strategy for integrating a motivational interviewing-based brief intervention (MIBI) for SUDs within HIV community-based organizations.

Methods: Using a cluster-randomized, type 2 hybrid trial design, 39 HIV organizations were randomized to either (1) ATTC (n = 19) or (2) ATTC + ISF (n = 20). Each HIV organization identified two staff members to be prepared to implement the MIBI (N = 78). Subsequently, during the implementation phase, HIV organizations in each condition randomized client participants (N = 824) to one of the two intervention conditions: usual care (UC; n = 415) or UC + MIBI (n = 409). Both staff-level outcomes and client-level outcomes were examined.

Results: The ISF strategy had a significant impact on the implementation effectiveness (i.e., the consistency and the quality of implementation; β = .65, p = .01) but not on time-to-proficiency (β = -.02) or level-of-sustainment (β = .09). In addition, the ISF strategy was found to have a significant impact on the intervention effectiveness (the effectiveness of the MIBI), at least in terms of significantly decreasing the odds (odds ratio = 0.11, p = .02) of clients using their primary substance daily during follow-up.

Conclusion: The ISF strategy was found to be an effective adjunct to the ATTC strategy in terms of implementation effectiveness and intervention effectiveness. It is recommended that future efforts to integrate the project's MIBI for SUD within HIV organizations use the ATTC + ISF strategy. However, given the ISF strategy did not have a significant impact on level-of-sustainment, implementation research testing the extent to which the ATTC + ISF strategy can be significantly enhanced through effective sustainment strategies is warranted.

Plain language abstract: Substance use among people living with HIV is associated with increased mental health problems, worse medication adherence, and worse HIV viral suppression. Increasing substance use-related services in HIV community-based organizations is an important public health need. The Substance Abuse Treatment to HIV care project tested two strategies for helping HIV organizations implement a brief intervention (BI) designed to motivate clients to decrease their substance use. The project also tested if receiving a BI improved clients' outcome. Two staff from each of the 39 participating organizations were taught how to deliver the BI using the Addiction Technology Transfer Center (ATTC) training strategy (online and in-person training, monthly feedback, and coaching). Half of the organizations also received the Implementation and Sustainment Facilitation (ISF) strategy, which included monthly meetings with an ISF coach for the two BI staff and one or more leadership staff from the organization. Organizations that received both the ATTC and ISF strategies delivered more BIs and higher quality BIs than organizations that only received the ATTC strategy. In addition, clients receiving BIs at organizations that received both strategies were more likely to decrease their substance use. However, receiving both strategies did not improve how quickly staff learned to deliver the BI or improve the number of BIs delivered during the project's 6-month sustainment phase. Future research focused on implementing BIs within HIV organizations should consider using the ATTC and ISF strategies while also seeking to enhance the strategies to improve sustainment.

Keywords: Addiction Technology Transfer Center; HIV; Implementation strategies; external facilitation; motivational interviewing; substance use.

Conflict of interest statement

Declaration of conflicting interests The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Figures

Figure 1.
Figure 1.
Aims and hypotheses. Note. ATTC = Addiction Technology Transfer Center; ISF = implementation and sustainment facilitation; MIBI = motivational interviewing-based brief intervention; UC = usual care. Bolded lines indicate primary aim and hypotheses; thin line indicates other aim; and dashed lines indicate hypothesized moderators.
Figure 2.
Figure 2.
Participant flow. Note. ATTC = Addiction Technology Transfer Center; IQR = interquartile range; ISF = implementation and sustainment facilitation; MIBI = motivational interviewing-based brief intervention; UC = usual care.
Figure 3.
Figure 3.
Baseline distribution for client’s days of primary substance use.
Figure 4.
Figure 4.
Follow-up distribution for client’s days of primary substance use.
Figure 5.
Figure 5.
The impact of the ISF strategy on intervention effectiveness. Note. ISF = implementation and sustainment facilitation.

References

    1. Aarons G. A., Hurlburt M., Horwitz S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health, 38(1), 4–23. 10.1007/s10488-010-0327-7
    1. Aharonovich E., Greenstein E., O’Leary A., Johnston B., Seol S. G., Hasin D. S. (2012). HealthCall: Technology-based extension of motivational interviewing to reduce non-injection drug use in HIV primary care patients—A pilot study. AIDS Care, 24(12), 1461–1469. 10.1080/09540121.2012.663882
    1. Aharonovich E., Hatzenbuehler M. L., Johnston B., O’Leary A., Morgenstern J., Wainberg M. L., Yao P., Helzer J. E., Hasin D. S. (2006). A low-cost, sustainable intervention for drinking reduction in the HIV primary care setting. AIDS Care, 18(6), 561–568. 10.1080/09540120500264134
    1. Aharonovich E., Sarvet A., Stohl M., DesJarlais D., Tross S., Hurst T., Urbina A., Hasin D. (2017). Reducing non-injection drug use in HIV primary care: A randomized trial of brief motivational interviewing, with and without HealthCall, a technology-based enhancement. Journal of Substance Abuse Treatment, 74, 71–79. 10.1016/j.jsat.2016.12.009
    1. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing. 10.1176/appi.books.9780890425596
    1. Arnsten J. H., Demas P. A., Grant R. W., Gourevitch M. N., Farzadegan H., Howard A. A., Schoenbaum E. E. (2002). Impact of active drug use on antiretroviral therapy adherence and viral suppression in HIV-infected drug users. Journal of General Internal Medicine, 17(5), 377–381. 10.1046/j.1525-1497.2002.10644.x
    1. Azar M. M., Springer S. A., Meyer J. P., Altice F. L. (2010). A systematic review of the impact of alcohol use disorders on HIV treatment outcomes, adherence to antiretroviral therapy and health care utilization. Drug and Alcohol Dependence, 112(3), 178–193. 10.1016/j.drugalcdep.2010.06.014
    1. Baker A. L., Hides L., Lubman D. I. (2010). Treatment of cannabis use among people with psychotic or depressive disorders: A systematic review. The Journal of Clinical Psychiatry, 71(3), 247–254. 10.4088/JCP.09r05119gry
    1. Baker A. L., Turner A., Kay-Lambkin F. J., Lewin T. J. (2009). The long and the short of treatments for alcohol or cannabis misuse among people with severe mental disorders. Addictive Behaviors, 34(10), 852–858. 10.1016/j.addbeh.2009.02.002
    1. Barwick M. A., Bennett L. M., Johnson S. N., McGowan J., Moore J. E. (2012). Training health and mental health professionals in motivational interviewing: A systematic review. Children and Youth Services Review, 34(9), 1786–1795. 10.1016/j.childyouth.2012.05.012
    1. Baskerville N. B., Liddy C., Hogg W. (2012). Systematic review and meta-analysis of practice facilitation within primary care settings. Annals of Family Medicine, 10(1), 63–74. 10.1370/afm.1312
    1. Campbell M. K., Piaggio G., Elbourne D. R., Altman D. G., & CONSORT Group. (2012). Consort 2010 statement: Extension to cluster randomised trials. British Medical Journal, 345, Article e5661. 10.1136/bmj.e5661
    1. Chambers D. A., Glasgow R. E., Stange K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), Article 117. 10.1186/1748-5908-8-117
    1. Charpentier P. A. (2003). Urn randomization program gRand [Computer program] (1.10th ed.). Yale University.
    1. Chen H., Cohen P., Chen S. (2010). How big is a big odds ratio? Interpreting the magnitudes of odds ratios in epidemiological studies. Communications in Statistics—Simulation and Computation, 39(4), 860–864. 10.1080/03610911003650383
    1. Chinman M., Acosta J., Ebener P., Malone P. S., Slaughter M. E. (2015). Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®. Implementation Science, 11(1), Article 78. 10.1186/s13012-016-0446-y
    1. Chinman M., McCarthy S., Hannah G., Byrne T. H., Smelson D. A. (2017). Using getting to outcomes to facilitate the use of an evidence-based practice in VA homeless programs: A cluster-randomized trial of an implementation support strategy. Implementation Science, 12(1), Article 34. 10.1186/s13012-017-0565-0
    1. Cully J. A., Armento M. E., Mott J., Nadorff M. R., Naik A. D., Stanley M. A., Sorocco K. H., Kunik M. E., Petersen N. J., Kauth M. R. (2012). Brief cognitive behavioral therapy in primary care: A hybrid type 2 patient-randomized effectiveness-implementation design. Implementation Science, 7, Article 64. 10.1186/1748-5908-7-64
    1. Curran G. M., Bauer M., Mittman B., Pyne J. M., Stetler C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226. 10.1097/MLR.0b013e3182408812
    1. Damschroder L. J., Aron D. C., Keith R. E., Kirsh S. R., Alexander J. A., Lowery J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, Article 50. 10.1186/1748-5908-4-50
    1. Darnell D., Dunn C., Atkins D., Ingraham L., Zatzick D. (2016). A randomized evaluation of motivational interviewing training for mandated implementation of alcohol screening and brief intervention in trauma centers. Journal of Substance Abuse Treatment, 60, 36–44. 10.1016/j.jsat.2015.05.010
    1. Dennhardt A. A., Murphy J. G. (2013). Prevention and treatment of college student drug use: A review of the literature. Addictive Behaviors, 38(10), 2607–2618. 10.1016/j.addbeh.2013.06.006
    1. de Roten Y., Zimmermann G., Ortega D., Despland J. N. (2013). Meta-analysis of the effects of MI training on clinicians’ behavior. Journal of Substance Abuse Treatment, 45(2), 155–162. 10.1016/j.jsat.2013.02.006
    1. DiClemente C. C., Corno C. M., Graydon M. M., Wiprovnick A. E., Knoblach D. J. (2017). Motivational interviewing, enhancement, and brief interventions over the last decade: A review of reviews of efficacy and effectiveness. Psychology of Addictive Behaviors, 31(8), 862–887. 10.1037/adb0000318
    1. Durlak J. A., DuPre E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. 10.1007/s10464-008-9165-0
    1. Foy R., Sales A., Wensing M., Aarons G. A., Flottorp S., Kent B., Straus S., Wilson P. (2015). Implementation science: A reappraisal of our journal mission and scope. Implementation Science, 10, Article 51. 10.1186/s13012-015-0240-2
    1. Friedman M. S., Marshal M. P., Stall R., Kidder D. P., Henny K. D., Courtenay-Quirk C., Wolitski R. J., Aidala A., Royal S., Holtgrave D. R. (2009). Associations between substance use, sexual risk taking and HIV treatment adherence among homeless people living with HIV. AIDS Care, 21(6), 692–700. 10.1080/09540120802513709
    1. Garner B. R., Godley S. H., Dennis M. L., Hunter B., Bair C., Godley M. D. (2012). Using pay for performance to improve treatment implementation for adolescent substance use disorders: Results from a cluster randomized trial. Archives of Pediatrics & Adolescent Medicine, 166, 938–944. 10.1001/archpediatrics.2012.802
    1. Garner B. R., Gotham H. J., Tueller S. J., Ball E. L., Kaiser D., Stilen P., Speck K., Vandersloot D., Rieckmann T. R., Chaple M., Martin E. G., Martino S. (2017). Testing the effectiveness of a motivational interviewing-based brief intervention for substance use as an adjunct to usual care in community-based AIDS service organizations: Study protocol for a multisite randomized controlled trial. Addiction Science & Clinical Practice, 12(1), Article 31. 10.1186/s13722-017-0095-8
    1. Garner B. R., Hunter S. B., Funk R. R., Griffin B. A., Godley S. H. (2016). Toward evidence-based measures of implementation: Examining the relationship between implementation outcomes and client outcomes. Journal of Substance Abuse Treatment, 67, 15–21. 10.1016/j.jsat.2016.04.006
    1. Garner B. R., Zehner M., Roosa M. R., Martino S., Gotham H. J., Ball E. L., Stilen P., Speck K., Vandersloot D., Rieckmann T. R., Chaple M., Martin E. G., Kaiser D., Ford J. H., II. (2017). Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: Study protocol for a cluster randomized trial. Addiction Science & Clinical Practice, 12(1), Article 32. 10.1186/s13722-017-0096-7
    1. Gaynes B. N., Pence B. W., Eron J. J., Jr., Miller W. C. (2008). Prevalence and comorbidity of psychiatric diagnoses based on reference standard in an HIV+ patient population. Psychosomatic Medicine, 70(4), 505–511. 10.1097/PSY.0b013e31816aa0cc
    1. Gustafson D. H., Quanbeck A. R., Robinson J. M., Ford J. H., 2nd, Pulvermacher A., French M. T., McConnell K. J., Batalden P. B., Hoffman K. A., McCarty D. (2013). Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction, 108(6), 1145–1157. 10.1111/add.12117
    1. Haldane V., Legido-Quigley H., Chuah F. L. H., Sigfrid L., Murphy G., Ong S. E., Cervero-Liceras F., Watt N., Balabanova D., Hogarth S., Maimaris W., Buse K., McKee M., Piot P., Perel P. (2018). Integrating cardiovascular diseases, hypertension, and diabetes with HIV services: A systematic review. AIDS Care, 30(1), 103–115. 10.1080/09540121.2017.1344350
    1. Hartzler B., Dombrowski J. C., Crane H. M., Eron J. J., Geng E. H., Christopher Mathews W., Mayer K. H., Moore R. D., Mugavero M. J., Napravnik S., Rodriguez B., Donovan D. M. (2017). Prevalence and predictors of substance use disorders among HIV care enrollees in the United States. AIDS and Behavior, 21(4), 1138–1148. 10.1007/s10461-016-1584-6
    1. Harvey G., Loftus-Hills A., Rycroft-Malone J., Titchen A., Kitson A., McCormack B., Seers K. (2002). Getting evidence into practice: The role and function of facilitation. Journal of Advanced Nursing, 37(6), 577–588. 10.1046/j.1365-2648.2002.02126.x
    1. Hasin D. S., Aharonovich E., Greenstein E. (2014). HealthCall for the smartphone: Technology enhancement of brief intervention in HIV alcohol dependent patients. Addiction Science & Clinical Practice, 9(1), Article 5. 10.1186/1940-0640-9-5
    1. Hasin D. S., Aharonovich E., O’Leary A., Greenstein E., Pavlicova M., Arunajadai S., Waxman R., Wainberg M., Helzer J., Johnston B. (2013). Reducing heavy drinking in HIV primary care: A randomized trial of brief intervention, with and without technological enhancement. Addiction, 108(7), 1230–1240. 10.1111/add.12127
    1. Helfrich C. D., Weiner B. J., McKinney M. M., Minasian L. (2007). Determinants of implementation effectiveness: Adapting a framework for complex innovations. Medical Care Research and Review, 64(3), 279–303. 10.1177/1077558707299887
    1. Hendershot C. S., Stoner S. A., Pantalone D. W., Simoni J. M. (2009). Alcohol use and antiretroviral adherence: Review and meta-analysis. JAIDS: Journal of Acquired Immune Deficiency Syndromes, 52(2), 180–202. 10.1097/QAI.0b013e3181b18b6e
    1. Hunter S. B., Han B., Slaughter M. E., Godley S. H., Garner B. R. (2015). Associations between implementation characteristics and evidence-based practice sustainment: A study of the Adolescent Community Reinforcement Approach. Implementation Science, 10(1), Article 173. 10.1186/s13012-015-0364-4
    1. Hunter S. B., Han B., Slaughter M. E., Godley S. H., Garner B. R. (2017). Predicting evidence-based treatment sustainment: Results from a longitudinal study of the Adolescent-Community Reinforcement Approach. Implementation Science, 12(1), Article 75. 10.1186/s13012-017-0606-8
    1. Hutton H. E., Lesko C. R., Li X., Thompson C. B., Lau B., Napravnik S., Mayer K. H., Mathews W. C., McCaul M. E., Crane H. M., Fredericksen R. J., Cropsey K. L., Saag M., Christopoulos K., Chander G. (2019). Alcohol use patterns and subsequent sexual behaviors among women, men who have sex with men and men who have sex with women engaged in routine HIV care in the United States. AIDS and Behavior, 23(6), 1634–1646. 10.1007/s10461-018-2337-5
    1. Jacobs S. R., Weiner B. J., Bunger A. C. (2014). Context matters: Measuring implementation climate among individuals and groups. Implementation Science, 9, Article 46. 10.1186/1748-5908-9-46
    1. Jones J., Wyse R., Finch M., Lecathelinais C., Wiggers J., Marshall J., Falkiner M., Pond N., Yoong S. L., Hollis J., Fielding A., Dodds P., Clinton-McHarg T., Freund M., McElduff P., Gillham K., Wolfenden L. (2015). Effectiveness of an intervention to facilitate the implementation of healthy eating and physical activity policies and practices in childcare services: A randomised controlled trial. Implementation Science, 10(1), Article 147. 10.1186/s13012-015-0340-z
    1. Kahler C. W., Pantalone D. W., Mastroleo N. R., Liu T., Bove G., Ramratnam B., Mayer K. H. (2018). Motivational interviewing with personalized feedback to reduce alcohol use in HIV-infected men who have sex with men: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 86(8), 645–656. 10.1037/ccp0000322
    1. Kaner E. F., Dickinson H. O., Beyer F., Pienaar E., Schlesinger C., Campbell F., Saunders J. B., Burnand B., Heather N. (2009). The effectiveness of brief alcohol interventions in primary care settings: A systematic review. Drug and Alcohol Review, 28(3), 301–323. 10.1111/j.1465-3362.2009.00071.x
    1. Kauth M. R., Sullivan G., Blevins D., Cully J. A., Landes R. D., Said Q., Teasdale T. A. (2010). Employing external facilitation to implement cognitive behavioral therapy in VA clinics: A pilot study. Implementation Science, 5, Article 75. 10.1186/1748-5908-5-75
    1. Kilbourne A. M., Almirall D., Goodrich D. E., Lai Z., Abraham K. M., Nord K. M., Bowersox N. W. (2014). Enhancing outreach for persons with serious mental illness: 12-month results from a cluster randomized trial of an adaptive implementation strategy. Implementation Science, 9(1), Article 163. 10.1186/s13012-014-0163-3
    1. Kilbourne A. M., Goodrich D. E., Lai Z., Almirall D., Nord K. M., Bowersox N. W., Abraham K. M. (2015). Reengaging veterans with serious mental illness into care: Preliminary results from a national randomized trial. Psychiatric Services, 66(1), 90–93. 10.1176/appi.ps.201300497
    1. King W. D., Larkins S., Hucks-Ortiz C., Wang P. C., Gorbach P. M., Veniegas R., Shoptaw S. (2009). Factors associated with HIV viral load in a respondent driven sample in Los Angeles. AIDS and Behavior, 13(1), 145–153. 10.1007/s10461-007-9337-1
    1. Kirchner J. E., Ritchie M. J., Pitcock J. A., Parker L. E., Curran G. M., Fortney J. C. (2014). Outcomes of a partnered facilitation strategy to implement primary care-mental health. Journal of General Internal Medicine, 29(Suppl. 4), 904–912. 10.1007/s11606-014-3027-2
    1. Kitson A. L., Rycroft-Malone J., Harvey G., McCormack B., Seers K., Titchen A. (2008). Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implementation Science, 3(1), Article 1. 10.1186/1748-5908-3-1
    1. Klein K. J., Conn A. B., Sorra J. S. (2001). Implementing computerized technology: An organizational analysis. Journal of Applied Psychology, 86(5), 811–824. 10.1037/0021-9010.86.5.811
    1. Klein K. J., Sorra J. S. (1996). The challenge of innovation implementation. The Academy of Management Review, 21(4), 1055–1080. 10.2307/259164
    1. Kotz D., Spigt M., Arts I. C., Crutzen R., Viechtbauer W. (2012. a). Researchers should convince policy makers to perform a classic cluster randomized controlled trial instead of a stepped wedge design when an intervention is rolled out. Journal of Clinical Epidemiology, 65(12), 1255–1256. 10.1016/j.jclinepi.2012.06.016
    1. Kotz D., Spigt M., Arts I. C., Crutzen R., Viechtbauer W. (2012. b). Use of the stepped wedge design cannot be recommended: A critical appraisal and comparison with the classic cluster randomized controlled trial design. Journal of Clinical Epidemiology, 65(12), 1249–1252. 10.1016/j.jclinepi.2012.06.004
    1. Landes S. J., McBain S. A., Curran G. M. (2019). An introduction to effectiveness-implementation hybrid designs. Psychiatry Research, 280, 112513.
    1. Lessard S., Bareil C., Lalonde L., Duhamel F., Hudon E., Goudreau J., Lévesque L. (2015). External facilitators and interprofessional facilitation teams: A qualitative study of their roles in supporting practice change. Implementation Science, 11(1), Article 97. 10.1186/s13012-016-0458-7
    1. Liddy C., Hogg W., Russell G., Wells G., Armstrong C. D., Akbari A., Cornett A. (2011). Improved delivery of cardiovascular care (IDOCC) through outreach facilitation: Study protocol and implementation details of a cluster randomized controlled trial in primary care. Implementation Science, 6(1), Article 110. 10.1186/1748-5908-6-110
    1. Liddy C., Hogg W., Singh J., Taljaard M., Russell G., Deri Armstrong C., Akbari A., Dahrouge S., Grimshaw J. M. (2015). A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implementation Science, 10(1), Article 150. 10.1186/s13012-015-0341-y
    1. Liu F., Kong Y. (2015). zoib: An R package for Bayesian inference for beta regression and zero/one inflated beta regression. The R Journal, 7(2), 34–51. 10.32614/rj-2015-019
    1. Lucas G. M., Cheever L. W., Chaisson R. E., Moore R. D. (2001). Detrimental effects of continued illicit drug use on the treatment of HIV-1 infection. JAIDS: Journal of Acquired Immune Deficiency Syndromes, 27(3), 251–259. 10.1097/00126334-200107010-00006
    1. Lundahl B. W., Kunz C., Brownell C., Tollefson D., Burke B. L. (2010). A meta-analysis of motivational interviewing: Twenty-five years of empirical studies. Research on Social Work Practice, 20(2), 137–160. 10.1177/1049731509347850
    1. MacKinnon D. P. (2011). Integrating mediators and moderators in research design. Research on Social Work Practice, 21(6), 675–681. 10.1177/1049731511414148
    1. Madson M. B., Loignon A. C., Lane C. (2009). Training in motivational interviewing: A systematic review. Journal of Substance Abuse Treatment, 36(1), 101–109. 10.1016/j.jsat.2008.05.005
    1. Madson M. B., Villarosa-Hurlocker M. C., Schumacher J. A., Williams D. C., Gauthier J. M. (2019). Motivational interviewing training of substance use treatment professionals: A systematic review. Substance Abuse, 40(1), 43–51. 10.1080/08897077.2018.1475319
    1. Malta M., Strathdee S. A., Magnanini M. M., Bastos F. I. (2008). Adherence to antiretroviral therapy for human immunodeficiency virus/acquired immune deficiency syndrome among drug users: A systematic review. Addiction, 103(8), 1242–1257. 10.1111/j.1360-0443.2008.02269.x
    1. Martino S. (2010). Strategies for training counselors in evidence-based treatments. Addiction Science & Clinical Practice, 5(2), 30–39.
    1. Martino S., Ball S. A., Nich C., Frankforter T. L., Carroll K. M. (2008). Community program therapist adherence and competence in motivational enhancement therapy. Drug and Alcohol Dependence, 96(1–2), 37–48. 10.1016/j.drugalcdep.2008.01.020
    1. McLellan A. T., Kushner H., Metzger D., Peters R., Smith I., Grissom G., Pettinati H., Argeriou M. (1992). The fifth edition of the Addiction Severity Index. Journal of Substance Abuse Treatment, 9(3), 199–213. 10.1016/0740-5472(92)90062-s
    1. McQueen J., Howe T. E., Allan L., Mains D., Hardy V. (2011). Brief interventions for heavy alcohol users admitted to general hospital wards. Cochrane Database of Systematic Reviews, 8, CD005191. 10.1002/14651858.CD005191.pub3
    1. Mdege N. D., Man M. S., Taylor C. A., Torgerson D. J. (2012). There are some circumstances where the stepped-wedge cluster randomized trial is preferable to the alternative: No randomized trial at all. Response to the commentary by Kotz and colleagues. Journal of Clinical Epidemiology, 65(12), 1253–1254.
    1. Miller W. R., Yahne C. E., Moyers T. B., Martinez J., Pirritano M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72(6), 1050–1062. 10.1037/0022-006x.72.6.1050
    1. Owen R. R., Drummond K. L., Viverito K. M., Marchant K., Pope S. K., Smith J. L., Landes R. D. (2013). Monitoring and managing metabolic effects of antipsychotics: A cluster randomized trial of an intervention combining evidence-based quality improvement and external facilitation. Implementation Science, 8(1), Article 120. 10.1186/1748-5908-8-120
    1. Palepu A., Tyndall M., Yip B., O’Shaughnessy M. V., Hogg R. S., Montaner J. S. (2003). Impaired virologic response to highly active antiretroviral therapy associated with ongoing injection drug use. JAIDS: Journal of Acquired Immune Deficiency Syndromes, 32(5), 522–526. 10.1097/00126334-200304150-00009
    1. Parchman M. L., Noel P. H., Culler S. D., Lanham H. J., Leykum L. K., Romero R. L., Palmer R. F. (2013). A randomized trial of practice facilitation to improve the delivery of chronic illness care in primary care: Initial and sustained effects. Implementation Science, 8, Article 93. 10.1186/1748-5908-8-93
    1. Pinnock H., Barwick M., Carpenter C. R., Eldridge S., Grandes G., Griffiths C. J., Rycroft-Malone J., Meissner P., Murray E., Patel A., Sheikh A., Taylor S. J., & StaRI Group. (2017). Standards for Reporting Implementation Studies (StaRI) statement. British Medical Journal, 356, Article i6795. 10.1136/bmj.i6795
    1. Preacher K. J., Zhang Z., Zyphur M. J. (2016). Multilevel structural equation models for assessing moderation within and across levels of analysis. Psychological Methods, 21(2), 189. 10.1037/met0000052
    1. Proctor E. K., Landsverk J., Aarons G., Chambers D., Glisson C., Mittman B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health, 36(1), 24–34. 10.1007/s10488-008-0197-4
    1. Proctor E. K., Luke D., Calhoun A., McMillen C., Brownson R., McCrary S., Padek M. (2015). Sustainability of evidence-based healthcare: Research agenda, methodological advances, and infrastructure support. Implementation Science, 10(1), Article 88. 10.1186/s13012-015-0274-5
    1. Raudenbush S. W., Spybrook J., Congdon R., Liu X. F., Martinez A., Bloom H., Hill C. (2011). Optimal design software for multi-level and longitudinal research (Version 3.01) [Software].
    1. Saldana L., Chamberlain P., Wang W., Hendricks Brown C. (2012). Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health and Mental Health, 39(6), 419–425. 10.1007/s10488-011-0363-y
    1. Satre D. D., Sarovar V., Leyden W., Hare C. B., Catz S. L., Bryant K. J., Williams E. C., Hojilla J. C., Horberg M. A., Silverberg M. J. (2020). Changes in days of unhealthy alcohol use and antiretroviral therapy adherence, HIV RNA levels, and condomless sex: A secondary analysis of clinical trial data. AIDS and Behavior, 24(6), 1784–1792. 10.1007/s10461-019-02742-y
    1. Scott-Sheldon L. A. J., Carey K. B., Johnson B. T., Carey M. P., & MASH Research Team. (2017). Behavioral interventions targeting alcohol use among people living with HIV/AIDS: A systematic review and meta-analysis. AIDS and Behavior, 21(Suppl. 2), 126–143. 10.1007/s10461-017-1886-3
    1. Sealed Envelope. (n.d.). Randomisation and online databases for clinical trials.
    1. Seers K., Cox K., Crichton N. J., Edwards R. T., Eldh A. C., Estabrooks C. A., Harvey G., Hawkes C., Kitson A., Linck P., McCarthy G., McCormack B., Mockford C., Rycroft-Malone J., Titchen A., Wallin L. (2012). FIRE (Facilitating Implementation of Research Evidence): A study protocol. Implementation Science, 7(1), Article 25. 10.1186/1748-5908-7-25
    1. Seers K., Rycroft-Malone J., Cox K., Crichton N., Edwards R. T., Eldh A. C., Estabrooks C. A., Harvey G., Hawkes C., Jones C., Kitson A., McCormack B., McMullan C., Mockford C., Niessen T., Slater P., Titchen A., van der Zijpp T., Wallin L. (2018). Facilitating Implementation of Research Evidence (FIRE): An international cluster randomised controlled trial to evaluate two models of facilitation informed by the Promoting Action on Research Implementation in Health Services (PARIHS) framework. Implementation Science, 13(1), Article 137. 10.1186/s13012-018-0831-9
    1. Shea C. M., Jacobs S. R., Esserman D. A., Bruce K., Weiner B. J. (2014). Organizational readiness for implementing change: A psychometric assessment of a new measure. Implementation Science, 9(1), Article 7. 10.1186/1748-5908-9-7
    1. Stetler C. B., Legro M. W., Rycroft-Malone J., Bowman C., Curran G., Guihan M., Hagedorn H., Pineros S., Wallace C. M. (2006). Role of “external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1, Article 23. 10.1186/1748-5908-1-23
    1. Stewart J. S. (2012). A critical appraisal of motivational interviewing within the field of alcohol misuse. Journal of Psychiatric and Mental Health Nursing, 19(10), 933–938. 10.1111/j.1365-2850.2012.01880.x
    1. Stirman S. W., Kimberly J., Cook N., Calloway A., Castro F., Charns M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, Article 17. 10.1186/1748-5908-7-17
    1. Stout R. L., Wirtz P. W., Carbonari J. P., Del Boca F. K. (1994). Ensuring balanced distribution of prognostic factors in treatment outcome research. Journal of Studies on Alcohol. Supplement, 12(Suppl.), 70–75. 10.15288/jsas.1994.s12.70
    1. U.S. Department of Health and Human Services, Health Resources and Services Administration, Bureau of Primary Health Care. (2017). Integrating HIV care, treatment & prevention services into primary care—A toolkit for health centers.
    1. Wagner C. C., Ingersoll K. S. (2012). Motivational interviewing in groups. Guilford Press.
    1. Weiner B. J., Lewis M. A., Linnan L. A. (2009). Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Education Research, 24(2), 292–305. 10.1093/her/cyn019
    1. Wray T. B., Grin B., Dorfman L., Glynn T. R., Kahler C. W., Marshall B. D., van den Berg J. J., Zaller N. D., Bryant K. J., Operario D. (2016). Systematic review of interventions to reduce problematic alcohol use in men who have sex with men. Drug and Alcohol Review, 35(2), 148–157. 10.1111/dar.12271

Source: PubMed

3
Sottoscrivi