Adapting the self-assessment of contextual fit scale for implementation of evidence-based practices in adolescent HIV settings

Karin Coyle, April Idalski Carcone, Seyram Butame, Meardith Pooler-Burgess, Jason Chang, Sylvie Naar, Karin Coyle, April Idalski Carcone, Seyram Butame, Meardith Pooler-Burgess, Jason Chang, Sylvie Naar

Abstract

Background: Contextual fit is an important variable in the implementation of evidence-based programs (EBPs). The objectives of the current study were to examine the psychometric properties of the adapted Self-Assessment of Contextual Fit (SACF) measure for HIV clinical care settings (calling it SACF-HIV) and explore how perceptions of contextual fit varied across two different interventions (an intervention to scale up tailored motivational interviewing and an individually focused HIV prevention intervention) and 12 clinical sites.

Methods: We collected SACF-HIV data as part of a larger cross-project implementation science study (ATN 153). The study sample includes 128 clinicians, community health workers, interventionists, adherence counselors, and other members of the prevention and care team who engage in the implementation of EBPs at 12 HIV prevention and clinical care sites in the USA. We assessed the internal consistency of the SACF-HIV using Cronbach's alpha and examined the sub-dimensionality of the scale with an exploratory factor analysis. To explore concurrent validity, we examined Pearson's correlation coefficients between the adapted scale and fit-related sub-scale scores from the Evidence-Based Practice Attitudes Scale-50 (EBPAS-50). Variation in perceptions of fit by intervention was examined using descriptive statistics.

Results: Internal consistency of the adapted scale was strong (α=0.895). Factor analyses revealed two sub-scales-one capturing general insights regarding contextual fit, such as perceptions of skill, experience, and alignment with client needs (loadings ranging from .5 to .84), and a second centering perceptions regarding implementation support, such as resources and administrative support (loadings ranging from .89 to .97). Concurrent validity was supported by statistically significant correlations in the expected direction with EBPAS-50 fit-related sub-scales (r=.33-.35, p ≤ 0.05). SACF-HIV mean fit scores varied by intervention and the difference was statistically significant (2.78 vs. 2.53, p < 0.05).

Conclusions: There are relatively few tools assessing perceptions of contextual fit in HIV clinical settings. These results suggest the 12-item adapted SACF is a reliable, valid global assessment of perceptions of contextual fit and implementation support. The SACF-HIV can be used by practitioners and researchers interested in understanding an implementation context when planning to prepare and support EBP implementation.

Trial registration: TMI ClinicalTrials.gov NCT03681912; YMPH ClinicalTrials.gov NCT03488914.

Keywords: Adolescent; Contextual fit measurement; Evidence-based practices; Implementation science.

Conflict of interest statement

The authors declare that they have no competing interests.

© 2022. The Author(s).

References

    1. Schackman BR. Implementation science for the prevention and treatment of HIV/AIDS. J Acquir Immune Defic Syndr. 2010;55(Suppl 1):S27–S31. doi: 10.1097/QAI.0b013e3181f9c1da.
    1. Fauci AS, Redfield RR, Sigounas G, Weahkee MD, Giroir BP. Ending the HIV epidemic: a plan for the United States. JAMA. 2019;321(9):844. doi: 10.1001/jama.2019.1343.
    1. Albin RW, Lucyshyn JM, Horner RH, Flannery KB. Contextual fit or behavioral support plans: a model for “goodness of fit.”. In: Koegel LK, Koegel RL, Dunlap G, editors. Positive behavior support: including people with difficult behavior in the community. Baltimore: Paul H. Brookes, Publishing Co.; 1996. p. 81–98.
    1. Horner RH, Blitz C, Ross SW. The importance of contextual fit when implementing evidence-based programs. Washington, DC: Office of the Assistant Secretary for Planning and Evaluation; 2014.
    1. Pyne JM, Rost KM, Farahati F, Tripathi SP, Smith J, Williams DK, et al. One size fits some: the impact of patient treatment attitudes on the cost-effectiveness of a depression primary-care intervention. Psychol Med. 2005;35(6):839–854. doi: 10.1017/S0033291704003332.
    1. Kreuter MW, Oswald DL, Bull FC, Clark EM. Are tailored health education materials always more effective than non-tailored materials? Health Educ Res. 2000;15(3):305–315. doi: 10.1093/her/15.3.305.
    1. Monzalve M, Horner RH. The impact of the contextual fit enhancement protocol on behavior support plan fidelity and student behavior. Behav Disord. 2021;46(4):267–278. doi: 10.1177/0198742920953497.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. doi: 10.1186/1748-5908-4-50.
    1. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23. doi: 10.1007/s10488-010-0327-7.
    1. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1. doi: 10.1186/s13012-018-0842-6.
    1. Centers for Disease Control and Prevention . Replicating effective programs (REP) 2019.
    1. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2(1):42. doi: 10.1186/1748-5908-2-42.
    1. Horner RH, Salentine S, Albin RW. Self-assessment of contextual fit in schools. 2013.
    1. Rodriguez BJ, Loman SL, Horner RH. A preliminary analysis of the effects of coaching feedback on teacher implementation fidelity of first step to success. Behav Analysis Pract. 2009;2(2):11–21. doi: 10.1007/BF03391744.
    1. Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: the evidence based practice attitude scale-50. Adm Policy Ment Health. 2012;39(5):331–340. doi: 10.1007/s10488-010-0302-3.
    1. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. doi: 10.1186/s13012-017-0635-3.
    1. Kegler MC, Liang S, Weiner BJ, Tu SP, Friedman DB, Glenn BA, et al. Measuring constructs of the consolidated framework for implementation research in the context of increasing colorectal cancer screening in federally qualified health center. Health Serv Res. 2018;53(6):4178–4203. doi: 10.1111/1475-6773.13035.
    1. Naar S, Parsons JT, Stanton BF. Adolescent Trials Network for HIV-AIDS Scale It Up Program: protocol for a rational and overview. JMIR Res Protoc. 2019;8(2):e11204. doi: 10.2196/11204.
    1. Idalski Carcone A, Coyle K, Gurung S, Cain D, Dilones RE, Jadwin-Cakmak L, et al. Implementation science research examining the integration of evidence-based practices into HIV prevention and clinical care: protocol for a mixed-methods study using the Exploration, Preparation, Implementation, and Sustainment (EPIS) model. JMIR Res Protoc. 2019;8(5):e11202. doi: 10.2196/11202.
    1. Naar S, MacDonell K, Chapman JE, Todd L, Gurung S, Cain D, et al. Testing a motivational interviewing implementation intervention in adolescent HIV clinics: protocol for a type 3, hybrid implementation-effectiveness trial. JMIR Res Protoc. 2019;8(6):e11200. doi: 10.2196/11200.
    1. Miller WR, Rollnick S. Motivational interviewing: helping people change. 3. New York: Guilford Press; 2012. p. 482.
    1. Parsons JT, Starks T, Gurung S, Cain D, Marmo J, Naar S. Clinic-based delivery of the Young Men’s Health Project (YMHP) targeting HIV risk reduction and substance use among young men who have sex with men: protocol for a type 2, hybrid implementation-effectiveness trial. JMIR Res Protoc. 2019;8(5):e11184. doi: 10.2196/11184.
    1. Butame SA, Idalski Carcone A, Coyle K, Naar S. Implementation of evidence-based practices to reduce youth HIV transmission and improve self-management: a survey of key stakeholder perspectives. AIDS Patient Care STDS. 2021;35(10):385–391. doi: 10.1089/apc.2021.0071.
    1. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. PsycholMethods. 1999;4(3):272–299.
    1. Nunnally JC. Psychometric theory. 2. New York: McGraw-Hill; 1978. p. 701.
    1. Naar-King S, Suarez M, editors. Motivational interviewing with adolescents and young adults. New York: Guilford Press; 2011. p. 224.
    1. Carcone AI, Coyle K, Butame S, Harper GW, Aarons GA, Naar S. Using the Exploration-Preparation-Implementation-Sustainment (EPIS) Framework to prepare for the implementation of evidence-based practices into adolescent HIV settings. AIDS Behav. 2022. 10.1007/s10461-022-03735-0.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Metz A, Louison L. Based on Kiser, Zabel, Zachik, & Smith (2007) and Blase, Kiser & Van Dyke (2013) Chapel Hill: National Implementation Research Network, Frank Porter Graham Child Development Institute, University of North Carolina at Chapel Hill; 2018. The Hexagon: an exploration tool.

Source: PubMed

Спонсоры и соавторы

Заболевания

Медикаментозные вмешательства

Подписаться