Psychometric Properties of a Fidelity Scale for Illness Management and Recovery

Karina Myhren Egeland, Kristin Sverdvik Heiervang, Matthew Landers, Torleif Ruud, Robert E Drake, Gary R Bond, Karina Myhren Egeland, Kristin Sverdvik Heiervang, Matthew Landers, Torleif Ruud, Robert E Drake, Gary R Bond

Abstract

This study examined the psychometric properties and feasibility of the Illness Management and Recovery (IMR) Fidelity scale. Despite widespread use of the scale, the psychometric properties have received limited attention. Trained fidelity assessors conducted assessments four times over 18 months at 11 sites implementing IMR. The IMR Fidelity scale showed excellent interrater reliability (.99), interrater item agreement (94%), internal consistency (.91-.95 at three time points), and sensitivity to change. Frequency distributions generally showed that item ratings included the entire range. The IMR Fidelity scale has excellent psychometric properties and should be used to evaluate and guide the implementation of IMR.Trial registration: ClinicalTrials.gov Identifier: NCT03271242.

Keywords: IMR Fidelity scale; Illness Management and Recovery; Measurement; Psychometric properties.

Conflict of interest statement

The authors declare that they have no conflict of interest.

Figures

Fig. 1
Fig. 1
Development of IMR fidelity from baseline to 18 months

References

    1. Bartholomew T, Kensler D. Illness Management and Recovery in state psychiatric hospitals. American Journal of Psychiatric Rehabilitation. 2010;13(2):105–125. doi: 10.1080/15487761003756977.
    1. Bond G, Becker DR, Drake RE. Measurement of fidelity of implementation of evidence-based practices: Case example of the IPS Fidelity scale. Clinical Psychology: Science and Practice. 2011;18(2):126–141.
    1. Bond G, Drake RE, McHugo GJ, Peterson AE, Jones AM, Williams J. Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health and Mental Health Services Research. 2014;41(2):228–236. doi: 10.1007/s10488-012-0461-5.
    1. Bond G, Drake RE, McHugo GJ, Rapp CA, Whitley R. Strategies for improving fidelity in the national evidence-based practices project. Research on Social Work Practice. 2009;19(5):569–581. doi: 10.1177/1049731509335531.
    1. Cross W, West J. Examining implementer fidelity: Conceptualising and measuring adherence and competence. Journal of Children’s Services. 2011;6(1):18–33. doi: 10.5042/jcs.2011.0123.
    1. Egeland, K. M. (2018). The role of practitioners in the implementation of evidence-based practices in mental health services: Attitudes, participation, and experiences.. (PhD), University of Oslo, Oslo, Norway Retrieved from .
    1. Egeland KM, Ruud T, Ogden T, Färdig R, Lindstrøm JC, Heiervang KS. How to implement Illness Management and Recovery (IMR) in mental health service settings: Evaluation of the implementation strategy. International Journal of Mental Health Systems. 2017;11(1):13. doi: 10.1186/s13033-017-0120-z.
    1. Garber-Epstein P, Yamin A, Roe D. Promoting recovery in Israel: A decade of efforts to implement Illness Management and Recovery (IMR) Worl Association of Psychiatric Rehabilitation Bulletin. 2013;31:5–11.
    1. Gingerich S, Mueser K. Illness Management and Recovery IMR: Personalized skills and strategies for those with mental illness. 3. Center City, MN: Hazelden; 2011.
    1. Hasson-Ohayon I, Roe D, Kravetz S. A randomized controlled trial of the effectiveness of the Illness Management and Recovery program. Psychiatric Services. 2007;58(11):1461–1466. doi: 10.1176/appi.ps.58.11.1461.
    1. Lakens D. Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology. 2013;4:863. doi: 10.3389/fpsyg.2013.00863.
    1. Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implementation Science. 2014;9(1):118. doi: 10.1186/s13012-014-0118-8.
    1. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychological Methods. 1996;1:30–46. doi: 10.1037/1082-989X.1.1.30.
    1. McGuire AB, Kukla M, Green A, Gilbride D, Mueser KT, Salyers MP. Illness Management and Recovery: A review of the literature. Psychiatric Services. 2014;65(2):171–179. doi: 10.1176/appi.ps.201200274.
    1. McGuire AB, Stull LG, Mueser KT, Santos M, Mook A, Rose N, Salyers MP. Development and reliability of a measure of clinician competence in providing Illness Management and Recovery. Psychiatric Services (Washington, DC) 2012;63(8):772–778. doi: 10.1176/appi.ps.201100144.
    1. McHugo GJ, Drake RE, Whitley R, Bond G, Campbell K, Rapp CA, Finnerty MT. Fidelity outcomes in the national implementing evidence-based practices project. Psychiatric Services. 2007;58(10):1279–1284. doi: 10.1176/appi.ps.58.10.1279.
    1. Mueser KT, Meyer PS, Penn DL, Clancy R, Clancy DM, Salyers MP. The Illness Management and Recovery program: Rationale, development, and preliminary findings. Schizophrenia Bulletin. 2006;32(Suppl 1):S32–S43. doi: 10.1093/schbul/sbl022.
    1. Pratt CW, Smith RC, Kazmi A, Ahmed S. Inttoducing pychiatric rehabilitation at a psychiatric faculty in Pakistan. American Journal of Psychiatric Rehabilitation. 2011;14:259–271. doi: 10.1080/15487768.2011.622140.
    1. Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Hensley M. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy In Mental Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Roosenschoon B-J, Mulder CL, Deen ML, van Weeghel J. Effectiveness of Illness Management and Recovery (IMR) in the Netherlands: A randomised clinical trial. BMC Psychiatry. 2016;16(1):73. doi: 10.1186/s12888-016-0774-0.
    1. Rychener M, Salyers MP, Labriola S, Little N. Thresholds’ wellness management and recovery implementation. American Journal of Psychiatric Rehabilitation. 2009;12(2):172–184. doi: 10.1080/15487760902813186.
    1. Salyers MP, Godfrey JL, McGuire AB, Gearhart T, Rollins AL, Boyle C. Implementing the Illness Management and Recovery program for consumers with severe mental illness. Psychiatric Services. 2009;60(4):483–490. doi: 10.1176/appi.ps.60.4.483.
    1. The National Board of Health and Welfare. (2017). Nationella riktlinjer för vård och stöd vid schizofreni och schizofreniliknande tilstånd—Stöd för styrning och ledning—Remissversion. Stockholm, Sweden: Socialstyrelsen Retrieved from file:///C:/Users/KREG/Downloads/Socialstyrelsen.se.pdf.

Source: PubMed

3
Subskrybuj