Early Psychosis Intervention-Spreading Evidence-based Treatment (EPI-SET): protocol for an effectiveness-implementation study of a structured model of care for psychosis in youth and emerging adults

Nicole Kozloff, George Foussias, Janet Durbin, Sanjeev Sockalingam, Jean Addington, Donald Addington, Augustina Ampofo, Kelly K Anderson, Melanie Barwick, Sarah Bromley, Jasmyn E A Cunningham, Simone Dahrouge, Lillian Duda, Catherine Ford, Sheila Gallagher, John D Haltigan, Joanna Henderson, Alexia Jaouich, Dielle Miranda, Patrick Mitchell, Josette Morin, Claire de Oliveira, Valerie Primeau, Eva Serhal, Sophie Soklaridis, Diana Urajnik, Krista Whittard, Juveria Zaheer, Paul Kurdyak, Aristotle N Voineskos, Nicole Kozloff, George Foussias, Janet Durbin, Sanjeev Sockalingam, Jean Addington, Donald Addington, Augustina Ampofo, Kelly K Anderson, Melanie Barwick, Sarah Bromley, Jasmyn E A Cunningham, Simone Dahrouge, Lillian Duda, Catherine Ford, Sheila Gallagher, John D Haltigan, Joanna Henderson, Alexia Jaouich, Dielle Miranda, Patrick Mitchell, Josette Morin, Claire de Oliveira, Valerie Primeau, Eva Serhal, Sophie Soklaridis, Diana Urajnik, Krista Whittard, Juveria Zaheer, Paul Kurdyak, Aristotle N Voineskos

Abstract

Introduction: While early psychosis intervention (EPI) has proliferated in recent years amid evidence of its effectiveness, programmes often struggle to deliver consistent, recovery-based care. NAVIGATE is a manualised model of EPI with demonstrated effectiveness consisting of four components: individualised medication management, individual resiliency training, supported employment and education and family education. We aim to implement NAVIGATE in geographically diverse EPI programmes in Ontario, Canada, evaluating implementation and its effect on fidelity to the EPI model, as well as individual-level outcomes (patient/family member-reported and interviewer-rated), system-level outcomes (captured in provincial administrative databases) and engagement of participants with lived experience.

Methods and analysis: This is a multisite, non-randomised pragmatic hybrid effectiveness-implementation type III mixed methods study coordinated at the Centre for Addiction and Mental Health (CAMH) in Toronto. Implementation is supported by the Provincial System Support Program, a CAMH-based programme with provincial offices across Ontario, and Extension of Community Healthcare Outcomes Ontario Mental Health at CAMH and the University of Toronto. The primary outcome is fidelity to the EPI model as measured using the First Episode Psychosis Services-Fidelity Scale. Four hundred participants in the EPI programmes will be recruited and followed using both individual-level assessments and health administrative data for 2 years following NAVIGATE initiation. People with lived experience will be engaged in all aspects of the project, including through youth and family advisory committees.

Ethics and dissemination: Research ethics board approval has been obtained from CAMH and institutions overseeing the local EPI programmes. Study findings will be reported in scientific journal articles and shared with key stakeholders including youth, family members, programme staff and policymakers.

Trial registration number: NCT03919760; Pre-results.

Keywords: mental health; patient engagement; quality in health care; schizophrenia and psychotic disorders.

Conflict of interest statement

Competing interests: None declared.

© Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

References

    1. McGlashan TH. Early detection and intervention of schizophrenia: rationale and research. Br J Psychiatry Suppl 1998;172:3–6. 10.1192/S0007125000297584
    1. Birchwood M, Todd P, Jackson C. Early intervention in psychosis. The critical period hypothesis. Br J Psychiatry Suppl 1998;172:53–9.
    1. Arnett JJ. Emerging adulthood. A theory of development from the late teens through the twenties. Am Psychol 2000;55:469–80. 10.1037/0003-066X.55.5.469
    1. World Economic Forum and the Harvard School of Public Health Methodological appendix: the global economic burden of non-communicable diseases, 2011. Available:
    1. de Oliveira C, Cheng J, Rehm J, et al. . The economic burden of chronic psychotic disorders in Ontario. J Ment Health Policy Econ 2016;19:181–92.
    1. Schoenbaum M, Sutherland JM, Chappel A, et al. . Twelve-Month health care use and mortality in commercially insured young people with incident psychosis in the United States. Schizophr Bull 2017;43:1262–72. 10.1093/schbul/sbx009
    1. Simon GE, Stewart C, Yarborough BJ, et al. . Mortality rates after the first diagnosis of psychotic disorder in adolescents and young adults. JAMA Psychiatry 2018;75:254–60. 10.1001/jamapsychiatry.2017.4437
    1. Gatov E, Rosella L, Chiu M, et al. . Trends in standardized mortality among individuals with schizophrenia, 1993-2012: a population-based, repeated cross-sectional study. CMAJ 2017;189:E1177–87. 10.1503/cmaj.161351
    1. Correll CU, Solmi M, Veronese N, et al. . Prevalence, incidence and mortality from cardiovascular disease in patients with pooled and specific severe mental illness: a large-scale meta-analysis of 3,211,768 patients and 113,383,368 controls. World Psychiatry 2017;16:163–80. 10.1002/wps.20420
    1. Hjorthøj C, Stürup AE, McGrath JJ, et al. . Years of potential life lost and life expectancy in schizophrenia: a systematic review and meta-analysis. Lancet Psychiatry 2017;4:295–301. 10.1016/S2215-0366(17)30078-0
    1. Penttilä M, Jääskeläinen E, Hirvonen N, et al. . Duration of untreated psychosis as predictor of long-term outcome in schizophrenia: systematic review and meta-analysis. Br J Psychiatry 2014;205:88–94. 10.1192/bjp.bp.113.127753
    1. Anderson KK, Norman R, MacDougall A, et al. . Effectiveness of early psychosis intervention: comparison of service users and Nonusers in population-based health administrative data. Am J Psychiatry 2018;175:443–52. 10.1176/appi.ajp.2017.17050480
    1. Craig TKJ, Garety P, Power P, et al. . The Lambeth early onset (Leo) team: randomised controlled trial of the effectiveness of specialised care for early psychosis. BMJ 2004;329:1067. 10.1136/bmj.38246.594873.7C
    1. Petersen L, Jeppesen P, Thorup A, et al. . A randomised multicentre trial of integrated versus standard treatment for patients with a first episode of psychotic illness. BMJ 2005;331:602. 10.1136/bmj.38565.415000.E01
    1. Malla A, Schmitz N, Norman R, et al. . A multisite Canadian study of outcome of first-episode psychosis treated in publicly funded early intervention services. Can J Psychiatry 2007;52:563–71. 10.1177/070674370705200904
    1. Bond GR, Drake RE, Luciano A. Employment and educational outcomes in early intervention programmes for early psychosis: a systematic review. Epidemiol Psychiatr Sci 2015;24:446–57. 10.1017/S2045796014000419
    1. Aceituno D, Vera N, Prina AM, et al. . Cost-Effectiveness of early intervention in psychosis: systematic review. Br J Psychiatry 2019;215:388–94. 10.1192/bjp.2018.298
    1. Vos T, Barber RM, Bell B, et al. . Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the global burden of disease study 2013. The Lancet 2015;386:743–800. 10.1016/S0140-6736(15)60692-4
    1. Jääskeläinen E, Juola P, Hirvonen N, et al. . A systematic review and meta-analysis of recovery in schizophrenia. Schizophr Bull 2013;39:1296–306. 10.1093/schbul/sbs130
    1. Fusar-Poli P, McGorry PD, Kane JM. Improving outcomes of first-episode psychosis: an overview. World Psychiatry 2017;16:251–65. 10.1002/wps.20446
    1. Kane JM, Robinson DG, Schooler NR, et al. . Comprehensive versus usual community care for First-Episode psychosis: 2-year outcomes from the NIMH RAISE early treatment program. Am J Psychiatry 2016;173:362–72. 10.1176/appi.ajp.2015.15050632
    1. Durbin J, Selick A, Hierlihy D, et al. . A first step in system improvement: a survey of early psychosis intervention programmes in Ontario. Early Interv Psychiatry 2016;10:485–93. 10.1111/eip.12201
    1. Nolin M, Malla A, Tibbo P, et al. . Early intervention for psychosis in Canada: what is the state of affairs? Can J Psychiatry 2016;61:186–94. 10.1177/0706743716632516
    1. Catts SV, Evans RW, O'Toole BI, et al. . Is a national framework for implementing early psychosis services necessary? results of a survey of Australian mental health service directors. Early Interv Psychiatry 2010;4:25–30. 10.1111/j.1751-7893.2009.00157.x
    1. Ministry of Health and Long-Term Care Early psychosis intervention program standards government of Ontario, 2011.
    1. Addington DE, Norman R, Bond GR, et al. . Development and testing of the First-Episode psychosis services fidelity scale. Psychiatr Serv 2016;67:1023–5. 10.1176/appi.ps.201500398
    1. Durbin J, Selick A, Langill G, et al. . Using fidelity measurement to assess quality of early psychosis intervention services in Ontario. Psychiatr Serv 2019;70:840–4. 10.1176/appi.ps.201800581
    1. Mueser KT, Penn DL, Addington J, et al. . The navigate program for First-Episode psychosis: rationale, overview, and description of psychosocial components. Psychiatr Serv 2015;66:680–90. 10.1176/appi.ps.201400413
    1. Rosenheck R, Mueser KT, Sint K, et al. . Supported employment and education in comprehensive, integrated care for first episode psychosis: effects on work, school, and disability income. Schizophr Res 2017;182:120–8. 10.1016/j.schres.2016.09.024
    1. Arora S, Thornton K, Murata G, et al. . Outcomes of treatment for hepatitis C virus infection by primary care providers. N Engl J Med 2011;364:2199–207. 10.1056/NEJMoa1009370
    1. Sockalingam S, Arena A, Serhal E, et al. . Building provincial mental health capacity in primary care: an evaluation of a project ECHO mental health program. Acad Psychiatry 2018;42:451–7. 10.1007/s40596-017-0735-z
    1. Curran GM, Bauer M, Mittman B, et al. . Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012;50:217–26. 10.1097/MLR.0b013e3182408812
    1. Kane JM, Schooler NR, Marcy P, et al. . The raise early treatment program for first-episode psychosis: background, rationale, and study design. J Clin Psychiatry 2015;76:240–6. 10.4088/JCP.14m09289
    1. Fixsen DL NS, Blase KA, Friedman RM, et al. . Implementation research: a synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, 2005.
    1. Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol 2012;50:462–80. 10.1007/s10464-012-9522-x
    1. Fortney J, Enderle M, McDougall S, et al. . Implementation outcomes of evidence-based quality improvement for depression in Va community based outpatient clinics. Implement Sci 2012;7:30. 10.1186/1748-5908-7-30
    1. Proctor EK, Landsverk J, Aarons G, et al. . Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health 2009;36:24–34. 10.1007/s10488-008-0197-4
    1. Scott VC, Kenworthy T, Godly-Reynolds E, et al. . The readiness for integrated care questionnaire (RICQ): an instrument to assess readiness to integrate behavioral health and primary care. Am J Orthopsychiatry 2017;87:520–30. 10.1037/ort0000270
    1. Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci 2013;8:51. 10.1186/1748-5908-8-51
    1. Damschroder LJ, Aron DC, Keith RE, et al. . Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50. 10.1186/1748-5908-4-50
    1. Damschroder LJ, Moin T, Datta SK, et al. . Implementation and evaluation of the Va DPP clinical demonstration: protocol for a multi-site non-randomized hybrid effectiveness-implementation type III trial. Implement Sci 2015;10:68. 10.1186/s13012-015-0250-0
    1. Zhou C, Crawford A, Serhal E, et al. . The impact of Project ECHO on participant and patient outcomes: a systematic review. Acad Med 2016;91:1439–61. 10.1097/ACM.0000000000001328
    1. Moore DE, Green JS, Gallis HA. Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Health Prof 2009;29:1–15. 10.1002/chp.20001
    1. Serhal E, Arena A, Sockalingam S, et al. . Adapting the consolidated framework for implementation research to create organizational readiness and implementation tools for project ECHO. J Contin Educ Health Prof 2018;38:145–51. 10.1097/CEH.0000000000000195
    1. Zarate CA, Weinstock L, Cukor P, et al. . Applicability of telemedicine for assessing patients with schizophrenia: acceptance and reliability. J Clin Psychiatry 1997;58:22–5. 10.4088/jcp.v58n0104
    1. Harris PA, Taylor R, Thielke R, et al. . Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. 10.1016/j.jbi.2008.08.010
    1. Harris PA, Taylor R, Minor BL, et al. . The REDCap Consortium: building an international community of software platform partners. J Biomed Inform 2019;95:103208. 10.1016/j.jbi.2019.103208
    1. First M, Williams J, Karg R, et al. . Structured clinical interview for DSM-5—Research version (SCID-5 for DSM-5, research version; SCID-5-RV, version 1.0.0. Arlington, VA: American Psychiatric Association, 2015.
    1. Heinrichs DW, Hanlon TE, Carpenter WT. The quality of life scale: an instrument for rating the schizophrenic deficit syndrome. Schizophr Bull 1984;10:388–98. 10.1093/schbul/10.3.388
    1. Leifker FR, Patterson TL, Heaton RK, et al. . Validating measures of real-world outcome: the results of the VALERO expert survey and Rand panel. Schizophr Bull 2011;37:334–43. 10.1093/schbul/sbp044
    1. World Health Organization Measuring health and disability manual for who disability assessment schedule WHODAS 2.0. Malta: World Health Organization, 2010.
    1. Flemenbaum A, Zimmermann RL. Inter- and intra-rater reliability of the brief psychiatric rating scale. Psychol Rep 1973;32:783–92. 10.2466/pr0.1973.33.3.783
    1. Guy W, Impressions CG. ECDEU assessment manual for psychopharmacology. Rockville. Maryland: National Institute for Mental Health, 1976: 218–22.
    1. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–13. 10.1046/j.1525-1497.2001.016009606.x
    1. Moberg D. Screening for alcohol and other drug problems using the adolescent alcohol and drug involvement scale (AADIS): center for health policy and program evaluation: University of Wisconsin Madison, 2005.
    1. Rosenheck R, Kasprow W, Frisman L, et al. . Cost-Effectiveness of supported housing for homeless persons with mental illness. Arch Gen Psychiatry 2003;60:940–51. 10.1001/archpsyc.60.9.940
    1. Addington D, Addington J, Schissel B. A depression rating scale for schizophrenics. Schizophr Res 1990;3:247–51. 10.1016/0920-9964(90)90005-R
    1. Tobon JI, Reid GJ, Goffin RD. Continuity of care in children's mental health: development of a measure. Adm Policy Ment Health 2014;41:668–86. 10.1007/s10488-013-0518-0
    1. McGuire-Snieckus R, McCabe R, Catty J, et al. . A new scale to assess the therapeutic relationship in community mental health care: StAR. Psychol Med 2007;37:85–95. 10.1017/S0033291706009299
    1. O'Connell M, Tondora J, Croog G, et al. . From rhetoric to routine: assessing perceptions of recovery-oriented practices in a state mental health and addiction system. Psychiatr Rehabil J 2005;28:378–86. 10.2975/28.2005.378.386
    1. Rosen A, Hadzi-Pavlovic D, Parker G. The life skills profile: a measure assessing function and disability in schizophrenia. Schizophr Bull 1989;15:325–37. 10.1093/schbul/15.2.325
    1. Parker G, Rosen A, Emdur N, et al. . The life skills profile: psychometric properties of a measure assessing function and disability in schizophrenia. Acta Psychiatr Scand 1991;83:145–52. 10.1111/j.1600-0447.1991.tb07381.x
    1. Rosen A, Trauer T, Hadzi-Pavlovic D, et al. . Development of a brief form of the life skills profile: the LSP-20. Aust N Z J Psychiatry 2001;35:677–83. 10.1080/0004867010060518
    1. Richieri R, Boyer L, Reine G, et al. . The schizophrenia caregiver quality of life questionnaire (S-CGQoL): development and validation of an instrument to measure quality of life of caregivers of individuals with schizophrenia. Schizophr Res 2011;126:192–201. 10.1016/j.schres.2010.08.037
    1. Signorovitch JE, Wu EQ, Yu AP, et al. . Comparative effectiveness without head-to-head trials: a method for matching-adjusted indirect comparisons applied to psoriasis treatment with adalimumab or etanercept. Pharmacoeconomics 2010;28:935–45. 10.2165/11538370-000000000-00000
    1. Williams JI, Young W. A Summary of Studies on the Quality of Health Care Administrative Databases in Canada : Goel V, Williams JI, Anderson GM, et al., Eds. patterns of health care in Ontario the ICES practice atlas. Ottawa, ON: Canadian Medical Association, 1996.
    1. Juurlink DN, Preyra C, Croxford R, et al. . Canadian Institute for health information discharge Abstract database: a validation study. Toronto, ON: Institute for Clinical Evaluative Sciences, 2006.
    1. Canadian Institute for Health Information Ontario mental health reporting system, data quality documentation, 2015-2016. Ottawa, ON: CIHI, 2017.
    1. Canadian Institute for Health Information CIHI data quality study of Ontario emergency department visits for fiscal year 2004-2005-Executive summary. Ottawa, ON: CIHI, 2008.
    1. Kurdyak P, Lin E, Green D, et al. . Validation of a population-based algorithm to detect chronic psychotic illness. Can J Psychiatry 2015;60:362–8. 10.1177/070674371506000805
    1. Austin PC. A comparison of 12 algorithms for matching on the propensity score. Stat Med 2014;33:1057–69. 10.1002/sim.6004
    1. Gatov E, Kurdyak P, Sinyor M, et al. . Comparison of vital statistics definitions of suicide against a coroner reference standard: a population-based linkage study. Can J Psychiatry 2018;63:152–60. 10.1177/0706743717737033
    1. Saunders NR, Lebenbaum M, Stukel TA, et al. . Suicide and self-harm trends in recent immigrant youth in Ontario, 1996-2012: a population-based longitudinal cohort study. BMJ Open 2017;7:e014863. 10.1136/bmjopen-2016-014863
    1. Steele LS, Glazier RH, Lin E, et al. . Using administrative data to measure ambulatory mental health service provision in primary care. Med Care 2004;42:960–5. 10.1097/00005650-200410000-00004
    1. Wodchis WP, Austin PC, Henry DA. A 3-year study of high-cost users of health care. CMAJ 2016;188:182–8. 10.1503/cmaj.150064
    1. Wodchis WP, Bushmeneva K, Nikitovic M, et al. . Guidelines on person-level costing using administrative databases in Ontario. Working Paper Series. Toronto, ON 2013.
    1. Hart RA. Children's participation: from tokenism to citizenship. Innocenti essay no 4. Florence: International Child Development Centre, 1992.
    1. Pereira N. Ready. set. engage! building effective Youth/Adult partnerships for a stronger child and youth mental health system. Toronto & Ottawa: Children’s Mental Health Ontario & The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO, 2007.
    1. Zeldin S, Christens BD, Powers JL. The psychology and practice of youth-adult partnership: bridging generations for youth development and community change. Am J Community Psychol 2013;51:385–97. 10.1007/s10464-012-9558-y
    1. Abelson J. Patient engagement and Canada's SPOR initiative: a resource guide for research teams and networks: McMaster University, 2015.
    1. Canadian Institutes of Health Research CIHR's citizen engagement Handbook, 2012.
    1. INVOLVE Briefing notes for researchers: involving the public in NHS, public health and social care research. Eastleigh: INVOLVE, 2012.
    1. PCORI PCORI engagement rubric, 2015. Available: [Accessed 12 Oct 2015].
    1. CIHR Strategy for patient-oriented research: patient engagement framework, 2014.
    1. Tambuyzer E, Pieters G, Van Audenhove C. Patient involvement in mental health care: one size does not fit all. Health Expect 2014;17:138–50. 10.1111/j.1369-7625.2011.00743.x
    1. Boivin A, Abelson J, Gauvin F. Patient and public engagement evaluation toolkit.
    1. Abelson J, Li K, Wilson G, et al. . Supporting quality public and patient engagement in health system organizations: development and usability testing of the public and patient engagement evaluation tool. Health Expect 2016;19:817–27. 10.1111/hex.12378
    1. Forsythe LP, Ellis LE, Edmundson L, et al. . Patient and Stakeholder engagement in the PCORI pilot projects: description and lessons learned. J Gen Intern Med 2016;31:13–21. 10.1007/s11606-015-3450-z
    1. Chan A-W, Tetzlaff JM, Altman DG, et al. . Spirit 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med 2013;158:200–7. 10.7326/0003-4819-158-3-201302050-00583
    1. National Implementation Research Network Stages of implementation analysis: where are we. NC: Chapel Hill, 2013.

Source: PubMed

3
Se inscrever