Controlled Study of the Impact of a Virtual Program to Reduce Stigma Among University Students Toward People With Mental Disorders

Matías E Rodríguez-Rivas, Adolfo J Cangas, Daniela Fuentes-Olavarría, Matías E Rodríguez-Rivas, Adolfo J Cangas, Daniela Fuentes-Olavarría

Abstract

Stigma toward mental disorders is one of today's most pressing global issues. The Covid-19 pandemic has exacerbated the barriers to social inclusion faced by individuals with mental disorders. Concurrently, stigma reduction interventions, especially those aimed at university students, have been more difficult to implement given social distancing and campus closures. As a result, alternative delivery for programs contributing to stigma reduction is required, such as online implementation. This paper reports the results of a controlled study focused on an online multi-component program on reducing stigma toward mental illness that included project-based learning, clinical simulations with standardized patients and E-Contact with real patients. A total of 40 undergraduate students from the Universidad del Desarrollo in Santiago, Chile, participated in the study. They were randomly divided between an intervention and control group. The intervention group participated in the online multi-component program, while the control group participated in an online educational program on cardiovascular health. We assessed the impact of the program by using the validated Spanish-language versions of the Attribution Questionnaire AQ-27 and the Questionnaire on Student Attitudes toward Schizophrenia with both groups, before and after the intervention. In addition, an ad hoc Likert scale ranging from 0 to 5 was used with the intervention group in order to assess the learning strategies implemented. Following the intervention, the participants belonging to the intervention group displayed significantly lower levels of stereotypes, perception of dangerousness, and global score toward people with schizophrenia (p < 0.001). In addition, participants presented lower levels of dangerousness-fear, avoidance, coercion, lack of solidarity, and global score (p < 0.001). The control group displayed no statistically significant differences in the level of stigma before and after the evaluation, for all of the items assessed. Finally, the overall assessment of each of the components of the program was highly positive. In conclusion, the study shows that online programs can contribute to reducing stigma toward mental disorders. The program assessed in this study had a positive impact on all the dimensions of stigma and all of the components of the program itself were positively evaluated by the participants.

Keywords: E-contact; multicomponent interventions; project based learning (PBL); standardized patient (SP); stigma; stigma reduction programme; undergraduate education.

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Copyright © 2021 Rodríguez-Rivas, Cangas and Fuentes-Olavarría.

Figures

Figure 1
Figure 1
Participant assignment procedure to the multicomponent intervention [MCI].

References

    1. WHO-AIMS Evaluación del Sistema de Salud Mental de Chile: Segundo inform. Informe Anual Sobre Derechos Humanos En Chile 2014. Ginebra: WHO; (2014). Available online at:
    1. Thornicroft G, Rose D, Kassam A, Sartorius N. Stigma: Ignorance, prejudice or discrimination? Br J Psychiatry. (2007) 190:192–3. 10.1192/bjp.bp.106.025791
    1. Corrigan PW, Shapiro JR. Measuring the impact of programs that challenge the public stigma of mental illness. Clin Psychol Rev. (2010) 30:907–22. 10.1016/j.cpr.2010.06.004
    1. Mascayano F, Lips W, Mena C, Manchego C. Estigma hacia los trastornos mentales: características e intervenciones. Salud Ment. (2015) 38:53–8. Available online at: (accessed November 11, 2020).
    1. López M. Work and employment for people with severe mental disorders. Some proposals based on the available information. Revi Asoc Esp Neuropsiq. (2004) 24:31–66. Available online at: (accessed November 11, 2020)
    1. Yang L, Valencia E, Alvarado R, Link B, Huynh N, Nguyen K, et al. . A theoretical and empirical framework for constructing culture-specific stigma instruments for Chile. Cad Saude Colet. (2013) 21:71–9. 10.1590/S1414-462X2013000100011
    1. Vicente B, Saldivia S, Pihán R. Prevalencias y brechas hoy; salud mental mañana. Acta Bioeth. (2016) 22:51–61. Available online at: (accessed November 11, 2020)
    1. Navarro N, Triguero R. Estigma en los profesionales de la Salud Mental: una revisión sistemática. Psychol Soc Educ. (2019) 11:253–66. 10.25115/psye.v11i2.2268
    1. Arens E, Berger C, Lincoln T. Stigmatization of patients with schizophrenia: the influence of university courses on the attitudes of prospective psychologists and doctors. Nervenarzt. (2009) 80:329–39. 10.1007/s00115-008-2646-4
    1. Funk M, Drew N, Knapp M. Mental health, poverty and development. JPMH. (2012) 11:166–85. 10.1108/17465721211289356
    1. Hernández de Cadena N, Escobar C. Una aproximación al maltrato a los pacientes con trastornos mentales. MedUNAB. (2004) 7:3. Available online at: (accessed November 11, 2020)
    1. Khenti A, Bobbili S, Sapag J. Evaluation of a pilot intervention to reduce mental health and addiction stigma in primary care settings. J Community Health. (2019) 44:1204–13. 10.1007/s10900-019-00706-w
    1. Poreddi V, Thimmaiah R, BadaMath S. Medical and nursing students' attitudes toward mental illness: an Indian perspective. Invest Educ Enferm. (2017) 35:86–94. Available online at: 10.17533/udea.iee.v35n1a10 (accessed November 11, 2020)
    1. Jadhav S, Littlewood R, Ryder A, Chakraborty A, Jain S, Barua M. Stigmatization of severe mental illness in India: against the simple industrialization hypothesis. Indian J Psychiatry. (2007) 43:189–94. 10.4103/0019-5545.37320
    1. Vidourek R, Burbage M. Positive mental health and mental health stigma: A qualitative study assessing student attitudes. MHP. (2019) 13:1–6. 10.1016/j.mhp.2018.11.006
    1. Yin H, Wardenaar K, Xu G, Tian H, Schoevers R. Mental health stigma and mental health knowledge in Chinese population: a cross-sectional study. BMC Psychiatry. (2020) 20:323. 10.1186/s12888-020-02705-x
    1. Lien Y, Lin H, Tsai C, Lien Y, Wu T. Changes in attitudes toward mental illness in healthcare professionals and students. Int J Environ Res Public Health. (2019) 16:4655. 10.3390/ijerph16234655
    1. Schulze B. Stigma and mental health professionals: a review of the evidence on an intricate relationship. Int Rev Psychiatry. (2007) 19:137–55. 10.1080/09540260701278929
    1. Thornicroft G, Mehta N, Clement S, Evans-Lacko S, Doherty M, Rose D, et al. . Evidence for effective interventions to reduce mental-health-related stigma and discrimination. Lancet. (2016) 387:1123–32. 10.1016/s0140-6736(15)00298-6
    1. Corrigan P, Wassel A. Understanding and influencing the stigma of mental illness. J Psychosoc Nurs Ment Health Serv. (2008) 46:42–8. 10.3928/02793695-20080101-04
    1. Yuan Q, Picco L, Chang S, Abdin E, Cuha B, Ong S, et al. . Attitudes to mental illness among mental health professionals in Singapore and comparisons with the general population. PLoS One. (2017). 10.1371/journal.pone.0187593
    1. Kadri N, Sartorius N. The global fight against the stigma of schizophrenia. PLoS Med. (2005) 2:e136. 10.1371/journal.pmed.0020136
    1. Knaak S, Modgill G, Patten S. Key ingredients of anti-stigma programs for health care providers: a data synthesis of evaluative studies. Can J Psychiatry. (2014) 59:19–26. 10.1177/070674371405901s06
    1. Lanfredi M, Macis A, Ferrari C, Rillosi L, Cadone E, Fanetti A, et al. . Effects of education and social contact on mental health-related stigma among high-school students. Psychiatry Res. (2019) 281:112581. 10.1016/j.psychres.2019.112581
    1. Corrigan PW, Michaels PJ, Vega E, Gause M, Larson J, Krzyzanowski R, et al. . Key ingredients to contact-based stigma change: A cross-validation. Psychiatr Rehabil J. (2014) 37:62–4. 10.1037/prj0000038
    1. Corrigan PW, Vega E, Larson J, Michaels PJ, McClintock G, Krzyzanowski R, et al. . The California schedule of key ingredients for contact-based antistigma programs. Psychiatr Rehabil J. (2013) 36:173–9. 10.1037/prj0000006 (accessed January 8, 2021).
    1. Morgan A, Reavley N, Ross A, Too LS, Jorm A. Interventions to reduce stigma towards people with severe mental illness: Systematic review and meta-analysis. J Psychiatr Res. (2018) 103:120–33. 10.1016/j.jpsychires.2018.05.017
    1. Hickie I. Can we reduce the burden of depression? The Australian experience with beyondblue: the national depression initiative. Australas Psychiatry. (2004) 12:S38–S46. 10.1111/j.1039-8562.2004.02097.x
    1. Ministry of Health and Health Promotion Agency Like Minds, Like Mine National Plan 2014-2019: Programme to Increase Social Inclusion and Reduce Stigma and Discrimination for People with Experience of Mental Illness. Wellington: Ministry of Health; (2014).
    1. Stuart H, Chen S, Christie R, Dobson K, Kirsh B, Knaak S, et al. . Opening minds in canada: targeting change. Can J Psychiatry. (2014) 59:13–8. 10.1177/070674371405901s05
    1. Corrigan P, Rafacz J, Hautamaki J, Walton J, Rüsch N, Rao D, et al. . Changing stigmatizing perceptions and recollections about mental illness: the effects of NAMI's in our own voice. Community Ment Health J. (2010) 46:517–22. 10.1007/s10597-009-9287-3
    1. Pelzang R. Attitude of nurses towards mental illness in Bhutan. J Bhutan Studies. (2010) 22:60–76. Available online at: (accessed November 11, 2020)
    1. Corrigan P. Lessons learned from unintended consequences about erasing the stigma of mental illness. World Psychiatry. (2016) 15:67–73. 10.1002/wps.20295
    1. Lam A, Jorm A, Wong D. Mental health first aid training for the Chinese community in Melbourne, Australia: Effects on knowledge about and attitudes toward people with mental illness. IJMHS. (2010) 4:18. 10.1186/1752-4458-4-18
    1. Shann C, Martin A, Chester A, Ruddock S. Effectiveness and application of an online leadership intervention to promote mental health and reduce depression-related stigma in organizations. J Occup Health Psychol. (2019) 24:20–35. 10.1037/ocp0000110
    1. Amsalem D, Yang L, Jankowski S, Lieff S, Markowitz J, Dixon L. Reducing stigma toward individuals with schizophrenia using a brief video: a randomized controlled trial of young adults. Schizophr Bull. (2020) 2020:sbaa114. 10.1093/schbul/sbaa114
    1. Amsalem D, Gothelf D, Soul O, Dorman A, Ziv A, Gross R. Single-day simulation-based training improves communication and psychiatric skills of medical students. Front Psychiatry. (2020) 11:221. 10.3389/fpsyt.2020.00221
    1. Maunder RD, White FA, Verrelli S. Modern avenues for intergroup contact: using E-contact and intergroup emotions to reduce stereotyping and social distancing against people with schizophrenia. GPIR. (2019) 22:947–63. 10.1177/1368430218794873
    1. Cangas AJ, Navarro N, Aguilar JM, Trigueros R, Gallego J, Zárate R, et al. . Analysis of the usefulness of a serious game to raise awareness about mental health problems in a sample of high school and university students: relationship with familiarity and time spent playing video games. J Clin Med. (2019) 8:1504. 10.3390/jcm8101504
    1. Mullor D, Sayans P, Cangas A, Navarro N. Effect of a Serious Game (Stigma-Stop) on reducing stigma among psychology students: a controlled study. Cyberpsychol Behav Soc Netw. (2019) 22:205–11. 10.1089/cyber.2018.0172
    1. Javed B, Sarwer A, Soto E, Mashwani Z. Impact of SARS-CoV-2 (coronavirus) pandemic on public mental health. Public Health Front. (2020) 8:292. 10.3389/fpubh.2020.00292
    1. Yao H, Chen J, Xu Y. Patients with mental health disorders in the COVID-19 epidemic. Lancet Psychiatry. (2020) 7:E21. 10.1016/S2215-0366(20)30090-0
    1. King B, Smith C. Using project-based learning to develop teachers for leadership. J Educ Strat Issues Ideas. (2020) 93:158–64. 10.1080/00098655.2020.1735289
    1. MacLeod M, van der Veen J. Scaffolding interdisciplinary project-based learning: a case study. Eur J Eng Educ. (2020) 45:363-77. 10.1080/03043797.2019.1646210
    1. Wang J, Tsiligiris V, Hartley R. Perceptions of the benefits of the A3 planner in facilitating project-based learning in accounting education. JAEd. (2019) 28:221–38. 10.1080/09639284.2018.1516151
    1. Bell B. Project-Based Learning for the 21st Century: Skills for the Future. J Educ Strat Issues Ideas. (2010) 83:39–43. 10.1080/00098650903505415
    1. Burke B, Currin-McCulloch J. Educating our future colleagues: creating an MSW palliative care practicum. J Soc Work End Life Palliat Care. (2019) 15:7–15. 10.1080/15524256.2019.1586806
    1. Leggett G, Harrington I. The impact of Project Based Learning (PBL) on students from low socio economic statuses: a review. Int J Incl Educ. (2019) 1–17. 10.1080/13603116.2019.1609101
    1. Chen CH, Yang YC. Revisiting the effects of project-based learning on students' academic achievement: a meta-analysis investigating moderators. Educ Res Rev. (2019) 26:71–81. 10.1016/j.edurev.2018.11.001
    1. Hunt J, Brannan E, Sexson S. Lifelong learning for professional development in psychiatry: pedagogy, innovations, and maintenance of certification. Psychiatr Clin N. (2019) 42:425–37. 10.1016/j.psc.2019.05.014
    1. Bokken L, Rethans JJ, Jöbsis Q, Duvivier R, Scherpbier A, van der Vleuten C. Instructiveness of real patients and simulated patients in undergraduate medical education: a randomized experiment. Acad Med. (2010) 85:148–54. 10.1097/ACM.0b013e3181c48130
    1. Karim A, Campbell M, Hasan M. A new method of integrating project-based and work-integrated learning in postgraduate engineering study. Curric J. (2019) 31:157–73. 10.1080/09585176.2019.1659839
    1. Schomerus G, Angermeyer MC, Baumeister SE, Stolzenburg S, Link BG, Phelan JC. An online intervention using information on the mental health-mental illness continuum to reduce stigma. Eur Psychiatry. (2016) 32:21–7. 10.1016/j.eurpsy.2015.11.006
    1. Martin A, Krause R, Jacobs A, Chilton J, Amsalem D. The mental status exam through video clips of simulated psychiatric patients: an online educational resource. Acad Psychiatry. (2020) 44:179–83. 10.1007/s40596-019-01140-9
    1. Tippin GK, Maranzan KA. Efficacy of a Photovoice-based video as an online mental illness anti-stigma intervention and the role of empathy in audience response: A randomized controlled trial. J Appl Soc Psychol. (2019) 49:381–94. 10.1111/jasp.12590
    1. Martin A, Krause R, Chilton J, Jacobs A, Amsalem D. Attitudes to psychiatry and to mental illness among nursing students: adaptation and use of two validated instruments in preclinical education. J Psychiatr Ment Health Nurs. (2020) 27:308–17. 10.1111/jpm.12580
    1. White F, Abu-Rayya H. A dual identity-electronic contact (DIEC) experiment promoting short-and long-term inter-group harmony. J Exp Soc Psychol. (2012) 48:597–608. 10.1016/j.jesp.2012.01.007
    1. Hodson G. Do ideologically intolerant people benefit from intergroup contact? Curr Dir Psychol. (2011) 20:154–9. 10.1177/0963721411409025
    1. White F, Turner R, Verrelli S, Harvey L, Hanna J. Improving intergroup relations between catholics and protestants in Northern Ireland via E-contact. Eur J Soc Psychol. (2019) 49:429–38. 10.1002/ejsp.2515
    1. Boccanfuso E, White FA, Maunder RD. Reducing transgender stigma via an E-contact intervention. Sex Roles. (2020) 1–11. 10.1007/s11199-020-01171-9
    1. Martin A, Chilton J, Paasche C, Nabatkhorian N, Gortler H, Cohenmehr E, et al. . Shared living experiences by physicians have a positive impact on mental health attitudes and stigma among medical students: a mixed-methods study. J Med Educ Curric Dev. (2020) 7:1–9. 10.1177/2382120520968072
    1. Schulze B, Richter-Werling M, Matschinger H, Angermeyer M.C. Crazy? So what! Effects of a school project on students' attitudes toward people with schizophrenia. Acta Psychiatr Scand. (2003) 107:142–50. 10.1034/j.1600-0447.2003.02444.x
    1. Navarro N, Cangas A, Aguilar-Parra J, Gallego J, Moreno-San Pedro E, Carrasco-Rodríguez Y, et al. Propiedades psicométricas de la versión en castellano del cuestionario de las actitudes de los estudiantes hacia la esquizofrenia. Psychol Soc Educ. (2017) 9:325–34. 10.25115/psye.v9i2.865
    1. Corrigan P, Markowitz F, Watson A, Rowan D, Kubiak M. An attribution model of public discrimination towards persons with mental illness. J Health Soc Behav. (2003) 44:162–79. 10.2307/1519806
    1. Saavedra J, Arias-Sánchez S, Corrigan P, López M. Assessing the factorial structure of the mental illness public stigma in Spain. Disabil Rehabil. (2020) 6:1–7. 10.1080/09638288.2019.1710769
    1. Asociación Médica Mundial. Declaración de Helsinki de la AMM – Principios Éticos Para las Investigaciones Médicas en Seres Humanos. (2017). Available online at: (accessed November 11, 2020).
    1. Resnik D, Shamoo A. The Singapore statement on research integrity. Account Res. (2011) 18:71–5. 10.1080/08989621.2011.557296
    1. Howells FM, Kingdon DG, Baldwin DS. Current and potential pharmacological and psychosocial interventions for anxiety symptoms and disorders in patients with schizophrenia: structured review. Hum Psychopharmacol. (2017) 32:5. 10.1002/hup.2628
    1. Khokhar JY, Dwiel LL, Henricks AM, Doucette WT, Green AI. The link between schizophrenia and substance use disorder: a unifying hypothesis. Schizophr Res. (2018) 194:78–85. 10.1016/j.schres.2017.04.016
    1. Wahl O, Aroesty-Cohen E. Attitudes of mental health professionals about mental illness: a review of the recent literature. J Community Psychol. (2010) 38:49–62. 10.1002/jcop.20351
    1. Stefanovics E, Rosenheck R, He H, Ofori-Atta A, Cavalcanti M, Chiles C. Medical student belief and attitudes toward mental illness across five nations. J Nerv Ment Dis. (2016) 204:909–15. 10.1097/NMD.0000000000000610
    1. Gallego J, Cangas A, Aguilar J, Trigueros R, Navarro N, Galván B, et al. . Education students' stigma toward mental health problems: a cross-cultural comparison. Front Psychiatry. (2020) 11:587321. 10.3389/fpsyt.2020.587321
    1. Kemp C, Jarrett B, Kwon C, Song L, Jetté N, Sapag J, et al. . Implementation science and stigma reduction interventions in low- and middle-income countries: a systematic review. BMC Med. (2019) 17:6. 10.1186/s12916-018-1237-x
    1. Maunder RD, White F. Intergroup contact and mental health stigma: A comparative effectiveness meta-analysis. Clin Psychol Rev. (2019) 72:1749. 10.1016/j.cpr.2019.101749
    1. Kitay B, Martin A, Chilton J, Amsalem D, Duvivier R, Goldenberg M. Electroconvulsive therapy: a video-based educational resource using standardized patients. Acad Psychiatry. (2020) 44:531–7 10.1007/s40596-020-01292-z
    1. Nickerson A, Byrow Y, Pajak R, McMahon T, Bryant R, Christensen H, et al. . ‘Tell Your Story’: A randomized controlled trial of an online intervention to reduce mental health stigma and increase help-seeking in refugee men with posttraumatic stress. Psychol Med. (2020) 50:781–92. 10.1017/S0033291719000606
    1. Inan FS, Günüşen N, Duman ZÇ, Ertem MY. The impact of mental health nursing module, clinical practice and an anti-stigma program on nursing students' attitudes toward mental illness: a quasi-experimental study. J Prof Nurs. (2019) 35:201–8. 10.1016/j.profnurs.2018.10.001
    1. Koike S, Yamaguchi S, Ojio Y, Ohta K, Shimada T, Watanabe K, et al. . A randomised controlled trial of repeated filmed social contact on reducing mental illness-related stigma in young adults. Epidemiol Psychiatr Sci. (2018) 27:199–208. 10.1017/S2045796016001050
    1. Dedeilia A, Sotiropoulos MG, Hanrahan JG, Janga D, Dedeilias P, Sideris M. Medical and surgical education challenges and innovations in the COVID-19 era: a systematic review. In Vivo. (2020) 34(3 Suppl):1603–11. 10.21873/invivo.11950
    1. Chick RC, Clifton GT, Peace KM, Propper BW, Hale DF, Alseidi AA, et al. . Using technology to maintain the education of residents during the COVID-19 pandemic. J Surg Educ. (2020) 77:729–32. 10.1016/j.jsurg.2020.03.018
    1. Tabatabai S. COVID-19 impact and virtual medical education. J Adv Med Educ Prof. (2020) 8:140–3. 10.30476/jamp.2020.86070.1213
    1. Sabharwal S, Ficke JR, LaPorte DM. How we do it: modified residency programming and adoption of remote didactic curriculum during the COVID-19 pandemic. J Surg Educ. (2020) 77:1033–6. 10.1016/j.jsurg.2020.05.026
    1. Amsalem D, Gothelf D, Dorman A, Goren Y, Tene O, Shelef A, et al. . Reducing stigma toward psychiatry among medical students: a multicenter controlled trial. Prim Care Companion CNS Disord. (2020) 22:19m02527. 10.4088/PCC.19m02527
    1. López M, Laviana M, Fernández L, López A, Rodríguez AM, Aparicio A. La lucha contra el estigma y la discriminación en salud mental. Una estrategia compleja basada en la información disponible. Rev Asoci Esp Neuropsiquiatr. (2008) 28:48–83. 10.4321/S0211-57352008000100004

Source: PubMed

3
Suscribir