The COVID Psychosocial Impacts Scale: A Reliable and Valid Tool to Examine the Psychosocial Impacts of the COVID-19 Pandemic

Sandila Tanveer, Philip J Schluter, Ben Beaglehole, Richard J Porter, Joseph Boden, Ruqayya Sulaiman-Hill, Damian Scarf, Shaystah Dean, Fatima Assad, Mahammad Abul Hasnat, Caroline Bell, Sandila Tanveer, Philip J Schluter, Ben Beaglehole, Richard J Porter, Joseph Boden, Ruqayya Sulaiman-Hill, Damian Scarf, Shaystah Dean, Fatima Assad, Mahammad Abul Hasnat, Caroline Bell

Abstract

This paper reports on the development and validation of the COVID Psychosocial Impacts Scale (CPIS), a self-report measure that comprehensively examines both positive and negative psychosocial impacts from the COVID-19 pandemic. This is the first part of the program of work in which the CPIS was administered and compared with a measure of psychological distress (Kessler Psychological Distress Scale, K-10) and wellbeing (World Health Organization Well-Being Index, WHO-5). The data were obtained online in 2020 and 2022 at two distinct time points to capture different exposures to the pandemic in the New Zealand population to a non-representative sample of 663 and 687 adults, respectively. Two hundred seventy-one participants took part in both surveys. Findings indicate a unidimensional structure within CPIS subscales and inter-relatedness among CPIS stress-related subscales. The scatter plots and correlation matrix indicate CPIS having a positive moderate correlation with K10 and a negative moderate correlation with WHO-5, indicative of construct validity. The paper outlines contextual factors surrounding CPIS development and makes suggestions for future iterations of CPIS. Further work will examine its psychometric properties across cultures.

Keywords: COVID-19; psychological distress; psychosocial impacts; reliability; validity; wellbeing.

Conflict of interest statement

All authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.

Figures

Figure A1
Figure A1
Showing Scatter Plot Showing a Positive Linear Correlation between COVID Psychosocial Impacts Scale (CPIS) and Kessler 10 (K10); and a Negative Linear Correlation between CPIS and World Health Organization Well-Being Index 5 (WHO-5) for Participants Who Responded to the Education-related Stress Subscale.
Figure A2
Figure A2
Showing Scatter Plot Showing a Positive Linear Correlation between COVID Psychosocial Impacts Scale (CPIS) and Kessler 10 (K10); and a Negative Linear Correlation between CPIS and World Health Organization Well-Being Index 5 (WHO-5) for Participants Who Responded to Faith-related Stress Subscale.
Figure 1
Figure 1
Scatter Plot Showing Correlation between COVID Psychosocial Impacts Scale (CPIS) Composite Scores with Kessler 10 (K10), and World Health Organization Well-Being Index 5 (WHO-5).

References

    1. Cénat J.M., Blais-Rochette C., Kokou-Kpolou C.K., Noorishad P.G., Mukunzi J.N., McIntee S.E., Dalexis R.D., Goulet M.A., Labelle P.R. Prevalence of Symptoms of Depression, Anxiety, Insomnia, Posttraumatic Stress Disorder, and Psychological Distress among Populations Affected by the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Psychiatry Res. 2021;295:113599. doi: 10.1016/j.psychres.2020.113599.
    1. Wu T., Jia X., Shi H., Niu J., Yin X., Xie J., Wang X. Prevalence of Mental Health Problems during the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. J. Affect. Disord. 2021;281:91–98. doi: 10.1016/j.jad.2020.11.117.
    1. Muldoon O.T., Liu J.H., McHugh C. The Political Psychology of COVID-19. Polit. Psychol. 2021;42:715–728. doi: 10.1111/pops.12775.
    1. Dubey S., Biswas P., Ghosh R., Chatterjee S., Dubey M.J., Chatterjee S., Lahiri D., Lavie C.J. Psychosocial Impact of COVID-19. Diabetes Metab. Syndr. Clin. Res. Rev. 2020;14:779–788. doi: 10.1016/j.dsx.2020.05.035.
    1. World Health Organization Mental Health and Psychosocial Considerations during COVID-19 Outbreak. 2020. [(accessed on 1 September 2022)]. Available online: .
    1. Généreux M., Schluter P.J., Hung K.K., Wong C.S., Mok C.P.Y., O’sullivan T., David M.D., Carignan M.-E., Blouin-Genest G., Champagne-Poirier O., et al. One Virus, Four Continents, Eight Countries: An Interdisciplinary and International Study on the Psychosocial Impacts of the COVID-19 Pandemic among Adults. Int. J. Environ. Res. Public Health. 2020;17:8390. doi: 10.3390/ijerph17228390.
    1. Généreux M., Schluter P.J., Landaverde E., Hung K.K., Wong C.S., Mok C.P.Y., Blouin-Genest G., O’Sullivan T., David M.D., Carignan M.E., et al. The Evolution in Anxiety and Depression with the Progression of the Pandemic in Adult Populations from Eight Countries and Four Continents. Int. J. Environ. Res. Public Health. 2021;18:4845. doi: 10.3390/ijerph18094845.
    1. Every-Palmer S., Jenkins M., Gendall P., Hoek J., Beaglehole B., Bell C., Williman J., Rapsey C., Stanley J. Psychological Distress, Anxiety, Family Violence, Suicidality, and Wellbeing in New Zealand during the COVID-19 Lockdown: A Cross-Sectional Study. PLoS ONE. 2020;15:e0241658. doi: 10.1371/journal.pone.0241658.
    1. Gasteiger N., Vedhara K., Massey A., Jia R., Ayling K., Chalder T., Coupland C., Broadbent E. Depression, Anxiety and Stress during the COVID-19 Pandemic: Results from a New Zealand Cohort Study on Mental Well-Being. BMJ Open. 2021;11:e045325. doi: 10.1136/bmjopen-2020-045325.
    1. Chew N.W.S., Lee G.K.H., Tan B.Y.Q., Jing M., Goh Y., Ngiam N.J.H., Yeo L.L.L., Ahmad A., Ahmed Khan F., Napolean Shanmugam G., et al. A Multinational, Multicentre Study on the Psychological Outcomes and Associated Physical Symptoms amongst Healthcare Workers during COVID-19 Outbreak. Brain Behav. Immun. 2020;88:559–565. doi: 10.1016/j.bbi.2020.04.049.
    1. Krishnamoorthy Y., Nagarajan R., Saya G.K., Menon V. Prevalence of Psychological Morbidities among General Population, Healthcare Workers and COVID-19 Patients amidst the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Psychiatry Res. 2020;293:113382. doi: 10.1016/j.psychres.2020.113382.
    1. Iasevoli F., Fornaro M., D’Urso G., Galletta D., Casella C., Paternoster M., Buccelli C., de Bartolomeis A. Psychological Distress in Patients with Serious Mental Illness during the COVID-19 Outbreak and One-Month Mass Quarantine in Italy. Psychol. Med. 2020;51:1054–1056. doi: 10.1017/S0033291720001841.
    1. Van Rheenen T.E., Meyer D., Neill E., Phillipou A., Tan E.J., Toh W.L., Rossell S.L. Mental Health Status of Individuals with a Mood-Disorder during the COVID-19 Pandemic in Australia: Initial Results from the COLLATE Project. J. Affect. Disord. 2020;275:69–77. doi: 10.1016/j.jad.2020.06.037.
    1. Bell C., Williman J., Beaglehole B., Stanley J., Jenkins M., Gendall P., Rapsey C., Every-Palmer S. Psychological Distress, Loneliness, Alcohol Use and Suicidality in New Zealanders with Mental Illness during a Strict COVID-19 Lockdown. Aust. N. Z. J. Psychiatry. 2021;56:800–810. doi: 10.1177/00048674211034317.
    1. Schluter P.J., Généreux M., Hung K.K., Landaverde E., Law R.P., Mok C.P.Y., Murray V., O’Sullivan T., Qadar Z., Roy M. Patterns of Suicide Ideation Across Eight Countries in Four Continents During the COVID-19 Pandemic Era: Repeated Cross-Sectional Study. JMIR Public Health Surveill. 2022;8:e32140. doi: 10.2196/32140.
    1. Chandu V.C., Marella Y., Panga G.S., Pachava S., Vadapalli V. Measuring the Impact of COVID-19 on Mental Health: A Scoping Review of the Existing Scales. Indian J. Psychol. Med. 2020;42:421–427. doi: 10.1177/0253717620946439.
    1. Recommended Scales. [(accessed on 1 May 2020)]. Available online: .
    1. The Coronoavirus Health Impact Survey (CRISIS) (n.d.) [(accessed on 1 May 2020)]. Available online:
    1. Ahorsu D.K., Lin C.Y., Imani V., Saffari M., Griffiths M.D., Pakpour A.H. The Fear of COVID-19 Scale: Development and Initial Validation. Int. J. Ment. Health Addict. 2020;20:1537–1545. doi: 10.1007/s11469-020-00270-8.
    1. Lee S.A. Coronavirus Anxiety Scale: A Brief Mental Health Screener for COVID-19 Related Anxiety. Death Stud. 2020;44:393–401. doi: 10.1080/07481187.2020.1748481.
    1. Silva W.A.D., de Sampaio Brito T.R., Pereira C.R. COVID-19 Anxiety Scale (CAS): Development and Psychometric Properties. Curr. Psychol. 2022;41:5693–5702. doi: 10.1007/s12144-020-01195-0.
    1. COVID-Minds February Update: The Psychological Impact of COVID-19. [(accessed on 1 May 2020)]. Available online: .
    1. Jenkins M., Hoek J., Jenkin G., Gendall P., Stanley J., Beaglehole B., Bell C., Rapsey C., Every-Palmer S. Silver Linings of the COVID-19 Lockdown in New Zealand. PLoS ONE. 2021;16:e0249678. doi: 10.1371/journal.pone.0249678.
    1. Beaglehole B., Williman J., Bell C., Stanley J., Jenkins M., Gendall P., Hoek J., Rapsey C., Every-Palmer S. Thriving in a Pandemic: Determinants of Excellent Wellbeing Among New Zealanders During the 2020 COVID-19 Lockdown. PLoS ONE. 2022;17:e0262745. doi: 10.1371/journal.pone.0262745.
    1. Fergusson D.M., Boden J.M., Horwood L.J., Mulder R.T. Perceptions of Distress and Positive Consequences Following Exposure to a Major Disaster amongst a Well-Studied Cohort. Aust. N. Z. J. Psychiatry. 2014;49:351–359. doi: 10.1177/0004867414560652.
    1. McLeod G.F.H., Horwood L.J., Fergusson D.M., Boden J.M. Life-stress and Reactivity by Gender in a Longitudinal Birth Cohort at 30 and 35 Years. Soc. Psychiatry Psychiatr. Epidemiol. 2016;51:1385–1394. doi: 10.1007/s00127-016-1254-z.
    1. Holmes T.H., Rahe R.H. The Social Readjustment Rating Scale. J. Psychosom. Res. 1967;11:213–218. doi: 10.1016/0022-3999(67)90010-4.
    1. Boateng G.O., Neilands T.B., Frongillo E.A., Melgar-Quiñonez H.R., Young S.L. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front. Public Health. 2018;6:149. doi: 10.3389/fpubh.2018.00149.
    1. Theiner G. A Beginner’s Guide to Group Minds. In: Sprevak M., Kallestrup J., editors. New Waves in Philosophy of Mind. Palgrave Macmillan; London, UK: 2014. pp. 301–322.
    1. Kessler R.C., Barker P.R., Colpe L.J., Epstein J.F., Gfroerer J.C., Hiripi E., Howes M.J., Normand S.L.T., Manderscheid R.W., Walters E.E., et al. Screening for Serious Mental Illness in the General Population. Arch. Gen. Psychiatry. 2003;60:184. doi: 10.1001/archpsyc.60.2.184.
    1. World Health Organisation . The World Health Organisation-Five Well-Being Index (WHO-5). Wellbeing Measures in Primary Health Care/The Depcare Project. WHO Regional Office for Europe; Copenhagen, Denmark: 1998.
    1. New Zealand Coronavirus: Cases and Deaths—Worldometer. [(accessed on 2 September 2022)]. Available online:
    1. Ministry of Health HISO 10001:2017 Ethnicity Data Protocols. [(accessed on 1 October 2020)];2017 Available online: .
    1. Boden J.M., Fergusson D.M., Horwood L.J. Associations Between Exposure to Stressful Life Events and Alcohol Use Disorder in a Longitudinal Birth Cohort Studied to Age 30. Drug Alcohol Depend. 2014;142:154–160. doi: 10.1016/j.drugalcdep.2014.06.010.
    1. Boden J.M., Lee J.O., Horwood L.J., Grest C.V., McLeod G.F.H. Modelling Possible Causality in the Associations Between Unemployment, Cannabis Use, and Alcohol Misuse. Soc. Sci. Med. 2017;175:127–134. doi: 10.1016/j.socscimed.2017.01.001.
    1. Andrews G., Slade T. Interpreting Scores on the Kessler Psychological Distress Scale (K10) Aust. N. Z. J. Public Health. 2001;25:494–497. doi: 10.1111/j.1467-842X.2001.tb00310.x.
    1. Topp C.W., Østergaard S.D., Søndergaard S., Bech P. The WHO-5 Well-Being Index: A Systematic Review of the Literature. Psychother. Psychosom. 2015;84:167–176. doi: 10.1159/000376585.
    1. Zijlmans E.A.O., Tijmstra J., van der Ark L.A., Sijtsma K. Item-Score Reliability as a Selection Tool in Test Construction. Front. Psychol. 2019;9:2298. doi: 10.3389/fpsyg.2018.02298.
    1. New Zealand Health Survey 2018/19. [(accessed on 21 January 2021)]; Available online:
    1. General Social Survey 2018/9: Final Content. [(accessed on 21 January 2021)]; Available online: .
    1. Bruine de Bruin W. Age Differences in COVID-19 Risk Perceptions and Mental Health: Evidence from a National U.S. Survey Conducted in March 2020. J. Gerontol. B. 2020;76:e24–e29. doi: 10.1093/geronb/gbaa074.
    1. González-Sanguino C., Ausín B., Castellanos M.Á., Saiz J., López-Gómez A., Ugidos C., Muñoz M. Mental Health Consequences during the Initial Stage of the 2020 Coronavirus Pandemic (COVID-19) in Spain. Brain Behav. Immun. 2020;87:172–176. doi: 10.1016/j.bbi.2020.05.040.
    1. Petzold M.B., Bendau A., Plag J., Pyrkosch L., Mascarell Maricic L., Betzler F., Rogoll J., Große J., Ströhle A. Risk, Resilience, Psychological Distress, and Anxiety at the Beginning of the COVID-19 Pandemic in Germany. Brain Behav. 2020;10:e01745. doi: 10.1002/brb3.1745.
    1. Wang C., Pan R., Wan X., Tan Y., Xu L., Ho C.S., Ho R.C. Immediate Psychological Responses and Associated Factors during the Initial Stage of the 2019 Coronavirus Disease (COVID-19) Epidemic among the General Population in China. Int. J. Environ. Res. Public Health. 2020;17:1729. doi: 10.3390/ijerph17051729.
    1. Tedeschi R., Cann A., Taku K., Senol-Durak E., Calhoun L.G. The Posttraumatic Growth Inventory: A Revision Integrating Existential and Spiritual Change. J. Trauma. Stress. 2017;30:11–18. doi: 10.1002/jts.22155.
    1. DeVellis R.F., Carolyn T.T. Scale Development: Theory and Applications. 5th ed. SAGE Publications; Thousand Oaks, CA, USA: 2022.
    1. Pierce M., McManus S., Jessop C., John A., Hotopf M., Ford T., Hatch S., Wessely S., Abel K.M. Says Who? The Significance of Sampling in Mental Health Surveys during COVID-19. Lancet Psychiatry. 2020;7:567–568. doi: 10.1016/S2215-0366(20)30237-6.
    1. World Health Organization WHO Coronavirus (COVID-19) Dashboard. [(accessed on 21 March 2023)]. Available online:
    1. Weathers F.W., Litz B.T., Keane T.M., Palmieri P.A., Marx B.P., Schnurr P.P. The PTSD Checklist for DSM-5 (PCL-5)—Standard [Measurement instrument]. The National Center for PTSD. [(accessed on 2 September 2022)];2013 Available online:
    1. Tanveer S., Schluter P.J., Porter R.J., Boden J.M., Beaglehole B., Sulaiman-Hill R., Dean S., Bell R., Al-Hussainni W.N., Arshi M., et al. Examining the Psychosocial Impacts of the COVID-19 Pandemic: An International Cross-sectional Study Protocol. BMJ Open. 2023;13:e067886. doi: 10.1136/bmjopen-2022-067886.
    1. Sulaiman-Hill R.C., Porter R., Tanveer S., Boden J., Beaglehole B., Schluter P.J., Dean S., Bell C. Psychosocial Impacts on the Christchurch Muslim Community Following the 15 March Terrorist Attacks: A Mixed-Methods Study Protocol. BMJ Open. 2021;11:e055413. doi: 10.1136/bmjopen-2021-055413.

Source: PubMed

3
Abonner