Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

Brandon A Kohrt, Mark J D Jordans, Wietse A Tol, Nagendra P Luitel, Sujen M Maharjan, Nawaraj Upadhaya, Brandon A Kohrt, Mark J D Jordans, Wietse A Tol, Nagendra P Luitel, Sujen M Maharjan, Nawaraj Upadhaya

Abstract

Background: The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings.

Methods: Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n=64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion.

Results: The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC)=0.82, sensitivity=0.71, specificity=0.81, cutoff score ≥ 14); CPSS (AUC=0.77, sensitivity=0.68, specificity=0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling lonely" (DSRS.15). The CPSS items with significant discriminant validity were nightmares (CPSS.2), flashbacks (CPSS.3), traumatic amnesia (CPSS.8), feelings of a foreshortened future (CPSS.12), and easily irritated at small matters (CPSS.14).

Conclusions: Transcultural translation and alternative validation feasibly can be performed in low clinical resource settings through task-shifting the validation process to trained mental health paraprofessionals using structured interviews. This process is helpful to evaluate cost-effectiveness of psychosocial interventions.

© 2011 Kohrt et al; licensee BioMed Central Ltd.

Figures

Figure 1
Figure 1
Picture-based response sets: water glasses, abacus, and dhoko-basket scales. Children in focus groups reviewed these three drawing series to determine appropriate pictorial response sets to maintain technical equivalence. The water glasses and abacus scales were generally understood. The dhoko-basket scale was not used because children consistently identified option '0' (empty basket) as 'sad' or 'lazy' because the boy had no bricks in his basket and would therefore earn no money compared with '4' (full basket), which was associated with happiness because of high earning potential with a large number of bricks.

References

    1. UNICEF. State of the World's Children 2009: Maternal and Newborn Health. New York: UNICEF; 2009.
    1. Patel V, Flisher AJ, Nikapota A, Malhotra S. Promoting child and adolescent mental health in low and middle income countries. Journal of Child Psychology & Psychiatry & Allied Disciplines. 2008;49(3):313–334. doi: 10.1111/j.1469-7610.2007.01824.x.
    1. Betancourt TS, Williams T. Building an evidence base on mental health interventions for children affected by armed conflict. Intervention: International Journal of Mental Health, Psychosocial Work & Counselling in Areas of Armed Conflict. 2008;6(1):39–56.
    1. Canino G, Alegria M. Psychiatric diagnosis - is it universal or relative to culture? Journal of Child Psychology & Psychiatry & Allied Disciplines. 2008;49(3):237–250. doi: 10.1111/j.1469-7610.2007.01854.x.
    1. Lotrakul M, Sumrithe S, Saipanish R. Reliability and validity of the Thai version of the PHQ-9. BMC Psychiatry. 2008;8:46. doi: 10.1186/1471-244X-8-46.
    1. Kleinman A. Rethinking psychiatry : from cultural category to personal experience. New York: Free Press; Collier Macmillan; 1988.
    1. Ahmer S, Faruqui RA, Aijaz A. Psychiatric rating scales in Urdu: a systematic review. BMC Psychiatry. 2007;7:59. doi: 10.1186/1471-244X-7-59.
    1. Weems CFP, Carrion VGMD. Brief Report: Diurnal Salivary Cortisol in Youth-Clarifying the Nature of Posttraumatic Stress Dysregulation. Journal of Pediatric Psychology. 2009;34(4):389–395. doi: 10.1093/jpepsy/jsn087.
    1. Allden K, Jones L, Weissbecker I, Wessells M, Bolton P, Betancourt TS, Hijazi Z, Galappatti A, Yamout R, Patel P. et al.Mental health and psychosocial support in crisis and conflict: report of the Mental Health Working Group. Prehospital & Disaster Medicine. 2009;24(Suppl 2):s217–227.
    1. Wessells MG. Do No Harm: Toward Contextually Appropriate Psychosocial Support in International Emergencies. American Psychologist. 2009;64(8):842–854.
    1. Van Ommeren M, Sharma B, Thapa S, Makaju R, Prasain D, Bhattaria R, de Jong JTVM. Preparing instruments for transcultural research: use of the translation monitoring form with Nepali-speaking Bhutanese. Transcultural Psychiatry. 1999;36(3):285–301. doi: 10.1177/136346159903600304.
    1. Flaherty JA, Gaviria FM, Pathak D, Mitchell T, Wintrob R, Richman JA, Birz S. Developing instruments for cross-cultural psychiatric research. Journal of Nervous & Mental Disease. 1988;176(5):257–263.
    1. Matias-Carrelo LE, Chavez LM, Negron G, Canino G, Aguilar-Gaxiola S, Hoppe S. The Spanish Translation and Cultural Adaptation of Five Mental Health Outcome Measures. Culture, Medicine & Psychiatry. 2003;27(3):291–313.
    1. Miller KE, Omidian P, Quraishy AS, Quraishy N, Nasiry MN, Nasiry S, Karyar NM, Yaqubi AA. The Afghan symptom checklist: a culturally grounded approach to mental health assessment in a conflict zone. American Journal of Orthopsychiatry. 2006;76(4):423–433.
    1. Bolton P. Cross-cultural validity and reliability testing of a standard psychiatric assessment instrument without a gold standard. Journal of Nervous & Mental Disease. 2001;189(4):238–242. doi: 10.1097/00005053-200104000-00005.
    1. Jordans MJD, Komproe IH, Ventevogel P, Tol WA, de Jong J. Development and Validation of the Child Psychosocial Distress Screener in Burundi. American Journal of Orthopsychiatry. 2008;78(3):290–299.
    1. Jordans MJD, Komproe IH, Tol WA, De Jong JTVM. Screening for psychosocial distress amongst war-affected children: cross-cultural construct validity of the CPDS. Journal of Child Psychology & Psychiatry & Allied Disciplines. 2009;50(4):514–523. doi: 10.1111/j.1469-7610.2008.02028.x.
    1. Folmar S, Palmes GK. Cross-cultural psychiatry in the field: collaborating with anthropology. Journal of the American Academy of Child & Adolescent Psychiatry. 2009;48(9):873–876. doi: 10.1097/CHI.0b013e3181ae09b6.
    1. Dyregrov A, Yule W. A Review of PTSD in Children. Child & Adolescent Mental Health. 2006;11(4):176–184. doi: 10.1111/j.1475-3588.2005.00384.x.
    1. Ohan JLPD, Myers KMD, Collett BRPD. Ten-Year Review of Rating Scales. IV: Scales Assessing Trauma and Its Effects. Journal of the American Academy of Child & Adolescent Psychiatry. 2002;41(12):1401–1422. doi: 10.1097/00004583-200212000-00012.
    1. Thienkrua W, Cardozo BL, Chakkraband MLS, Guadamuz TE, Pengjuntr W, Tantipiwatanaskul P, Sakornsatian S, Ekassawin S, Panyayong B, Varangrat A. et al.Symptoms of posttraumatic stress disorder and depression among children in tsunami-affected areas in southern Thailand. Jama. 2006;296(5):549–559. doi: 10.1001/jama.296.5.549.
    1. Tol WA, Komproe IH, Susanty D, Jordans MJD, Macy RD, De Jong J. School-based mental health intervention for children affected by political violence in Indonesia - A cluster randomized trial. JAMA (Journal of the American Medical Association) 2008;300(6):655–662. doi: 10.1001/jama.300.6.655.
    1. Tol WA, Komproe IH, Jordans MJD, Gross AL, Susanty D, Macy RD, de Jong JTVM. Mediators and moderators of a psychosocial intervention for children affected by political violence. Journal of Consulting & Clinical Psychology. 2010;78(6):818–828.
    1. Betancourt TS, Borisova I, de la Soudiere M, Williamson J. Sierra Leone's Child Soldiers: War Exposures and Mental Health Problems by Gender. Journal of Adolescent Health. 2011;49(1):21–28.
    1. Onyut LP, Neuner F, Schauer E, Ertl V, Odenwald M, Schauer M, Elbert T. Narrative Exposure Therapy as a treatment for child war survivors with posttraumatic stress disorder: two case reports and a pilot study in an African refugee settlement. BMCPsychiatry. 2005;5:7.
    1. Hruschka DJ, Kohrt BA, Worthman CM. Estimating between- and within-individual variation in cortisol levels using multilevel models. Psychoneuroendocrinology. 2005;30(7):698–714. doi: 10.1016/j.psyneuen.2005.03.002.
    1. Kohrt BA, Jordans MJD, Tol WA, Speckman RA, Maharjan SM, Worthman CM, Komproe IH. Comparison of mental health between former child soldiers and children never conscripted by armed groups in Nepal. Journal of the American Medical Association (JAMA) 2008;300(6):691–702. doi: 10.1001/jama.300.6.691.
    1. Jordans MJD, Komproe IH, Tol WA, Kohrt BA, Luitel NP, Macy RD, de Jong JTVM. Evaluation of a classroom-based psychosocial intervention in conflict-affected Nepal: a cluster randomized controlled trial. Journal of Child Psychology & Psychiatry & Allied Disciplines. 2010;51(7):818–826. doi: 10.1111/j.1469-7610.2010.02209.x.
    1. de Jong JTVM. In: Trauma, War, and Violence: Public Mental Health in Socio-cultural Context. de Jong JTVM, editor. New York: Kluwer Academic/Plenum Publishers; 2002. Public mental health, traumatic stress, and human rights violations in low-income countries; pp. 1–91.
    1. Breslau J. Cultures of trauma: anthropological views of posttraumatic stress disorder in international health. Culture, Medicine & Psychiatry. 2004;28(2):113–126. discussion 211-120.
    1. Munroe RL, Hulefeld R, Rodgers JM, Tomeo DL, Yamazaki SK. Aggression among children in four cultures. Cross-Cultural Research: The Journal of Comparative Social Science. 2000;34(1):3–25. doi: 10.1177/106939710003400101.
    1. Chen I, Roberts RE, Aday L. Ethnicity and Adolescent Depression: The Case of Chinese Americans. Journal of Nervous & Mental Disease. 1998;186(10):623–630. doi: 10.1097/00005053-199810000-00006.
    1. Klasen F, Oettingen G, Daniels J, Adam H. Multiple trauma and mental health in former Ugandan child soldiers. Journal of Traumatic Stress. pp. 573–581.
    1. Bolton P, Wilk CM, Ndogoni L. Assessment of depression prevalence in rural Uganda using symptom and function criteria. SocPsychiatry PsychiatrEpidemiol. 2004;39(6):442–447.
    1. Kohrt BA, Hruschka DJ. Nepali concepts of psychological trauma: the role of idioms of distress, ethnopsychology and ethnophysiology in alleviating suffering and preventing stigma. Culture, Medicine & Psychiatry. 2010;34(2):322–352. doi: 10.1007/s11013-010-9170-2.
    1. Pettigrew J, Adhikari K. Fear and everyday life in rural Nepal. Dialectical Anthropology. 2009;33(3-4):403–422. doi: 10.1007/s10624-009-9131-8.
    1. Karki R, Kohrt BA, Jordans MJD. Child Led Indicators: Pilot testing a child participation tool for psychosocial support programmes for former child soldiers in Nepal. Intervention: International Journal of Mental Health, Psychosocial Work & Counselling in Areas of Armed Conflict. 2009;7(2):92–109. doi: 10.1097/WTF.0b013e3283302725.
    1. Kohrt BA, Maharjan SM. When a child is no longer a child: Nepali ethnopsychology of child development and violence. Studies in Nepali History and Society. 2009;14(1):107–142.
    1. Kohrt BA, Tol WA, Pettigrew J, Karki R. In: The War Machine and Global Health. Singer M, Hodge GD, editor. Lanham, Maryland: Altamira Press: Rowan & Littlefield Publishers, Inc; 2010. Children and Revolution: The Mental Health and Psychosocial Wellbeing of Child Soldiers in Nepal's Maoist Army; pp. 89–116.
    1. Betancourt TS, Speelman L, Onyango G, Bolton P. A qualitative study of mental health problems among children displaced by war in northern Uganda. Transcultural Psychiatry. 2009;46(2):238–256. doi: 10.1177/1363461509105815.
    1. Bolton P, Tang AM. An alternative approach to cross-cultural function assessment. Social Psychiatry and Psychiatric Epidemiology. 2002;37(11):537–543. doi: 10.1007/s00127-002-0580-5.
    1. Van Ommeren M. Validity issues in transcultural epidemiology. British Journal of Psychiatry. 2003;182:376–378. doi: 10.1192/bjp.182.5.376.
    1. INSEC. Fact Sheet: Number of Victims Killed by State and Maoist in Connection with the "People's War" (12 Feb 1996-31 Dec 2006) In: Centre ISS, editor. Volume 2009. Kathmandu; 2008.
    1. Tol WA, Kohrt BA, Jordans MJD, Thapa SB, Pettigrew J, Upadhaya N, de Jong JTVM. Political violence and mental health: a multi-disciplinary review of the literature on Nepal. Social Science & Medicine. 2010;70(1):35–44. doi: 10.1016/j.socscimed.2009.09.037.
    1. Birleson P. The Validity of Depressive Disorder in Childhood and the Development of a Self-Rating Scale - a Research Report. Journal of Child Psychology and Psychiatry and Allied Disciplines. 1981;22(1):73–88. doi: 10.1111/j.1469-7610.1981.tb00533.x.
    1. Denda K, Kako Y, Kitagawa N, Koyama T. Assessment of depressive symptoms in Japanese school children and adolescents using the Birleson Depression Self-Rating Scale. International Journal of Psychiatry in Medicine. 2006;36(2):231–241. doi: 10.2190/3YCX-H0MT-49DK-C61Q.
    1. Ivarsson T, Lidberg A, Gillberg C. The Birleson Depression Self-Rating Scale (Dsrs) - Clinical-Evaluation in an Adolescent Inpatient Population. Journal of Affective Disorders. 1994;32(2):115–125. doi: 10.1016/0165-0327(94)90069-8.
    1. Panter-Brick C, Eggerman M, Gonzalez V, Safdar S. Violence, suffering, and mental health in Afghanistan: a school-based survey. Lancet. 2009;374(9692):807–816. doi: 10.1016/S0140-6736(09)61080-1.
    1. Foa EB, Cashman L, Jaycox L, Perry K. The validation of a self-report measure of posttraumatic stress disorder: The Posttraumatic Diagnostic Scale. Psychological Assessment. 1997;9(4):445–451.
    1. Foa EB, Johnson KM, Feeny NC, Treadwell KR. The child PTSD Symptom Scale: a preliminary examination of its psychometric properties. Journal of Clinical Child Psychology. 2001;30(3):376–384. doi: 10.1207/S15374424JCCP3003_9.
    1. APA. Diagnostic and statistical manual of mental disorders : DSM-IV-TR. 4. Washington, DC: Task Force on DSM-IV, American Psychiatric Association; 2000.
    1. Kaufman J, Chambers W, Puig-Antich J, Birmaher B, Rao U, Ryan ND. Kiddie-Sads-Present and Lifetime Version. Pittsburgh: University of Pittsburgh; 1996. p. 191.
    1. Dyrborg J, Larsen FW, Nielsen S, Byman J, Nielsen BB, Gautre-Delay F. The Children's Global Assessment Scale (CGAS) and Global Assessment of Psychosocial Disability (GAPD) in clinical practice--substance and reliability as judged by intraclass correlations. European Child & Adolescent Psychiatry. 2000;9(3):195–201. doi: 10.1007/s007870070043.
    1. Endicott J, Spitzer RL. A diagnostic interview: the schedule for affective disorders and schizophrenia. Archives of General Psychiatry. 1978;35(7):837–844.
    1. WHO. The ICD-10 Classification of Mental and Behavioural Disorders: Diagnostic criteria for research. Delhi: A.I.T.B.S. Publishers and Distributors; 2004.
    1. Jordans MJ, Keen AS, Pradhan H, Tol WA. Psychosocial counselling in Nepal: Perspectives of counsellors and beneficiaries. International Journal for the Advancement of Counselling. 2007;29(1):57–68. doi: 10.1007/s10447-006-9028-z.
    1. SPSS Inc. SPSS Version 16. 16.0. Chicago: SPSS Inc; 2007.
    1. Kohrt BA, Kunz RD, Koirala NR, Sharma VD, Nepal MK. Validation of a Nepali version of the Beck Depression Inventory. Nepalese Journal of Psychiatry. 2002;2(4):123–130.
    1. Kohrt BA, Kunz RD, Koirala NR, Sharma VD, Nepal MK. Validation of the Nepali Version of the Beck Anxiety Inventory. Journal of the Institute of Medicine. 2003;25(1):1–4.
    1. Kohrt BA, Tol WA, Harper I. Reconsidering Somatic Presentation in Nepal. Journal of Nervous & Mental Disease. 2007;195(6):544. doi: 10.1097/NMD.0b013e318064e7eb.
    1. Kassam-Adams NPD, Marsac MLPD, Cirilli CMA. Posttraumatic Stress Disorder Symptom Structure in Injured Children: Functional Impairment and Depression Symptoms in a Confirmatory Factor Analysis. Journal of the American Academy of Child & Adolescent Psychiatry. 2010;49(6):616–625e614.
    1. Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks, California: Sage Publications, Inc; 2005.
    1. Kohrt BA, Jordans MJD, Worthman CM. Measuring mental health in child soldiers-Reply. Jama. 2008;300(23):2729–2730. doi: 10.1001/jama.2008.774.
    1. Kohrt BA, Jordans MJD, Morley CA. Four Principles of Mental Health Research and Psychosocial Intervention for Child Soldiers: Lessons Learned in Nepal. International Psychiatry. 2010;7(3):58–60.
    1. Jordans MJD, Komproe IH, Tol WA, Susanty D, Vallipuram A, Ntamatumba P, Lasuba AC, De Jong JTVM. Practice-Driven Evaluation of a Multi-Layered Psychosocial Care Package for Children in Areas of Armed Conflict. Community Mental Health Journal. 2011;47:267–277. doi: 10.1007/s10597-010-9301-9.

Source: PubMed

3
Se inscrever