Measuring functional disability in children with developmental disorders in low-resource settings: validation of Developmental Disorders-Children Disability Assessment Schedule (DD-CDAS) in rural Pakistan

Syed Usman Hamdani, Zill-E Huma, Lawrence Wissow, Atif Rahman, Melissa Gladstone, Syed Usman Hamdani, Zill-E Huma, Lawrence Wissow, Atif Rahman, Melissa Gladstone

Abstract

Background: Developmental disorders (DDs) in children are a priority condition and guidelines have been developed for their management within low-resource community settings. However, a key obstacle is lack of open access, reliable and valid tools that lay health workers can use to evaluate the impact of such programmes on child outcomes. We adapted and validated the World Health Organization's Disability Assessment Schedule for children (WHODAS-Child), a lay health worker-administered functioning-related tool, for children with DDs in Pakistan.

Methods: Lay health workers administered a version of the WHODAS-Child to parents of children with DDs (N = 400) and without DDs (N = 400), aged 2-12 years, after it was adapted using qualitative study. Factor analysis, validity, reliability and sensitivity to change analyses were conducted to evaluate the psychometric properties of the adapted outcome measure.

Results: Among 800 children, 58% of children were male [mean (s.d.) age 6.68 (s.d. = 2.89)]. Confirmatory Factor Analysis showed a robust factor structure [χ2/df 2.86, RMSEA 0.068 (90% CI 0.064-0.073); Tucker-Lewis Index (TLI) 0.92; Comparative Fit Index (CFI) 0.93; Incremental Fit Index (IFI) 0.93]. The tool demonstrated high internal consistency (α 0.82-0.94), test-retest [Intra-class Correlation Coefficient (ICC) 0.71-0.98] and inter-data collector (ICC 0.97-0.99) reliabilities; good criterion (r -0.71), convergent (r -0.35 to 0.71) and discriminative [M (s.d.) 52.00 (s.d. = 21.97) v. 2.14 (s.d. = 4.00); 95% CI -52.05 to -47.67] validities; and adequate sensitivity to change over time (ES 0.19-0.23).

Conclusions: The lay health worker administrated version of adapted WHODAS-Child is a reliable, valid and sensitive-to-change measure of functional disability in children aged 2-12 years with DDs in rural community settings of Pakistan.

Keywords: AMOS, Analysis of Moment Structure; Autism; CFA, Confirmatory Factor Analysis; CFI, Comparative Fit Index; CGAS, Children-Global Assessment of Functioning; DD-CDAS, Developmental Disorders-Children Disability Assessment Schedule; DD-CGAS, Developmental Disorders Children-Global Assessment of Functioning; Developmental Disabilities Children's Global Assessment Scale (DD-CGAS); Developmental Disorders-Children Disability Assessment Schedule (DD-CDAS); ICC, Interclass Correlation; ICF, International Classification of Functioning; ICF-CY, International Classification of Functioning-Children and Youth; IFI, Incremental Fit Index; International Classification of Functioning-Children and Youth (ICF-CY); LHWs, Lady Health Workers.; RMSEA, Root Mean Square Error of Approximation; SDGs, Sustainable Development Goals; TLI, Tucker–Lewis Index; TQS, Ten Questions Screen; VABS, Vineland Adaptive Behavior Scales; WHO Disability Assessment Schedule (WHODAS 2.0); WHO mhGAP, World Health Organization Mental Health Gap Action Programme; childhood disability; developmental disorders/disabilities; functional disability; intellectual disability; low-resource settings; non-specialists.

Conflict of interest statement

The authors declare that they have no competing interests.

© The Author(s) 2020.

Figures

Fig. 1.
Fig. 1.
Developmental Disorders-Children Disability Assessment Schedule (DD-CDAS) domain profile by sub-group (N=400) (N = 800).
Fig. 2.
Fig. 2.
Distribution curve for ‘global disability score’ of DD-CDAS for children with and without developmental disorders (N = 800).
Fig. 3.
Fig. 3.
First-order Confirmatory Factor Analysis of the Developmental Disorders-Children Disability Assessment Schedule (DD-CDAS).
Fig. 4.
Fig. 4.
Second-order Confirmatory Factor Analysis of Developmental Disorders-Children Disability Assessment Schedule (DD-CDAS).
Fig. 5.
Fig. 5.
DD-CDAS domain profile by sub-group (N = 400).

References

    1. American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders, 5th Edn., American Psychiatry Association Publishing: Washington, DC.
    1. Baron M, Schieir O, Hudson M, Steele R, Kolahi S, Berkson L, Couture F, Fitzcharles M, Gagné M and Garfield B (2008) The clinimetric properties of the World Health Organization Disability Assessment Schedule II in early inflammatory arthritis. Arthritis Care & Research 59, 382–390.
    1. Buist-Bouwman M, Ormel J, De Graaf R, Vilagut G, Alonso J, Van Sonderen E and Vollebergh W (2008) Psychometric properties of the World Health Organization Disability Assessment Schedule used in the European study of the epidemiology of mental disorders. International Journal of Methods in Psychiatric Research 17, 185–197.
    1. Bureau of Statistics and UNICEF Pakistan (2003) District based Multiple Indicator Cluster Survey (MICS), 2003-2004: Punjab. [Lahore] Government of Punjab, Planning and Development Department, Federal Bureau of Statistics Islamabad United Nations Children's Fund, 2004
    1. Charman T and Gotham K (2013) Measurement issues: screening and diagnostic instruments for autism spectrum disorders – lessons from research and practise. Child and Adolescent Mental Health 18, 52–63.
    1. Chisolm TH, Abrams HB, Mcardle R, Wilson RH and Doyle PJ (2005) The WHO-DAS II: psychometric properties in the measurement of functional health status in adults with acquired hearing loss. Trends in Amplification 9, 111–126.
    1. Chopra PK, Couper J and Herrman H (2004) The assessment of patients with long-term psychotic disorders: application of the WHO Disability Assessment Schedule II. Australian and New Zealand Journal of Psychiatry 38, 753–759.
    1. Durkin M, Hasan Z and Hasan K (1995a) The ten questions screen for childhood disabilities: its uses and limitations in Pakistan. Journal of Epidemiology and Community Health 49, 431–436.
    1. Durkin MS, Wang W, Shrout PE, Zaman SS, Hasan Z, Desai P and Davidson L (1995b) Evaluating a ten questions screen for childhood disability: reliability and internal structure in different cultures. Journal of Clinical Epidemiology 48, 657–666.
    1. Elashoff J (2014) nQuery Advisor (Version 7.0 User's Guide. 2007. Los Angeles.
    1. Federici S, Bracalenti M, Meloni F and Luciano JV (2017) World Health Organization disability assessment schedule 2.0: an international systematic review. Disability and Rehabilitation 39, 2347–2380.
    1. Federici S, Meloni F, Mancini A, Lauriola M and Olivetti Belardinelli M (2009) World Health Organisation disability assessment schedule II: contribution to the Italian validation. Disability and Rehabilitation 31, 553–564.
    1. Gallagher P and Mulvany F (2004) Levels of ability and functioning: using the WHODAS II in an Irish context. Disability and Rehabilitation 26, 506–517.
    1. Gladstone MJ, Lancaster G, Umar E, Nyirenda M, Kayira E, Van Dan Broek N and Smyth R (2010) The Malawi Developmental Assessment Tool (MDAT): the creation, validation, and reliability of a tool to assess child development in rural African settings. PLoS Medicine 7.
    1. Glorisa JC, Prudence WF, Margarita A and Hector R (2013) Assessing child impairment in functioning in different contexts: implications for use of services and the classification of psychiatric disorders. Open Journal of Medical Psychology 2, 29–34.
    1. Goodman R (1997) The Strengths and Difficulties Questionnaire: a research note. Journal of Child Psychology and Psychiatry 38, 581–586.
    1. Groce N, Challenger E, Berman-Bieler R, Farkas A, Yilmaz N, Schultink W, Clark D, Kaplan C and Kerac M (2014) Malnutrition and disability: unexplored opportunities for collaboration. Paediatrics and International Child Health 34, 308–314.
    1. Hamdani S, Akhtar P, Huma Z-E, Nazir H, Minhas F, Sikander S, Wang D, Servilli C and Rahman A (2017) WHO Parents Skills Training (PST) programme for children with developmental disorders and delays delivered by Family Volunteers in rural Pakistan: study protocol for effectiveness implementation hybrid cluster randomized controlled trial. Global Mental Health, 4.
    1. Hamdani S, Minhas FA, Iqbal Z and Rahman A (2015) Model for service delivery for developmental disorders in low-income countries. Pediatrics 136, 1166–1172.
    1. Hooper D, Coughlan J and Mullen M (2008) Structural equation modelling: guidelines for determining model fit (Articles) p. 2.
    1. Hudson M, Steele R, Taillefer S and Baron M (2008) Quality of life in systemic sclerosis: psychometric properties of the World Health Organization Disability Assessment Schedule II. Arthritis Care & Research 59, 270–278.
    1. Jackson DL, Gillaspy JA JR and Purc-Stephenson R (2009) Reporting practices in confirmatory factor analysis: an overview and some recommendations. Journal of Psychological Methods 14, 6.
    1. Konecky B, Meyer EC, Marx BP, Kimbrel NA and Morissette SB (2014) Using the WHODAS 2.0 to assess functional disability associated with DSM-5 mental disorders. American Journal of Psychiatry 171, 818–820.
    1. Koo TK and Li MYJJOCM (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractice Medicine 15, 155–163.
    1. Kuruvilla S, Bustreo F, Kuo T, Mishra C, Taylor K, Fogstad H, Gupta GR, Gilmore K, Temmerman M and Thomas J (2016) The global strategy for women's, children's and adolescents’ health (2016–2030): a roadmap based on evidence and country experience. Bulletin of the World Health Organization 94, 398.
    1. Maccallum RC, Widaman KF, Zhang S and Hong S (1999) Sample size in factor analysis. Psychological Methods 4, 84.
    1. Maselko J, Sikander S, Bangash O, Bhalotra S, Franz L, Ganga N, Rajan DG, O'donnell K, and Rahman A (2016) Child mental health and maternal depression history in Pakistan. Social Psychiatry and Psychiatric Epidemiology 51, 49–62.
    1. Mckibbin C, Patterson TL and Jeste DV (2004) Assessing disability in older patients with schizophrenia: results from the WHODAS-II. The Journal of Nervous and Mental Disease 192, 405–413.
    1. Mirza I, Mehmood T, Tareen A, Davidson L and Rahman A (2008) Feasibility study on the use of the Ten Questions Screen by Lady Health Workers to detect developmental disabilities in Pakistan. JPPS 5, 97–100.
    1. Murray CJ (2002) Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications. World Health Organization: Geneva.
    1. Olsson NC and Bölte S (2014) Brief report: ‘quick and (not so) dirty’ assessment of change in autism: cross-cultural reliability of the developmental disabilities CGAS and the OSU autism CGI. Journal of Autism Developmental Disorders 44, 1773–1778.
    1. Olusanya BO, Davis AC, Wertlieb D, Boo N-Y, Nair M, Halpern R, Kuper H, Breinbauer C, De Vries PJ and Gladstone M (2018) Developmental disabilities among children younger than 5 years in 195 countries and territories, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Global Health 6, e1100–e1121.
    1. Perini SJ, Slade T and Andrews G (2006) Generic effectiveness measures: sensitivity to symptom change in anxiety disorders. Journal of Affective Disorders 90, 123–130.
    1. Rahman A, Divan G, Hamdani SU, Vajaratkar V, Taylor C, Leadbitter K, Aldred C, Minhas A, Cardozo P and Emsley RJTLP (2016) Effectiveness of the parent-mediated intervention for children with autism spectrum disorder in south Asia in India and Pakistan (PASS): A randomised controlled trial. The Lancet Psychiatry 3, 128–136.
    1. Russell G, Rodgers LR and Ford T (2013) The strengths and difficulties questionnaire as a predictor of parent-reported diagnosis of autism spectrum disorder and attention deficit hyperactivity disorder. PLoS ONE 8.
    1. Salomone E, Pacione L, Shire S, Brown FL, Reichow B and Servili C (2019) Development of the WHO caregiver skills training program for developmental disorders or delays. Journal of Frontiers in Psychiatry 10.
    1. Schlote A, Richter M, Wunderlich M, Poppendick U, Möller C and Wallesch C (2008) Use of the WHODAS II with stroke patients and their relatives: reliability and inter-rater-reliability. Die Rehabilitation 47, 31–38.
    1. Schorre BEH and Vandvik IH (2004) Global assessment of psychosocial functioning in child and adolescent psychiatry. European Child & Adolescent Psychiatry 13, 273–286.
    1. Scorza P, Stevenson A, Canino G, Mushashi C, Kanyanganzi F, Munyanah M and Betancourt T (2013) Validation of the ‘World Health Organization Disability Assessment Schedule for Children, WHODAS-Child’ in Rwanda. PLoS ONE 8, e57725.
    1. Selb M, Kohler F, Nicol MMR, Riberto M, Stucki G, Kennedy C and Üstün B (2015) ICD-11: a comprehensive picture of health, an update on the ICD–ICF joint use initiative. Journal of Rehabilitation Medicine 47, 2–8.
    1. Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H and Aluwahlia S (1983) A children's global assessment scale (CGAS). Archives of General Psychiatry 40, 1228–1231.
    1. Singhi P, Kumar M, Malhi P and Kumar R (2007) Utility of the WHO Ten Questions Screen for Disability Detection in a Rural Community-the North Indian Experience. Journal of Tropical Pediatrics 53(6), 383–387. doi: .
    1. Soberg HL, Bautz-Holter E, Roise O and Finset A (2007) Long-term multidimensional functional consequences of severe multiple injuries two years after trauma: a prospective longitudinal cohort study. Journal of Trauma and Acute Care Surgery 62, 461–470.
    1. Sousa RM, Ferri CP, Acosta D, Albanese E, Guerra M, Huang Y, Jacob K, Jotheeswaran A, Rodriguez JJL and Pichardo GR (2009) Contribution of chronic diseases to disability in elderly people in countries with low and middle incomes: a 10/66 Dementia Research Group population-based survey. The Lancet 374, 1821–1830.
    1. Sparrow S, Cicchetti D and Balla D (2005) Vineland Adaptive Behavior Scales: (Vineland II), Survey Interview Form/Caregiver Rating Form. Livonia, MN: Pearson Assessments.
    1. Üstün TB, Chatterji S, Villanueva M, Bendib L, Çelik C, Sadana R, Valentine N, Ortiz J, Tandon A and Salomon J (2001) WHO Multi-country Survey Study on Health and Responsiveness. Geneva: World Health Organization.
    1. Üstün TB, Kostanjsek N, Chatterji S and Rehm J (2010) Measuring health and disability: manual for WHO disability assessment schedule WHODAS 2.0, World Health Organization.
    1. Van Ommeren M, Sharma B, Thapa S, Makaju R, Prasain D, Bhattarai R and De Jong J (1999) Preparing instruments for transcultural research: use of the translation monitoring form with Nepali-speaking Bhutanese refugees. Transcultural Psychiatry 36, 285–301.
    1. Wagner A, Lecavalier L, Arnold LE, Aman MG, Scahill L, Stigler KA, Johnson CR, Mcdougle CJ and Vitiello B (2007) Developmental disabilities modification of the Children's Global Assessment Scale. Biological Psychiatry 61, 504–511.
    1. Wheaton B, Muthen B, Alwin DF and Summers GF (1977) Assessing reliability and stability in panel models. Sociological Methodology 8, 84–136.
    1. White SW, Smith LA and Schry ARJA (2014) Assessment of global functioning in adolescents with autism spectrum disorders: utility of the Developmental Disability–Child Global Assessment Scale. Autism 18, 362–369.
    1. WHO (2001) International Classification of Functioning, Disability and Health: ICF. World Health Organization: Geneva.
    1. WHO (2017) mhGAP training manuals for the mhGAP intervention guide for mental, neurological and substance use disorders in non-specialized health settings-version 2.0 (for field testing).

Source: PubMed

Patrocinadores y Colaboradores

Condiciones médicas

Intervenciones de drogas

3
Suscribir