Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures

Jessica Deighton, Tim Croudace, Peter Fonagy, Jeb Brown, Praveetha Patalay, Miranda Wolpert, Jessica Deighton, Tim Croudace, Peter Fonagy, Jeb Brown, Praveetha Patalay, Miranda Wolpert

Abstract

There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures' psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against standards of feasibility and psychometric credibility in relation to use for practice and policy.

Keywords: Child mental health services; Children; Measurement; Mental health outcomes; Patient reported outcome measures.

Figures

Figure 1
Figure 1
Flow diagram summarizing the review process.

References

    1. Bickman L, Kelley SD, Breda C, de Andrade AR, Riemer M. Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatr Serv. 2011;62:1423–1429.
    1. Wolpert M, Ford T, Trustam E, Law D, Deighton J, Flannery H, Fugard A. Patient-reported outcomes in child and adolescent mental health services (CAMHS): use of idiographic and standardized measures. J Ment Health. 2012;21:165–173. doi: 10.3109/09638237.2012.664304.
    1. Wolpert M, Fugard AJB, Deighton J, Görzig A. Routine outcomes monitoring as part of children and young people's Improving Access to Psychological Therapies (CYP IAPT) – improving care or unhelpful burden? Child Adolesc Ment Health. 2012;17:129–130. doi: 10.1111/j.1475-3588.2012.00676.x.
    1. Achenbach TM, Rescorla L. Manual for the ASEBA school-age forms & profiles: an integrated system of multi-informant assessment. Burlington, Vt: ASEBA; 2001.
    1. Goodman R. The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997;38:581–586. doi: 10.1111/j.1469-7610.1997.tb01545.x.
    1. Goodman R, Scott S. Comparing the strengths and difficulties questionnaire and the child behavior checklist: is small beautiful? J Abnorm Child Psychol. 1999;27:17–24. doi: 10.1023/A:1022658222914.
    1. Cremeens J, Eiser C, Blades M. Characteristics of health-related self-report measures for children aged three to eight years: a review of the literature. Qual Life Res. 2006;15:739–754. doi: 10.1007/s11136-005-4184-x.
    1. Myers K, Winters NC. Ten-year review of rating scales. II: scales for internalizing disorders. J Am Acad Child Adolesc Psychiatry. 2002;41:634–659. doi: 10.1097/00004583-200206000-00004.
    1. Hunter J, Higginson I, Garralda E. Systematic literature review: outcome measures for child and adolescent mental health services. J Public Health Med. 1996;18:197–206. doi: 10.1093/oxfordjournals.pubmed.a024480.
    1. UK Government. Children Act, Volume 31. London: The Stationery Office; 2004.
    1. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167. doi: 10.1136/bmj.f167.
    1. Department of Health. Liberating the NHS: No decision about me without me. Government response. London: Stationary Office; 2012.
    1. Nations U. The United Nations Convention on the Rights of the Child. London: UNICEF; 1989.
    1. Lesley C. Unit Costs of Health and Social Care 2012. Canterbury: Personal Social services Research Unit; 2012.
    1. Marsh H, Debus R, Bornholt L. Handbook of Research Methods in Developmental Science. Blackwell Publishing Ltd: Malden, Oxford and Victoria: Blackwell Publishing Ltd.; 2008. Validating Young Children's Self-Concept Responses: Methodological Ways and Means to Understand their Responses; pp. 23–160.
    1. Edelbrock C, Costello AJ, Dulcan MK, Kalas R, Conover NC. Age differences in the reliability of the psychiatric interview of the child. Child Dev. 1985;56:265–275. doi: 10.2307/1130193.
    1. Truman J, Robinson K, Evans AL, Smith D, Cunningham L, Millward R, Minnis H. The strengths and difficulties questionnaire: a pilot study of a new computer version of the self-report scale. Eur Child Adolesc Psychiatry. 2003;12:9–14. doi: 10.1007/s00787-003-0303-9.
    1. Schmidt LJ, Garratt AM, Fitzpatrick R. Instruments for Mental Health: A review. London: Patient-Reported Health Instruments Group; 2000.
    1. Sharp C, Croudace TJ, Goodyer IM, Amtmann D. The strength and difficulties questionnaire: predictive validity of parent and teacher ratings for help-seeking behaviour over one year. Educ Child Psychol. 2005;22:28–44.
    1. Arseneault L, Kim-Cohen J, Taylor A, Caspi A, Moffitt TE. Psychometric evaluation of 5- and 7-year-old children's self-reports of conduct problems. J Abnorm Child Psychol. 2005;33:537–550. doi: 10.1007/s10802-005-6736-5.
    1. Deighton J, Tymms P, Vostanis P, Belsky J, Fonagy P, Brown A, Martin A, Patalay P, Wolpert M. The development of a school-based measure of child mental health. J Psychoeduc Assess. 2013;31:247–257. doi: 10.1177/0734282912465570.
    1. Chorpita BF, Reise S, Weisz JR, Grubbs K, Becker KD, Krull JL. Evaluation of the brief problem checklist: child and caregiver interviews to measure clinical progress. J Consult Clin Psychol. 2010;78:526–536.
    1. Weisz JR, Jensen-Doss A, Hawley KM. Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons. Am Psychol. 2006;61:671–689.
    1. Wolpert M, Aitken J, Syrad H, Munroe M, Saddington C, Trustam E, Bradley J, Nolas SM, Lavis P, Jones A, Fonagy P, Frederickson N, Day C, Rutter M, Humphrey N, Vostanis P, Meadows P, Croudace T, Tymms P, Brown J. Review and recommendations for national policy for England for the use of mental health outcome measures with children and young people. London: Department for Children, Schools and Families; 2008. [ ]
    1. Beck JS, Beck AT, Jolly JB. Beck Youth Inventories Manual. San Antonio: Psychological Corporation; 2001.
    1. Flanagan D, Alfonso V, Primavera L, Povall L, Higgins D. Convergent validity of the BASC and SSRS: implications for social skills assessment. Psychol Sch. 1996;33:13–23. doi: 10.1002/(SICI)1520-6807(199601)33:1<13::AID-PITS2>;2-X.
    1. Flanagan R. A Review of the Behavior Assessment System for Children (BASC): Assessment Consistent With the Requirements of the Individuals With Disabilities Education Act (IDEA) J Sch Psychol. 1995;33:177–186. doi: 10.1016/0022-4405(95)00003-5.
    1. Sandoval J, Echandia A. Behavior assessment system for children. J Sch Psychol. 1994;32:419–425. doi: 10.1016/0022-4405(94)90037-X.
    1. Epstein MH. Behavioral and Emotional Rating Scale. PRO-ED: Austin; 2004.
    1. Reid R, Epstein MH, Pastor DA, Ryser GR. Strengths-based assessment differences across students with LD and EBD. Remedial Spec Educ. 2000;21:346–355. doi: 10.1177/074193250002100604.
    1. Landgraf JM, Abetz L, Ware JE. The CHQ: A user's manual. Boston: HealthAct; 1999.
    1. Raat H, Botterweck AM, Landgraf JM, Hoogeveen WC, Essink-Bot ML. Reliability and validity of the short form of the Child Health Questionnaire for parents (CHQ-PF28) in large random school based and general population samples. J Epidemiol Community Health. 2005;59:75–82. doi: 10.1136/jech.2003.012914.
    1. Sung L, Greenberg ML, Doyle JJ, Young NL, Ingber S, Rubenstein J, Wong J, Samanta T, McLimont M, Feldman BM. Construct validation of the health utilities index and the Child Health Questionnaire in children undergoing cancer chemotherapy. Br J Cancer. 2003;88:1185–1190. doi: 10.1038/sj.bjc.6600895.
    1. Gadow KD, Sprafkin J. Child Symptom Inventory 4: Screening and Norms Manual. Stony Brook, NY: Checkmate Plus; 2002.
    1. Garralda ME, Yates P, Higginson I. Child and adolescent mental health service use. HoNOSCA as an outcome measure. Br J Psychiatry. 2000;177:52–58. doi: 10.1192/bjp.177.1.52.
    1. Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, Jezzard R. Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for children and Adolescents (HoNOSCA) Br J Psychiatry. 1999;174:413–416. doi: 10.1192/bjp.174.5.413.
    1. Gowers SG, Levine W, Bailey-Rogers S, Shore A, Burhouse E. Use of a routine, self-report outcome measure (HoNOSCA-SR) in two adolescent mental health services. Health of the nation outcome scale for children and adolescents. Br J Psychiatry. 2002;180:266–269. doi: 10.1192/bjp.180.3.266.
    1. Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, Duer W, Auquier P, Cloetta B, Czemy L, Mazur J, Czimbalmos A, Tountas Y, Hagquist C, Kilroe J. KIDSCREEN Group. The KIDSCREEN-52 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Value Health. 2008;11:645–658. doi: 10.1111/j.1524-4733.2007.00291.x.
    1. Berra S, Ravens-Sieberer U, Erhart M, Tebe C, Bisegger C, Duer W, von Rueden U, Herdman M, Alonso J, Rajmil L. Methods and representativeness of a European survey in children and adolescents: the KIDSCREEN study. BMC Public Health. 2007;7:182. doi: 10.1186/1471-2458-7-182.
    1. Ravens-Sieberer U, Erhart M, Rajmil L, Herdman M, Auquier P, Bruil J, Power M, Duer W, Abel T, Czemy L, Azur J, Czimbalmos A, Tountas Y, Hagquist C, Kilroe J. KIDSCREEN Group. Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents’ well-being and health-related quality of life. Qual Life Res. 2010;19:1487–1500. doi: 10.1007/s11136-010-9706-5.
    1. Robitail S, Ravens-Sieberer U, Simeoni MC, Rajmil L, Bruil J, Power M, Duer W, Cloetta B, Czemy L, Mazur J, Czimbalmos A, Tountas Y, Hagquist C, Kilroe J, Auquier P. Kidscreen Group. Testing the structural and cross-cultural validity of the KIDSCREEN-27 quality of life questionnaire. Qual Life Res. 2007;16:1335–1345. doi: 10.1007/s11136-007-9241-1.
    1. Gall G, Pagano ME, Desmond MS, Perrin JM, Murphy JM. Utility of psychosocial screening at a school-based health center. J Sch Health. 2000;70:292–298. doi: 10.1111/j.1746-1561.2000.tb07254.x.
    1. Gardner W, Lucas A, Kolko DJ, Campo JV. Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adolesc Psychiatry. 2007;46:611–618. doi: 10.1097/chi.0b013e318032384b.
    1. Jellinek MS, Murphy JM, Little M, Pagano ME, Comer DM, Kelleher KJ. Use of the Pediatric Symptom Checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Arch Pediatr Adolesc Med. 1999;153:254–260.
    1. Murphy JM, Jellinek M, Milinsky S. The Pediatric Symptom Checklist: validation in the real world of middle school. J Pediatr Psychol. 1989;14:629–639. doi: 10.1093/jpepsy/14.4.629.
    1. Wasserman RC, Kelleher KJ, Bocian A, Baker A, Childs GE, Indacochea F, Stulp C, Gardner WP. Identification of attentional and hyperactivity problems in primary care: a report from pediatric research in office settings and the ambulatory sentinel practice network. Pediatrics. 1999;103:E38. doi: 10.1542/peds.103.3.e38.
    1. Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40:1337–1345. doi: 10.1097/00004583-200111000-00015.
    1. Goodman R, Meltzer H, Bailey V. The Strengths and Difficulties Questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatry. 1998;7:125–130. doi: 10.1007/s007870050057.
    1. Dunn TW, Burlingame GM, Walbridge M, Smith J, Crum MJ, Dunn TW, Burlingame GM, Walbridge M, Smith J, Crum MJ. Outcome assessment for children and adolescents: psychometric validation of the Youth Outcome Questionnaire 30.1 (Y-OQ®-30.1) Clin Psychol Psychother. 2005;12:388–401. doi: 10.1002/cpp.461.
    1. Edwards TC, Huebner CE, Connell FA, Patrick DL. Adolescent quality of life, Part I: conceptual and measurement model. J Adolesc. 2002;25:275–286. doi: 10.1006/jado.2002.0470.
    1. Bares C, Andrade F, Delva J, Grogan-Kaylor A, Kamata A. Differential item functioning due to gender between depression and anxiety items among Chilean adolescents. Int J Soc Psychiatry. 2012;58:386–392. doi: 10.1177/0020764011400999.
    1. McClendon DT, Warren JS, Green KM, Burlingame GM, Eggett DL, McClendon RJ. Sensitivity to change of youth treatment outcome measures: a comparison of the CBCL, BASC-2, and Y-OQ. J Clin Psychol. 2011;67:111–125. doi: 10.1002/jclp.20746.
    1. Humphrey N, Kalambouka A, Wigelsworth M, Lendrum A, Deighton J, Wolpert M. Measures of social and emotional skills for children and young people: a systematic review. Educ Psychol Meas. 2011;71:617–637. doi: 10.1177/0013164410382896.
    1. Fokkema M, Smits N, Kelderman H, Cuijpers P. Response shifts in mental health interventions: an illustration of longitudinal measurement invariance. Psychol Assess. 2013;25:520–531.
    1. Oort FJ. Using structural equation modeling to detect response shifts and true change. Qual Life Res. 2005;14:587–598. doi: 10.1007/s11136-004-0830-y.
    1. Wolpert M. Uses and Abuses of Patient Reported Outcome Measures (PROMs): potential iatrogenic impact of PROMs implementation and how it can be mitigated. Adm Policy Ment Health. 2014;41:141–145. doi: 10.1007/s10488-013-0509-1.
    1. Law D, Wolpert M, editor. Guide to Using Outcomes and Feedback Tools With Children, Young People and Families. 2. London: CAMHS Press; 2014.
    1. Badham B. Talking about talking therapies: thinking and planning about how to make good and accessible talking therapies available to children and young people. 2011. .
    1. Curtis-Tyler K. Facilitating children's contributions in clinic? Findings from an in-depth qualitative study with children with Type 1 diabetes. Diabet Med. 2012;29:1303–1310. doi: 10.1111/j.1464-5491.2012.03714.x.
    1. Moran P, Kelesidi K, Guglani S, Davidson S, Ford T. What do parents and carers think about routine outcome measures and their use? A focus group study of CAMHS attenders. Clin Child Psychol Psychiatry. 2012;17(1):65–79. doi: 10.1177/1359104510391859.

Source: PubMed

Sponzoři a spolupracovníci

Zdravotní podmínky

Drogové intervence

3
Předplatit