Psychometric properties of the Brief Problem Monitor (BPM) in children with internalizing symptoms: examining baseline data from a national randomized controlled intervention study

Marit Løtveit Pedersen, Thomas Jozefiak, Anne Mari Sund, Solveig Holen, Simon-Peter Neumer, Kristin D Martinsen, Lene Mari P Rasmussen, Joshua Patras, Stian Lydersen, Marit Løtveit Pedersen, Thomas Jozefiak, Anne Mari Sund, Solveig Holen, Simon-Peter Neumer, Kristin D Martinsen, Lene Mari P Rasmussen, Joshua Patras, Stian Lydersen

Abstract

Background: Prevention is essential to reduce the development of symptomology among children and adolescents into disorders, thereby improving public health and reducing costs. Therefore, easily administered screening and early assessment methods with good reliability and validity are necessary to effectively identify children's functioning and how these develop. The Brief Problem Monitor (BPM) is an instrument designed for this purpose. This study examined the psychometric properties of the Norwegian version of the BPM parent (BPM-P) and teacher (BPM-T) versions, including internal reliability and construct validity at assessing children with internalizing problems.

Methods: Baseline data were collected from a national randomized controlled intervention study. Children aged 8-12 years with self-reported symptoms of anxiety and/or depression with one standard deviation above a chosen population's mean were included in this study. Teachers (n = 750) and parents (n = 596) rated children using the BPM-T and BPM-P, respectively. Internal consistency was measured using Cronbach's alpha, and multi-informant agreement between the BPM-P and BPM-T was measured using Spearman's correlations. Construct validity was assessed via confirmatory factor analysis.

Results: Internal consistency was good throughout all domains for both the BPM-P and BPM-T, with a Cronbach's alpha ranging from .763 to .878. Multi-informant agreement between the parents and the teacher was moderate on the externalizing, attention, and total scales and low on the internalizing scale. The model fit for the three-factor structure of the BPM was excellent for the BPM-P and good for the BPM-T.

Conclusions: Internal consistency was good, and the original three-factor solution of the BPM-P and BPM-T was confirmed based on our sample of school children at-risk for emotional problems. These promising results indicate that the BPM may be a valid short assessment tool for measuring attentional, behavioral, and internalizing problems in children. Trial registration in Clinical Trials: NCT02340637; June 12, 2014.

Keywords: Anxiety; BPM-P; BPM-T; Brief Problem Monitor; Children; Confirmatory factor analysis; Depression; Internalizing problems; Psychometric properties.

Conflict of interest statement

Author KM receives royalties from sales of the EMOTION manual. The other authors declare that they have no competing interest with publishing this article.

© 2021. The Author(s).

Figures

Fig. 1
Fig. 1
BPM-P. Standardized factor loadings and factor correlations. Note: BPM-P = Brief Problem Monitor-Parents. ATT = Attention; EXT = Externalizing problems; INT = Internalizing problems; P = parents. All the factors are significant at p < 0.01. In bold; highest correlation between factors, and items with the highest factor loading
Fig. 2
Fig. 2
BPM-T. Standardized factor loadings and factor correlations. Note: BPM-T = Brief Problem Monitor-Teacher. ATT = Attention; EXT = Externalizing problems; INT = Internalizing problems; P = parents. All the factors are significant at p < 0.01. In bold; highest correlation between factors, and items with the highest factor loading

References

    1. Heiervang E, Stormark KM, Lundervold AJ, Heimann M, Goodman R, Posserud MB, et al. Psychiatric disorders in Norwegian 8- to 10-year-olds: an epidemiological survey of prevalence, risk factors, and service use. J Am Acad Child Adolesc Psychiatry. 2007;46:438–447.
    1. Wichstrøm L, Berg-Nielsen TS, Angold A, Egger HL, Solheim E, Sveen TH. Prevalence of psychiatric disorders in preschoolers. J Child Psychol Psychiatry. 2012;53(6):695–705.
    1. Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, et al. Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement. Arch Gen Psychiatry. 2012;69(4):372–380.
    1. Costello EJ, Mustillo S, Erkanli A, Keeler G, Angold A. Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry. 2003;60(8):837–844.
    1. Merikangas KR, He JP, Brody D, Fisher PW, Bourdon K, Koretz DS. Prevalence and treatment of mental disorders among US children in the 2001–2004 NHANES. Pediatrics. 2010;125(1):75–81.
    1. Ford T, Goodman R, Meltzer H. The British child and adolescent mental health survey 1999: the prevalence of DSM-IV disorders. J Am Acad Child Adolesc Psychiatry. 2003;42(10):1203–1211.
    1. Angold A, Costello EJ, Erkanli A. Comorbidity. J Child Psychol Psychiatry. 1999;40(1):57–87.
    1. Costello EJ, Egger HL, Angold A. The developmental epidemiology of anxiety disorders: Phenomenology, prevalence, and comorbidity. Child Adolesc Psychiatr Clin N Am. 2005;14(4):631–648.
    1. Birmaher B, Ryan ND, Williamson DE, Brent DA, Kaufman J. Childhood and adolescent depression: a review of the past 10 years, Part II. J Am Acad Child Adolesc Psychiatry. 1996;35(12):1575–1583.
    1. Fergusson DM, Woodward LJ. Mental health, educational, and social role outcomes of adolescents with depression. Arch Gen Psychiatry. 2002;59(3):225–231.
    1. Kearney CA, Albano AM. The functional profiles of school refusal behavior diagnostic aspects. Behav Modif. 2004;28(1):147–161.
    1. Mychailyszyn MP, Méndez JL, Kendall PC. School functioning in youth with and without anxiety disorders: Comparisons by diagnosis and comorbidity. Sch Psych Rev. 2010;39(1):106–121.
    1. Swan AJ, Kendall PC. Fear and missing out: Youth anxiety and functional outcomes. Clin Psychol Sci Pract. 2016;23(4):417–435.
    1. Egger HL, Angold A. Common emotional and behavioral disorders in preschool children: Presentation, nosology, and epidemiology. J Child Psychol Psychiatry. 2006;47(3–4):313–337.
    1. Mathiesen KS. Psykiske lidelser blant barn og unge i Norge. Psykiske lidelser i Norge: et folkehelseperspektiv [Mental disorders among children and young people in Norway. Mental disorders in Norway: a public health perspective]. Oslo: Nasjonalt folkehelseinstitutt; 2009. pp. S41–S56.
    1. Reneflot A, Aarø LE, Aase H, Reichborn-Kjennerud T, Tambs K, Øverland S. Psykisk helse i Norge [Mental health in Norway]; 2018.
    1. Chorpita BF, Reise S, Weisz JR, Grubbs K, Becker KD, Krull JL, et al. Evaluation of the Brief Problem Checklist: Child and caregiver interviews to measure clinical progress. J Consult Clin Psychol. 2010;78(4):526–536.
    1. Achenbach TM, McConaughy SH, Ivanova MY, Rescorla LA. Manual for the ASEBA Brief Problem Monitor (BPM). Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.: ASEBA; 2011.
    1. Achenbach TM, Rescorla LA. Manual for the ASEBA school-age forms & profiles: Child Behavior Checklist for ages 6–18. Teacher's Report form, Youth Self-report: An integrated system of multi-informant assessment. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families: ASEBA; 2001.
    1. Rescorla LA, Achenbach TM, Ginzburg S, Ivanova M, Dumenci L, Almqvist F, et al. Consistency of teacher-reported problems for students in 21 countries. Sch Psych Rev. 2007;36(1):91–110.
    1. Richter J. Preliminary evidence for good psychometric properties of the Norwegian version of the Brief Problems Monitor (BPM) Nord J Psychiatry. 2015;69(3):174–178.
    1. Penelo E, De la Osa N, Navarro JB, Domènech JM, Ezpeleta L. The Brief Problem Monitor-parent form (BPM-P), a short version of the Child Behavior Checklist: psychometric properties in Spanish 6- to 8-year-old children. Psychol Assess. 2017;29(11):1309–1320.
    1. Piper BJ, Gray HM, Raber J, Birkett MA. Reliability and validity of Brief Problem Monitor, an abbreviated form of the Child Behavior Checklist. Psychiatry Clin Neurosci. 2014;68(10):759–767.
    1. Rodenacker K, Plück J, Döpfner M. Fragebogen zum Problem-Monitoring für Eltern, Lehrer und Jugendliche–eine Deutsche Fassung des Brief Problem Monitor (BPM) [Questionnaire for problem monitoring for parents, teachers and young people - A German version of the Brief Problem Monitor (BPM)] Z Klin Psychol Psychother. 2015;44:197–206.
    1. Backer-Grøndahl A, Martinussen M. Måleegenskaper ved den norske versjonen av Brief Problem Monitor (BPM). [Psychometric properties of the Norwegian version of Brief Problem Monitor (BPM)]. PsykTestBarn. 2018;1(2).
    1. EFPA. EFPA review model for the description and evaluation of psychological tests: test review form and notes for reviewers, v 4.2. 6. European Federation of Psychologists’ Association; 2013.
    1. De Los RA, Augenstein TM, Wang M, Thomas SA, Drabick DAG, Burgers DE, et al. The validity of the multi-informant approach to assessing child and adolescent mental health. Psychol Bull. 2015;141(4):858–900.
    1. Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull. 1987;101(2):213–232.
    1. Achenbach TM, Rescorla LA. Multicultural supplement to the manual for the ASEBA school-age forms and profiles. Burlington VT: University of Vermont Research Center for Children, Youth, & Families; 2007.
    1. Patras J, Martinsen KD, Holen S, Sund AM, Adolfsen F, Rasmussen L-MP, et al. Study protocol of an RCT of EMOTION: An indicated intervention for children with symptoms of anxiety and depression. BMC Psychol. 2016;4(1):48.
    1. Kendall PC, Stark KD, Martinsen K, O'Neil KA, Arora P. EMOTION: "Coping kids" managing anxiety and depression; groupleaders manual. Ardmore, PA: Workbook Publishing; 2013.
    1. March JS, Parker JD, Sullivan K, Stallings P, Conners CK. The multidimensional anxiety scale for children (MASC): factor structure, reliability, and validity. J Am Acad Child Adolesc Psychiatry. 1997;36(4):554–565.
    1. Angold A, Costello EJ, Messer SC, Pickles A. Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res. 1995;5(4):237–249.
    1. Angold A, Erkanli A, Silberg J, Eaves L, Costello EJ. Depression scale scores in 8–17 year olds: effects of age and gender. J Child Psychol Psychiatry. 2002;43(8):1052–1063.
    1. Ólason DT, Sighvatsson MB, Smári J. Psychometric properties of the multidimensional anxiety scale for children (MASC) among Icelandic schoolchildren. Scand J Psychol. 2004;45(5):429–436.
    1. Rhew IC, Simpson K, Tracy M, Lymp J, McCauley E, Tsuang D, et al. Criterion validity of the short mood and feelings questionnaire and one- and two-item depression screens in young adolescents. Child Adolesc Psychiatry Ment Health. 2010;4(1):8.
    1. Kornør H, Jozefiak T. Måleegenskaper ved den norske versjonen av Child Behavior Checklist–versjon 2–3, 4–18, 1½-5 og 6–18 (CBCL). [Psychometric properties of the Norwegian version of Child Behavior Checklist Version ages 2–3, 4–18, 1½-5 and 6–18 (CBCL)]. PsykTestBarn. 2012;2(1).
    1. March JS, Sullivan K, Parker J. Test-retest reliability of the multidimensional anxiety scale for children. J Anxiety Disord. 1999;13(4):349–358.
    1. Villabø MA, Gere M, Torgersen S, March JS, Kendall PC. Diagnostic efficiency of the child and parent versions of the Multidimensional Anxiety Scale for Children. J Clin Child Adolesc Psychol. 2012;41(1):75–85.
    1. Martinsen KD, Holen S, Neumer S-P, Waaktaar T, Rasmussen LMP, Kendall PC, et al. The factor structure of MASC youth report in Norwegian school children. J Child Fam Stud. 2017;26(7):1808–1816.
    1. Larsson B, Ingul JM, Jozefiak T, Leikanger E, Sund AM. Prevalence, stability, 1-year incidence and predictors of depressive symptoms among Norwegian adolescents in the general population as measured by the short mood and feelings questionnaire. Nord J Psychiatry. 2016;70(4):290–296.
    1. Richter J, Sund AM. Måleegenskaper ved den norske versjonen av the Mood and Feelings Questionnaire-Humøret Ditt (MFQ) [Psychometric properties of the Norwegian version of mood and feelings questionnaire (MFQ)]. PsykTestBarn. 2013;1(1).
    1. Cohen JW. Statistical power analysis for the behavioral sciences. 2. Hillsdale: Erbaum Press; 1988.
    1. Muthén B. A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika. 1984;49(1):115–132.
    1. Li CH. Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936–949.
    1. Brown TA. Confirmatory factor analysis for applied research. Guilford Publications; 2015.
    1. Tabachnick BG, Fidell LS. Using Multivariate Statistics. Pearson; 2019.
    1. Muthén LK, Muthén BO. Mplus User’s Guide. Eighth Edition ed. Los Angeles, CA: Muthén & Muthén. 1998–2017.
    1. Hooper D, Coughlan J, Mullen M, editors. Evaluating model fit: A synthesis of the structural equation modelling literature. In: 7th European conference on research methodology for business and management studies; 2008.
    1. West SG, Taylor AB, Wu W. Model fit and model selection in structural equation modeling. Handb Struct Eq Model. 2012;1:209–231.
    1. APA. Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Publishing; 2013.
    1. Ogden T, Hagen KA. Adolescent mental health: Prevention and intervention. Second Edition. Routledge; 2018.
    1. De Los RA, Cook CR, Gresham FM, Makol BA, Wang M. Informant discrepancies in assessments of psychosocial functioning in school-based services and research: Review and directions for future research. J Sch Psychol. 2019;74:74–89.
    1. Kendall PC. Child and adolescent therapy: Cognitive-behavioral procedures. Kendall PC, editor. Guilford Publications; 2012.
    1. Dumenci L, McConaughy SH, Achenbach TM. A hierarchical three-factor model of inattention-hyperactivity-impulsivity derived from the attention problems syndrome of the teacher's report form. Sch Psych Rev. 2004;33(2):287–301.
    1. Harter S. The construction of the self 2nd. ed. New York: Guilford Press; 2012.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera