The Parent Participation Engagement Measure (PPEM): Reliability and Validity in Child and Adolescent Community Mental Health Services
Rachel Haine-Schlagel, Scott C Roesch, Emily V Trask, Kya Fawley-King, William C Ganger, Gregory A Aarons, Rachel Haine-Schlagel, Scott C Roesch, Emily V Trask, Kya Fawley-King, William C Ganger, Gregory A Aarons
Abstract
Parent participation in community-based child mental health services is an important yet understudied process associated with treatment effectiveness. This paper describes the development and psychometrics of the Parent Participation Engagement Measure in a sample of 1374 parents and 563 youth receiving publicly-funded mental health services. Analyses indicated excellent internal consistency, and model fit indices/factor loadings supported a one-factor model. Convergent and discriminant validity were supported, although some coefficients were modest in magnitude. Psychometric results were consistent for Caucasian versus Hispanic, parent versus youth, and English versus Spanish-language respondents. The clinical and research utility of this measure are discussed.
Keywords: Caregiver; Community-based services; Measurement; Parent; Participation; Psychometrics.
Conflict of interest statement
No other potential conflicts of interest are noted.
References
- Allen JD, Linnan LA, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. Oxford University Press; 2012. pp. 281–304.
- Baker-Ericzén MJ, Jenkins MM, Haine-Schlagel R. Therapist, parent, and youth perspectives of treatment barriers to family-focused community outpatient mental health services. Journal of Child and Family Studies. 2013;22(6):854–868.
- Baydar N, Reid MJ, Webster-Stratton C. The role of mental health factors and program engagement in the effectiveness of a preventive parenting program for head start mothers. Child Development. 2003;74(5):1433–1453.
- Becker KD, Lee BR, Daleiden EL, Lindsey M, Brandt NE, Chorpita BF. The common elements of engagement in children’s mental health services: Which elements for which outcomes? Journal of Clinical Child & Adolescent Psychology. 2015;44(1):30–43.
- Bentler PM. Comparative fit indexes in structural models. Psychological Bulletin. 1990;107(2):238–246.
- Bentler PM. On tests and indices for evaluating structural models. Personality and Individual Differences. 2007;42(5):825–829.
- Braswell L, Kendall PC, Braith J, Carey MP, Vye CS. “Involvement” in cognitive-behavioral therapy with children: Process and its relationship to outcome. Cognitive Therapy and Research. 1985;9(6):611–630.
- Brunk M. Guidelines for the YSS & the YSS-F. Retrieved from Mental Health Statistics Improvement Program Website. 2001 website: .
- Carrillo E. Assessment and treatment of the Latino patient. In: Lopez AG, Carrillo E, editors. The Latino psychiatric patient: Assessment and treatment. Washington, DC: American Psychiatric Publishing, Inc; 2001. pp. 37–56.
- Chacko A, Wymbs BT, Chimiklis A, Wymbs FA, Pelham WE. Evaluating a comprehensive strategy to improve engagement to group-based behavioral parent training for high-risk families of children with ADHD. Journal of Abnormal Child Psychology. 2012;40(8):1351–1362.
- Chamberlain P, Patterson G, Reid J, Kavanagh K, Forgatch M. Observation of client resistance. Behavior Therapy. 1984;15(2):144–155.
- Clarke AT, Marshall SA, Mautone JA, Soffer SL, Jones HA, Costigan TE, Power TJ. Parent attendance and homework adherence predict response to a family-school intervention for children with ADHD. Journal of Clinical Child & Adolescent Psychology. 2015;44(1):58–67.
- David-Ferdon C, Kaslow NJ. Evidence-based psychosocial treatments for child and adolescent depression. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):62–104.
- Dowell KA, Ogles BM. The effects of parent participation on child psychotherapy outcome: A meta-analytic review. Journal of Clinical Child & Adolescent Psychology. 2010;39(2):151–162.
- Evans SW, Owens J, Bunford N. Evidence-based psychosocial treatments for children and adolescents with attention-deficit/hyperactivity disorder. Journal of Clinical Child & Adolescent Psychology. 2014;43(4):527–551.
- Eyberg SM, Nelson MM, Boggs SR. Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):215–237.
- Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factory analysis in psychological research. Psychological Methods. 1999;4(3):272.
- Fawley-King K, Haine-Schlagel R, Trask EV, Zhang J, Garland AF. Caregiver participation in community-based mental health services for children receiving outpatient care. Journal of Behavioral Health Services & Research. 2012;40(2):180–190.
- Garcia JA, Weisz JR. When youth mental health care stops: Therapeutic relationship problems and other reasons for ending youth outpatient treatment. Journal of Consulting and Clinical Psychology. 2002;70(2):493–443.
- Garland AF, Brookman-Frazee L, Hurlburt M, Arnold E, Zoffness R, Haine-Schlagel R, Ganger W. Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services. 2010;61(8):788–795.
- Garland AF, Lewczyk-Boxmeyer CM, Gabayan EN, Hawley KM. Multiple stakeholder agreement on desired outcomes for adolescents’ mental health services. Psychiatric Services. 2004;55(6):671–676.
- Glasgow RE, Riley WT. Pragmatic measures: What they are and why we need them. American Journal of Preventive Medicine. 2013;45(2):237–243.
- Gopalan G, Goldstein L, Klingenstein K, Sicher C, Blake C, McKay MM. Engaging families into child mental health treatment: Updates and special considerations. Journal of the Canadian Academy of Child and Adolescent Psychiatry. 2010;19(3):182–196.
- Gorin SS. The prediction of child psychotherapy outcome: Factors specific to treatment. Psychotherapy. 1993;30(1):152–158.
- Haine-Schlagel R, Brookman-Frazee L, Fettes DL, Baker-Ericzén M, Garland AF. Therapist focus on parent involvement in community-based youth psychotherapy. Journal of Child and Family Studies. 2012;21(4):646–656.
- Haine-Schlagel R, Walsh N. Parent participatory engagement in youth and family mental health treatment. Clinical Child and Family Psychology Review. 2015;18(1):133–150.
- Hoagwood KE. Family-based services in children’s mental health: A research review and synthesis. Journal of Child Psychology and Psychiatry. 2005;46(7):690–713.
- Hock R, Priester MA, Lachini AL, Browne T, DeHart D, Clone S. A Review of family engagement measures for adolescent substance use services. Journal of Child and Family Studies. 2015;24:1–11.
- Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6(1):1–55.
- Ingoldsby EM. Review of interventions to improve family engagement and retention in parent and child mental health programs. Journal of Child & Family Studies. 2010;19(5):629–645.
- Israel P, Thomsen PH, Langeveld JH, Stormark KM. Child factors associated with parent involvement in usual clinical care of children and adolescents: A national register study. Nordic Journal of Psychiatry. 2007;61(3):173–181.
- Karver MS, Handelsman JB, Fields S, Bickman L. Meta-analysis of therapeutic relationship variables in youth and family therapy: The evidence for different relationship variables in the child and adolescent treatment outcome literature. Clinical Psychology Review. 2006;26(1):50–65.
- Karver MS, Handelsman JB, Fields S, Bickman L. A theoretical model of common process factors in youth and family therapy. Mental Health Services Research. 2005;7(1):35–51.
- Keel PK, Haedt A. Evidence-based psychosocial treatments for eating problems and eating disorders. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):39–61.
- Kim H, Munson MR, McKay MM. Engagement in mental health treatment among adolescents and young adults: A systematic review. Child and Adolescent Social Work Journal. 2012;29(3):241–266.
- Lindsey MA, Brandt NE, Becker KD, Lee BR, Barth RP, Daleiden EL, Chorpita BF. Identifying the common elements of treatment engagement interventions in children’s mental health services: Which elements for which outcomes? Clinical Child and Family Psychology Review. 2014;17(3):283–298. (ahead of print)
- Macdonald E, Lee E, Geraghty K, McCann K, Mohay H, O’Brien T. Towards a developmental framework of consumer and carer participation in child and adolescent mental health services. Australasian Psychiatry. 2007;15(6):504–508.
- McMurran M, Husband N, Overton E, Institute Non-completion of personality disorder treatments: A systematic review of correlates, consequences, and interventions. Clinical Psychology Review. 2010;30(3):277–287.
- Meyer B, Pilkonis PA, Krupnick JL, Egan MK, Simmens SJ, Sotsky SM. Treatment expectancies, patient alliance, and outcome: Further analyses from the National Institue of Mental Health Treatment of Depression Collaborative Research Program. Journal of Consulting and Clinical Psychology. 2002;70(4):1051–1055.
- Muthén LK, Muthén BO. Mplus User’s Guide. Los Angeles, CA: Muthén & Muthén; 1998–2014.
- Nye CL, Zucker RA, Fitzgerald HE. Early family-based intervention in the path to alcohol problems: Rationale and relationship between treatment process characteristics and child and parenting outcomes. Journal of Studies on Alcohol, Supplement No. 1999;13:10–21.
- Olin S, Kutash K, Pollock M, Burns BJ, Kuppinger A, Craig N, Hoagwood K. Developing quality indicators for family support services in community team-based mental health care. Administration and Policy in Mental Health and Health Services Research. 2014;41(1):7–20.
- Patterson GR, Forgatch MS. Therapist behavior as a determinant for client noncompliance: A paradox for the behavior modifier. Journal of Consulting and Clinical Psychology. 1985;53(6):846–851.
- Pelegrina S, Garcia-Linares MC, Casanova PF. Adolescents and their parents’ perceptions about parenting characteristics. Who can better predict the adolescent’s academic competence? Journal of Adolescence. 2003;26(6):651–665.
- Perepletchikova F, Kazdin AE. Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice. 2005;12(4):365–383.
- Quinn KP, Epstein MH, Cumblad CL. Developing comprehensive, individualized community-based services for children and youth with emotional and behavioral disorders: Direct service providers’ perspectives. Journal of Child and Family Studies. 1995;4(1):19–42.
- Resendez MG, Quist RM, Matshazi DGM. A longitudinal analysis of family empowerment and client outcomes. Journal of Child & Family Studies. 2000;9(4):449–460.
- Riley SE, Stromberg AJ, Clark JJ. Assessing parental satisfaction with children’s mental health services with the youth services survey for families. Journal of Child and Family Studies. 2005;14:87–89.
- Schoenwald SK, Sheidow AJ, Letourneau EJ, Liao JG. Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research. 2003;5(4):223–239.
- Shafer AB, Temple JM. Factor structure of the Mental Health Statistics Improvement Program (MHSIP) family and youth satisfaction surveys. Journal of Behavioral Health Services & Research. 2013;40(3):306–316.
- Shirk SR, Saiz CC. Clinical, empirical, and developmental perspectives on the therapeutic relationship in child psychotherapy. Development and Psychopathology. 1992;4(4):713–728.
- Silverman WK, Pina AA, Viswesvaran C. Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):105–130.
- Staudt M. Treatment engagement with caregivers of at-risk children: Gaps in research and conceptualization. Journal of Child and Family Studies. 2007;16(2):183–196.
- Taub J, Tighe TA, Burchard J. The effects of parent empowerment on adjustment for children receiving comprehensive mental health services. Children’s Services: Socialy Policy, Research, and Practice. 2001;4(3):103–122.
- Tetley A, Jinks M, Huband N, Howells K. A systematic review of measures of therapeutic engagement in psychosocial and psychological treatment. Journal of Clinical Psychology. 2011;67(9):927–941.
- Tolan PH, Dodge KA. Children’s mental health as a primary care and concern: A system for comprehensive support and service. American Psychologist. 2005;60(6):601–614.
Source: PubMed