The Parent Participation Engagement Measure (PPEM): Reliability and Validity in Child and Adolescent Community Mental Health Services

Rachel Haine-Schlagel, Scott C Roesch, Emily V Trask, Kya Fawley-King, William C Ganger, Gregory A Aarons, Rachel Haine-Schlagel, Scott C Roesch, Emily V Trask, Kya Fawley-King, William C Ganger, Gregory A Aarons

Abstract

Parent participation in community-based child mental health services is an important yet understudied process associated with treatment effectiveness. This paper describes the development and psychometrics of the Parent Participation Engagement Measure in a sample of 1374 parents and 563 youth receiving publicly-funded mental health services. Analyses indicated excellent internal consistency, and model fit indices/factor loadings supported a one-factor model. Convergent and discriminant validity were supported, although some coefficients were modest in magnitude. Psychometric results were consistent for Caucasian versus Hispanic, parent versus youth, and English versus Spanish-language respondents. The clinical and research utility of this measure are discussed.

Keywords: Caregiver; Community-based services; Measurement; Parent; Participation; Psychometrics.

Conflict of interest statement

No other potential conflicts of interest are noted.

References

    1. Allen JD, Linnan LA, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. Oxford University Press; 2012. pp. 281–304.
    1. Baker-Ericzén MJ, Jenkins MM, Haine-Schlagel R. Therapist, parent, and youth perspectives of treatment barriers to family-focused community outpatient mental health services. Journal of Child and Family Studies. 2013;22(6):854–868.
    1. Baydar N, Reid MJ, Webster-Stratton C. The role of mental health factors and program engagement in the effectiveness of a preventive parenting program for head start mothers. Child Development. 2003;74(5):1433–1453.
    1. Becker KD, Lee BR, Daleiden EL, Lindsey M, Brandt NE, Chorpita BF. The common elements of engagement in children’s mental health services: Which elements for which outcomes? Journal of Clinical Child & Adolescent Psychology. 2015;44(1):30–43.
    1. Bentler PM. Comparative fit indexes in structural models. Psychological Bulletin. 1990;107(2):238–246.
    1. Bentler PM. On tests and indices for evaluating structural models. Personality and Individual Differences. 2007;42(5):825–829.
    1. Braswell L, Kendall PC, Braith J, Carey MP, Vye CS. “Involvement” in cognitive-behavioral therapy with children: Process and its relationship to outcome. Cognitive Therapy and Research. 1985;9(6):611–630.
    1. Brunk M. Guidelines for the YSS & the YSS-F. Retrieved from Mental Health Statistics Improvement Program Website. 2001 website: .
    1. Carrillo E. Assessment and treatment of the Latino patient. In: Lopez AG, Carrillo E, editors. The Latino psychiatric patient: Assessment and treatment. Washington, DC: American Psychiatric Publishing, Inc; 2001. pp. 37–56.
    1. Chacko A, Wymbs BT, Chimiklis A, Wymbs FA, Pelham WE. Evaluating a comprehensive strategy to improve engagement to group-based behavioral parent training for high-risk families of children with ADHD. Journal of Abnormal Child Psychology. 2012;40(8):1351–1362.
    1. Chamberlain P, Patterson G, Reid J, Kavanagh K, Forgatch M. Observation of client resistance. Behavior Therapy. 1984;15(2):144–155.
    1. Clarke AT, Marshall SA, Mautone JA, Soffer SL, Jones HA, Costigan TE, Power TJ. Parent attendance and homework adherence predict response to a family-school intervention for children with ADHD. Journal of Clinical Child & Adolescent Psychology. 2015;44(1):58–67.
    1. David-Ferdon C, Kaslow NJ. Evidence-based psychosocial treatments for child and adolescent depression. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):62–104.
    1. Dowell KA, Ogles BM. The effects of parent participation on child psychotherapy outcome: A meta-analytic review. Journal of Clinical Child & Adolescent Psychology. 2010;39(2):151–162.
    1. Evans SW, Owens J, Bunford N. Evidence-based psychosocial treatments for children and adolescents with attention-deficit/hyperactivity disorder. Journal of Clinical Child & Adolescent Psychology. 2014;43(4):527–551.
    1. Eyberg SM, Nelson MM, Boggs SR. Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):215–237.
    1. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factory analysis in psychological research. Psychological Methods. 1999;4(3):272.
    1. Fawley-King K, Haine-Schlagel R, Trask EV, Zhang J, Garland AF. Caregiver participation in community-based mental health services for children receiving outpatient care. Journal of Behavioral Health Services & Research. 2012;40(2):180–190.
    1. Garcia JA, Weisz JR. When youth mental health care stops: Therapeutic relationship problems and other reasons for ending youth outpatient treatment. Journal of Consulting and Clinical Psychology. 2002;70(2):493–443.
    1. Garland AF, Brookman-Frazee L, Hurlburt M, Arnold E, Zoffness R, Haine-Schlagel R, Ganger W. Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services. 2010;61(8):788–795.
    1. Garland AF, Lewczyk-Boxmeyer CM, Gabayan EN, Hawley KM. Multiple stakeholder agreement on desired outcomes for adolescents’ mental health services. Psychiatric Services. 2004;55(6):671–676.
    1. Glasgow RE, Riley WT. Pragmatic measures: What they are and why we need them. American Journal of Preventive Medicine. 2013;45(2):237–243.
    1. Gopalan G, Goldstein L, Klingenstein K, Sicher C, Blake C, McKay MM. Engaging families into child mental health treatment: Updates and special considerations. Journal of the Canadian Academy of Child and Adolescent Psychiatry. 2010;19(3):182–196.
    1. Gorin SS. The prediction of child psychotherapy outcome: Factors specific to treatment. Psychotherapy. 1993;30(1):152–158.
    1. Haine-Schlagel R, Brookman-Frazee L, Fettes DL, Baker-Ericzén M, Garland AF. Therapist focus on parent involvement in community-based youth psychotherapy. Journal of Child and Family Studies. 2012;21(4):646–656.
    1. Haine-Schlagel R, Walsh N. Parent participatory engagement in youth and family mental health treatment. Clinical Child and Family Psychology Review. 2015;18(1):133–150.
    1. Hoagwood KE. Family-based services in children’s mental health: A research review and synthesis. Journal of Child Psychology and Psychiatry. 2005;46(7):690–713.
    1. Hock R, Priester MA, Lachini AL, Browne T, DeHart D, Clone S. A Review of family engagement measures for adolescent substance use services. Journal of Child and Family Studies. 2015;24:1–11.
    1. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6(1):1–55.
    1. Ingoldsby EM. Review of interventions to improve family engagement and retention in parent and child mental health programs. Journal of Child & Family Studies. 2010;19(5):629–645.
    1. Israel P, Thomsen PH, Langeveld JH, Stormark KM. Child factors associated with parent involvement in usual clinical care of children and adolescents: A national register study. Nordic Journal of Psychiatry. 2007;61(3):173–181.
    1. Karver MS, Handelsman JB, Fields S, Bickman L. Meta-analysis of therapeutic relationship variables in youth and family therapy: The evidence for different relationship variables in the child and adolescent treatment outcome literature. Clinical Psychology Review. 2006;26(1):50–65.
    1. Karver MS, Handelsman JB, Fields S, Bickman L. A theoretical model of common process factors in youth and family therapy. Mental Health Services Research. 2005;7(1):35–51.
    1. Keel PK, Haedt A. Evidence-based psychosocial treatments for eating problems and eating disorders. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):39–61.
    1. Kim H, Munson MR, McKay MM. Engagement in mental health treatment among adolescents and young adults: A systematic review. Child and Adolescent Social Work Journal. 2012;29(3):241–266.
    1. Lindsey MA, Brandt NE, Becker KD, Lee BR, Barth RP, Daleiden EL, Chorpita BF. Identifying the common elements of treatment engagement interventions in children’s mental health services: Which elements for which outcomes? Clinical Child and Family Psychology Review. 2014;17(3):283–298. (ahead of print)
    1. Macdonald E, Lee E, Geraghty K, McCann K, Mohay H, O’Brien T. Towards a developmental framework of consumer and carer participation in child and adolescent mental health services. Australasian Psychiatry. 2007;15(6):504–508.
    1. McMurran M, Husband N, Overton E, Institute Non-completion of personality disorder treatments: A systematic review of correlates, consequences, and interventions. Clinical Psychology Review. 2010;30(3):277–287.
    1. Meyer B, Pilkonis PA, Krupnick JL, Egan MK, Simmens SJ, Sotsky SM. Treatment expectancies, patient alliance, and outcome: Further analyses from the National Institue of Mental Health Treatment of Depression Collaborative Research Program. Journal of Consulting and Clinical Psychology. 2002;70(4):1051–1055.
    1. Muthén LK, Muthén BO. Mplus User’s Guide. Los Angeles, CA: Muthén & Muthén; 1998–2014.
    1. Nye CL, Zucker RA, Fitzgerald HE. Early family-based intervention in the path to alcohol problems: Rationale and relationship between treatment process characteristics and child and parenting outcomes. Journal of Studies on Alcohol, Supplement No. 1999;13:10–21.
    1. Olin S, Kutash K, Pollock M, Burns BJ, Kuppinger A, Craig N, Hoagwood K. Developing quality indicators for family support services in community team-based mental health care. Administration and Policy in Mental Health and Health Services Research. 2014;41(1):7–20.
    1. Patterson GR, Forgatch MS. Therapist behavior as a determinant for client noncompliance: A paradox for the behavior modifier. Journal of Consulting and Clinical Psychology. 1985;53(6):846–851.
    1. Pelegrina S, Garcia-Linares MC, Casanova PF. Adolescents and their parents’ perceptions about parenting characteristics. Who can better predict the adolescent’s academic competence? Journal of Adolescence. 2003;26(6):651–665.
    1. Perepletchikova F, Kazdin AE. Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice. 2005;12(4):365–383.
    1. Quinn KP, Epstein MH, Cumblad CL. Developing comprehensive, individualized community-based services for children and youth with emotional and behavioral disorders: Direct service providers’ perspectives. Journal of Child and Family Studies. 1995;4(1):19–42.
    1. Resendez MG, Quist RM, Matshazi DGM. A longitudinal analysis of family empowerment and client outcomes. Journal of Child & Family Studies. 2000;9(4):449–460.
    1. Riley SE, Stromberg AJ, Clark JJ. Assessing parental satisfaction with children’s mental health services with the youth services survey for families. Journal of Child and Family Studies. 2005;14:87–89.
    1. Schoenwald SK, Sheidow AJ, Letourneau EJ, Liao JG. Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research. 2003;5(4):223–239.
    1. Shafer AB, Temple JM. Factor structure of the Mental Health Statistics Improvement Program (MHSIP) family and youth satisfaction surveys. Journal of Behavioral Health Services & Research. 2013;40(3):306–316.
    1. Shirk SR, Saiz CC. Clinical, empirical, and developmental perspectives on the therapeutic relationship in child psychotherapy. Development and Psychopathology. 1992;4(4):713–728.
    1. Silverman WK, Pina AA, Viswesvaran C. Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. Journal of Clinical Child & Adolescent Psychology. 2008;37(1):105–130.
    1. Staudt M. Treatment engagement with caregivers of at-risk children: Gaps in research and conceptualization. Journal of Child and Family Studies. 2007;16(2):183–196.
    1. Taub J, Tighe TA, Burchard J. The effects of parent empowerment on adjustment for children receiving comprehensive mental health services. Children’s Services: Socialy Policy, Research, and Practice. 2001;4(3):103–122.
    1. Tetley A, Jinks M, Huband N, Howells K. A systematic review of measures of therapeutic engagement in psychosocial and psychological treatment. Journal of Clinical Psychology. 2011;67(9):927–941.
    1. Tolan PH, Dodge KA. Children’s mental health as a primary care and concern: A system for comprehensive support and service. American Psychologist. 2005;60(6):601–614.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren