Effectiveness of an Internet-Based and Telephone-Assisted Training for Parents of 4-Year-Old Children With Disruptive Behavior: Implementation Research

Andre Sourander, Terja Ristkari, Marjo Kurki, Sonja Gilbert, Susanna Hinkka-Yli-Salomäki, Malin Kinnunen, Laura Pulkki-Råback, Patrick J McGrath, Andre Sourander, Terja Ristkari, Marjo Kurki, Sonja Gilbert, Susanna Hinkka-Yli-Salomäki, Malin Kinnunen, Laura Pulkki-Råback, Patrick J McGrath

Abstract

Background: There is a lack of effectiveness studies when digital parent training programs are implemented in real-world practice. The efficacy of the internet-based and telephone-assisted Finnish Strongest Families Smart Website (SFSW) parent training intervention on the disruptive behavior of 4-year-old children was studied in a randomized controlled trial setting in Southwest Finland between 2011 and 2013. After that, the intervention was implemented nationwide in child health clinics from 2015 onwards.

Objective: The main aim of this study was to compare the treatment characteristics and effectiveness of the SFSW parent training intervention between the families who received the intervention when it was implemented as a normal practice in child health clinics and the families who received the same intervention during the randomized controlled trial.

Methods: The implementation group comprised 600 families who were recruited in the SFSW intervention between January 2015 and May 2017 in real-world implementation. The RCT intervention group comprised 232 families who were recruited between October 2011 and November 2013. The same demographic and child and parent measures were collected from both study groups and were compared using linear mixed-effect models for repeated measurements. The child psychopathology and functioning level were measured using the Child Behavior Checklist (CBCL) version 1.5-5 for preschool children, the Inventory of Callous-Unemotional Traits (ICU), and a modified version of the Barkley Home Situations Questionnaire. Parenting skills were measured using the 31-item Parenting Scale and the shorter 21-item Depression, Anxiety and Stress Scale (DASS-21). The estimated child and parent outcomes were adjusted for CBCL externalizing scores at baseline, maternal education, duration of the behavior problems, and paternal age. The baseline measurements of each outcome were used as covariates.

Results: The implementation group was more likely to complete the intervention than the RCT intervention group (514/600, 85.7% vs 176/232, 75.9%, respectively; P<.001). There were no significant differences between the implementation and RCT intervention groups with regard to child measures, including CBCL externalizing score (-0.2, 95% CI -1.3 to 1.6; P=.83), total score (-0.7, 95% CI -3.0 to 4.5; P=.70), internalizing score (-0.3, 95% CI -1.0 to 1.6; P=.64), and ICU total score (-0.4, 95% Cl -1.9 to 1.2; P=.64). No significant difference was detected in the Parenting Scale total score (0.0, 95% Cl -0.1 to 0.1; P=.50), while DASS-21 total score differed nearly significantly (2.5, 95% Cl 0.0-5.1; P=.05), indicating better improvement in the implementation group.

Conclusions: The internet-based and telephone-assisted SFSW parent training intervention was effectively implemented in real-world settings. These findings have implications for addressing the unmet needs of children with disruptive behavior problems. Our initiative could also provide a quick socially distanced solution for the considerable mental health impact of the COVID-19 pandemic.

Trial registration: ClinicalTrials.gov NCT01750996; https://ichgcp.net/clinical-trials-registry/NCT01750996.

International registered report identifier (irrid): RR2-10.1186/1471-2458-13-985.

Keywords: behavior; behavior problems; child mental health; children; disruptive behavior; early intervention; implementation; internet-assisted; intervention; mental health; parent training; parents; preschool children.

Conflict of interest statement

Conflicts of Interest: AS is the founder and director of Digifamilies, which provides evidence-based treatments to Finnish public health services. The Strongest Families Institute (SFI) is a not-for-profit organization that delivers services to Canadian families. PJM is the cofounder and Chair of SFI Board of Directors. The other authors have no conflicts of interest to declare.

©Andre Sourander, Terja Ristkari, Marjo Kurki, Sonja Gilbert, Susanna Hinkka-Yli-Salomäki, Malin Kinnunen, Laura Pulkki-Råback, Patrick J McGrath. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 04.04.2022.

Figures

Figure 1
Figure 1
Flowchart of the families in the implementation and randomized controlled trial intervention groups.
Figure 2
Figure 2
Kaplan-Meier curves of families completing the program in the implementation and the randomized controlled trial intervention groups. RCT: randomized controlled trial, fixed axes according to editor comments.

References

    1. Dretzke J, Davenport C, Frew E, Barlow J, Stewart-Brown S, Bayliss S, Taylor RS, Sandercock J, Hyde C. The clinical effectiveness of different parenting programmes for children with conduct problems: a systematic review of randomised controlled trials. Child Adolesc Psychiatry Ment Health. 2009 Mar 04;3(1):7. doi: 10.1186/1753-2000-3-7. 1753-2000-3-7
    1. Michelson D, Davenport C, Dretzke J, Barlow J, Day C. Do evidence-based interventions work when tested in the "real world?" A systematic review and meta-analysis of parent management training for the treatment of child disruptive behavior. Clin Child Fam Psychol Rev. 2013 Mar;16(1):18–34. doi: 10.1007/s10567-013-0128-0.
    1. Baumel A, Pawar A, Kane JM, Correll CU. Digital Parent Training for Children with Disruptive Behaviors: Systematic Review and Meta-Analysis of Randomized Trials. J Child Adolesc Psychopharmacol. 2016 Oct;26(8):740–749. doi: 10.1089/cap.2016.0048.
    1. Caspi A, Moffitt T E, Newman D L, Silva P A. Behavioral observations at age 3 years predict adult psychiatric disorders. Longitudinal evidence from a birth cohort. Arch Gen Psychiatry. 1996 Nov;53(11):1033–9. doi: 10.1001/archpsyc.1996.01830110071009.
    1. Sourander Andre, Jensen Peter, Davies Mark, Niemelä Solja, Elonheimo Henrik, Ristkari Terja, Helenius Hans, Sillanmäki Lauri, Piha Jorma, Kumpulainen Kirsti, Tamminen Tuula, Moilanen Irma, Almqvist Fredrik. Who is at greatest risk of adverse long-term outcomes? The Finnish From a Boy to a Man study. J Am Acad Child Adolesc Psychiatry. 2007 Sep;46(9):1148–1161. doi: 10.1097/chi.0b013e31809861e9.S0890-8567(09)61933-X
    1. Perrin EC, Leslie LK, Boat T. Parenting as Primary Prevention. JAMA Pediatr. 2016 Jul 01;170(7):637–8. doi: 10.1001/jamapediatrics.2016.0225.2522754
    1. Weber L, Kamp-Becker I, Christiansen H, Mingebach T. Treatment of child externalizing behavior problems: a comprehensive review and meta-meta-analysis on effects of parent-based interventions on parental characteristics. Eur Child Adolesc Psychiatry. 2019 Aug;28(8):1025–1036. doi: 10.1007/s00787-018-1175-3.10.1007/s00787-018-1175-3
    1. Jensen PS, Goldman E, Offord D, Costello EJ, Friedman R, Huff B, Crowe M, Amsel L, Bennett K, Bird H, Conger R, Fisher P, Hoagwood K, Kessler RC, Roberts R. Overlooked and underserved: "action signs" for identifying children with unmet mental health needs. Pediatrics. 2011 Nov;128(5):970–9. doi: 10.1542/peds.2009-0367. peds.2009-0367
    1. Breitenstein SM, Gross D, Christophersen R. Digital delivery methods of parenting training interventions: a systematic review. Worldviews Evid Based Nurs. 2014 Jun;11(3):168–76. doi: 10.1111/wvn.12040.
    1. Mastnak W. Psychopathological problems related to the COVID-19 pandemic and possible prevention with music therapy. Acta Paediatr. 2020 Aug;109(8):1516–1518. doi: 10.1111/apa.15346.
    1. McGrath PJ, Lingley-Pottie P, Thurston C, MacLean C, Cunningham C, Waschbusch DA, Watters C, Stewart S, Bagnell A, Santor D, Chaplin W. Telephone-based mental health interventions for child disruptive behavior or anxiety disorders: randomized trials and overall analysis. J Am Acad Child Adolesc Psychiatry. 2011 Nov;50(11):1162–72. doi: 10.1016/j.jaac.2011.07.013.S0890-8567(11)00643-5
    1. Sanders MR, Baker S, Turner KMT. A randomized controlled trial evaluating the efficacy of Triple P Online with parents of children with early-onset conduct problems. Behav Res Ther. 2012 Nov;50(11):675–84. doi: 10.1016/j.brat.2012.07.004.S0005-7967(12)00119-2
    1. Sourander A, McGrath PJ, Ristkari T, Cunningham C, Huttunen J, Lingley-Pottie P, Hinkka-Yli-Salomäki Susanna, Kinnunen M, Vuorio J, Sinokki A, Fossum S, Unruh A. Internet-Assisted Parent Training Intervention for Disruptive Behavior in 4-Year-Old Children: A Randomized Clinical Trial. JAMA Psychiatry. 2016 Apr;73(4):378–87. doi: 10.1001/jamapsychiatry.2015.3411.2494708
    1. Sourander A, McGrath PJ, Ristkari T, Cunningham C, Huttunen J, Hinkka-Yli-Salomäki Susanna, Kurki M, Lingley-Pottie P. Two-Year Follow-Up of Internet and Telephone Assisted Parent Training for Disruptive Behavior at Age 4. J Am Acad Child Adolesc Psychiatry. 2018 Sep;57(9):658–668.e1. doi: 10.1016/j.jaac.2018.07.001.S0890-8567(18)30329-0
    1. Ristkari T, Kurki M, Suominen A, Gilbert S, Sinokki A, Kinnunen M, Huttunen J, McGrath P, Sourander A. Web-Based Parent Training Intervention With Telephone Coaching for Disruptive Behavior in 4-Year-Old Children in Real-World Practice: Implementation Study. J Med Internet Res. 2019 Apr 11;21(4):e11446. doi: 10.2196/11446. v21i4e11446
    1. Bandura A. Social Learning Theory, 1st edition. Morristown, New York: General Learning Press; 1971.
    1. Reinecke Mark A, Dattilio Frank M, Freeman Arthur., editors. Cognitive Therapy with Children and Adolescents: A Casebook for Clinical Practice, 2nd ed. New York City, New York: Guilford Press; 2003.
    1. Piquero AR, Jennings WG, Diamond B, Farrington DP, Tremblay RE, Welsh BC, Gonzalez JMR. A meta-analysis update on the effects of early family/parent training programs on antisocial behavior and delinquency. J Exp Criminol. 2016 Apr 13;12(2):229–248. doi: 10.1007/s11292-016-9256-0.
    1. Fixsen DL, Blase KA, Naoom SF, Wallace F. Core Implementation Components. Research on Social Work Practice. 2009 May 27;19(5):531–540. doi: 10.1177/1049731509335549.
    1. May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016 Oct 19;11(1):141. doi: 10.1186/s13012-016-0506-3. 10.1186/s13012-016-0506-3
    1. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008 Jun;41(3-4):327–50. doi: 10.1007/s10464-008-9165-0.
    1. Vis C, Mol M, Kleiboer A, Bührmann Leah, Finch T, Smit J, Riper H. Improving Implementation of eMental Health for Mood Disorders in Routine Practice: Systematic Review of Barriers and Facilitating Factors. JMIR Ment Health. 2018 Mar 16;5(1):e20. doi: 10.2196/mental.9769. v5i1e20
    1. Kasvun tuki (early interventions) resource. ITLA Children's Foundation. 2016. Jun 23, [2021-02-15].
    1. McGrath PJ, Sourander A, Lingley-Pottie P, Ristkari T, Cunningham C, Huttunen J, Filbert K, Aromaa M, Corkum P, Hinkka-Yli-Salomäki Susanna, Kinnunen M, Lampi K, Penttinen A, Sinokki A, Unruh A, Vuorio J, Watters C. Remote population-based intervention for disruptive behavior at age four: study protocol for a randomized trial of Internet-assisted parent training (Strongest Families Finland-Canada) BMC Public Health. 2013 Oct 21;13:985. doi: 10.1186/1471-2458-13-985. 1471-2458-13-985
    1. Child welfare clinic. National Institute for Health and Welfare. [2021-02-15]. .
    1. Goodman R. The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997 Jul;38(5):581–6. doi: 10.1111/j.1469-7610.1997.tb01545.x.
    1. Koskelainen M, Sourander A, Kaljonen A. The Strengths and Difficulties Questionnaire among Finnish school-aged children and adolescents. Eur Child Adolesc Psychiatry. 2000 Dec;9(4):277–84. doi: 10.1007/s007870070031.
    1. Borg A, Kaukonen P, Salmelin R, Joukamaa M, Tamminen T. Reliability of the strengths and difficulties questionnaire among Finnish 4-9-year-old children. Nord J Psychiatry. 2012 Dec;66(6):403–13. doi: 10.3109/08039488.2012.660706.
    1. Ristkari T, Mishina K, Lehtola M, Sourander A, Kurki M. Public health nurses' experiences of assessing disruptive behaviour in children and supporting the use of an Internet-based parent training programme. Scand J Caring Sci. 2020 Jun;34(2):420–427. doi: 10.1111/scs.12744.
    1. Barlow J, Smailagic N, Huband N, Roloff V, Bennett C. Group-based parent training programmes for improving parental psychosocial health. Cochrane Database Syst Rev. 2012 Jun 13;(6):CD002020. doi: 10.1002/14651858.CD002020.pub3.
    1. Achenbach Thomas M, Rescorla Leslie A. Manual for the ASEBA Preschool Forms & Profiles. Burlington, VT: AESBA; 2000.
    1. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders, 5th ed. Washington DC: American Psychiatric Publishing; 2013. May 22, Anxiety disorders.
    1. Sourander A. Emotional and behavioural problems in a sample of Finnish three-year-olds. Eur Child Adolesc Psychiatry. 2001 Jun;10(2):98–104. doi: 10.1007/s007870170032.
    1. Rescorla LA, Achenbach TM, Ivanova MY, Harder VS, Otten L, Bilenberg N, Bjarnadottir G, Capron C, De Pauw SSW, Dias P, Dobrean A, Döpfner Manfred, Duyme M, Eapen V, Erol N, Esmaeili EM, Ezpeleta L, Frigerio A, Fung DSS, Gonçalves Miguel, Guðmundsson Halldór, Jeng S, Jusiené Roma, Ah Kim Y, Kristensen S, Liu J, Lecannelier F, Leung PWL, Machado BC, Montirosso R, Ja Oh K, Ooi YP, Plück Julia, Pomalima R, Pranvera J, Schmeck K, Shahini M, Silva JR, Simsek Z, Sourander A, Valverde J, van der Ende J, Van Leeuwen KG, Wu Y, Yurdusen S, Zubrick SR, Verhulst FC. International comparisons of behavioral and emotional problems in preschool children: parents' reports from 24 societies. J Clin Child Adolesc Psychol. 2011;40(3):456–67. doi: 10.1080/15374416.2011.563472. 937016395
    1. Kimonis ER, Fanti KA, Anastassiou-Hadjicharalambous X, Mertan B, Goulter N, Katsimicha E. Can Callous-Unemotional Traits be Reliably Measured in Preschoolers? J Abnorm Child Psychol. 2016 May 7;44(4):625–38. doi: 10.1007/s10802-015-0075-y. 10.1007/s10802-015-0075-y
    1. Ezpeleta L, de la Osa Núria, Granero R, Penelo E, Domènech Josep M. Inventory of callous-unemotional traits in a community sample of preschoolers. J Clin Child Adolesc Psychol. 2013;42(1):91–105. doi: 10.1080/15374416.2012.734221.
    1. Barkley Russell A, Murphy Kevin R. Attention-Deficit Hyperactivity Disorder: A Clinical Workbook, 2nd Edition. New York City, New York: Guilford Press; 1998. Home situations questionnaire.
    1. Arnold DS, O'Leary SG, Wolff LS, Acker MM. The Parenting Scale: A measure of dysfunctional parenting in discipline situations. Psychological Assessment. 1993;5(2):137–144. doi: 10.1037/1040-3590.5.2.137.
    1. Rhoades KA, O'Leary SG. Factor structure and validity of the parenting scale. J Clin Child Adolesc Psychol. 2007;36(2):137–46. doi: 10.1080/15374410701274157.
    1. Lovibond Sydney H, Lovibond Peter F. Manual for the Depression Anxiety Stress Scales, 2nd ed. Sydney, NSW: Psychology Foundation of Australia; 1995.
    1. Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clin Psychol. 2005 Jun;44(Pt 2):227–39. doi: 10.1348/014466505X29657.
    1. Chacko A, Jensen SA, Lowry LS, Cornwell M, Chimklis A, Chan E, Lee D, Pulgarin B. Engagement in Behavioral Parent Training: Review of the Literature and Implications for Practice. Clin Child Fam Psychol Rev. 2016 Sep;19(3):204–15. doi: 10.1007/s10567-016-0205-2.10.1007/s10567-016-0205-2
    1. Dadds MR, Sicouri G, Piotrowska PJ, Collins DA, Hawes DJ, Moul C, Lenroot RK, Frick PJ, Anderson V, Kimonis ER, Tully LA. Keeping Parents Involved: Predicting Attrition in a Self-Directed, Online Program for Childhood Conduct Problems. J Clin Child Adolesc Psychol. 2019;48(6):881–893. doi: 10.1080/15374416.2018.1485109.
    1. Ozbek A, Gencer O, Mustan AT. Which parents dropout from an evidence-based parenting programme (Triple-P) at CAMHS? Comparison of programme-completing and dropout parents. Clin Child Psychol Psychiatry. 2019 Jan;24(1):144–157. doi: 10.1177/1359104518792294.
    1. Kazdin AE, Whitley MK. Pretreatment social relations, therapeutic alliance, and improvements in parenting practices in parent management training. J Consult Clin Psychol. 2006 Apr;74(2):346–55. doi: 10.1037/0022-006X.74.2.346.2006-05351-015
    1. Schmidt F, Chomycz S, Houlding C, Kruse A, Franks J. The Association Between Therapeutic Alliance and Treatment Outcomes in a Group Triple P Intervention. J Child Fam Stud. 2013 Jul 3;23(8):1337–1350. doi: 10.1007/s10826-013-9792-4.
    1. van der Zanden Rianne A P, Speetjens P, Arntz KS, Onrust Simone A. Online group course for parents with mental illness: development and pilot study. J Med Internet Res. 2010 Dec 19;12(5):e50. doi: 10.2196/jmir.1394. v12i5e50
    1. Enebrink P, Högström Jens, Forster M, Ghaderi A. Internet-based parent management training: a randomized controlled study. Behav Res Ther. 2012 Apr;50(4):240–9. doi: 10.1016/j.brat.2012.01.006.S0005-7967(12)00018-6
    1. Kable JA, Coles CD, Strickland D, Taddeo E. Comparing the Effectiveness of On-Line versus In-Person Caregiver Education and Training for Behavioral Regulation in Families of Children with FASD. Int J Ment Health Addict. 2012 Dec;10(6):791–803. doi: 10.1007/s11469-012-9376-3.
    1. Hall CM, Bierman KL. Technology-assisted Interventions for Parents of Young Children: Emerging Practices, Current Research, and Future Directions. Early Child Res Q. 2015;33:21–32. doi: 10.1016/j.ecresq.2015.05.003.
    1. Baumel A, Muench F, Edan S, Kane JM. Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis. J Med Internet Res. 2019 Sep 25;21(9):e14567. doi: 10.2196/14567. v21i9e14567
    1. Torous J, Lipschitz J, Ng M, Firth J. Dropout rates in clinical trials of smartphone apps for depressive symptoms: A systematic review and meta-analysis. J Affect Disord. 2020 Feb 15;263:413–419. doi: 10.1016/j.jad.2019.11.167.S0165-0327(19)32606-0
    1. Karyotaki E, Efthimiou O, Miguel C, Bermpohl FMG, Furukawa TA, Cuijpers P, Individual Patient Data Meta-Analyses for Depression (IPDMA-DE) Collaboration. Riper H, Patel V, Mira A, Gemmil AW, Yeung AS, Lange A, Williams AD, Mackinnon A, Geraedts A, van Straten A, Meyer B, Björkelund Cecilia, Knaevelsrud C, Beevers CG, Botella C, Strunk DR, Mohr DC, Ebert DD, Kessler D, Richards D, Littlewood E, Forsell E, Feng F, Wang F, Andersson G, Hadjistavropoulos H, Christensen H, Ezawa ID, Choi I, Rosso IM, Klein JP, Shumake J, Garcia-Campayo J, Milgrom J, Smith J, Montero-Marin J, Newby JM, Bretón-López Juana, Schneider J, Vernmark K, Bücker Lara, Sheeber LB, Warmerdam L, Farrer L, Heinrich M, Huibers MJH, Kivi M, Kraepelien M, Forand NR, Pugh N, Lindefors N, Lintvedt O, Zagorscak P, Carlbring P, Phillips R, Johansson R, Kessler RC, Brabyn S, Perini S, Rauch SL, Gilbody S, Moritz S, Berger T, Pop V, Kaldo V, Spek V, Forsell Y. Internet-Based Cognitive Behavioral Therapy for Depression: A Systematic Review and Individual Patient Data Network Meta-analysis. JAMA Psychiatry. 2021 Apr 01;78(4):361–371. doi: 10.1001/jamapsychiatry.2020.4364. 2774861
    1. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012 Jun;32(4):329–42. doi: 10.1016/j.cpr.2012.02.004.S0272-7358(12)00027-X
    1. Blasé Karen, Fixsen Dean L. Core intervention components: identifying and operationalizing what makes programs work. ASPE: Office of the Assistant Secretary for Planning and Evaluation. 2013. Jan 13, [2021-02-15]. .
    1. Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz Matthew. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry. 2019 Oct;18(3):325–336. doi: 10.1002/wps.20673. doi: 10.1002/wps.20673.
    1. Flückiger Christoph, Del Re AC, Wampold BE, Horvath AO. The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy (Chic) 2018 Dec;55(4):316–340. doi: 10.1037/pst0000172.2018-23951-001
    1. Juengsiragulwit D. Opportunities and obstacles in child and adolescent mental health services in low- and middle-income countries: a review of the literature. WHO South East Asia J Public Health. 2015;4(2):110–122. doi: 10.4103/2224-3151.206680. WHOSouth-EastAsiaJPublicHealth_2015_4_2_110_206680
    1. Measuring progress: Commitments to support and expand the mental health workforce in England. British Medical Association. [2021-02-15]. .

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera