Examining the Usage, User Experience, and Perceived Impact of an Internet-Based Cognitive Behavioral Therapy Program for Adolescents With Anxiety: Randomized Controlled Trial

Ashley D Radomski, Alexa Bagnell, Sarah Curtis, Lisa Hartling, Amanda S Newton, Ashley D Radomski, Alexa Bagnell, Sarah Curtis, Lisa Hartling, Amanda S Newton

Abstract

Background: Internet-based cognitive behavioral therapy (iCBT) increases treatment access for adolescents with anxiety; however, completion rates of iCBT programs are typically low. Understanding adolescents' experiences with iCBT, what program features and changes in anxiety (minimal clinically important difference [MCID]) are important to them, may help explain and improve iCBT program use and impact.

Objective: Within a randomized controlled trial comparing a six-session iCBT program for adolescent anxiety, Being Real, Easing Anxiety: Tools Helping Electronically (Breathe), with anxiety-based resource webpages, we aimed to (1) describe intervention use among adolescents allocated to Breathe or webpages and those who completed postintervention assessments (Breathe or webpage respondents); (2) describe and compare user experiences between groups; and (3) calculate an MCID for anxiety and explore relationships between iCBT use, experiences, and treatment response among Breathe respondents.

Methods: Enrolled adolescents with self-reported anxiety, aged 13 to 19 years, were randomly allocated to Breathe or webpages. Self-reported demographics and anxiety symptoms (Multidimensional Anxiety Scale for Children-2nd edition [MASC-2]) were collected preintervention. Automatically-captured Breathe or webpage use and self-reported symptoms and experiences (User Experience Questionnaire for Internet-based Interventions) were collected postintervention. Breathe respondents also reported their perceived change in anxiety (Global Rating of Change Scale [GRCS]) following program use. Descriptive statistics summarized usage and experience outcomes, and independent samples t tests and correlations examined relationships between them. The MCID was calculated using the mean MASC-2 change score among Breathe respondents reporting somewhat better anxiety on the GRCS.

Results: Adolescents were mostly female (382/536, 71.3%), aged 16.6 years (SD 1.7), with very elevated anxiety (mean 92.2, SD 18.1). Intervention use was low for adolescents allocated to Breathe (mean 2.2 sessions, SD 2.3; n=258) or webpages (mean 2.1 visits, SD 2.7; n=278), but was higher for Breathe (median 6.0, range 1-6; 81/258) and webpage respondents (median 2.0, range 1-9; 148/278). Total user experience was significantly more positive for Breathe than webpage respondents (P<.001). Breathe respondents reported program design and delivery factors that may have challenged (eg, time constraints and program support) or facilitated (eg, demonstration videos, self-management activities) program use. The MCID was a mean MASC-2 change score of 13.8 (SD 18.1). Using the MCID, a positive treatment response was generated for 43% (35/81) of Breathe respondents. Treatment response was not correlated with respondents' experiences or use of Breathe (P=.32 to P=.88).

Conclusions: Respondents reported positive experiences and changes in their anxiety with Breathe; however, their reports were not correlated with program use. Breathe respondents identified program design and delivery factors that help explain their experiences and use of iCBT and inform program improvements. Future studies can apply our measures to compare user experiences between internet-based interventions, interpret treatment outcomes and improve treatment decision making for adolescents with anxiety.

Trial registration: ClinicalTrials.gov Identifier: NCT02970734 https://ichgcp.net/clinical-trials-registry/NCT02970734.

Keywords: adolescents; anxiety; clinical effectiveness; cognitive behavioral therapy; computer-assisted therapy; internet; minimal clinically important difference; satisfaction; treatment adherence.

Conflict of interest statement

Conflicts of Interest: None declared.

©Ashley D Radomski, Alexa Bagnell, Sarah Curtis, Lisa Hartling, Amanda S Newton. Originally published in JMIR Mental Health (http://mental.jmir.org), 07.02.2020.

Figures

Figure 1
Figure 1
A screenshot of the Check-in activity within the Breathe program.
Figure 2
Figure 2
A screenshot of the Discover section within the Breathe program.
Figure 3
Figure 3
A screenshot of the Check-out activity within the Breathe program.
Figure 4
Figure 4
A screenshot of the Try Out activity within the Breathe program.
Figure 5
Figure 5
A collage of screenshots from the resource-based webpages.

References

    1. Costello EJ, Mustillo S, Erkanli A, Keeler G, Angold A. Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry. 2003 Aug;60(8):837–44. doi: 10.1001/archpsyc.60.8.837.
    1. Georgiades K, Duncan L, Wang L, Comeau J, Boyle M, 2014 Ontario Child Health Study Team Six-month prevalence of mental disorders and service contacts among children and youth in Ontario: evidence from the 2014 Ontario Child Health Study. Can J Psychiatry. 2019 Apr;64(4):246–55. doi: 10.1177/0706743719830024.
    1. Waddell C, Offord D, Shepherd C, Hua J, McEwan K. Child psychiatric epidemiology and Canadian public policy-making: the state of the science and the art of the possible. Can J Psychiatry. 2002 Nov;47(9):825–32. doi: 10.1177/070674370204700903.
    1. Essau CA. Comorbidity of anxiety disorders in adolescents. Depress Anxiety. 2003;18(1):1–6. doi: 10.1002/da.10107.
    1. Kim-Cohen J, Caspi A, Moffitt T, Harrington H, Milne B, Poulton R. Prior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort. Arch Gen Psychiatry. 2003 Jul;60(7):709–17. doi: 10.1001/archpsyc.60.7.709.
    1. James AC, James G, Cowdrey FA, Soler A, Choke A. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2013 Jun 3;(6):CD004690. doi: 10.1002/14651858.CD004690.pub3.
    1. James A, Soler A, Weatherall R. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2005 Oct 19;(4):CD004690. doi: 10.1002/14651858.CD004690.pub2.
    1. Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. 2015 Mar 5;(3):CD011565. doi: 10.1002/14651858.CD011565.
    1. de Haan AM, Boon AE, de Jong JT, Hoeve M, Vermeiren RR. A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin Psychol Rev. 2013 Jul;33(5):698–711. doi: 10.1016/j.cpr.2013.04.005.
    1. Grist R, Croker A, Denne M, Stallard P. Technology delivered interventions for depression and anxiety in children and adolescents: a systematic review and meta-analysis. Clin Child Fam Psychol Rev. 2019 Jun;22(2):147–71. doi: 10.1007/s10567-018-0271-8.
    1. Orlowski S, Lawn S, Matthews B, Venning A, Wyld K, Jones G, Winsall M, Antezana G, Schrader G, Bidargaddi N. The promise and the reality: a mental health workforce perspective on technology-enhanced youth mental health service delivery. BMC Health Serv Res. 2016 Oct 10;16(1):562. doi: 10.1186/s12913-016-1790-y.
    1. Ye X, Bapuji SB, Winters SE, Struthers A, Raynard M, Metge C, Kreindler SA, Charette CJ, Lemaire JA, Synyshyn M, Sutherland K. Effectiveness of internet-based interventions for children, youth, and young adults with anxiety and/or depression: a systematic review and meta-analysis. BMC Health Serv Res. 2014 Jul 18;14:313. doi: 10.1186/1472-6963-14-313.
    1. Pennant ME, Loucas CE, Whittington C, Creswell C, Fonagy P, Fuggle P, Kelvin R, Naqvi S, Stockton S, Kendall T, Expert Advisory Group Computerised therapies for anxiety and depression in children and young people: a systematic review and meta-analysis. Behav Res Ther. 2015 Apr;67:1–18. doi: 10.1016/j.brat.2015.01.009.
    1. Rooksby M, Elouafkaoui P, Humphris G, Clarkson J, Freeman R. Internet-assisted delivery of cognitive behavioural therapy (CBT) for childhood anxiety: systematic review and meta-analysis. J Anxiety Disord. 2015 Jan;29:83–92. doi: 10.1016/j.janxdis.2014.11.006.
    1. Ebert DD, Zarski AC, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, Riper H. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10(3):e0119895. doi: 10.1371/journal.pone.0119895.
    1. Podina IR, Mogoase C, David D, Szentagotai A, Dobrean A. A meta-analysis on the efficacy of technology mediated CBT for anxious children and adolescents. J Ration Emot Cogn Behav Ther. 2016 Mar;34(1):31–50. doi: 10.1007/s10942-015-0228-5.
    1. Vigerland S, Lenhard F, Bonnert M, Lalouni M, Hedman E, Ahlen J, Olén O, Serlachius E, Ljótsson B. Internet-delivered cognitive behavior therapy for children and adolescents: a systematic review and meta-analysis. Clin Psychol Rev. 2016 Dec;50:1–10. doi: 10.1016/j.cpr.2016.09.005.
    1. Hollis C, Falconer C, Martin J, Whittington C, Stockton S, Glazebrook C, Davies E. Annual Research Review: Digital health interventions for children and young people with mental health problems - a systematic and meta-review. J Child Psychol Psychiatry. 2017 Apr;58(4):474–503. doi: 10.1111/jcpp.12663.
    1. Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med. 2009 Aug;38(1):4–17. doi: 10.1007/s12160-009-9130-7.
    1. Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014 Feb;13(1):4–11. doi: 10.1002/wps.20083. doi: 10.1002/wps.20083.
    1. Wozney L, Baxter P, Newton AS. Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders. BMC Pediatr. 2015 Dec 16;15:213. doi: 10.1186/s12887-015-0534-1.
    1. Currie SL, McGrath PJ, Day V. Development and usability of an online CBT program for symptoms of moderate depression, anxiety, and stress in post-secondary students. Comput Human Behav. 2010;26(6):1419–26. doi: 10.1016/j.chb.2010.04.020.
    1. Stoll RD, Pina AA, Gary K, Amresh A. Usability of a smartphone application to support the prevention and early intervention of anxiety in youth. Cogn Behav Pract. 2017 Nov;24(4):393–404. doi: 10.1016/j.cbpra.2016.11.002.
    1. Patwardhan M. ASU Digital Repository. Arizona State University: ProQuest Dissertations & Theses; 2016. [2017-11-03]. Assessing the Impact of Usability Design Features of an mHealth App on Clinical Protocol Compliance Using a Mixed Methods Approach .
    1. Jolstedt M, Wahlund T, Lenhard F, Ljótsson B, Mataix-Cols D, Nord M, Öst L, Högström J, Serlachius E, Vigerland S. Efficacy and cost-effectiveness of therapist-guided internet cognitive behavioural therapy for paediatric anxiety disorders: a single-centre, single-blind, randomised controlled trial. Lancet Child Adolesc Heal. 2018 Nov;2(11):792–801. doi: 10.1016/s2352-4642(18)30275-x.
    1. March S, Spence SH, Donovan CL. The efficacy of an internet-based cognitive-behavioral therapy intervention for child anxiety disorders. J Pediatr Psychol. 2009 Jun;34(5):474–87. doi: 10.1093/jpepsy/jsn099.
    1. Spence SH, Donovan CL, March S, Gamble A, Anderson RE, Prosser S, Kenardy J. A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. J Consult Clin Psychol. 2011 Oct;79(5):629–42. doi: 10.1037/a0024512.
    1. Spence SH, Holmes JM, March S, Lipp OV. The feasibility and outcome of clinic plus internet delivery of cognitive-behavior therapy for childhood anxiety. J Consult Clin Psychol. 2006 Jun;74(3):614–21. doi: 10.1037/0022-006X.74.3.614.
    1. Spence SH, Donovan CL, March S, Gamble A, Anderson R, Prosser S, Kercher A, Kenardy J. Online CBT in the treatment of child and adolescent anxiety disorders: issues in the development of BRAVE-ONLINE and two case illustrations. Behav Cogn Psychother. 2008;36(4):411–30. doi: 10.1017/s135246580800444x.
    1. Bradley KL, Robinson LM, Brannen CL. Adolescent help-seeking for psychological distress, depression, and anxiety using an internet program. Int J Ment Health Promot. 2012;14(1):23–34. doi: 10.1080/14623730.2012.665337.
    1. Gerrits RS, van der Zanden RA, Visscher RF, Conijn BP. Master your mood online: a preventive chat group intervention for adolescents. Aust J Adv Ment Health. 2007;6(3):152–62. doi: 10.5172/jamh.6.3.152.
    1. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009 Apr 24;11(2):e13. doi: 10.2196/jmir.1194.
    1. Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: a systematic review. Clin Child Fam Psychol Rev. 2010 Sep;13(3):275–90. doi: 10.1007/s10567-010-0069-9.
    1. Clarke AM, Kuosmanen T, Barry MM. A systematic review of online youth mental health promotion and prevention interventions. J Youth Adolesc. 2015 Jan;44(1):90–113. doi: 10.1007/s10964-014-0165-0.
    1. Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989 Dec;10(4):407–15. doi: 10.1016/0197-2456(89)90005-6.
    1. Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR, Clinical Significance Consensus Meeting Group Methods to explain the clinical significance of health status measures. Mayo Clin Proc. 2002 Apr;77(4):371–83. doi: 10.4065/77.4.371.
    1. Neely JG, Karni RJ, Engel SH, Fraley PL, Nussenbaum B, Paniello RC. Practical guides to understanding sample size and minimal clinically important difference (MCID) Otolaryngol Head Neck Surg. 2007 Jan;136(1):14–8. doi: 10.1016/j.otohns.2006.11.001.
    1. Graham ML, Strawderman MS, Demment M, Olson CM. Does usage of an eHealth intervention reduce the risk of excessive gestational weight gain? Secondary analysis from a randomized controlled trial. J Med Internet Res. 2017 Jan 9;19(1):e6. doi: 10.2196/jmir.6644.
    1. Mattila E, Lappalainen R, Välkkynen P, Sairanen E, Lappalainen P, Karhunen L, Peuhkuri K, Korpela R, Kolehmainen M, Ermes M. Usage and dose response of a mobile acceptance and commitment therapy app: secondary analysis of the intervention arm of a randomized controlled trial. JMIR Mhealth Uhealth. 2016 Jul 28;4(3):e90. doi: 10.2196/mhealth.5241.
    1. Kelders SM, van Gemert-Pijnen JE, Werkman A, Nijland N, Seydel ER. Effectiveness of a web-based intervention aimed at healthy dietary and physical activity behavior: A randomized controlled trial about users and usage. J Med Internet Res. 2011 Apr 14;13(2):e32. doi: 10.2196/jmir.1624.
    1. The Breathe Research Team . Wayback Machine - Internet Archive. The University of Alberta; 2016. [2019-01-01]. The Breathe Research Study
    1. Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, Neer S. The Screen for Child Anxiety Related Emotional Disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry. 1997 Apr;36(4):545–53. doi: 10.1097/00004583-199704000-00018.
    1. Horowitz LM, Bridge JS, Teach SJ, Ballard E, Klima J, Rosenstein DL, Wharff EA, Ginnis K, Cannon E, Joshi P, Pao M. Ask Suicide-Screening Questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med. 2012 Dec;166(12):1170–6. doi: 10.1001/archpediatrics.2012.1276.
    1. Mulhauser G. Counselling Resource. 2011. [2020-01-21]. Schizophrenia Test and Early Psychosis Indicator (STEPI)
    1. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption--II. Addiction. 1993 Jun;88(6):791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x.
    1. Newton AS, Wozney L, Bagnell A, Fitzpatrick E, Curtis S, Jabbour M, Johnson D, Rosychuk RJ, Young M, Ohinmaa A, Joyce A, McGrath P. Increasing access to mental health care with Breathe, an internet-based program for anxious adolescents: study protocol for a pilot randomized controlled trial. JMIR Res Protoc. 2016 Jan 29;5(1):e18. doi: 10.2196/resprot.4428.
    1. Oinas-Kukkonen H, Harjumaa M. A Systematic Framework for Designing and Evaluating Persuasive Systems. Proceedings of the International Conference on Persuasive Technology; PERSUASIVE'08; June 4-6, 2008; Oulu, Finland. Springer; 2008.
    1. March JS. Documents - ACER. Toronto, ON: Multi-Health Systems; 2013. [2020-01-21]. Multidimensional Anxiety Scale for Children. Second Edition - Self Report .
    1. March JS. International Neuroimaging Data-sharing Initiative - NITRC. North Tonawanda, NY: Multi-Health Systems; 1998. [2020-01-21]. Multidimensional Anxiety Scale for Children .
    1. Fraccaro RL, Stelnicki AM, Nordstokke DW. Test review: multidimensional anxiety scale for children by J.S. March. Can J Sch Psychol. 2015;30(1):70–7. doi: 10.1177/0829573514542924.
    1. Ritterband LM, Borowitz S, Cox DJ, Kovatchev B, Walker LS, Lucas V, Sutphen J. Using the internet to provide information prescriptions. Pediatrics. 2005 Nov;116(5):e643–7. doi: 10.1542/peds.2005-0404.
    1. Ritterband LM, Ardalan K, Thorndike FP, Magee JC, Saylor DK, Cox DJ, Sutphen JL, Borowitz SM. Real world use of an internet intervention for pediatric encopresis. J Med Internet Res. 2008 Jun 30;10(2):e16. doi: 10.2196/jmir.1081.
    1. Thorndike FP, Saylor DK, Bailey ET, Gonder-Frederick L, Morin CM, Ritterband LM. Development and perceived utility and impact of an internet intervention for insomnia. E J Appl Psychol. 2008;4(2):32–42. doi: 10.7790/ejap.v4i2.133.
    1. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. Fifth Edition. USA: Oxford University Press; 2015.
    1. Kamper SJ, Maher CG, Mackay G. Global rating of change scales: a review of strengths and weaknesses and considerations for design. J Man Manip Ther. 2009;17(3):163–70. doi: 10.1179/jmt.2009.17.3.163.
    1. Guyatt GH. Making sense of quality-of-life data. Med Care. 2000 Sep;38(9 Suppl):II175–9. doi: 10.1097/00005650-200009002-00027.
    1. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. doi: 10.1191/1478088706qp063oa.
    1. Maguire M, Delahunt B. Doing a thematic analysis: a practical, step-by-step guide for learning and teaching scholars. All Ireland J Teaching Teach Learn High Educ. 2017;9(3):3351–14.
    1. Copay AG, Subach BR, Glassman SD, Polly DW, Schuler TC. Understanding the minimum clinically important difference: a review of concepts and methods. Spine J. 2007;7(5):541–6. doi: 10.1016/j.spinee.2007.01.008.
    1. Guyatt GH, Juniper EF, Walter SD, Griffith LE, Goldstein RS. Interpreting treatment effects in randomised trials. Br Med J. 1998 Feb 28;316(7132):690–3. doi: 10.1136/bmj.316.7132.690.
    1. Juniper E, Guyatt G, Willan A, Griffith L. Determining a minimal important change in a disease-specific quality of life questionnaire. J Clin Epidemiol. 1994;47(1):81–7. doi: 10.1016/0895-4356(94)90036-1.
    1. Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003 May;41(5):582–92. doi: 10.1097/01.MLR.0000062554.74615.4C.
    1. Brown A, Ford T, Deighton J, Wolpert M. Satisfaction in child and adolescent mental health services: translating users' feedback into measurement. Adm Policy Ment Health. 2014 Jul;41(4):434–46. doi: 10.1007/s10488-012-0433-9.
    1. Barbic SP, Leon A, Manion I, Irving S, Zivanovic R, Jenkins E, Ben-David S, Azar P, Salmon A, Helps C, Gillingham S, Beaulieu T, Pattison R, Talon C, Oyedele O, Tee K, Mathias S. Understanding the mental health and recovery needs of Canadian youth with mental health disorders: a Strategy for Patient-Oriented Research (SPOR) collaboration protocol. Int J Ment Health Syst. 2019;13:6. doi: 10.1186/s13033-019-0264-0.
    1. Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, Müller AM, Wark P, Vandelanotte C, Poppe L, Hingle M, Crutzen R. Measuring engagement in eHealth and mHealth behavior change interventions: viewpoint of methodologies. J Med Internet Res. 2018 Nov 16;20(11):e292. doi: 10.2196/jmir.9397.
    1. Feather J, Howson M, Ritchie L, Carter P, Parry D, Koziol-McLain J. Evaluation methods for assessing users' psychological experiences of web-based psychosocial interventions: a systematic review. J Med Internet Res. 2016 Jun 30;18(6):e181. doi: 10.2196/jmir.5455.
    1. Short CE, Rebar A, Plotnikoff RC, Vandelanotte C. Designing engaging online behaviour change interventions: a proposed model of user engagement. Eur Heal Psychol. 2015;17(1):32–8.
    1. Litvin EB, Abrantes AM, Brown RA. Computer and mobile technology-based interventions for substance use disorders: an organizing framework. Addict Behav. 2013 Mar;38(3):1747–56. doi: 10.1016/j.addbeh.2012.09.003.
    1. Yardley L, Spring B, Riper H, Morrison L, Crane D, Curtis K, Merchant G, Naughton F, Blandford A. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016 Nov;51(5):833–42. doi: 10.1016/j.amepre.2016.06.015.
    1. Radomski AD, Wozney L, McGrath P, Huguet A, Hartling L, Dyson MP, Bennett K, Newton AS. Design and delivery features that may improve the use of internet-based cognitive behavioral therapy for children and adolescents with anxiety: a realist literature synthesis with a persuasive systems design perspective. J Med Internet Res. 2019 Feb 5;21(2):e11128. doi: 10.2196/11128.
    1. MediaSmarts. 2014. [2020-01-21]. Young Canadians in a Wired World, Phase III: Life Online .
    1. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010 Dec 30;10:113. doi: 10.1186/1471-244X-10-113.
    1. Stjerneklar S, Hougaard E, Nielsen A, Gaardsvig M, Thastum M. Internet-based cognitive behavioral therapy for adolescents with anxiety disorders: a feasibility study. Internet Interv. 2018 Mar;11:30–40. doi: 10.1016/j.invent.2018.01.001.
    1. Iloabachie C, Wells C, Goodwin B, Baldwin M, Vanderplough-Booth K, Gladstone T, Murray M, Fogel J, van Voorhees BW. Adolescent and parent experiences with a primary care/Internet-based depression prevention intervention (CATCH-IT) Gen Hosp Psychiatry. 2011;33(6):543–55. doi: 10.1016/j.genhosppsych.2011.08.004.
    1. Kaltenthaler E, Sutcliffe P, Parry G, Beverley C, Rees A, Ferriter M. The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review. Psychol Med. 2008 Nov;38(11):1521–30. doi: 10.1017/S0033291707002607.
    1. Schulz A, Vincent A, Berger T. Daydreamer and night owl: comparing positive and negative outcome cases in an online, clinician-guided, self-help intervention for social anxiety disorder. Pragmat Case Stud Psychother. 2017;13(3):217. doi: 10.14713/pcsp.v13i3.2012.
    1. Ciuca AM, Berger T, Miclea M. Maria and Andrea: comparing positive and negative outcome cases in an online, clinician-guided, self-help intervention for panic disorder. Pragmatic Case Stud Psychother. 2017;13(3):173. doi: 10.14713/pcsp.v13i3.2011.
    1. Anderson RE, Spence SH, Donovan CL, March S, Prosser S, Kenardy J. Working alliance in online cognitive behavior therapy for anxiety disorders in youth: comparison with clinic delivery and its role in predicting outcome. J Med Internet Res. 2012 Jun 28;14(3):e88. doi: 10.2196/jmir.1848.
    1. Vigerland S, Ljótsson B, Thulin U, Öst LG, Andersson G, Serlachius E. Internet-delivered cognitive behavioural therapy for children with anxiety disorders: a randomised controlled trial. Behav Res Ther. 2016 Jan;76:47–56. doi: 10.1016/j.brat.2015.11.006.
    1. Vigerland S, Serlachius E, Thulin U, Andersson G, Larsson J, Ljótsson B. Long-term outcomes and predictors of internet-delivered cognitive behavioral therapy for childhood anxiety disorders. Behav Res Ther. 2017 Mar;90:67–75. doi: 10.1016/j.brat.2016.12.008.
    1. Vigerland S, Thulin U, Ljótsson B, Svirsky L, Ost LG, Lindefors N, Andersson G, Serlachius E. Internet-delivered CBT for children with specific phobia: a pilot study. Cogn Behav Ther. 2013;42(4):303–14. doi: 10.1080/16506073.2013.844201.
    1. Keller ML. An Internet Cognitive-Behavioral Skills-Based Program for Child Anxiety. Ann Arbor, Michigan, United States: ProQuest; 2009.
    1. Nordh M, Vigerland S, Öst LG, Ljótsson B, Mataix-Cols D, Serlachius E, Högström J. Therapist-guided internet-delivered cognitive-behavioural therapy supplemented with group exposure sessions for adolescents with social anxiety disorder: a feasibility trial. BMJ Open. 2017 Dec 14;7(12):e018345. doi: 10.1136/bmjopen-2017-018345.
    1. Silfvernagel K, Gren-Landell M, Emanuelsson M, Carlbring P, Andersson G. Individually tailored internet-based cognitive behavior therapy for adolescents with anxiety disorders: a pilot effectiveness study. Internet Interv. 2015 Sep;2(3):297–302. doi: 10.1016/j.invent.2015.07.002.
    1. Shahnavaz S, Hedman-Lagerlöf E, Hasselblad T, Reuterskiöld L, Kaldo V, Dahllöf G. Internet-based cognitive behavioral therapy for children and adolescents with dental anxiety: open trial. J Med Internet Res. 2018 Jan 22;20(1):e12. doi: 10.2196/jmir.7803.
    1. Calear AL, Batterham PJ, Poyser CT, Mackinnon AJ, Griffiths KM, Christensen H. Cluster randomised controlled trial of the e-couch Anxiety and Worry program in schools. J Affect Disord. 2016 May 15;196:210–7. doi: 10.1016/j.jad.2016.02.049.
    1. Neil AL, Batterham P, Christensen H, Bennett K, Griffiths KM. Predictors of adherence by adolescents to a cognitive behavior therapy website in school and community-based settings. J Med Internet Res. 2009 Feb 23;11(1):e6. doi: 10.2196/jmir.1050.
    1. Andersson G, Carlbring P, Berger T, Almlöv J, Cuijpers P. What makes internet therapy work? Cogn Behav Ther. 2009;38(Suppl 1):55–60. doi: 10.1080/16506070902916400.
    1. Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med. 2009 Aug;38(1):18–27. doi: 10.1007/s12160-009-9133-4.
    1. O’Brien HL, Cairns P, Hall M. A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. Int J Hum Comput Stud. 2018;112:28–39. doi: 10.1016/j.ijhcs.2018.01.004.
    1. Beintner I, Görlich D, Berger T, Ebert D, Zeiler M, Camarano RH, Waldherr K, Jacobi C, ICare Consortium Interrelations between participant and intervention characteristics, process variables and outcomes in online interventions: A protocol for overarching analyses within and across seven clinical trials in ICare. Internet Interv. 2019 Apr;16:86–97. doi: 10.1016/j.invent.2018.05.001.
    1. Calear AL, Christensen H, Brewer J, Mackinnon A, Griffiths KM. A pilot randomized controlled trial of the e-couch anxiety and worry program in schools. Internet Interv. 2016 Nov;6:1–5. doi: 10.1016/j.invent.2016.08.003.
    1. Jolstedt M, Ljótsson B, Fredlander S, Tedgård T, Hallberg A, Ekeljung A, Högström J, Mataix-Cols D, Serlachius E, Vigerland S. Implementation of internet-delivered CBT for children with anxiety disorders in a rural area: A feasibility trial. Internet Interv. 2018 Jun;12:121–9. doi: 10.1016/j.invent.2017.11.003.
    1. Pramana G, Parmanto B, Kendall PC, Silk JS. The SmartCAT: an m-health platform for ecological momentary intervention in child anxiety treatment. Telemed J E Health. 2014 May;20(5):419–27. doi: 10.1089/tmj.2013.0214.
    1. Dombrowski SU, Sniehotta FF, Avenell A, Johnston M, MacLennan G, Araújo-Soares V. Identifying active ingredients in complex behavioural interventions for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: a systematic review. Health Psychol Rev. 2012;6(1):7–32. doi: 10.1080/17437199.2010.513298.
    1. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009 Nov;28(6):690–701. doi: 10.1037/a0016136.
    1. Lentferink A, Oldenhuis H, de Groot M, Polstra L, Velthuijsen H, van Gemert-Pijnen JE. Key components in eHealth interventions combining self-tracking and persuasive eCoaching to promote a healthier lifestyle: a scoping review. J Med Internet Res. 2017 Aug 1;19(8):e277. doi: 10.2196/jmir.7288.
    1. Fogg BJ. Persuasive Technology: Using Computers to Change What We Think and Do. New York: ACM; 2002.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008 Sep 29;337:a1655. doi: 10.1136/bmj.a1655.
    1. Zabinski MF, Wilfley DE, Pung MA, Winzelberg AJ, Eldredge K, Taylor CB. An interactive internet-based intervention for women at risk of eating disorders: a pilot study. Int J Eat Disord. 2001 Sep;30(2):129–37. doi: 10.1002/eat.1065.
    1. Wright A, Hannon J, Hegedus EJ, Kavchak AE. Clinimetrics corner: a closer look at the minimal clinically important difference (MCID) J Man Manip Ther. 2012 Aug;20(3):160–6. doi: 10.1179/2042618612Y.0000000001.
    1. March S. UQ eSpace, The University of Queensland. 2008. [2017-11-03]. Investigation of an Internet-Based Treatment for Childhood Anxiety (BRAVE for Children-ONLINE): An Evaluation of Efficacy and Factors Associated With Treatment Outcome .
    1. March S, Spence SH, Donovan CL, Kenardy JA. Large-scale dissemination of internet-based cognitive behavioral therapy for youth anxiety: feasibility and acceptability study. J Med Internet Res. 2018 Jul 4;20(7):e234. doi: 10.2196/jmir.9211.
    1. Liber JM, McLeod BD, van Widenfelt BM, Goedhart AW, van der Leeden AJ, Utens EM, Treffers PD. Examining the relation between the therapeutic alliance, treatment adherence, and outcome of cognitive behavioral therapy for children with anxiety disorders. Behav Ther. 2010 Jun;41(2):172–86. doi: 10.1016/j.beth.2009.02.003.
    1. Spence SH, Donovan CL, March S, Kenardy JA, Hearn CS. Generic versus disorder specific cognitive behavior therapy for social anxiety disorder in youth: a randomized controlled trial using internet delivery. Behav Res Ther. 2017 Mar;90:41–57. doi: 10.1016/j.brat.2016.12.003.
    1. Crutzen R, de Nooijer J, Brouwer W, Oenema A, Brug J, de Vries NK. A conceptual framework for understanding and improving adolescents' exposure to internet-delivered interventions. Health Promot Int. 2009 Sep;24(3):277–84. doi: 10.1093/heapro/dap018.
    1. Christensen H, Griffiths KM, Korten A. Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J Med Internet Res. 2002;4(1):e3. doi: 10.2196/jmir.4.1.e3.
    1. Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. 2011 Aug 5;13(3):e52. doi: 10.2196/jmir.1772.
    1. O'Connell ME, Boat T, Warner KE, Youth and Young Adults: Research Advances and Promising Interventions Committee on the Prevention of Mental Disorders and Substance Abuse Among Children. Families Board on Children, Youth. Division of Behavioral and Social Sciences and Education. National Research Council. Institute of Medicine . Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities. Washington, DC: National Academies Press; 2009.
    1. Perski O, Blandford A, Garnett C, Crane D, West R, Michie S. A self-report measure of engagement with digital behavior change interventions (DBCIs): development and psychometric evaluation of the 'DBCI Engagement Scale'. Transl Behav Med. 2019 Mar 30; doi: 10.1093/tbm/ibz039.
    1. Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med. 2017 Jun;7(2):254–67. doi: 10.1007/s13142-016-0453-1.
    1. Wozney L, Huguet A, Bennett K, Radomski AD, Hartling L, Dyson M, McGrath PJ, Newton AS. How do eHealth programs for adolescents with depression work? A realist review of persuasive system design components in Internet-based psychological therapies. J Med Internet Res. 2017 Aug 9;19(8):e266. doi: 10.2196/jmir.7573.
    1. Morrison LG, Yardley L, Powell J, Michie S. What design features are used in effective e-health interventions? A review using techniques from Critical Interpretive Synthesis. Telemed J E Health. 2012 Mar;18(2):137–44. doi: 10.1089/tmj.2011.0062.
    1. Rickwood D, Wallace A, Kennedy V, O'Sullivan S, Telford N, Leicester S. Young people's satisfaction with the online mental health service eheadspace: development and implementation of a service satisfaction measure. JMIR Ment Health. 2019 Apr 17;6(4):e12169. doi: 10.2196/12169.
    1. Wells G, Beaton D, Shea B, Boers M, Simon L, Strand V, Brooks P, Tugwell P. Minimal clinically important differences: review of methods. J Rheumatol. 2001 Feb;28(2):406–12.
    1. Beaton DE, Boers M, Wells GA. Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research. Curr Opin Rheumatol. 2002 Mar;14(2):109–14. doi: 10.1097/00002281-200203000-00006.
    1. Ebrahim S, Vercammen K, Sivanand A, Guyatt G, Carrasco-Labra A, Fernandes R, Crawford M, Nesrallah G, Johnston B. Minimally important differences in patient or proxy-reported outcome studies relevant to children: a systematic review. Pediatrics. 2017 Mar;139(3):pii: e20160833. doi: 10.1542/peds.2016-0833.
    1. King MT. A point of minimal important difference (MID): a critique of terminology and methods. Expert Rev Pharmacoecon Outcomes Res. 2011 Apr;11(2):171–84. doi: 10.1586/erp.11.9.
    1. Morse JM. Designing funded qualitative research. In: Denzin NK, Lincoln YS, editors. The SAGE Handbook of Qualitative Research. Thousand Oaks, CA: Sage Publications, Inc; 1994. pp. 220–35.
    1. Song MK, Lin FC, Ward SE, Fine JP. Composite variables: when and how. Nurs Res. 2013;62(1):45–9. doi: 10.1097/NNR.0b013e3182741948.
    1. Eysenbach G. The law of attrition. J Med Internet Res. 2005 Mar 31;7(1):e11. doi: 10.2196/jmir.7.1.e11.
    1. Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv. 2014 Jan 1;65(1):24–32. doi: 10.1176/appi.ps.201300009.
    1. Melville KM, Casey LM, Kavanagh DJ. Dropout from internet-based treatment for psychological disorders. Br J Clin Psychol. 2010 Nov;49(Pt 4):455–71. doi: 10.1348/014466509X472138.
    1. Calear AL, Christensen H, Mackinnon A, Griffiths KM. Adherence to the MoodGYM program: outcomes and predictors for an adolescent school-based population. J Affect Disord. 2013 May;147(1-3):338–44. doi: 10.1016/j.jad.2012.11.036.

Source: PubMed

Подписаться