Protocol for the Process Evaluation of the Online Remote Behavioural Intervention for Tics (ORBIT) randomized controlled trial for children and young people

K Khan, C Hollis, C L Hall, E B Davies, D Mataix-Cols, P Andrén, T Murphy, B J Brown, E Murray, C Glazebrook, K Khan, C Hollis, C L Hall, E B Davies, D Mataix-Cols, P Andrén, T Murphy, B J Brown, E Murray, C Glazebrook

Abstract

Background: Process evaluations are an important component in the interpretation and understanding of outcomes in trials. The Online Remote Behavioural Intervention for Tics (ORBIT) study is a randomized controlled trial evaluating the effectiveness of an Internet-delivered behavioural intervention (called BIP TIC) compared to an Internet-delivered education programme aimed at children and young people with tics. A process evaluation will be undertaken alongside the main trial to determine precisely how the behavioural intervention works and ascertain whether, and if so, how, the intervention could be successfully implemented in standard clinical practice. This protocol paper describes the rationale, aims, and methodology of the ORBIT trial process evaluation.

Methods: The process evaluation will have a mixed-methods design following the UK Medical Research Council 2015 guidelines, comprising both quantitative and qualitative data collection. This will include analysing data usage of participants in the intervention arm; purposively sampled, semi-structured interviews of parents and children, therapists and supervisors, and referring clinicians of the ORBIT trial, as well as analysis of qualitative comments put into the online therapy platform by participants at the end of treatment. Qualitative data will be analysed thematically. Quantitative and qualitative data will be integrated in a triangulation approach, to provide an understanding of how the intervention works, and what resources are needed for effective implementation, uptake and use in routine clinical care.

Discussion: This process evaluation will explore the experiences of participants, therapists and supervisors and referring clinicians of a complex online intervention. By contextualising trial efficacy results, this will help understand how and if the intervention worked and what may be required to sustain the implementation of the treatment long term. The findings will also aid in our understanding of factors that can affect the success of complex interventions. This will enable future researchers developing online behavioural interventions for children and young people with mental health and neurological disorders to gain invaluable information from this process evaluation.

Trial registration: International Standard Randomised Controlled Trials Number, ISRCTN70758207. Registered on 20 March 2018. ClinicalTrials.gov, NCT03483493. Registered on 30 March 2018.

Keywords: Children and young people; Complex intervention; Mixed methods; Process evaluation; Protocol; Randomized controlled trial; Tics; Tourette’s.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Schedule of ORBIT and process evaluation procedures. *t1, mid-treatment (3 weeks); t2, mid-treatment (5 weeks); t3, primary end point (3 months); t4, 6 months; t5, 12 months; t6, 18 months; YGTSS, Yale Global Tic Severity Scale; TTSS, Total Tic Severity Score; ERP, exposure and response prevention

References

    1. Fairburn Christopher G., Patel Vikram. The impact of digital technology on psychological treatments and their dissemination. Behaviour Research and Therapy. 2017;88:19–25. doi: 10.1016/j.brat.2016.08.012.
    1. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602. doi: 10.1001/archpsyc.62.6.593.
    1. McGorry PD, Jorm AF. Investing in youth mental health is a best buy. Med J Aust. 2007;187(7):S5–7.
    1. Gibb SJ, Fergusson DM, Horwood LJ. Burden of psychiatric disorder in young adulthood and life outcomes at age 30. Br J Psychiatry. 2010;197(2):122–127. doi: 10.1192/bjp.bp.109.076570.
    1. Sanci L, Lewis D, Patton G. Detecting emotional disorder in young people in primary care. Curr Opin Psychiatry. 2010;23(4):318–323. doi: 10.1097/YCO.0b013e32833aac38.
    1. Cuenca J, Glazebrook C, Kendall T, Hedderly T, Heyman I, Jackson G, et al. Perceptions of treatment for tics among young people with Tourette syndrome and their parents: a mixed methods study. BMC Psychiatry. 2015;15:46. doi: 10.1186/s12888-015-0430-0.
    1. Excellence NI for H and C . Depression in children and young people. Identification and management in primary, community and secondary care. Clinical Guideline, 28. London: National Institute for Health and Clinical Excellence; 2015.
    1. Gega L, Marks I, Mataix-Cols D. Computer-aided CBT self-help for anxiety and depressive disorders: experience of a London clinic and future directions. J Clin Psychol. 2004;60(2):147–157. doi: 10.1002/jclp.10241.
    1. Rice SM, Goodall J, Hetrick SE, Parker AG, Gilbertson T, Amminger GP, et al. Online and social networking interventions for the treatment of depression in young people: a systematic review. J Med Internet Res. 2014;16(9):e206. doi: 10.2196/jmir.3304.
    1. Conaughton Rebecca J., Donovan Caroline L., March Sonja. Efficacy of an internet-based CBT program for children with comorbid High Functioning Autism Spectrum Disorder and anxiety: A randomised controlled trial. Journal of Affective Disorders. 2017;218:260–268. doi: 10.1016/j.jad.2017.04.032.
    1. Ricketts Emily J, Goetz Amy R, Capriotti Matthew R, Bauer Christopher C, Brei Natalie G, Himle Michael B, Espil Flint M, Snorrason Ívar, Ran Dagong, Woods Douglas W. A randomized waitlist-controlled pilot trial of voice over Internet protocol-delivered behavior therapy for youth with chronic tic disorders. Journal of Telemedicine and Telecare. 2015;22(3):153–162. doi: 10.1177/1357633X15593192.
    1. Khan Kareem, Hall Charlotte L, Davies E Bethan, Hollis Chris, Glazebrook Cris. The Effectiveness of Web-Based Interventions Delivered to Children and Young People With Neurodevelopmental Disorders: Systematic Review and Meta-Analysis. Journal of Medical Internet Research. 2019;21(11):e13478. doi: 10.2196/13478.
    1. Fletcher-Watson Sue, Petrou Alexandra, Scott-Barrett Juliet, Dicks Pamela, Graham Catherine, O’Hare Anne, Pain Helen, McConachie Helen. A trial of an iPad™ intervention targeting social communication skills in children with autism. Autism. 2016;20(7):771–782. doi: 10.1177/1362361315605624.
    1. Whitehouse Andrew J.O., Granich Joanna, Alvares Gail, Busacca Margherita, Cooper Matthew N., Dass Alena, Duong Thi, Harper Rajes, Marshall Wendy, Richdale Amanda, Rodwell Tania, Trembath David, Vellanki Pratibha, Moore Dennis W., Anderson Angelika. A randomised controlled trial of an iPad-based application to complement early behavioural intervention in Autism Spectrum Disorder. Journal of Child Psychology and Psychiatry. 2017;58(9):1042–1052. doi: 10.1111/jcpp.12752.
    1. Hawe Penelope, Shiell Alan, Riley Therese. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328(7455):1561–1563. doi: 10.1136/bmj.328.7455.1561.
    1. Oakley Ann, Strange Vicki, Bonell Chris, Allen Elizabeth, Stephenson Judith. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–416. doi: 10.1136/bmj.332.7538.413.
    1. Moore G. F., Audrey S., Barker M., Bond L., Bonell C., Hardeman W., Moore L., O'Cathain A., Tinati T., Wight D., Baird J. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350(mar19 6):h1258–h1258. doi: 10.1136/bmj.h1258.
    1. Grant A, Dreischulte T, Treweek S, Guthrie B. Study protocol of a mixed-methods evaluation of a cluster randomized trial to improve the safety of NSAID and antiplatelet prescribing: data-driven quality improvement in primary care. Trials. 2012;13:154.
    1. Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–102. doi: 10.1136/jech-2013-202869.
    1. Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14(1):15. doi: 10.1186/1745-6215-14-15.
    1. Jong ST, Brown HE, Croxson CHD, Wilkinson P, Corder KL, van Sluijs EMF. GoActive: a protocol for the mixed methods process evaluation of a school-based physical activity promotion programme for 13–14 year old adolescents. Trials. 2018;19(1):282. doi: 10.1186/s13063-018-2661-0.
    1. Mann C, Shaw A, Guthrie B, Wye L, Man M-S, Hollinghurst S, et al. Protocol for a process evaluation of a cluster randomised controlled trial to improve management of multimorbidity in general practice: the 3D study. BMJ Open. 2016;6(5):e011260. doi: 10.1136/bmjopen-2016-011260.
    1. Hall CL, Davies EB, Andrén P, Murphy T, Bennett S, Brown BJ, et al. Investigating a therapist-guided, parent-assisted remote digital behavioural intervention for tics in children and adolescents—‘Online Remote Behavioural Intervention for Tics’ (ORBIT) trial: protocol of an internal pilot study and single-blind randomised. BMJ Open. 2019;9(1):e027583. doi: 10.1136/bmjopen-2018-027583.
    1. Andrén P, Aspvall K, de la Cruz LF, Wiktor P, Romano S, Andersson E, et al. Therapist-guided and parent-guided internet-delivered behaviour therapy for paediatric Tourette’s disorder: a pilot randomised controlled trial with long-term follow-up. BMJ Open. 2019;9(2):e024685. doi: 10.1136/bmjopen-2018-024685.
    1. Verdellen C, van de Griendt J, Hartmann A, Murphy T. European clinical guidelines for Tourette syndrome and other tic disorders. Part III: behavioural and psychosocial interventions. Eur Child Adolesc Psychiatry. 2011;20(4):197–207. doi: 10.1007/s00787-011-0167-3.
    1. Rizzo R, Pellico A, Silvestri PR, Chiarotti F, Cardona F. A randomized controlled trial comparing behavioral, educational, and pharmacological treatments in youths with chronic tic disorder or Tourette syndrome. Front Psychiatry. 2018;9:100. doi: 10.3389/fpsyt.2018.00100.
    1. Hollis C, Pennant M, Cuenca J, Glazebrook C, Kendall T, Whittington C, et al. Clinical effectiveness and patient perspectives of different treatment strategies for tics in children and adolescents with Tourette syndrome: a systematic review and qualitative analysis. Health Technol Assess. 2016;20(4):1–450. doi: 10.3310/hta20040.
    1. Leckman JF, Riddle MA, Hardin MT, Ort SI, Swartz KL, Stevenson J, et al. The Yale Global Tic Severity Scale: initial testing of a clinician-rated scale of tic severity. J Am Acad Child Adolesc Psychiatry. 1989;28(4):566–573. doi: 10.1097/00004583-198907000-00015.
    1. Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krle A-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Rev Panam Salud Publica. 2015;38(6):506–514.
    1. Eysenbach Gunther. CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. Journal of Medical Internet Research. 2011;13(4):e126. doi: 10.2196/jmir.1923.
    1. Partridge SR, Allman-Farinelli M, McGeechan K, Balestracci K, Wong ATY, Hebden L, et al. Process evaluation of TXT2BFiT: a multi-component mHealth randomised controlled trial to prevent weight gain in young adults. Int J Behav Nutr Phys Act. 2016;13(1):7. doi: 10.1186/s12966-016-0329-2.
    1. Young DR, Steckler A, Cohen S, Pratt C, Felton G, Moe SG, et al. Process evaluation results from a school- and community-linked intervention: the Trial of Activity for Adolescent Girls (TAAG) Health Educ Res. 2008;23(6):976–986. doi: 10.1093/her/cyn029.
    1. Dworkin SL. Sample size policy for qualitative studies using in-depth interviews. Arch Sex Behav. 2012;41(6):1319–1320. doi: 10.1007/s10508-012-0016-6.
    1. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8(1 LB-Murray2010):63. doi: 10.1186/1741-7015-8-63.
    1. May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4(1 LB-May2009):29. doi: 10.1186/1748-5908-4-29.
    1. Guy W, National Institute of Mental H . DHEW publication ; no. (ADM) 76–338. Rockville: U.S. Dept. of Health, Education, and Welfare, Public Health Service, Alcohol, Drug Abuse, and Mental Health Administration, National Institute of Mental Health, Psychopharmacology Research Branch, Division of Extramural Research Programs; 1976. ECDEU assessment manual for psychopharmacology; p. 603.
    1. Angold A, Costello E, Messer S, Pickles A, Winder F, Silver D. The Development of a questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res. 1995;5:237–49.
    1. Byford S, Barrett B, Roberts C, Wilkinson P, Dubicka B, Kelvin RG, et al. Cost-effectiveness of selective serotonin reuptake inhibitors and routine specialist care with and without cognitive–behavioural therapy in adolescents with major depression. Br J Psychiatry. 2018;191(6):521–527. doi: 10.1192/bjp.bp.107.038984.
    1. Ltd. QSRIP . NVivo qualitative data analysis software. Version 12. 2018.
    1. Corp. IBM . IBM SPSS Statistics for Windows. Version 25. Armonk: IBM Corp; 2017.
    1. Braun V, Clarke V. Successful qualitative research: a practical guide for beginners: SAGE Publications; 2013. Available from: . Accessed 8 Apr 2019.
    1. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Bryman A, Burgess RG, editors. Analysing qualitative data. London: Routledge; 1994. p. 173–94.
    1. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):117. doi: 10.1186/1471-2288-13-117.
    1. O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341(7783):1147–1150.
    1. O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy. 2008;13(2):92–98. doi: 10.1258/jhsrp.2007.007074.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera