Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders

Charlotte L Hall, Susan Brown, Marilyn James, Jennifer L Martin, Nikki Brown, Kim Selby, Julie Clarke, Laura Williams, Kapil Sayal, Chris Hollis, Madeleine J Groom, Charlotte L Hall, Susan Brown, Marilyn James, Jennifer L Martin, Nikki Brown, Kim Selby, Julie Clarke, Laura Williams, Kapil Sayal, Chris Hollis, Madeleine J Groom

Abstract

Background: The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful change, and non-adherence to the protocol. For clinical RCTs, involving patients and clinicians in protocol design provides the opportunity to develop research protocols that are meaningful to their target audience and may help overcome some of the inherent threats in conducting RCTs. However, the majority of protocols do not describe the methodology underpinning their development, limiting the amount of learned experience shared between research groups.

Method: With the purpose of reporting a collaborative approach towards developing a protocol, we present the findings from three sequential workshops that were conducted with the aim of developing a protocol to investigate the feasibility of adding a computerised test of attention, impulsivity and activity (QbTest) to medication management of children and young people with Attention deficit hyperactivity disorder (ADHD). Based on previous qualitative interviews with clinicians and families, each workshop prioritised topics for focused discussion. Information from the workshops was fed back to the participants for reflection in advance of the next workshop.

Results: The workshops involved 21 multi-disciplinary ADHD experts, including clinicians, patient and public involvement (PPI) members, parents of young people with ADHD and researchers. The consensus workshops addressed key research issues such as: the most relevant outcome measures/ resource drivers; methods and time points for data collection; and the clinical protocol for utilising the QbTest, including when best to use this within the medication management process. The resulting protocol details a feasibility RCT design describing these factors.

Conclusion: Protocols which are co-developed may help overcome some of the risks associated with RCT completion (e.g. recruitment, retention, protocol adherence) and help prioritise outcomes of greater relevance to the populations under study. The methodology has potential value for researchers and organisations developing clinical guidelines, and offers insights into the valuable impact of PPI upon trial design.

Trial registration: Clinicaltrials.gov NCT03368573, 11th December 2017 (retrospectively registered).

Keywords: Expert workshop; Management; Medication; Patient and public involvement; Protocol development; QbTest; Titration.

Conflict of interest statement

On behalf of all authors, the corresponding author declares no conflicts of interests.

Figures

Fig. 1
Fig. 1
Study Flow

References

    1. Tetzlaff JM, Moher D, Chan A-W. Developing a guideline for clinical trial protocol content: Delphi consensus survey. Trials. 2012;13:176. doi: 10.1186/1745-6215-13-176.
    1. Group E-BMW Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992;268:2420. doi: 10.1001/jama.1992.03490170092032.
    1. Grossman J, Mackenzie FJ. The randomized controlled trial: gold standard, or merely standard? Perspect Biol Med. 2005;48:516–534. doi: 10.1353/pbm.2005.0092.
    1. Fogg L, Gross D. Focus on research methods-threats to validity in randomized clinical trials. Res Nurs Health. 2000;23:79–87. doi: 10.1002/(SICI)1098-240X(200002)23:1<79::AID-NUR9>;2-R.
    1. Neugebauer EA, Rath A, Antoine S-L, Eikermann M, Seidel D, Koenen C, Jacobs E, Pieper D, Laville M, Pitel S. Specific barriers to the conduct of randomised clinical trials on medical devices. Trials. 2017;18:427. doi: 10.1186/s13063-017-2168-0.
    1. NICE. Patient and Public Involvement Policy.. Accessed 23 Mar 2018.
    1. Involve. Briefing notes for researchers: involving the public in NHS, public health and social care research. . Accessed 12 Mar 2018.
    1. Brett J, Staniszewska S, Mockford C, Seers K, Herron-Marx S, Bayliss H: The PIRICOM Study: A systematic review of the conceptualisation, measurement, impact and outcomes of patients and public involvement in health and social care research. 2010. Warwick: University of Warwick, .
    1. Wilson Patricia, Mathie Elspeth, Keenan Julia, McNeilly Elaine, Goodman Claire, Howe Amanda, Poland Fiona, Staniszewska Sophie, Kendall Sally, Munday Diane, Cowe Marion, Peckham Stephen. ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study. Health Services and Delivery Research. 2015;3(38):1–176. doi: 10.3310/hsdr03380.
    1. Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, Altman D, Moher D, Barber R, Denegri S. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Research Involvement and Engagement. 2017;3:13. doi: 10.1186/s40900-017-0062-2.
    1. Popay J, Collins M, Group wtPS: The public involvement impact assessment framework guidance. Universities of Lancaster, Liverpool and Exeter; 2014. . Accessed 18 Mar 2018.
    1. Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, Dickersin K, Hróbjartsson A, Schulz KF, Parulekar WR. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586. doi: 10.1136/bmj.e7586.
    1. Hall CL, James M, Brown S, Martin JL, Brown N, Selby K, Clarke J, Vijayan H, Guo B, Sayal K. Protocol investigating the clinical utility of an objective measure of attention, impulsivity and activity (QbTest) for optimising medication management in children and young people with ADHD ‘QbTest utility for Optimising treatment in ADHD’(QUOTA): a feasibility randomised controlled trial. BMJ Open. 2018;8:e021104. doi: 10.1136/bmjopen-2017-021104.
    1. NICE: Attention deficit hyperactivity disorder:diagnosis and managment of ADHD in children, young people and adults. Clinical Guideline 72. In. London: National Institute for Health and Clinical Excellence 2008.
    1. Kovshoff H, Williams S, Vrijens M, Danckaerts M, Thompson M, Yardley L, Hodgkins P, Sonuga-Barke EJ. The decisions regarding ADHD management (DRAMa) study: uncertainties and complexities in assessment, diagnosis and treatment, from the clinician’s point of view. Eur Child Adolesc Psychiatry. 2012;21:87–99. doi: 10.1007/s00787-011-0235-8.
    1. Hall CL, Taylor JA, Newell K, Baldwin L, Sayal K, Hollis C. The challenges of implementing ADHD clinical guidelines and research best evidence in routine clinical care settings: Delphi survey and mixed-methods study. Br J Psychiatry Open. 2016;2:25–31. doi: 10.1192/bjpo.bp.115.002386.
    1. Hall CL, Selby K, Guo B, Valentine AZ, Walker GM, Hollis C. Innovations in practice: an objective measure of attention, impulsivity and activity reduces time to confirm attention deficit/hyperactivity disorder diagnosis in children–a completed audit cycle. Child Adolesc Mental Health. 2016;21(3):175–178. doi: 10.1111/camh.12140.
    1. Hall CL, Valentine AZ, Groom MJ, Walker GM, Sayal K, Daley D, Hollis C. The clinical utility of the continuous performance test and objective measures of activity for diagnosing and monitoring ADHD in children: a systematic review. Eur Child Adolesc Psychiatry. 2016;25:677–699. doi: 10.1007/s00787-015-0798-x.
    1. Hall CL, Valentine AZ, Walker GM, Ball HM, Cogger H, Daley D, Groom MJ, Sayal K, Hollis C. Study of user experience of an objective test (QbTest) to aid ADHD assessment and medication management: a multi-methods approach. BMC Psychiatry. 2017;17:66. doi: 10.1186/s12888-017-1222-5.
    1. Hall CL, Walker GM, Valentine AZ, Guo B, Kaylor-Hughes C, James M, Daley D, Sayal K, Hollis C. Protocol investigating the clinical utility of an objective measure of activity and attention (QbTest) on diagnostic and treatment decision-making in children and young people with ADHD—‘assessing QbTest utility in ADHD’(AQUA): a randomised controlled trial. BMJ Open. 2014;4:e006838. doi: 10.1136/bmjopen-2014-006838.
    1. Hollis Chris, Hall Charlotte L., Guo Boliang, James Marilyn, Boadu Janet, Groom Madeleine J., Brown Nikki, Kaylor‐Hughes Catherine, Moldavsky Maria, Valentine Althea Z., Walker Gemma M., Daley David, Sayal Kapil, Morriss Richard, Curran Sarah, Clarke Julie, Holsgrove Samina, Jennings Teresa, Kulkarni Neeta, Moldavsky Maria, Nathan Dilip, Skarstam Anne‐Marie, Selby Kim, Vijayan Hena, Williams Adrian. The impact of a computerised test of attention and activity (QbTest) on diagnostic decision‐making in children and young people with suspected attention deficit hyperactivity disorder: single‐blind randomised controlled trial. Journal of Child Psychology and Psychiatry. 2018;59(12):1298–1308. doi: 10.1111/jcpp.12921.
    1. Groom MJ, Young Z, Hall CL, Gillott A, Hollis C. The incremental validity of a computerised assessment added to clinical rating scales to differentiate adult ADHD from autism spectrum disorder. Psychiatry Res. 2016;243:168–173. doi: 10.1016/j.psychres.2016.06.042.
    1. Vogt C, Shameli A. Assessments for attention-deficit hyperactivity disorder: use of objective measurements. Psychiatrist. 2011;35:380–383. doi: 10.1192/pb.bp.110.032144.
    1. Vogt C, Williams T. Early identification of stimulant treatment responders, partial responders and non-responders using objective measures in children and adolescents with hyperkinetic disorder. Child Adolesc Mental Health. 2011;16:144–149. doi: 10.1111/j.1475-3588.2010.00593.x.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi: 10.1136/bmj.a1655.
    1. Swanson JM, Kraemer HC, Hinshaw SP, Arnold LE, Conners CK, Abikoff HB, Clevenger W, Davies M, Elliott GR, Greenhill LL. Clinical relevance of the primary findings of the MTA: success rates based on severity of ADHD and ODD symptoms at the end of treatment. J Am Acad Child & Adolesc Psychiatry. 2001;40:168–179. doi: 10.1097/00004583-200102000-00011.
    1. Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997;38:581–586. doi: 10.1111/j.1469-7610.1997.tb01545.x.
    1. Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S. A children's global assessment scale (CGAS) Arch Gen Psychiatry. 1983;40:1228–1231. doi: 10.1001/archpsyc.1983.01790100074010.
    1. Guy W. CGI clinical global impressions. EC-DEU Assessment Manual for Psychopharmacology. 1976:76–338.
    1. Wille N, Badia X, Bonsel G, Burström K, Cavrini G, Devlin N, Egmar A-C, Greiner W, Gusi N, Herdman M. Development of the EQ-5D-Y: a child-friendly version of the EQ-5D. Qual Life Res. 2010;19:875–886. doi: 10.1007/s11136-010-9648-y.
    1. Stevens K: The child health utility 9D (CHU9D). A new, paediatric, preference-based measure of health related quality of life PRO newsletter. 2010, 43:11–12.
    1. Hill P, Taylor E. An auditable protocol for treating attention deficit/hyperactivity disorder. Arch Dis Childhood. 2001;84:404–409. doi: 10.1136/adc.84.5.404.
    1. Beecham J, Knapp M. Costing psychiatric interventions: Gaskell in measuring mental health needs. London: Edited by Thornicroft G; 2001.
    1. Group MC A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 1999;56:1073. doi: 10.1001/archpsyc.56.12.1073.
    1. Vale C, Fitzgibbon J, Hanley B: Public involvement in clinical trials: supplement to the briefing notes for researchers. http://www invo org uk/wpcontent/uploads/2012/04/INVOLVEpublicinvolvementinclinicaltrialsBriefingnotes2012 pdf] 2012. Accessed 18 Mar 2018.
    1. Mann C, Chilcott S, Plumb K, Brooks E, Man M-S. Reporting and appraising the context, process and impact of PPI on contributors, researchers and the trial during a randomised controlled trial - the 3D study. Research Involvement and Engagement. 2018;4(1):15. doi: 10.1186/s40900-018-0098-y.

Source: PubMed

3
Subscribe