Challenges in the design, planning and implementation of trials evaluating group interventions

Katie Biggs, Daniel Hind, Rebecca Gossage-Worrall, Kirsty Sprange, David White, Jessica Wright, Robin Chatters, Katherine Berry, Diana Papaioannou, Mike Bradburn, Stephen J Walters, Cindy Cooper, Katie Biggs, Daniel Hind, Rebecca Gossage-Worrall, Kirsty Sprange, David White, Jessica Wright, Robin Chatters, Katherine Berry, Diana Papaioannou, Mike Bradburn, Stephen J Walters, Cindy Cooper

Abstract

Background: Group interventions are interventions delivered to groups of people rather than to individuals and are used in healthcare for mental health recovery, behaviour change, peer support, self-management and/or health education. Evaluating group interventions in randomised controlled trials (RCTs) presents trialists with a set of practical problems, which are not present in RCTs of one-to-one interventions and which may not be immediately obvious.

Methods: Case-based approach summarising Sheffield trials unit's experience in the design and implementation of five group interventions. We reviewed participant recruitment and attrition, facilitator training and attrition, attendance at the group sessions, group size and fidelity aspects across five RCTs.

Results: Median recruitment across the five trials was 3.2 (range 1.7-21.0) participants per site per month. Group intervention trials involve a delay in starting the intervention for some participants, until sufficient numbers are available to start a group. There was no evidence that the timing of consent, relative to randomisation, affected post-randomisation attrition which was a matter of concern for all trial teams. Group facilitator attrition was common in studies where facilitators were employed by the health system rather than the by the grant holder and led to the early closure of one trial; research sites responded by training 'back-up' and new facilitators. Trials specified that participants had to attend a median of 62.5% (range 16.7%-80%) of sessions, in order to receive a 'therapeutic dose'; a median of 76.7% (range 42.9%-97.8%) received a therapeutic dose. Across the five trials, 75.3% of all sessions went ahead without the pre-specified ideal group size. A variety of methods were used to assess the fidelity of group interventions at a group and individual level across the five trials.

Conclusion: This is the first paper to provide an empirical basis for planning group intervention trials. Investigators should expect delays/difficulties in recruiting groups of the optimal size, plan for both facilitator and participant attrition, and consider how group attendance and group size affects treatment fidelity.

Trial registration: ISRCTN17993825 registered on 11/10/2016, ISRCTN28645428 registered on 11/04/2012, ISRCTN61215213 registered on 11/05/2011, ISRCTN67209155 registered on 22/03/2012, ISRCTN19447796 registered on 20/03/2014.

Keywords: Clinical trials; Group interventions; Implementation; Intervention design; Therapy groups; Treatment fidelity.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Participant demand, supply of facilitators and group delivery graph for PLINY

References

    1. Wright J, Foster A, Cooper C, Sprange K, Walters S, Berry K, et al. Study protocol for a randomised controlled trial assessing the clinical and cost-effectiveness of the Journeying through Dementia (JtD) intervention compared to usual care. BMJ Open. 2019;9:e029207. doi: 10.1136/bmjopen-2019-029207.
    1. Mountain G, Windle G, Hind D, Walters S, Keertharuth A, Chatters R, et al. A preventative lifestyle intervention for older adults (lifestyle matters): a randomised controlled trial. Age Ageing. 2017;46:627–634. doi: 10.1093/ageing/afx021.
    1. Hind D, Mountain G, Gossage-Worrall R, Walters SJ, Duncan R, Newbould L, et al. Putting Life in Years (PLINY): a randomised controlled trial and mixed-methods process evaluation of a telephone friendship intervention to improve mental well-being in independently living older people. Public Heal Res. 2014;2:1–222. doi: 10.3310/phr02070.
    1. Heller S, White D, Lee E, Lawton J, Pollard D, Waugh N, et al. A cluster randomised trial, cost-effectiveness analysis and psychosocial evaluation of insulin pump therapy compared with multiple injections during flexible intensive insulin therapy for type 1 diabetes: The REPOSE Trial. Health Technol Assess (Rockv) 2017;21:1–277. doi: 10.3310/hta21200.
    1. Holt RIG, Gossage-Worrall R, Hind D, Bradburn MJ, McCrone P, Morris T, et al. Structured lifestyle education for people with schizophrenia, schizoaffective disorder and first-episode psychosis (STEPWISE): randomised controlled trial. Br J Psychiatry. 2019;214:63–73. doi: 10.1192/bjp.2018.167.
    1. Yalom ID, Leszcz M. The theroy and practice of group psychotherapy. 5. New York: Basic Books; 2005.
    1. Borek AJ, Abraham C. How do Small Groups Promote Behaviour Change? An Integrative Conceptual Review of Explanatory Mechanisms. Appl Psychol Heal Well Being. 2018;10:30–61. doi: 10.1111/aphw.12120.
    1. Montgomery C. Role of dynamic group therapy in psychiatry. Adv Psychiatr Treat. 2002;8:34–41. doi: 10.1192/apt.8.1.34.
    1. Corsini RJ, Rosenberg B. Mechanisms of group psychotherapy: Processes and dynamics. J Abnorm Soc Psychol. 1955;51:406–411. doi: 10.1037/h0048439.
    1. Borek AJ, Abraham C, Greaves CJ, Gillison F, Tarrant M, Morgan-Trimmer S, et al. Identifying change processes in group-based health behaviour-change interventions: development of the mechanisms of action in group-based interventions (MAGI) framework. Health Psychol Rev. 2019;13:227–247. doi: 10.1080/17437199.2019.1625282.
    1. Hill CE. Is individual therapy process really different from group therapy process? The jury is still out. Couns Psychol. 1990;18:126–130. doi: 10.1177/0011000090181008.
    1. Huebner RA. Group procedures. In: Chan F, Berven NL, Thomas KR, editors. Counseling theories and techniques for rehabilitation health professionals. New York: Springer; 2004. pp. 244–263.
    1. Stead LF, Carroll AJ, Lancaster T. Group behaviour therapy programmes for smoking cessation. Cochrane Database Syst Rev. 2017;3:CD001007. doi: 10.1002/14651858.CD001007.pub3.
    1. Hoddinott P, Chalmers M, Pill R. One-to-One or Group-Based Peer Support for Breastfeeding? Women’s Perceptions of a Breastfeeding Peer Coaching Intervention. Birth. 2006;33:139–146. doi: 10.1111/j.0730-7659.2006.00092.x.
    1. Paul-Ebhohimhen V, Avenell A. A systematic review of the effectiveness of group versus individual treatments for adult obesity. Obes Facts. 2009;2:17–24. doi: 10.1159/000186144.
    1. Renjilian DA, Perri MG, Nezu AM, McKelvey WF, Shermer RL, Anton SD. Individual versus group therapy for obesity: Effects of matching participants to their treatment preferences. J Consult Clin Psychol. 2001;69:717–721. doi: 10.1037/0022-006X.69.4.717.
    1. Deakin TA, McShane CE, Cade JE, Williams R. Group based training for self-management strategies in people with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2005;2:CD003417. doi: 10.1002/14651858.CD003417.pub2.
    1. Fals-Stewart W, Marks A, Schafer J. A Comparison of Behavioral Group Therapy and Individual Behavior Therapy in Treating Obsessive-Compulsive Disorder. J Nerv Ment Dis. 1993;181:189–193. doi: 10.1097/00005053-199303000-00007.
    1. Hoddinott P, Allan K, Avenell A, Britten J. Group interventions to improve health outcomes: A framework for their design and delivery. BMC Public Health. 2010;10:800. doi: 10.1186/1471-2458-10-800.
    1. Broome KM, Flynn PM, Knight DK, Simpson DD. Program structure, staff perceptions, and client engagement in treatment. J Subst Abus Treat. 2007;33:149–158. doi: 10.1016/J.JSAT.2006.12.030.
    1. Bastien CH, Morin CM, Ouellet M-C, Blais FC, Bouchard S. Cognitive-Behavioral Therapy for Insomnia: Comparison of Individual Therapy, Group Therapy, and Telephone Consultations. J Consult Clin Psychol. 2004;72:653–659. doi: 10.1037/0022-006X.72.4.653.
    1. Barrowclough C, Haddock G, Lobban F, Jones S, Siddle R, Roberts C, et al. Group cognitive-behavioural therapy for schizophrenia. Br J Psychiatry. 2006;189:527–532. doi: 10.1192/bjp.bp.106.021386.
    1. Wykes T, Hayward P, Thomas N, Green N, Surguladze S, Fannon D, et al. What are the effects of group cognitive behaviour therapy for voices? A randomised control trial. Schizophr Res. 2005;77:201–210. doi: 10.1016/J.SCHRES.2005.03.013.
    1. Morrison N. Group Cognitive Therapy: Treatment of Choice or Sub-optimal Option? Behav Cogn Psychother. 2001;29:311–332. doi: 10.1017/S1352465801003058.
    1. Whitfield G. Group cognitive–behavioural therapy for anxiety and depression. Adv Psychiatr Treat. 2010;16:219–227. doi: 10.1192/apt.bp.108.005744.
    1. Tasca GA, Mcquaid N, Balfour L. Complex contexts and relationships affect clinical decisions in group therapy. Psychotherapy. 2016;53:314–319. doi: 10.1037/pst0000071.
    1. Tuckman BW. Developmental sequence in small groups. Psychol Bull. 1965;63:384–399. doi: 10.1037/h0022100.
    1. Tuckman BW, Jensen MAC. Stages of Small-Group Development Revisited. Gr Organ Stud. 1977;2:419–427. doi: 10.1177/105960117700200404.
    1. Harris PM. Attrition Revisited. Am J Eval. 1998;19:293–305. doi: 10.1177/109821409801900303.
    1. Erickson RC. Inpatient Small Group Psychotherapy: A Survey. Clin Psychol Rev. 1982;2:137–152. doi: 10.1016/0272-7358(82)90008-3.
    1. Weis J. Support groups for cancer patients. Support Care Cancer. 2003;11:763–768. doi: 10.1007/s00520-003-0536-7.
    1. Thorn BE, Kuhajda MC. Group cognitive therapy for chronic pain. J Clin Psychol. 2006;62:1355–1366. doi: 10.1002/jclp.20315.
    1. Castore GF. Number of verbal interrelationships as a determinant of group size. J Abnorm Soc Psychol. 1962;64:456–458. doi: 10.1037/h0042997.
    1. Slavson SR. Are There “Group Dynamics” in Therapy Groups? Int J Group Psychother. 1957;7:131–154. doi: 10.1080/00207284.1957.11508726.
    1. Cohen SL, Cecil ED, Rice A. Maximising the therapeutic effectiveness of small psychotherapy groups. Group. 1985;9:3–9. doi: 10.1007/BF01458260.
    1. Anderson TI. Small and unfilled psychotherapy groups: Understanding and using them effectively. Group. 1993;17:13–20. doi: 10.1007/BF01419600.
    1. Fulkerson CCF, Hawkins DM, Alden AR. Psychotherapy Groups of Insufficient Size. Int J Group Psychother. 1981;31:73–81. doi: 10.1080/00207284.1981.11492046.
    1. Hollon SD, Shaw BF. Group Cognitive Therapy for Depressed Patients. In: Beck AT, Rush AJ, Shaw BF, Emery G, editors. Cognitive therapy of depression. New York: Guilford Press; 1979. pp. 328–353.
    1. Hare AP. Handbook of small group research. New York: Free Press; London: Collier-Macmillan; 1962. . Accessed 30 Aug 2018.
    1. Bond GR. Positive and negative norm regulation and their relationship to therapy group size. Group. 1984;8:35–44. doi: 10.1007/BF01456557.
    1. Roberts C, Roberts SA. Design and analysis of clinical trials with clustering effects due to treatment. Clin Trials J Soc Clin Trials. 2005;2:152–162. doi: 10.1191/1740774505cn076oa.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: new guidance. London: MRC; 2008.
    1. Borek AJ, Abraham C, Smith JR, Greaves CJ, Tarrant M. A checklist to improve reporting of group-based behaviour-change interventions. BMC Public Health. 2015;15:963. doi: 10.1186/s12889-015-2300-6.
    1. Flyvbjerg B. Curbing Optimism Bias and Strategic Misrepresentation in Planning: Reference Class Forecasting in Practice. Eur Plan Stud. 2008;16:3–21. doi: 10.1080/09654310701747936.
    1. CTRU - Design, Trials & Statistics - Sections - ScHARR - The University of Sheffield. . Accessed 26 Sept 2019.
    1. Rhee H, Ciurzynski SM, Yoos HL. Pearls and Pitfalls of Community-Based Group Interventions for Adolescents: Lessons Learned from an Adolescent Asthma Camp Study. Issues Compr Pediatr Nurs. 2008;31:122–135. doi: 10.1080/01460860802272888.
    1. Cooper CL, Hind D, Duncan R, Walters S, Lartey A, Lee E, et al. A rapid review indicated higher recruitment rates in treatment trials than in prevention trials. J Clin Epidemiol. 2015;68:347–354. doi: 10.1016/j.jclinepi.2014.10.007.
    1. Cohen BJ, Mcgarvey EL, Pinkerton RC, Kryzhanivska L. Willingness and Competence of Depressed and Schizophrenic Inpatients to Consent to Research. 2004.
    1. Siddiqi A-A, Sikorskii A, Given CW, Given B. Early participant attrition from clinical trials: role of trial design and logistics. Clin Trials J Soc Clin Trials. 2008;5:328–335. doi: 10.1177/1740774508094406.
    1. Greenfield SF, Crisafulli MA, Kaufman JS, Freid CM, Bailey GL, Connery HS, et al. Implementing substance abuse group therapy clinical trials in real-world settings: Challenges and strategies for participant recruitment and therapist training in the Women’s Recovery Group Study. Am J Addict. 2014;23:197–204. doi: 10.1111/j.1521-0391.2014.12099.x.
    1. Palmer R, Harrison M, Cross E, Enderby P. Negotiating excess treatment costs in a clinical research trial: the good, the bad and the innovative. Trials. 2016;17:71. doi: 10.1186/s13063-016-1208-5.
    1. Simmons T. Attributing the costs of health and social care Research & Development (AcoRD) London: Department of Health; 2012.
    1. Lenney W, Perry S, Price D. Clinical trials and tribulations: the MASCOT study. Thorax. 2011;66:457–458. doi: 10.1136/thx.2010.156885.
    1. Snooks H, Hutchings H, Seagrove A, Stewart-Brown S, Williams J, Russell I. Bureaucracy stifles medical research in Britain: a tale of three trials. BMC Med Res Methodol. 2012;12:122. doi: 10.1186/1471-2288-12-122.
    1. Mackway-Jones K. Seeking funding for research. Emerg Med J. 2003;20:359–361. doi: 10.1136/emj.20.4.359.
    1. Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be? BMJ. 2004;328:1561–1563. doi: 10.1136/bmj.328.7455.1561.
    1. Linnan L, Steckler A. Process evaluation for public health interventions and research: an overview. In: Linnan L, Steckler A, editors. Process evaluation for public health interventions and research. 1. San Francisco: Jossey-Bass; 2002. pp. 1–23.
    1. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. doi: 10.1136/bmj.h1258.
    1. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8:63. doi: 10.1186/1741-7015-8-63.
    1. Flight L, Allison A, Dimairo M, Lee E, Mandefield L, Walters SJ. Recommendations for the analysis of individually randomised controlled trials with clustering in one arm - A case of continuous outcomes. BMC Med Res Methodol. 2016;16:1–13. doi: 10.1186/s12874-016-0249-5.
    1. Walters SJ. Therapist effects in randomised controlled trials: What to do about them. J Clin Nurs. 2010;19:1102–1112. doi: 10.1111/j.1365-2702.2009.03067.x.
    1. Firth N, Barkham M, Kellett S, Saxon D. Therapist effects and moderators of effectiveness and efficiency in psychological wellbeing practitioners: A multilevel modelling analysis. Behav Res Ther. 2015;69:54–62. doi: 10.1016/J.BRAT.2015.04.001.
    1. Candlish J, Teare MD, Dimairo M, Flight L, Mandefield L, Walters SJ. Appropriate statistical methods for analysing partially nested randomised controlled trials with continuous outcomes: a simulation study. BMC Med Res Methodol. 2018;18:105. doi: 10.1186/s12874-018-0559-x.
    1. Campbell M, Walters S. How to design, analyse and report cluster randomised trials in medicine and health related research. Chichester: Wiley; 2014.
    1. Bernardo J, Nowacki A, Martin R, Fanaroff JM, Hibbs AM. Multiples and parents of multiples prefer same arm randomization of siblings in neonatal trials. J Perinatol. 2014;35:208–213. doi: 10.1038/jp.2014.192.
    1. Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG. Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999;3:iii–i92. doi: 10.3310/hta3050.
    1. Walters SJ, Bonacho dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7:e015276. doi: 10.1136/bmjopen-2016-015276.
    1. Mountain GA, Hind D, Gossage-Worrall R, Walters SJ, Duncan R, Newbould L, et al. “Putting Life in Years” (PLINY) telephone friendship groups research study: pilot randomised controlled trial. Trials. 2014;15:141. doi: 10.1186/1745-6215-15-141.
    1. White D, Hind D. Projection of participant recruitment to primary care research: a qualitative study. Trials. 2015;16:473. doi: 10.1186/s13063-015-1002-9.
    1. Pfadenhauer LM, Mozygemba K, Gerhardus A, Hofmann B, Booth A, Lysdahl KB, et al. Context and implementation: A concept analysis towards conceptual maturity. Z Evid Fortbild Qual Gesundhwes. 2015;109:103–114. doi: 10.1016/j.zefq.2015.01.004.
    1. Spilker B, Cramer JA. Patient Recruitment in Clinical Trials. New York: Raven; 1991. A frame of reference for patient recruitment Issues; pp. 3–23.
    1. Stein REK, Bauman LJ, Ireys HT. Who enrolls in prevention trials? Discordance in perception of risk by professionals and participants. Am J Community Psychol. 1991;19:603–617. doi: 10.1007/BF00937994.
    1. Cassileth BR. Attitudes Toward Clinical Trials Among Patients and the Public. JAMA. 1982;248:968. doi: 10.1001/jama.1982.03330080050028.
    1. Nager AL, Khanna K. Emergency Department Surge: Models and Practical Implications. J Trauma Inj Infect Crit Care. 2009;67(Supplement):S96–S99. doi: 10.1097/TA.0b013e3181ad2aaa.
    1. Vanderby S, Carter MW. An evaluation of the applicability of system dynamics to patient flow modelling. J Oper Res Soc. 2010;61:1572–1581. doi: 10.1057/jors.2009.150.
    1. Watson SK, Rudge JW, Coker R. Health Systems’ “Surge Capacity”: State of the Art and Priorities for Future Research. Milbank Q. 2013;91:78–122. doi: 10.1111/milq.12003.
    1. Schulz KF, Grimes DA. Sample size slippages in randomised trials: Exclusions and the lost and wayward. Lancet. 2002;359:781–785. doi: 10.1016/S0140-6736(02)07882-0.
    1. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999;319:670–674. doi: 10.1136/bmj.319.7211.670.
    1. Hawe P. Lessons from complex interventions to improve health. Annu Rev Public Health. 2015;36:307–323. doi: 10.1146/annurev-publhealth-031912-114421.
    1. Bellg AJ, Resnick B, Minicucci DS, Ogedegbe G, Ernst D, Borrelli B, et al. Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23:443–451. doi: 10.1037/0278-6133.23.5.443.
    1. Holt RIG, Pendlebury J, Wildgust HJ, Bushe CJ. Intentional weight loss in overweight and obese patients with severe mental illness: 8-year experience of a behavioral treatment program. J Clin Psychiatry. 2010;71:800–805. doi: 10.4088/JCP.09m05627gre.
    1. Kealy D, Ogrodniczuk JS, Piper WE, Sierra-Hernandez CA. When it is not a good fit: Clinical errors in patient selection and group composition in group psychotherapy. Psychotherapy. 2016;53:308–313. doi: 10.1037/pst0000069.
    1. Gans JS, Counselman EF. Patient selection for psychodynamic group psychotherapy: practical and dynamic considerations. Int J Group Psychother. 2010;60:197–220. doi: 10.1521/ijgp.2010.60.2.197.
    1. Tudor Smith C, Hopkins C, Sydes MR, Woolfall K, Clarke M, Murray G, et al. How should individual participant data (IPD) from publicly funded clinical trials be shared? BMC Med. 2015;13:298. doi: 10.1186/s12916-015-0532-z.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren