Cognitive Remediation Works But How Should We Provide It? An Adaptive Randomized Controlled Trial of Delivery Methods Using a Patient Nominated Recovery Outcome in First-Episode Participants

Til Wykes, Dominic Stringer, Janette Boadu, Rose Tinch-Taylor, Emese Csipke, Matteo Cella, Andrew Pickles, Paul McCrone, Clare Reeder, Max Birchwood, David Fowler, Kathryn Greenwood, Sonia Johnson, Jesus Perez, Rosa Ritunnano, Andrew Thompson, Rachel Upthegrove, Jon Wilson, Alex Kenny, Iris Isok, Eileen M Joyce, Til Wykes, Dominic Stringer, Janette Boadu, Rose Tinch-Taylor, Emese Csipke, Matteo Cella, Andrew Pickles, Paul McCrone, Clare Reeder, Max Birchwood, David Fowler, Kathryn Greenwood, Sonia Johnson, Jesus Perez, Rosa Ritunnano, Andrew Thompson, Rachel Upthegrove, Jon Wilson, Alex Kenny, Iris Isok, Eileen M Joyce

Abstract

Background and hypothesis: Cognitive remediation (CR) benefits cognition and functioning in psychosis but we do not know the optimal level of therapist contact, so we evaluated the potential benefits of different CR modes.

Study design: A multi-arm, multi-center, single-blinded, adaptive trial of therapist-supported CR. Participants from 11 NHS early intervention psychosis services were independently randomized to Independent, Group, One-to-One, or Treatment-as-usual (TAU). The primary outcome was functional recovery (Goal Attainment Scale [GAS]) at 15-weeks post randomization. Independent and TAU arms were closed after an interim analysis, and three informative contrasts tested (Group vs One-to-One, Independent vs TAU, Group + One-to-One vs TAU). Health economic analyses considered the cost per Quality Adjusted Life Year (QALY). All analyses used intention-to-treat principles.

Study results: We analyzed 377 participants (65 Independent, 134 Group, 112 One-to-One, 66 TAU). GAS did not differ for Group vs One-to-One: Cohen's d: 0.07, -0.25 to 0.40 95% CI, P = .655; Independent vs TAU: Cohen's d: 0.07, -0.41 to 0.55 95% CI, P = .777. GAS and the cognitive score improved for Group + One-to-One vs TAU favoring CR (GAS: Cohen's d: 0.57, 0.19-0.96 95% CI, P = .003; Cognitive score: Cohens d: 0.28, 0.07-0.48 95% CI, P = .008). The QALY costs were £4306 for Group vs TAU and £3170 for One-to-One vs TAU. Adverse events did not differ between treatment methods and no serious adverse events were related to treatment.

Conclusions: Both active therapist methods provided cost-effective treatment benefiting functional recovery in early psychosis and should be adopted within services. Some individuals benefited more than others so needs further investigation.

Trial registration: ISRCTN14678860 https://doi.org/10.1186/ISRCTN14678860Now closed.

Keywords: cognitive training; early intervention; functioning; goal achievement; therapist support.

Conflict of interest statement

Prof Wykes and Dr Reeder developed the cognitive remediation software, CIRCuiTS, used in this study. No other authors have any conflict of interest to report.

Funding/Support: This study is funded by the National Institute for Health Research (NIHR) Programme grant for Applied Research (NIHR-PGfAR RP-PG-0612-20002).

Author contributions: Wykes, Joyce, Pickles, and McCrone had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Wykes, Joyce, Pickles, and McCrone.

Drafting the manuscript: Wykes, Joyce, Pickles, McCrone, Boadu, Stringer, Tinch-Taylor, Cella, and Csipke.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical and health economic analysis: Pickles, Stringer, Tinch-Taylor, McCrone, and Boadu.

Obtained funding: Wykes, Joyce, Pickles, McCrone, Reeder, Birchwood, Fowler, Johnson, and Perez.

Administrative, technical, or material support: KCL CTU.

Supervision: Wykes and Joyce.

Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study, collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Data Sharing Statement: See supplement.

Additional Contributions: We would like to thank all the research assistants and therapists who helped us to recruit and treat participants in this trial. We would also like to acknowledge Tiyi Morris who carried out the interim health economic analysis and Andrew Watson, Tjasa Velikonja and Leena Subramanian who provided coordination at various times. The UK Clinical Research Collaboration-registered King’s Clinical Trials Unit at King’s Health Partners, which is part funded by the NIHR Biomedical Research Centre for Mental Health at South London and Maudsley NHS Foundation Trust and King’s College London and the NIHR Evaluation, Trials and Studies Coordinating Centre supported our randomization. Most importantly, vital support was provided by our Patient Advisory Board and the independent Data Monitoring Committee who both had input into each stage of the study.

© The Author(s) 2023. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center.

Figures

Fig. 1.
Fig. 1.
Consort flow chart.
Fig. 2.
Fig. 2.
Forest plots for primary and secondary results at each of the contrasts for the 3-month post therapy and 6-month follow-up time points.

References

    1. Leeson VC, Harrison I, Ron MA, Barnes TR, Joyce EM.. The effect of cannabis use and cognitive reserve on age at onset and psychosis outcomes in first-episode schizophrenia. Schizophr Bull. 2012;38(4):873–880.
    1. Wykes T, Dunn G.. Cognitive deficit and the prediction of rehabilitation success in a chronic psychiatric group. Psychol Med. 1992;22(2):389–398.
    1. Wykes T, Katz R, Sturt E, Hemsley D.. Abnormalities of response processing in a chronic psychiatric group: a possible predictor of failure in rehabilitation programmes? Br J Psychiatry. 1992;160(2):244–252.
    1. Wykes T. Predicting symptomatic and behavioural outcomes of community care. Br J Psychiatry. 1994;165(4):486–492.
    1. Wykes T, Huddy V, Cellard C, McGurk SR, Czobor P.. A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. Am J Psychiatry. 2011;168(5):472–485.
    1. Grynszpan O, Perbal S, Pelissolo A, et al. . Efficacy and specificity of computer-assisted cognitive remediation in schizophrenia: a meta-analytical study. Psychol Med. 2011;41(1):163–173.
    1. Cella M, Price T, Corboy H, Onwumere J, Shergill S, Preti A.. Cognitive remediation for inpatients with psychosis: a systematic review and meta-analysis. Psychol Med. 2020;50(7):1062–1076.
    1. Kambeitz-Ilankovic L, Betz LT, Dominke C, et al. . Multi-outcome meta-analysis (MOMA) of cognitive remediation in schizophrenia: revisiting the relevance of human coaching and elucidating interplay between multiple outcomes. Neurosci Biobehav Rev. 2019;107:828–845.
    1. Vita A, Barlati S, Ceraso A, et al. . Effectiveness, core elements, and moderators of response of cognitive remediation for schizophrenia: a systematic review and meta-analysis of randomized clinical trials. JAMA Psychiatry. 2021;78(8):848–858.
    1. National Institute for Health and Care Excellence. Rehabilitation for Adults with Complex Psychosis NICE Guideline; 2020. Published online August 19, 2020. . Accessed 1 November, 2022.
    1. Scottish Intercollegiate Guidelines Network. Management of Schizophrenia: A National Clinical Guideline; 2013. . Accessed 1 November, 2022.
    1. American Psychiatric Association. The American Psychiatric Association Practice Guideline for the Treatment of Patients with Schizophrenia; 2020. . Accessed 1 November, 2022.
    1. Ärzteblatt D. Schizophrenia—Clinical Practice Guideline ; 2020. . Accessed 1 November, 2022.
    1. Bowie CR, Bell MD, Fiszdon JM, et al. . Cognitive remediation for schizophrenia: an expert working group white paper on core techniques. Schizophr Res. 2020;215:49–53.
    1. Reeder C, Pile V, Crawford P, et al. . The feasibility and acceptability to service users of CIRCuiTS, a computerized cognitive remediation therapy programme for schizophrenia. Behav Cogn Psychother. 2016;44(3):288–305.
    1. Reeder C, Huddy V, Cella M, et al. . A new generation computerised metacognitive cognitive remediation programme for schizophrenia (CIRCuiTS): a randomised controlled trial. Psychol Med. 2017;47(15):2720–2730.
    1. Drake R, Day C, Picucci R, et al. . A naturalistic, randomized, controlled trial combining cognitive remediation with cognitive-behavioural therapy after first-episode non-affective psychosis. Psychol Med; 2014;44(9):1889–1899.
    1. Rose D, Wykes T, Farrier D, Doran A-M, Sporle T, Bogner D.. What do clients think of cognitive remediation therapy?: a consumer-led investigation of satisfaction and side effects. Am J Psychiatr Rehabil. 2008;11(2):181–204.
    1. Contreras NA, Lee S, Tan EJ, Castle DJ, Rossell SL.. How is cognitive remediation training perceived by people with schizophrenia? A qualitative study examining personal experiences. J Ment Health. 2016;25(3):260–266.
    1. Twamley EW, Thomas KR, Burton CZ, et al. . Compensatory cognitive training for people with severe mental illnesses in supported employment: a randomized controlled trial. Schizophr Res. 2019;203:41–48.
    1. Loewy R, Fisher M, Schlosser D, et al. . Improved cognition and positive symptoms with targeted auditory processing training in recent-onset schizophrenia. Paper presented at: Early Intervention in Psychiatry, 2016.
    1. Donohoe G, Dillon R, Hargreaves A, et al. . Effectiveness of a low support, remotely accessible, cognitive remediation training programme for chronic psychosis: cognitive, functional and cortical outcomes from a single blind randomised controlled trial. Psychol Med. 2018;48(5):751–764.
    1. Cella M, Reeder C, Wykes T.. Group cognitive remediation for schizophrenia: exploring the role of therapist support and metacognition. Psychol Psychother. 2016;89(1):1–14.
    1. Nuechterlein KH, Ventura J, Subotnik KL, et al. . A randomized controlled trial of cognitive remediation and long-acting injectable risperidone after a first episode of schizophrenia: improving cognition and work/school functioning. Psychol Med. 2022;52(8):1517–1526.
    1. Vidarsdottir OG, Roberts DL, Twamley EW, Gudmundsdottir B, Sigurdsson E, Magnusdottir BB.. Integrative cognitive remediation for early psychosis: results from a randomized controlled trial. Psychiatry Res. 2019;273:690–698.
    1. Bellani M, Ricciardi C, Rossetti MG, Zovetti N, Perlini C, Brambilla P.. Cognitive remediation in schizophrenia: the earlier the better? Epidemiol Psychiatr Sci. 2020;29:E57.
    1. Loewy R, Fisher M, Ma S, et al. . Durable cognitive gains and symptom improvement are observed in individuals with recent-onset schizophrenia 6 months after a randomized trial of auditory training completed remotely. Schizophr Bull. 2022;48(1):262–272.
    1. Lejeune JA, Northrop A, Kurtz MM.. A meta-analysis of cognitive remediation for schizophrenia: efficacy and the role of participant and treatment factors. Schizophr Bull. 2021;47(4):997–1006.
    1. Swildens W, van Busschbach JT, Michon H, et al. . Effectively working on rehabilitation goals: 24-month outcome of a randomized controlled trial of the Boston psychiatric rehabilitation approach. Can J Psychiatry. 2011;56(12):751–760.
    1. Sanches SA, Swildens WE, Schaefer B, et al. . Effectiveness of the Boston University approach to psychiatric rehabilitation in improving social participation in people with severe mental illnesses: a randomized controlled trial. Front Psychiatry. 2020;11:571640.
    1. Sheehan DV, Lecrubier Y, Sheehan KH, et al. . The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(20):22–33.
    1. Medalia A, Revheim N.. Computer assisted learning in psychiatric rehabilitation. Psychiatr Rehabil Ski. 1999;3(1):77–98.
    1. Kiresuk TJ, Smith A, Cardillo JE.. Goal Attainment Scaling: Applications, Theory, and Measurement. Hillsdale, NJ, England: Lawrence Erlbaum, Inc.; 1994.
    1. Turner-Stokes L. Goal attainment scaling (GAS) in rehabilitation: a practical guide. Clin Rehabil. 2009;23(4):362–370.
    1. Kiresuk TJ, Sherman RE.. Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J. 1968;4(6):443–453.
    1. Logan B, Jegatheesan D, Viecelli A, Pascoe E, Hubbard R.. Goal attainment scaling as an outcome measure for randomised controlled trials: a scoping review. BMJ Open. 2022;12(7):e063061.
    1. Rockwood K, Joyce B, Stolee P.. Use of goal attainment scaling in measuring clinically important change in cognitive rehabilitation patients. J Clin Epidemiol. 1997;50(5):581–588.
    1. Strawbridge R, Tsapekos D, Hodsoll J, et al. . Cognitive remediation therapy for patients with bipolar disorder: a randomised proof-of-concept trial. Bipolar Disord. 2021;23(2):196–208.
    1. Morosini PL, Magliano L, Brambilla La, Ugolini S, Pioli R.. Development, reliability and acceptability of a new version of the DSM-IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social funtioning. Acta Psychiatr Scand. 2000;101(4):323–329.
    1. Lader D, Short S, Gershuny J.. The Time Use Survey, 2005. London: Office for National Statistics; 2006.
    1. Forbes C, Blanchard JJ, Bennett M, Horan WP, Kring A, Gur R.. Initial development and preliminary validation of a new negative symptom measure: the Clinical Assessment Interview for Negative Symptoms (CAINS). Schizophr Res. 2010;124(1-3):36–42.
    1. Blanchard JJ, Gur RE, Horan WP, Kring AM.. Manual for the Clinical Assessment Interview for Negative Symptoms (CAINS). Berkeley, USA: CANSAS Collaborative Group; 2012.
    1. Barnett JH, Robbins TW, Leeson VC, Sahakian BJ, Joyce EM, Blackwell AD.. Assessing cognitive function in clinical trials of schizophrenia. Neurosci Biobehav Rev. 2010;34(8):1161–1177.
    1. Rosenberg M. Society and the Adolescent Self-Image. Revised edn with a New Introduction. Middletown: Wesleyan University Press; 1989.
    1. Kay, S. R., , Fiszbein, A., , Opler. L. A.. The Positive and Negative Syndrome Scale (PANSS) for Schizophrenia. Schizophrenia Bulletin 2012;13(13):261-276.
    1. NHS Improvement. NHS Improvement. National Cost Collection for the NHS; 2018. . Accessed 29 October, 2019.
    1. Beecham J, Knapp M.. Costing psychiatric intervention. In: Thornicroft G, ed. Measuring Mental Health Needs. London: Gaskell; 2001.
    1. Ennis L, Wykes T.. Impact of patient involvement in mental health research: longitudinal study. Br J Psychiatry. 2013;203(5):381–386.
    1. Patel A, Knapp M, Romeo R, et al. . Cognitive remediation therapy in schizophrenia: cost-effectiveness analysis. Schizophr Res. 2010;120(1-3):217–224.
    1. White IR, Thompson SG.. Adjusting for partially missing baseline measurements in randomized trials. Stat Med. 2005;24(7):993–1007.
    1. Dunn G, Emsley R, Liu H, et al. . Evaluation and validation of social and psychological markers in randomised trials of complex interventions in mental health: a methodological research programme. Health Technol Assess. 2015;19(93):1–115, v-vi.
    1. Van Hout B, Janssen M, Feng Y-S, et al. . Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15(5):708–715.
    1. Manca A, Hawkins N, Sculpher MJ.. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14(5):487–496.
    1. Curtis L, Burns A.. Unit Costs of Health and Social Care 2018. Kent: Personal Social Services Research Unit; 2019.
    1. Gur RE, March M, Calkins ME, et al. . Negative symptoms in youths with psychosis spectrum features: complementary scales in relation to neurocognitive performance and function. Schizophr Res. 2015;166(1-3):322–327.
    1. Nkire N, Scully PJ, Browne DJ, et al. . Systematic comparison of duration of untreated illness versus duration of untreated psychosis in relation to psychopathology and dysfunction in the Cavan-Monaghan first episode psychosis study (CAMFEPS). Eur Neuropsychopharmacol. 2021;47:20–30.
    1. Leeson VC, Robbins TW, Matheson E, et al. . Discrimination learning, reversal, and set-shifting in first-episode schizophrenia: stability over six years and specific associations with medication type and disorganization syndrome. Biol Psychiatry. 2009;66(6):586–593.
    1. Birchwood M, Connor C, Lester H, et al. . Reducing duration of untreated psychosis: care pathways to early intervention in psychosis services. Br J Psychiatry. 2013;203(1):58–64.
    1. Birchwood M, Lester H, McCarthy L, et al. . The UK national evaluation of the development and impact of E arly I ntervention S ervices (the N ational EDEN studies): study rationale, design and baseline characteristics. Early Interv Psychiatry. 2014;8(1):59–67.
    1. Seccomandi B, Agbedjro D, Bell M, et al. . Can IQ moderate the response to cognitive remediation in people with schizophrenia? J Psychiatr Res. 2021;133:38–45.
    1. Leucht S, Samara M, Heres S, Davis JM.. Dose equivalents for antipsychotic drugs: the DDD method. Schizophr Bull. 2016;42(suppl_1):S90–S94.
    1. National Institute for Health and Care Excellence. How NICE Measures Value for Money in Relation to Public Health Interventions; 2013. . Accessed 1 November, 2022.
    1. McGurk SR, Mueser KT, Xie H, et al. . Cognitive enhancement treatment for people with mental illness who do not respond to supported employment: a randomized controlled trial. Am J Psychiatry. 2015;172(9):852–861.

Source: PubMed

3
Subscribe