The development and validation of a prognostic model to PREDICT Relapse of depression in adult patients in primary care: protocol for the PREDICTR study

Andrew S Moriarty, Lewis W Paton, Kym I E Snell, Richard D Riley, Joshua E J Buckman, Simon Gilbody, Carolyn A Chew-Graham, Shehzad Ali, Stephen Pilling, Nick Meader, Bob Phillips, Peter A Coventry, Jaime Delgadillo, David A Richards, Chris Salisbury, Dean McMillan, Andrew S Moriarty, Lewis W Paton, Kym I E Snell, Richard D Riley, Joshua E J Buckman, Simon Gilbody, Carolyn A Chew-Graham, Shehzad Ali, Stephen Pilling, Nick Meader, Bob Phillips, Peter A Coventry, Jaime Delgadillo, David A Richards, Chris Salisbury, Dean McMillan

Abstract

Background: Most patients who present with depression are treated in primary care by general practitioners (GPs). Relapse of depression is common (at least 50% of patients treated for depression will relapse after a single episode) and leads to considerable morbidity and decreased quality of life for patients. The majority of patients will relapse within 6 months, and those with a history of relapse are more likely to relapse in the future than those with no such history. GPs see a largely undifferentiated case-mix of patients, and once patients with depression reach remission, there is limited guidance to help GPs stratify patients according to risk of relapse. We aim to develop a prognostic model to predict an individual's risk of relapse within 6-8 months of entering remission. The long-term objective is to inform the clinical management of depression after the acute phase.

Methods: We will develop a prognostic model using secondary analysis of individual participant data drawn from seven RCTs and one longitudinal cohort study in primary or community care settings. We will use logistic regression to predict the outcome of relapse of depression within 6-8 months. We plan to include the following established relapse predictors in the model: residual depressive symptoms, number of previous depressive episodes, co-morbid anxiety and severity of index episode. We will use a "full model" development approach, including all available predictors. Performance statistics (optimism-adjusted C-statistic, calibration-in-the-large, calibration slope) and calibration plots (with smoothed calibration curves) will be calculated. Generalisability of predictive performance will be assessed through internal-external cross-validation. Clinical utility will be explored through net benefit analysis.

Discussion: We will derive a statistical model to predict relapse of depression in remitted depressed patients in primary care. Assuming the model has sufficient predictive performance, we outline the next steps including independent external validation and further assessment of clinical utility and impact.

Study registration: ClinicalTrials.gov ID: NCT04666662.

Keywords: Depression; Predictive model; Prognosis; Prognostic model; Recurrence; Relapse.

Conflict of interest statement

The authors declare that they have no competing interests.

References

    1. Geneva: World Health Organization . Depression and Other common mental disorders: global health estimates. Geneva: World Health Organization; 2017.
    1. Rait G, Walters K, Griffin M, Buszewicz M, Petersen I, Nazareth I. Recent trends in the incidence of recorded depression in primary care. Br J Psychiatry. 2009;195(6):520–524. doi: 10.1192/bjp.bp.108.058636.
    1. Ali S, Rhodes L, Moreea O, McMillan D, Gilbody S, Leach C, Lucock M, Lutz W, Delgadillo J. How durable is the effect of low intensity CBT for depression and anxiety? Remission and relapse in a longitudinal cohort study. Behav Res Ther. 2017;94:1–8. doi: 10.1016/j.brat.2017.04.006.
    1. Frank E, Prien RF, Jarrett RB, Keller MB, Kupfer DJ, Lavori PW, et al. Conceptualization and rationale for consensus definitions of terms in major depressive disorder: remission, recovery, relapse, and recurrence. JAMA Psychiatry. 1991;48(9):851–855.
    1. Bockting CL, Hollon SD, Jarrett RB, Kuyken W, Dobson K. A lifetime approach to major depressive disorder: the contributions of psychological interventions in preventing relapse and recurrence. Clin Psychol Rev. 2015;41:16–26. doi: 10.1016/j.cpr.2015.02.003.
    1. Rush AJ, Kraemer HC, Sackeim HA, Fava M, Trivedi MH, Frank E, Ninan PT, Thase ME, Gelenberg AJ, Kupfer DJ, Regier DA, Rosenbaum JF, Ray O, Schatzberg AF, ACNP Task Force Report by the ACNP Task Force on response and remission in major depressive disorder. Neuropsychopharmacology. 2006;31(9):1841–1853. doi: 10.1038/sj.npp.1301131.
    1. Riso LP, Thase ME, Howland RH, Friedman ES, Simons AD, Tu XM. A prospective test of criteria for response, remission, relapse, recovery, and recurrence in depressed patients treated with cognitive behavior therapy. J Affect Disord. 1997;43(2):131–142. doi: 10.1016/S0165-0327(96)01420-6.
    1. Kendler KS, Thornton LM, Gardner CO. Stressful life events and previous episodes in the etiology of major depression in women: an evaluation of the “kindling” hypothesis. Am J Psychiatry. 2000;157(8):1243–1251. doi: 10.1176/appi.ajp.157.8.1243.
    1. Kessler RC, Nelson CB, McGonagle KA, Liu J, Swartz M, Blazer DG. Comorbidity of DSM–III–R major depressive disorder in the general population: results from the US National Comorbidity Survey. Br J Psychiatry. 1996;168(S30):17–30. doi: 10.1192/S0007125000298371.
    1. Burcusa SL, Iacono WG. Risk for recurrence in depression. Clin Psychol Rev. 2007;27(8):959–985. doi: 10.1016/j.cpr.2007.02.005.
    1. Solomon DA, Keller MB, Leon AC, Mueller TI, Lavori PW, Shea MT, et al. Multiple recurrences of major depressive disorder. Am J Psychiatry. 2000;157(2):229–233. doi: 10.1176/appi.ajp.157.2.229.
    1. Royston P, Moons KGM, Altman DG, Vergouwe Y. Prognosis and prognostic research: Developing a prognostic model. BMJ. 2009;338(mar31 1):b604. doi: 10.1136/bmj.b604.
    1. Klein NS, Holtman GA, Bockting CLH, Heymans MW, Burger H. Development and validation of a clinical prediction tool to estimate the individual risk of depressive relapse or recurrence in individuals with recurrent depression. J Psychiatr Res. 2018;104:1–7. doi: 10.1016/j.jpsychires.2018.06.006.
    1. van Loo HM, Aggen SH, Gardner CO, Kendler KS. Multiple risk factors predict recurrence of major depressive disorder in women. J Affect Disord. 2015;180:52–61. doi: 10.1016/j.jad.2015.03.045.
    1. Van Loo HM, Aggen SH, Gardner CO, Kendler KS. Sex similarities and differences in risk factors for recurrence of major depression. Psychol Med. 2018;48(10):1685–1693. doi: 10.1017/S0033291717003178.
    1. van Loo HM, Bigdeli TB, Milaneschi Y, Aggen SH, Kendler KS. Data mining algorithm predicts a range of adverse outcomes in major depression. J Affect Disord. 2020;276:945–953. doi: 10.1016/j.jad.2020.07.098.
    1. Wang JL, Patten S, Sareen J, Bolton J, Schmitz N, MacQueen G. Development and validation of a prediction algorithm for use by health professionals in prediction of recurrence of major depression. Depress Anxiety. 2014;31(5):451–457. doi: 10.1002/da.22215.
    1. Moriarty AS, Meader N, Snell KIE, Riley RD, Paton LW, Chew-Graham CA, Gilbody S, Churchill R, Phillips RS, Ali S, McMillan D. Prognostic models for predicting relapse or recurrence of major depressive disorder in adults. Cochrane Database of Systematic Reviews 2021, Issue 5. Art. No.: CD013491. DOI: 10.1002/14651858.CD013491.pub2.
    1. Riley RD, van der Windt D, P C, Moons K. Prognosis research in healthcare: concepts, methods, and impact. Oxford: 1st. Oxford University Press; 2019. pp 139–187.
    1. Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating. 2nd ed. Switzerland: Springer Nature; 2019. 10.1007/978-3-030-16399-0.
    1. Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, Vickers AJ, Ransohoff DF, Collins GS. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162(1):W1–73. doi: 10.7326/M14-0698.
    1. Stewart LA, Clarke M, Rovers M, Riley RD, Simmonds M, Stewart G, Tierney JF, PRISMA-IPD Development Group Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. JAMA J Am Med Assoc. 2015;313(16):1657–1665. doi: 10.1001/jama.2015.3656.
    1. Pajouheshnia R, Groenwold RHH, Peelen LM, Reitsma JB, Moons KGM. When and how to use data from randomised trials to develop or validate prognostic models. BMJ. 2019;2154.
    1. Bosanquet K, Adamson J, Atherton K, Bailey D, Baxter C, Beresford-Dent J, Birtwistle J, Chew-Graham C, Clare E, Delgadillo J, Ekers D, Foster D, Gabe R, Gascoyne S, Haley L, Hamilton J, Hargate R, Hewitt C, Holmes J, Keding A, Lewis H, McMillan D, Meer S, Mitchell N, Nutbrown S, Overend K, Parrott S, Pervin J, Richards DA, Spilsbury K, Torgerson D, Traviss-Turner G, Trépel D, Woodhouse R, Gilbody S. Collaborative care for screen-positive elders with major depression (CASPER plus): a multicentred randomized controlled trial of clinical effectiveness and cost-effectiveness. Health Technol Assess (Rockv) 2017;21(67):1–251. doi: 10.3310/hta21670.
    1. Gilbody S, Littlewood E, Hewitt C, Brierley G, Tharmanathan P, Araya R, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ. 2015;351:1–13.
    1. Gilbody S, Brabyn S, Lovell K, Kessler D, Devlin T, Smith L, Araya R, Barkham M, Bower P, Cooper C, Knowles S, Littlewood E, Richards DA, Tallon D, White D, Worthy G, on behalf of the REEACT collaborative Telephone-supported computerised cognitive-behavioural therapy: REEACT-2 large-scale pragmatic randomised controlled trial. Br J Psychiatry. 2017;210(5):362–367. doi: 10.1192/bjp.bp.116.192435.
    1. Coventry P, Lovell K, Dickens C, Bower P, Chew-Graham C, McElvenny D, et al. Integrated primary care for patients with mental and physical multimorbidity: cluster randomised controlled trial of collaborative care for patients with depression comorbid with diabetes or cardiovascular disease. BMJ. 2015;350:1–11. doi: 10.1136/bmj.h1.
    1. Buckman JEJ, Saunders R, Cohen ZD, Clarke K, Ambler G, Derubeis RJ, et al. What factors indicate prognosis for adults with depression in primary care? A protocol for meta-analyses of individual patient data using the dep-gp database. Wellcome Open Res. 2020;4:1–20. doi: 10.12688/wellcomeopenres.15225.3.
    1. Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren FC, Barrett B, Farrand PA, Gilbody S, Kuyken W, O'Mahen H, Watkins ER, Wright KA, Hollon SD, Reed N, Rhodes S, Fletcher E, Finning K. Cost and Outcome of Behavioural Activation versus Cognitive Behavioural Therapy for Depression (COBRA): a randomised, controlled, non-inferiority trial. Lancet. 2016;388(10047):871–880. doi: 10.1016/S0140-6736(16)31140-0.
    1. Richards DA, Hill JJ, Gask L, Lovell K, Chew-Graham C, Bower P, et al. Clinical effectiveness of collaborative care for depression in UK primary care (CADET): cluster randomised controlled trial. BMJ. 2013;347(f4913). .
    1. Salisbury C, O’Cathain A, Edwards L, Thomas C, Gaunt D, Hollinghurst S, et al. Effectiveness of an integrated telehealth service for patients with depression: a pragmatic randomised controlled trial of a complex intervention. Lancet Psychiatry. 2016;3(6):515–525. doi: 10.1016/S2215-0366(16)00083-3.
    1. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x.
    1. McMillan D, Gilbody S, Richards D. Defining successful treatment outcome in depression using the PHQ-9: a comparison of methods. J Affect Disord. 2010;127(1–3):122–129. doi: 10.1016/j.jad.2010.04.030.
    1. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12–19. doi: 10.1037/0022-006X.59.1.12.
    1. Beshai S, Dobson KS, Bockting CLH, Quigley L. Relapse and recurrence prevention in depression: current research and future prospects. Clin Psychol Rev. 2011;31(8):1349–1360. doi: 10.1016/j.cpr.2011.09.003.
    1. Fusar-Poli P, Hijazi Z, Stahl D, Steyerberg EW. The science of prognosis in psychiatry: a review. JAMA Psychiatry. 2018;75(12):1280–1288. doi: 10.1001/jamapsychiatry.2018.2377.
    1. Buckman JEJ, Underwood A, Clarke K, Saunders R, Hollon SD, Fearon P, Pilling S. Risk factors for relapse and recurrence of depression in adults and how they operate: a four-phase systematic review and meta-synthesis. Clin Psychol Rev. 2018;64:13–38. doi: 10.1016/j.cpr.2018.07.005.
    1. Wojnarowski C, Firth N, Finegan M, Delgadillo J. Predictors of depression relapse and recurrence after cognitive behavioural therapy: a systematic review and meta-analysis. Behav Cogn Psychother. 2019;47(5):514–529. doi: 10.1017/S1352465819000080.
    1. Kessler RC. The potential of predictive analytics to provide clinical decision support in depression treatment planning. Curr Opin Psychiatry. 2018;31(1):32–39. doi: 10.1097/YCO.0000000000000377.
    1. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092.
    1. Groenwold RHH, Moons KGM, Pajouheshnia R, Altman DG, Collins GS, Debray TPA, Reitsma JB, Riley RD, Peelen LM. Explicit inclusion of treatment in prognostic modeling was recommended in observational and randomized settings. J Clin Epidemiol. 2016;78:90–100. doi: 10.1016/j.jclinepi.2016.03.017.
    1. Pajouheshnia R, Peelen LM, Moons KGM, Reitsma JB, Groenwold RHH. Accounting for treatment use when validating a prognostic model: a simulation study. BMC Med Res Methodol. 2017;17(1):1–12. doi: 10.1186/s12874-017-0375-8.
    1. Burcusa SL, Iacono WG. Risk for recurrence in depression. Clin Psychol Rev. 2007;27(8):959–85.
    1. Wojnarowski C, Firth N, Finegan M, Delgadillo J. Predictors of depression relapse and recurrence after cognitive behavioural therapy: a systematic review and meta-analysis. Behav Cogn Psychother. 2019;47(5):514–29.
    1. LorimerB, Delgadillo J, Kellett S, Lawrence J. Dynamic prediction and identification of cases at risk of relapse following completion of low-intensity cognitive behavioural therapy. Psychother Res. 2021;31(1):19–32.
    1. Wang JL, Patten S, Sareen J, Bolton J, Schmitz N, MacQueen G. Development and validation of a prediction algorithm for use by health professionals in prediction of recurrence of major depression. Depression and Anxiety. 2014;31(5):451–7.
    1. Johansson O, Lundh LG, Bjärehed J. Twelve-month outcome and predictors of recurrence in psychiatric treatment of depression: a retrospective s. Psychiatr Q. 2015;86(3):407–17.
    1. National Institute for Health and Care Excellence. Multimorbidity: clinical assessment and management. 2016.
    1. Kok GD, Bockting CLH, Burger H, Hannig W, Pijnenborg GHM, Cuijpers P, Hollon SD, Laks J. Double trouble: does co-morbid chronic somatic illness increase risk for recurrence in depression? A systematic review. PLoS ONE. 2013;8(3):e57510.
    1. Van Smeden M, De Groot JAH, Moons KGM, Collins GS, Altman DG, Eijkemans MJC, et al. No rationale for 1 variable per 10 events criterion for binary logistic regression analysis. BMC Med Res Methodol. 2016;16(1):1–12. doi: 10.1186/s12874-015-0105-z.
    1. Riley RD, Ensor J, Snell KIE, Harrell FE, Martin GP, Reitsma JB, et al. Calculating the sample size required for developing a clinical prediction model. BMJ. 2020;18:m441. doi: 10.1136/bmj.m441.
    1. Riley RD, Snell KIE, Ensor J, Burke DL, Harrell FE, Moons KGM, et al. Minimum sample size for developing a multivariable prediction model: PART II - binary and time-to-event outcomes. Stat Med. 2018:1–21.
    1. Hughes RA, Heron J, Sterne JAC, Tilling K. Accounting for missing data in statistical analyses: multiple imputation is not always the answer. Int J Epidemiol. 2019;16. 1294-1304.
    1. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–399. doi: 10.1002/sim.4067.
    1. Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, Reitsma JB, Kleijnen J, Mallett S. PROBAST: A tool to assess risk of bias and applicability of prediction model studies: explanation and elaboration. Ann Intern Med. 2019;170(1):W1–33. doi: 10.7326/M18-1377.
    1. Harrell FE Jr. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. In: eBook. Statistical Methods in Medical Research, vol. 13. Switzerland: Springer International Publishing; 2015.
    1. Binder H, Sauerbrei W, Royston P. Comparison between splines and fractional polynomials for multivariable model building with continuous covariates: a simulation study with continuous response. Stat Med. 2013;32(13):2262–2277. doi: 10.1002/sim.5639.
    1. van Houwelingen HC, Sauerbrei W. Cross-validation, shrinkage and variable selection in linear regression revisited. Open J Stat. 2013;03(02):79–102.
    1. Vergouwe Y, RoystonP, Moons KGM, Altman DG. Development and validation of a prediction model with missing predictor data: a practical approach. J Clin Epidemiol. 2010;63(2):205–14.
    1. Vickers AJ, Van Calster B, Steyerberg EW. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ. 2016;352:3–7.
    1. Royston P, Parmar MKB, Sylvester R. Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. Stat Med. 2004;23(6):907–926. doi: 10.1002/sim.1691.
    1. Steyerberg EW, Harrell FE. Prediction models need appropriate internal, internal-external, and external validation. J Clin Epidemiol. 2016;69:245–247. doi: 10.1016/j.jclinepi.2015.04.005.
    1. Hingorani AD, Van Der Windt DA, Riley RD, Abrams K, Moons KGM, Steyerberg EW, et al. Prognosis research strategy (PROGRESS) 4: stratified medicine research. BMJ. 2013;346:1–9. doi: 10.1136/bmj.e5793.
    1. Cuijpers P. Expert Review of Neurotherapeutics Measuring success in the treatment of depression : what is most important to patients ? Measuring success in the treatment of depression : what is most important to. Expert Rev Neurother [Internet]. 2020;00(00):1–3.
    1. Moriarty AS, Gilbody S, McMillan D, Manea L. Screening and case finding for major depressive disorder using the Patient Health Questionnaire (PHQ-9): a meta-analysis. Gen Hosp Psychiatry. 2015;37(6):567–576. doi: 10.1016/j.genhosppsych.2015.06.012.
    1. Berlanga C, Heinze G, Torres M, Apiquián R, Caballero A. Personality and clinical predictors of recurrence of depression. Psychiatr Serv. 1999;50(3):376–380. doi: 10.1176/ps.50.3.376.

Source: PubMed

Sponsorzy i współpracownicy

Warunki medyczne

Interwencje lekowe

3
Subskrybuj