Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration

Irving Kirsch, Brett J Deacon, Tania B Huedo-Medina, Alan Scoboria, Thomas J Moore, Blair T Johnson, Irving Kirsch, Brett J Deacon, Tania B Huedo-Medina, Alan Scoboria, Thomas J Moore, Blair T Johnson

Abstract

Background: Meta-analyses of antidepressant medications have reported only modest benefits over placebo treatment, and when unpublished trial data are included, the benefit falls below accepted criteria for clinical significance. Yet, the efficacy of the antidepressants may also depend on the severity of initial depression scores. The purpose of this analysis is to establish the relation of baseline severity and antidepressant efficacy using a relevant dataset of published and unpublished clinical trials.

Methods and findings: We obtained data on all clinical trials submitted to the US Food and Drug Administration (FDA) for the licensing of the four new-generation antidepressants for which full datasets were available. We then used meta-analytic techniques to assess linear and quadratic effects of initial severity on improvement scores for drug and placebo groups and on drug-placebo difference scores. Drug-placebo differences increased as a function of initial severity, rising from virtually no difference at moderate levels of initial depression to a relatively small difference for patients with very severe depression, reaching conventional criteria for clinical significance only for patients at the upper end of the very severely depressed category. Meta-regression analyses indicated that the relation of baseline severity and improvement was curvilinear in drug groups and showed a strong, negative linear component in placebo groups.

Conclusions: Drug-placebo differences in antidepressant efficacy increase as a function of baseline severity, but are relatively small even for severely depressed patients. The relationship between initial severity and antidepressant efficacy is attributable to decreased responsiveness to placebo among very severely depressed patients, rather than to increased responsiveness to medication.

Conflict of interest statement

Competing Interests: IK has received consulting fees from Squibb and Pfizer. BJD, TBH, AS, TJM, and BTJ have no competing interests.

Figures

Figure 1. QUOROM Flow Chart
Figure 1. QUOROM Flow Chart
Figure 2. Mean Standardized Improvement as a…
Figure 2. Mean Standardized Improvement as a Function of Initial Severity and Treatment Group
Drug improvement is portrayed as red triangles around their solid red regression line and placebo improvement as blue circles around their dashed blue regression line; the green shaded area indicates the point at which comparisons of drug versus placebo reach the NICE clinical significance criterion of d = 0.50. Plotted values are sized according to their weight in analyses.
Figure 3. Mean Standardized Improvement as a…
Figure 3. Mean Standardized Improvement as a Function of Initial Severity and Treatment Group, Including Only Trials Whose Samples Had High Initial Severity
Drug improvement is portrayed as red triangles around their solid red regression line and placebo improvement as blue circles around their dashed blue regression line; the green shaded area indicates the point at which comparisons of drug versus placebo reach the NICE clinical significance criterion of d = 0.50. Plotted values are sized according to their weight in analyses.
Figure 4. Mean Drug–Placebo Difference Scores as…
Figure 4. Mean Drug–Placebo Difference Scores as a Function of Initial Severity
Plotted values are sized according to their sample sizes (n); the green line represents the NICE clinical significance criterion. The solid blue regression line represents the trend across all 35 trials; the dashed red line represents the trend excluding the left-most observation.

References

    1. National Institute for Clinical Excellence. Depression: management of depression in primary and secondary care. Clinical practice guideline No 23. London: National Institute for Clinical Excellence; 2004. 670
    1. Kirsch I, Moore TJ, Scoboria A, Nicholls SS. The emperor's new drugs: an analysis of antidepressant medication data submitted to the U.S. Food and Drug Administration. Prev Treat. 2002;5 article 23. Available: . Accessed 15 July 2002.
    1. Angst J. Severity of depression and benzodiazepine co-medication in relationship to efficacy of antidepressants in acute trials: a meta-analysis of moclobemide trials. Hum Psychopharmacol. 1993;8:401–407.
    1. Khan A, Leventhal R, Khan S, et al. Severity of depression and response to antidepressants and placebo: an analysis of the Food and Drug Administration database. J Clin Psychopharmacol. 2002;22:40–45.
    1. Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B. Evidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003;326:1171–1173.
    1. Center for Drug Evaluation and Research. Guidance for industry: guideline for the format and content of the summary for new drug and antibiotic applications. Rockville (Maryland): U.S. Department of Health, Education, and Welfare. Food and Drug Administration; 1987. Available: . Accessed 27 October 2007.
    1. Freedom of Information Act (FOIA). 5 US Congress. 552 (1994 & Supp. II 1996).
    1. Guidance for industry: good clinical practice: consolidated guidance. Rockville (Maryland): U.S. Department of Health, Education, and Welfare. Food and Drug Administration; 1996. Center for Drug Evaluation and Research. Available: . Accessed 27 October 2007.
    1. Guidance for industry: guidelines for the clinical evaluation of antidepressant drugs. Rockville (Maryland): U.S. Department of Health, Education, and Welfare. Food and Drug Administration; 1977. Center for Drug Evaluation and Research. Available: . Accessed 27 October 2007.
    1. Gibbons RD, Hedeker DR, Davis JM. Estimation of effect size from a series of experiments involving paired comparisons. J Educ Stat. 1993;18:271–279.
    1. Lipsey MW, Wilson DB. Practical meta-analysis. Applied social research methods. Thousand Oaks (California): Sage Publications; 2001. 247 Volume 49.
    1. Bond CF, Wiitala WL, Richard FD. Meta-analysis of raw mean differences. Psychol Methods. 2003;8:206–418.
    1. Furukawa TA, Barbui C, Cipriani A. Imputing missing standard deviations in meta-analyses can provide accurate results. J Clin Epidemiol. 2006;59:7–10.
    1. Thiessen-Philbrook H, Barrowman N, Garg AX. Imputing variance estimates do not alter the conclusions of a meta-analysis with continuous outcomes: a case study of changes in renal function after living kidney donation. J Clin Epidemiol. 2007;60:228–240.
    1. Hedges LV, Olkin I. Statistical methods for meta-analysis. New York: Academic Press; 1985. 369
    1. Higgins JPT, Thompson SG. Measuring inconsistency in meta-analyses. Educ Debate. 2002;327:557–560.
    1. Huedo-Medina TB, Johnson BT. I2 is subject to the same statistical power problems as Cochran's Q [Letter] BMJ. 2007. Available: . Accessed 23 January 2008.
    1. Thompson SG, Smith TC, Sharp SJ. Investigating underlying risk as a source of heterogeneity in meta-analysis. Stat Med. 1997;16:2741–2758.
    1. Hedges LV, Pigott TD. The power of statistical tests for moderators in meta-analysis. Psychol Methods. 2004;9:426–445.
    1. Glass GV, McGaw B, Smith ML. Meta-analysis in social research. Beverly Hills (California): Sage Publications; 1981. 279
    1. American Psychiatric Association. Task Force for the Handbook of Psychiatric Measures (2000) Handbook of psychiatric measures. Washington (D. C.): American Psychiatric Association; 820
    1. Thornton A, Lee P. Publication bias in meta-analysis: its causes and consequences. J Clin Epidemiol. 2000;53:207–216.
    1. Hansen RA, Gartlehner G, Lohr KN, Gaynes BN, Carey TS. Efficacy and safety of second-generation antidepressants in the treatment of major depressive disorder. Ann Intern Med. 2005;143:415–426.
    1. Evans FJ. The placebo response in pain reduction. Adv Neurol. 1974;4:289–296.
    1. Benedetti F, Arduino C, Amanzio M. Somatotopic activation of opioid systems by target-directed expectations of analgesia. J Neurosci. 1999;19:3639–3648.
    1. Evans FG. Expectancy, therapeutic instructions, and the placebo response. In: White L, Tursky B, Schwartz GE, editors. Placebo: theory, research and mechanisms. New York: Guilford Press; 1985. pp. 215–228.
    1. Fabre LF, Crimson L. Efficacy of fluoxetine in outpatients with major depression. Curr Ther Res Clin Exp. 1985;37:115–123.
    1. Stark P, Hardison CD. A review of multicenter controlled studies of fluoxetine vs. imipramine and placebo in outpatients with major depressive disorder. J Clin Psychiatry. 1985;46:53–58.
    1. Dunlop SR, Dornseif BE, Wernike JF, Potvin JH. Pattern analysis shows beneficial effect of fluoxetine treatment in major depression. Psychopharmacol Bull. 1990;26:173–180.
    1. Rudolph RL, Fabre LF, Feighner JP, Rickels K, Entsuah R, et al. A randomized, placebo-controlled, dose-response trial of venlafaxine hydrochloride in the treatment of major depression. J Clin Psychiatry. 1998;5:116–122.
    1. Ballenger J. Clinical evaluation of venlafaxine. J Clin Psychopharmacol. 1996;16(Suppl 2):29S–36S.
    1. Schweizer E, Feighner J, Mandos LA, Rickels K. Comparison of venlafaxine and imipramine in the acute treatment of major depression in outpatients. J Clin Psychiatry. 1994;55:104–108.
    1. Cunningham LA, Borison RL, Carman JS, Chouinard G, Crowder JE, et al. A comparison of venlafaxine, trazodone, and placebo in major depression. J Clin Psychopharmacol. 1994;14:99–106.
    1. Kelsey JE. Dose-response relationship with venlafaxine. J Clin Psychopharmacol. 1996;16(Suppl 2):21S–26S.
    1. Mendels J, Johnston R, Mattes J, Riesenberg R. Efficacy and safety of b.i.d. doses of venlafaxine in a dose-response study. Psychopharmacol Bull. 1993;29:169–174.
    1. Guelfi JD, White C, Hackett D, Guichoux JY, Magni G. Effectiveness of venlafaxine in patients hospitalized for major depression and melancholia. J Clin Psychiatry. 1995;56:450–458.
    1. Fintaine R, Ontiveros A, Elie R, Kensler TT, Roberts DL, et al. A double-blind comparison of nefazodone, imipramine, and placebo in major depression. J Clin Psychiatry. 1994;55:234–241.
    1. Mendels J, Reimherr F, Marcus RN, Roberts DL, Francis RJ, et al. A double-blind, placebo-controlled trial of two dose ranges of nefazodone in the treatment of depressed outpatients. J Clin Psychiatry. 1995;56(Suppl 6):30–36.
    1. D'Amico MF, Roberts DL, Robinson DS, Schwiderski UE, Copp J. Placebo-controlled dose-ranging trial designs in phase II development of nefazodone. Psychopharmacol Bull. 1990;26:147–150.
    1. Rickels K, Schweizer E, Clary C, Fox I, Weise C. Nefazodone and imipramine in major depression: a placebo-controlled trial. Brit J Psychiatry. 1994;164:802–805.
    1. Rickels K, Amsterdam J, Clary C, Fox I, Schweizer E, et al. A placebo-controlled, double-blind, clinical trial of paroxetine in depressed outpatients. Acta Psychiatr Scand. 1989;80(Suppl 350):117–123.
    1. Rickels K, Amsterdam J, Clary C, Fox I, Schweizer E, et al. The efficacy and safety of paroxetine compared with placebo in outpatients with major depression. J Clin Psychiatry. 1992;53(Suppl):30–32.
    1. Claghorn J. A double-blind comparison of paroxetine and placebo in the treatment of depressed outpatients. Int Clin Psychopharmacol. 1992;6(Suppl 4):25–30.
    1. Claghorn J. The safety and efficacy of paroxetine compared with placebo in a double-blind trial of depressed outpatients. J Clin Psychiatry. 1992;53(Suppl):33–35.
    1. Smith WT, Glaudin V. A placebo-controlled trial of paroxetine in the treatment of major depression. J Clin Psychiatry. 1992;53(Suppl):36–39.
    1. Kiev A. A double-blind, placebo-controlled study of paroxetine in depressed outpatients. J Clin Psychiatry. 1992;53(Suppl):27–29.
    1. Feighner JP, Boyer WF. Paroxetine in the treatment of depression: a comparison with imipramine and placebo. Acta Psychiatr Scand. 1989;80(Suppl 350):125–129.
    1. Feighner JP, Boyer WF. Paroxetine in the treatment of depression: a comparison with imipramine and placebo. J Clin Psychiatry. 1992;53(Suppl):44–47.
    1. Cohn JB, Crowder JE, Wilcox CS, Ryan PJ. A placebo- and imipramine-controlled study of paroxetine. Psychopharmacol Bull. 1990;26:185–189.
    1. Cohn JB, Wilcox CS. Paroxetine in major depression: a double-blind trial with imipramine and placebo. J Clin Psychiatry. 1992;53(Suppl):52–56.
    1. Shrivastava RK, Shrivastava SHP, Overweg N, Blumhardt CL. A double-blind comparison of paroxetine, imipramine, and placebo in major depression. J Clin Psychiatry. 1992;53(Suppl):48–51.
    1. Peselow ED, Filippi AM, Goodnick P, Barouche FB, Fieve RR. The short- and long-term efficacy of paroxetine HCl: A. Data from a 6-week double-blind parallel design trial vs. imipramine and placebo. Psychopharmacol Bull. 1989;25:267–271.
    1. Fabre LF. A 6-week, double-blind trial of paroxetine, imipramine, and placebo in depressed outpatients. J Clin Psychiatry. 1992;53(Suppl):40–43.
    1. Dunner DL, Dunbar GC. Optimal dose regimen for paroxetine. J Clin Psychiatry. 1992;53(Suppl):21–26.
    1. Miller SM, Naylor GJ, Murtagh M, Winslow G. A double-blind comparison of paroxetine and placebo in the treatment of depressed patients in a psychiatric outpatient clinic. Acta Psychiatr Scand. 1989;80(Suppl 350):143–144.

Source: PubMed

3
Sottoscrivi