SOFA and mortality endpoints in randomized controlled trials: a systematic review and meta-regression analysis

Harm-Jan de Grooth, Irma L Geenen, Armand R Girbes, Jean-Louis Vincent, Jean-Jacques Parienti, Heleen M Oudemans-van Straaten, Harm-Jan de Grooth, Irma L Geenen, Armand R Girbes, Jean-Louis Vincent, Jean-Jacques Parienti, Heleen M Oudemans-van Straaten

Abstract

Background: The sequential organ failure assessment score (SOFA) is increasingly used as an endpoint in intensive care randomized controlled trials (RCTs). Although serially measured SOFA is independently associated with mortality in observational cohorts, the association between treatment effects on SOFA vs. effects on mortality has not yet been quantified in RCTs. The aim of this study was to quantify the relationship between SOFA and mortality in RCTs and to identify which SOFA derivative best reflects between-group mortality differences.

Methods: The review protocol was prospectively registered (Prospero CRD42016034014). We performed a literature search (up to May 1, 2016) for RCTs reporting both SOFA and mortality, and analyzed between-group differences in these outcomes. Treatment effects on SOFA and mortality were calculated as the between-group SOFA standardized difference and log odds ratio (OR), respectively. We used random-effects meta-regression to (1) quantify the linear relationship between RCT treatment effects on mortality (logOR) and SOFA (i.e. responsiveness) and (2) quantify residual heterogeneity (i.e. consistency, expressed as I 2).

Results: Of 110 eligible RCTs, 87 qualified for analysis. Using all RCTs, SOFA was significantly associated with mortality (slope = 0.49 (95% CI 0.17; 0.82), p = 0.006, I 2 = 5%); the overall mortality effect explained by SOFA score (R 2) was 9%. Fifty-eight RCTs used Fixed-day SOFA as an endpoint (i.e. the score on a fixed day after randomization), 25 studies used Delta SOFA as an endpoint (i.e. the trajectory from baseline score) and 15 studies used other SOFA derivatives as an endpoint. Fixed-day SOFA was not significantly associated with mortality (slope = 0.35 (95% CI -0.04; 0.75), p = 0.08, I 2 = 12%) and explained 3% of the overall mortality effect (R 2). Delta SOFA was significantly associated with mortality (slope = 0.70 (95% CI 0.26; 1.14), p = 0.004, I 2 = 0%) and explained 32% of the overall mortality effect (R 2).

Conclusions: Treatment effects on Delta SOFA appear to be reliably and consistently associated with mortality in RCTs. Fixed-day SOFA was the most frequently reported outcome among the reviewed RCTs, but was not significantly associated with mortality. Based on this study, we recommend using Delta SOFA rather than Fixed-day SOFA as an endpoint in future RCTs.

Keywords: Critical care trials; Multiple organ failure; Sepsis; Surrogate endpoints.

Figures

Fig. 1
Fig. 1
Flowchart of the search strategy and included trials. SOFA sequential organ failure assessment, RCT randomized controlled trial
Fig. 2
Fig. 2
Included trials by publication year
Fig. 3
Fig. 3
Regression analyses of the relationship between the RCT treatment effects on mortality vs. (a) any SOFA endpoint, (b) Fixed-day SOFA, and (c) Delta SOFA. The size of the circle is proportional to the RCT sample size. RCTs in the green quadrants show agreement between SOFA and the effects on mortality (e.g. lower SOFA and lower mortality), while RCTs in the red quadrants show conflicting effects (lower SOFA but higher mortality or vice versa). Broken line significant association with residual heterogeneity; solid line significant association without residual heterogeneity. SOFA sequential organ failure assessment, RCT randomized controlled trial, OR odds ratio

References

    1. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–10. doi: 10.1007/BF01709751.
    1. Moreno R, Vincent JL, Matos R, Mendonça A, Cantraine F, Thijs L, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Working Group on Sepsis related Problems of the ESICM. Intensive Care Med. 1999;25:686–96. doi: 10.1007/s001340050931.
    1. Ferreira FL, Bota DP, Bross A, Mélot C, Vincent JL. Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001;286:1754–8. doi: 10.1001/jama.286.14.1754.
    1. Minne L, Abu-Hanna A, de Jonge E. Evaluation of SOFA-based models for predicting mortality in the ICU: a systematic review. Crit Care. 2008;12:R161. doi: 10.1186/cc7160.
    1. Rubenfeld GD. Surrogate Measures of Patient-centered Outcomes in Critical Care. In: Angus DC, Carlet J, editors. Surviv. Intensive Care. Berlin: Springer; 2003. pp. 169–80.
    1. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. ICH Harmonized Tripartite Guideline: Statistical Principles for Clinical Trials E9. 1998.
    1. Fleming TR, DeMets DL. Surrogate end points in clinical trials: are we being misled? Ann Intern Med. 1996;125:605–13. doi: 10.7326/0003-4819-125-7-199610010-00011.
    1. Kassaï B, Shah NR, Leizorovicza A, Cucherat M, Gueyffier F, Boissel J-P. The true treatment benefit is unpredictable in clinical trials using surrogate outcome measured with diagnostic tests. J Clin Epidemiol. 2005;58:1042–51. doi: 10.1016/j.jclinepi.2005.02.024.
    1. de Grooth HJ, Parienti JJ, Oudemans-van Straaten HM. PROSPERO: International prospective register of systematic reviews. Record CRD42016034014 [Internet]. 2016. Available from: . Accessed 18 Feb 2016.
    1. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17:1–12. doi: 10.1016/0197-2456(95)00134-4.
    1. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327:557–60. doi: 10.1136/bmj.327.7414.557.
    1. Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika. 1988;75:383–6. doi: 10.1093/biomet/75.2.383.
    1. Viechtbauer W. Conducting meta-analyses in R with the metafor Package. J Stat Softw. 2010;36:1–48. doi: 10.18637/jss.v036.i03.
    1. Peres Bota D, Melot C, Lopes Ferreira F, Nguyen Ba V, Vincent J-L. The Multiple Organ Dysfunction Score (MODS) versus the Sequential Organ Failure Assessment (SOFA) score in outcome prediction. Intensive Care Med. 2002;28:1619–24. doi: 10.1007/s00134-002-1491-3.
    1. Timsit J-F, Fosse J-P, Troché G, De Lassence A, Alberti C, Garrouste-Orgeas M, et al. Calibration and discrimination by daily Logistic Organ Dysfunction scoring comparatively with daily Sequential Organ Failure Assessment scoring for predicting hospital mortality in critically ill patients. Crit Care Med. 2002;30:2003–13. doi: 10.1097/00003246-200209000-00009.
    1. Pettilä V, Pettilä M, Sarna S, Voutilainen P, Takkunen O. Comparison of multiple organ dysfunction scores in the prediction of hospital mortality in the critically ill. Crit Care Med. 2002;30:1705–11. doi: 10.1097/00003246-200208000-00005.
    1. Junger A, Engel J, Benson M, Böttger S, Grabow C, Hartmann B, et al. Discriminative power on mortality of a modified Sequential Organ Failure Assessment score for complete automatic computation in an operative intensive care unit. Crit Care Med. 2002;30:338–42. doi: 10.1097/00003246-200202000-00012.
    1. Vincent J-L. Endpoints in sepsis trials: more than just 28-day mortality? Crit Care Med. 2004;32:S209–13. doi: 10.1097/01.CCM.0000126124.41743.86.
    1. Petros AJ, Marshall JC, van Saene HK. Should morbidity replace mortality as an endpoint for clinical trials in intensive care? Lancet (London, England) 1995;345:369–71. doi: 10.1016/S0140-6736(95)90347-X.
    1. Cleophas TJ, Zwinderman AH. Validating surrogate endpoints. Mach. Learn. Med. Dordrecht: Springer Netherlands; 2013. pp. 53–64.
    1. Freedman LS, Graubard BI, Schatzkin A. Statistical validation of intermediate endpoints for chronic diseases. Stat Med. 1992;11:167–78. doi: 10.1002/sim.4780110204.
    1. Chen LM, Martin CM, Morrison TL, Sibbald WJ. Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med. 1999;27:1999–2004. doi: 10.1097/00003246-199909000-00046.
    1. Arts DGT, de Keizer NF, Vroom MB, de Jonge E. Reliability and accuracy of Sequential Organ Failure Assessment (SOFA) scoring. Crit Care Med. 2005;33:1988–93. doi: 10.1097/01.CCM.0000178178.02574.AB.
    1. Baykara N, Gökduman K, Hoşten T, Solak M, Toker K. Comparison of sequential organ failure assessment (SOFA) scoring between nurses and residents. J Anesth. 2011;25:839–44. doi: 10.1007/s00540-011-1232-2.

Source: PubMed

3
Abonnieren