Comparison of risk scoring systems for patients presenting with upper gastrointestinal bleeding: international multicentre prospective study

Adrian J Stanley, Loren Laine, Harry R Dalton, Jing H Ngu, Michael Schultz, Roseta Abazi, Liam Zakko, Susan Thornton, Kelly Wilkinson, Cristopher J L Khor, Iain A Murray, Stig B Laursen, International Gastrointestinal Bleeding Consortium, Adrian J Stanley, Loren Laine, Harry R Dalton, Jing H Ngu, Michael Schultz, Roseta Abazi, Liam Zakko, Susan Thornton, Kelly Wilkinson, Cristopher J L Khor, Iain A Murray, Stig B Laursen, International Gastrointestinal Bleeding Consortium

Abstract

Objective: To compare the predictive accuracy and clinical utility of five risk scoring systems in the assessment of patients with upper gastrointestinal bleeding.

Design: International multicentre prospective study.

Setting: Six large hospitals in Europe, North America, Asia, and Oceania.

Participants: 3012 consecutive patients presenting over 12 months with upper gastrointestinal bleeding.

Main outcome measures: Comparison of pre-endoscopy scores (admission Rockall, AIMS65, and Glasgow Blatchford) and post-endoscopy scores (full Rockall and PNED) for their ability to predict predefined clinical endpoints: a composite endpoint (transfusion, endoscopic treatment, interventional radiology, surgery, or 30 day mortality), endoscopic treatment, 30 day mortality, rebleeding, and length of hospital stay. Optimum score thresholds to identify low risk and high risk patients were determined.

Results: The Glasgow Blatchford score was best (area under the receiver operating characteristic curve (AUROC) 0.86) at predicting intervention or death compared with the full Rockall score (0.70), PNED score (0.69), admission Rockall score (0.66, and AIMS65 score (0.68) (all P<0.001). A Glasgow Blatchford score of ≤1 was the optimum threshold to predict survival without intervention (sensitivity 98.6%, specificity 34.6%). The Glasgow Blatchford score was better at predicting endoscopic treatment (AUROC 0.75) than the AIMS65 (0.62) and admission Rockall scores (0.61) (both P<0.001). A Glasgow Blatchford score of ≥7 was the optimum threshold to predict endoscopic treatment (sensitivity 80%, specificity 57%). The PNED (AUROC 0.77) and AIMS65 scores (0.77) were best at predicting mortality, with both superior to admission Rockall score (0.72) and Glasgow Blatchford score (0.64; P<0.001). Score thresholds of ≥4 for PNED, ≥2 for AIMS65, ≥4 for admission Rockall, and ≥5 for full Rockall were optimal at predicting death, with sensitivities of 65.8-78.6% and specificities of 65.0-65.3%. No score was helpful at predicting rebleeding or length of stay.

Conclusions: The Glasgow Blatchford score has high accuracy at predicting need for hospital based intervention or death. Scores of ≤1 appear the optimum threshold for directing patients to outpatient management. AUROCs of scores for the other endpoints are less than 0.80, therefore their clinical utility for these outcomes seems to be limited.Trial registration Current Controlled Trials ISRCTN16235737.

Conflict of interest statement

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare that: (1) no authors have support from any company for the submitted work; (2) no authors have relationships with any company that might have an interest in the submitted work (3) no author, their spouses, partners, or children have financial relationships that may be relevant to the submitted work and (4) no authors have any non-financial interests that may be relevant to the submitted work.

Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Figures

https://www.ncbi.nlm.nih.gov/pmc/articles/instance/5217768/bin/staa033358.f1_default.jpg
Fig 1 Comparisons of scores in prediction of need for any intervention (transfusion, endoscopic treatment, interventional radiology or surgery) or 30 day mortality (n=1704). All figures compare patients with complete data for all compared scores. AUROC=area under the receiver operating characteristic curve
https://www.ncbi.nlm.nih.gov/pmc/articles/instance/5217768/bin/staa033358.f2_default.jpg
Fig 2 Comparisons of pre-endoscopic scores in prediction of need for endoscopic treatment (n=2478). AUROC=area under the receiver operating characteristic curve
https://www.ncbi.nlm.nih.gov/pmc/articles/instance/5217768/bin/staa033358.f3_default.jpg
Fig 3 Comparisons of scores in prediction of 30 day mortality (n=1707). AUROC=area under the receiver operating characteristic curve

References

    1. Rockall TA, Logan RFA, Devlin HB, Northfield TC. Incidence of and mortality from acute upper gastrointestinal haemorrhage in the UK. BMJ 1995;311:222-6. 10.1136/bmj.311.6999.222 .
    1. Blatchford O, Davidson LA, Murray WR, Blatchford M, Pell J. Acute upper gastrointestinal haemorrhage in west of Scotland: case ascertainment study. BMJ 1997;315:510-4. 10.1136/bmj.315.7107.510 .
    1. Hearnshaw SA, Logan RFA, Lowe D, Travis SP, Murphy MF, Palmer KR. Acute upper gastrointestinal bleeding in the UK: patient characteristics, diagnoses and outcomes in the 2007 UK audit. Gut 2011;60:1327-35. 10.1136/gut.2010.228437 .
    1. Rockall TA, Logan RFA, Devlin HB, Northfield TC. Risk assessment after acute upper gastrointestinal haemorrhage. Gut 1996;38:316-21. 10.1136/gut.38.3.316 .
    1. Marmo R, Koch M, Cipolletta L, et al. Italian registry on upper gastrointestinal bleeding (Progetto Nazionale Emorragie Digestive--PNED 2). Predicting mortality in non-variceal upper gastrointestinal bleeders: validation of the Italian PNED Score and Prospective Comparison with the Rockall Score. Am J Gastroenterol 2010;105:1284-91. 10.1038/ajg.2009.687 .
    1. Saeed ZA, Winchester CB, Carolyn B, Michaeletz PA, Woods KL, Graham DY. A scoring system to predict rebleeding after endoscopic therapy of non-variceal upper gastrointestinal hemorrhage. Am J Gastroenterol 1993;88:1842-9..
    1. Blatchford O, Murray WR, Blatchford M. A risk score to predict need for treatment for upper gastrointestinal haemorrhage. Lancet 2000;356:1318-21. .
    1. Saltzman JR, Tabak YP, Hyett BH, Sun X, Travis AC, Johannes RS. A simple risk score accurately predicts in-hospital mortality, length of stay, and cost in acute upper GI bleeding. Gastrointest Endosc 2011;74:1215-24. 10.1016/j.gie.2011.06.024 .
    1. Das A, Ben-Menachem T, Farooq FT, et al. Artificial neural network as a predictive instrument in patients with acute nonvariceal upper gastrointestinal hemorrhage. Gastroenterology 2008;134:65-74. 10.1053/j.gastro.2007.10.037 .
    1. Laursen SB, Hansen JM, Schaffalitzky de Muckadell OB. The Glasgow Blatchford score is the most accurate assessment of patients with upper gastrointestinal hemorrhage. Clin Gastroenterol Hepatol 2012;10:1130-1135.e1. 10.1016/j.cgh.2012.06.022 .
    1. Hearnshaw SA, Logan RFA, Lowe D, Travis SPL, Murphy MF, Palmer KR. Use of endoscopy for management of acute upper gastrointestinal bleeding in the UK: results of a nationwide audit. Gut 2010;59:1022-9. 10.1136/gut.2008.174599 .
    1. Stanley AJ, Ashley D, Dalton HR, et al. Outpatient management of patients with low-risk upper-gastrointestinal haemorrhage: multicentre validation and prospective evaluation. Lancet 2009;373:42-7. 10.1016/S0140-6736(08)61769-9 .
    1. Laursen SB, Dalton HR, Murray IA, et al. Upper Gastrointestinal Hemorrhage International Consortium Upper Gastrointestinal Hemorrhage International Consortium. Performance of new thresholds of the Glasgow Blatchford score in managing patients with upper gastrointestinal bleeding. Clin Gastroenterol Hepatol 2015;13:115-21.e2. 10.1016/j.cgh.2014.07.023 .
    1. McLaughlin C, Vine L, Chapman L, et al. The management of low-risk primary upper gastrointestinal haemorrhage in the community: a 5-year observational study. Eur J Gastroenterol Hepatol 2012;24:288-93. 10.1097/MEG.0b013e32834febef .
    1. Lim LG, Ho KY, Chan YH, et al. Urgent endoscopy is associated with lower mortality in high-risk but not low-risk nonvariceal upper gastrointestinal bleeding. Endoscopy 2011;43:300-6. 10.1055/s-0030-1256110 .
    1. Hyett BH, Abougergi MS, Charpentier JP, et al. The AIMS65 score compared with the Glasgow-Blatchford score in predicting outcomes in upper GI bleeding. Gastrointest Endosc 2013;77:551-7. 10.1016/j.gie.2012.11.022 .
    1. Stanley AJ, Dalton HR, Blatchford O, et al. Multicentre comparison of the Glasgow Blatchford and Rockall Scores in the prediction of clinical end-points after upper gastrointestinal haemorrhage. Aliment Pharmacol Ther 2011;34:470-5. 10.1111/j.1365-2036.2011.04747.x .
    1. Pang SH, Ching JY, Lau JYW, Sung JJY, Graham DY, Chan FKL. Comparing the Blatchford and pre-endoscopic Rockall score in predicting the need for endoscopic therapy in patients with upper GI hemorrhage. Gastrointest Endosc 2010;71:1134-40. 10.1016/j.gie.2010.01.028 .
    1. Yaka E, Yılmaz S, Doğan NÖ, Pekdemir M. Comparison of the Glasgow-Blatchford and AIMS65 scoring systems for risk stratification in upper gastrointestinal bleeding in the emergency department. Acad Emerg Med 2015;22:22-30. 10.1111/acem.12554 .
    1. Barkun AN, Bardou M, Kuipers EJ, et al. International Consensus Upper Gastrointestinal Bleeding Conference Group. International consensus recommendations on the management of patients with nonvariceal upper gastrointestinal bleeding. Ann Intern Med 2010;152:101-13. 10.7326/0003-4819-152-2-201001190-00009 .
    1. National Institute for Health and Clinical Excellence. Acute Upper Gastrointestinal Bleeding: management. Clinical Guideline 141.NICE, 2012.
    1. Gralnek IM, Dumonceau JM, Kuipers EJ, et al. Diagnosis and management of nonvariceal upper gastrointestinal hemorrhage: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy 2015;47:a1-46. 10.1055/s-0034-1393172 .
    1. Laine L, Jensen DM. Management of patients with ulcer bleeding. Am J Gastroenterol 2012;107:345-60, quiz 361. 10.1038/ajg.2011.480 .
    1. de Franchis R. Baveno V Faculty. Revising consensus in portal hypertension: report of the Baveno V consensus workshop on methodology of diagnosis and therapy in portal hypertension. J Hepatol 2010;53:762-8. 10.1016/j.jhep.2010.06.004 .
    1. Villanueva C, Colomo A, Bosch A, et al. Transfusion strategies for acute upper gastrointestinal bleeding. N Engl J Med 2013;368:11-21. 10.1056/NEJMoa1211801 .
    1. Laine L, Spiegel B, Rostom A, et al. Methodology for randomized trials of patients with nonvariceal upper gastrointestinal bleeding: recommendations from an international consensus conference. Am J Gastroenterol 2010;105:540-50. 10.1038/ajg.2009.702 .
    1. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837-45. 10.2307/2531595 .
    1. Youden WJ. Index for rating diagnostic tests. Cancer 1950;3:32-5. 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>;2-3 .
    1. Abougergi MS, Charpentier JP, Bethea E, et al. A prospective multicentre study of the AIMS65 score compared with the Glasgow Blatchford score in predicting upper gastrointestinal hemorrhage outcomes. J Clin Gastroenterol 2016;50:464-9. 10.1097/MCG.0000000000000395 .
    1. Palmer AJ, Moroni F, McLeish S, et al. P0440 A comparison of the Glasgow Blatchford and AIMS65 scores in predicting need for clinical intervention and mortality in acute non-variceal upper GI bleeds: a retrospective cohort study. United European Gastroenterol J 2014;2(Suppl):A132-605. 10.1177/2050640614548980
    1. Robertson M, Majumdar A, Boyapati R, et al. Risk stratification in acute upper GI bleeding: comparison of the AIMS65 score with the Glasgow-Blatchford and Rockall scoring systems. Gastrointest Endosc 2016;83:1151-60. 10.1016/j.gie.2015.10.021 .
    1. Lim WS, van der Eerden MM, Laing R, et al. Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study. Thorax 2003;58:377-82. 10.1136/thorax.58.5.377 .
    1. Aujesky D, Roy PM, Verschuren F, et al. Outpatient versus inpatient treatment for patients with acute pulmonary embolism: an international, open-label, randomised, non-inferiority trial. Lancet 2011;378:41-8. 10.1016/S0140-6736(11)60824-6 .
    1. Campbell HE, Stokes EA, Bargo D, et alCosts and quality of life associated with acute upper gastrointestinal bleeding in the UK: cohort analysis of patients in a cluster randomised trial. BMJ Open 2015;5:e007230.10.1136/bmjopen-2014-007230

Source: PubMed

3
Tilaa