Validation of the Preoperative Score to Predict Postoperative Mortality (POSPOM) in Germany

Yannik C Layer, Jan Menzenbach, Yonah L Layer, Andreas Mayr, Tobias Hilbert, Markus Velten, Andreas Hoeft, Maria Wittmann, Yannik C Layer, Jan Menzenbach, Yonah L Layer, Andreas Mayr, Tobias Hilbert, Markus Velten, Andreas Hoeft, Maria Wittmann

Abstract

Background: The Preoperative Score to Predict Postoperative Mortality (POSPOM) based on preoperatively available data was presented by Le Manach et al. in 2016. This prognostic model considers the kind of surgical procedure, patients' age and 15 defined comorbidities to predict the risk of postoperative in-hospital mortality. Objective of the present study was to validate POSPOM for the German healthcare coding system (G-POSPOM).

Methods and findings: All cases involving anaesthesia performed at the University Hospital Bonn between 2006 and 2017 were analysed retrospectively. Procedures codified according to the French Groupes Homogènes de Malades (GHM) were translated and adapted to the German Operationen- und Prozedurenschlüssel (OPS). Comorbidities were identified by the documented International Statistical Classification of Diseases (ICD-10) coding. POSPOM was calculated for the analysed patient collective using these data according to the method described by Le Manach et al. Performance of thereby adapted POSPOM was tested using c-statistic, Brier score and a calibration plot. Validation was performed using data from 199,780 surgical cases. With a mean age of 56.33 years (SD 18.59) and a proportion of 49.24% females, the overall cohort had a mean POSPOM value of 18.18 (SD 8.11). There were 4,066 in-hospital deaths, corresponding to an in-hospital mortality rate of 2.04% (95% CI 1.97 to 2.09%) in our sample. POSPOM showed a good performance with a c-statistic of 0.771 and a Brier score of 0.021.

Conclusions: After adapting POSPOM to the German coding system, we were able to validate the score using patient data of a German university hospital. According to previous demonstration for French patient cohorts, we observed a good correlation of POSPOM with in-hospital mortality. Therefore, further adjustments of POSPOM considering also multicentre and transnational validation should be pursued based on this proof of concept.

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1. Patient flow chart.
Fig 1. Patient flow chart.
Procedures without relevant anaesthesia include mainly patients of intensive care, patients who received electroconvulsion therapy or minor interventions as biopsies.
Fig 2. Receiver operating characteristic (ROC) curve.
Fig 2. Receiver operating characteristic (ROC) curve.
The ROC curve shows the false positive rate on the X-axis and the true positive rate on the Y-axis. The optimum is an area under the curve (AUC) of 1.
Fig 3. Calibration plot with predicted and…
Fig 3. Calibration plot with predicted and observed in-hospital mortality for POSPOM.
The bisectrix equals perfect calibration. Black dots represent the observed values. The blue line is the line of best fit using linear regression. Grey shade shows the confidence interval.
Fig 4. Distribution of the POSPOM scores…
Fig 4. Distribution of the POSPOM scores in the cohort of Bonn University Hospital (n = 199,780) in relation to the observed in-hospital mortality rate at each POSPOM value between 0 and 40.
Fig 5. Distribution of the POSPOM scores…
Fig 5. Distribution of the POSPOM scores in the cohort of Bonn University Hospital (orange bars, n = 199,780) compared to POSPOM validation cohort (grey bars, n = 2,789,932).
Fig 6. Observed in-hospital mortality rate at…
Fig 6. Observed in-hospital mortality rate at each POSPOM value between 0 and 40 in the cohort of Bonn University Hospital (red line, n = 199,780) compared to POSPOM validation cohort (grey line, n = 2,789,932).

References

    1. Weiser TG, Haynes AB, Molina G, Lipsitz SR, Esquivel MM, Uribe-Leitz T, et al. Estimate of the global volume of surgery in 2012: an assessment supporting improved health outcomes. Lancet 2015; 385(Suppl. 2), S11 10.1016/S0140-6736(15)60806-6
    1. International Surgical Outcomes Study Group. Global patient outcomes after elective surgery: prospective cohort study in 27 low-, middle-and high-income countries. Br J Anaesth 2016; 117:601–609. 10.1093/bja/aew316
    1. Devereaux PJ, Chan MT, Alonso-Coello P; Vascular Events In Noncardiac Surgery Patients Cohort Evaluation (VISION) Study Investigators: Association Between Postoperative Troponin Levels and 30-Day Mortality Among Patients Undergoing Noncardiac Surgery. JAMA 2012; 307(21):2295–2304. 10.1001/jama.2012.5502
    1. Glance LG, Lustik SJ, Hannan EL, Osler TM, Mukamel DB, Qian F, et al. The surgical mortality probability model. Ann Surg 2012; 255(4):696–702 10.1097/SLA.0b013e31824b45af
    1. Bilimoria KY, Liu Y, Paruch JL, Zhou L, Kmiecik TE, Ko CY, et al. Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aide and Informed Consent Tool for Patients and Surgeons. J Am Coll Surg 2013; 217(5):833–842.e3. 10.1016/j.jamcollsurg.2013.07.385
    1. Bainbridge D, Martin J, Arango M, Cheng D; Evidence-based Peri-operative Clinical Outcomes Research (EPiCOR) Group: Perioperative and anaesthetic-related mortality in developed and developing countries: a systematic review and meta-analysis. Lancet 2012; 380 (9847) pp. 1075–1081 10.1016/S0140-6736(12)60990-8
    1. Wijeysundera DN. Predicting outcomes: Is there utility in risk scores? Can J Anesth/J Can Anesth 2016; 63: 148 10.1007/s12630-015-0537-2
    1. Lee TH, Marcantonio ER, Mangione CM, Thomas EJ, Polanczyk CA, Cook EF, et al. Derivation and Prospective Validation of a Simple Index for Prediction of Cardiac Risk of Major Noncardiac Surgery. Circulation 1999; 100(10):1043–9. 10.1161/01.cir.100.10.1043
    1. Hackett NJ, De Oliveira GS, Jain UK, Kim JY. ASA class is a reliable independent predictor of medical complications and mortality following surgery. Int J Surg 2015; 18:184–90. 10.1016/j.ijsu.2015.04.079
    1. Sankar A, Johnson SR, Beattie WS, Tait G, Wijeysundera DN: Reliability of the American Society of Anesthesiologists physical status scale in clinical practice. Br J Anaesth 2014; 113(3):424–432. 10.1093/bja/aeu100
    1. Copeland GP, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg 1991; 78(3):355–60. 10.1002/bjs.1800780327
    1. Prytherch DR, Whiteley MS, Higgins B, Weaver PC, Prout WG, Powell SJ. POSSUM and Portsmouth POSSUM for predicting mortality Physiological and Operative Severity Score for the enUmeration of Mortality and morbidity. Br J Surg 1998; 85(9):1217–20. 10.1046/j.1365-2168.1998.00840.x
    1. Le Manach Y, Collins G, Rodseth R, Le Bihan-Benjamin C, Biccard B, Riou B et al. Preoperative Score to Predict Postoperative Mortality (POSPOM): Derivation and Validation. Anesthesiology 2016; 124(3):570–579. 10.1097/ALN.0000000000000972
    1. §21 Krankenhausentgeltgesetz Available at: Accessed January 23, 2020
    1. Berufsordnung für die nordrheinischen Ärztinnen und Ärzte. Available at: Accessed January 23,2020
    1. Manuel des Groupes Homogènes de Maladies; Ministère de la Santé et des Sports, France. Available at: Accessed January 23, 2020
    1. Operationen- und Prozedurenschlüssel Version 2018. Available at: Accessed January 23,2020
    1. Internationale statistische Klassifikation der Krankheiten und verwandter Gesundheitsprobleme 10. Revision German Modification Version 2019. Available at: Accessed January 23,2020
    1. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP; STROBE Initiative. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Int J Surg 2014; 12(12):1495–1499. 10.1016/j.ijsu.2014.07.013
    1. Cook NR. Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. Clin Chem 2008; 54:17–23. 10.1373/clinchem.2007.096529
    1. Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag; New York, 2016.
    1. Wickham H, François R, Henry L, Müller K. dplyr: A Grammar of Data Manipulation. R package version 0.7.6. 2018 Available at: Accessed January 31,2020
    1. Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 2011, 12, p. 77 10.1186/1471-2105-12-77
    1. Zaiss A, Dauben HP. International classification of health interventions. A balancing act between the demands of statistics and reimbursement. Bundesgesundheitsblatt 2018; 61:788.
    1. DEUTSCHE KODIERRICHTLINIEN: Allgemeine und Spezielle Kodierrichtlinien für die Verschlüsselung von Krankheiten und Prozeduren Version 2019 Available at: Accessed January 28,2020
    1. Heywood NA, Gill MD, Charlwood N, Brindle R, Kirwan CC. Improving accuracy of clinical coding in surgery: collaboration is key. Journal of Surgical Research 2016, Volume 204, Issue 2, 490–495
    1. Statistisches Bundesamt: Fachserie 12 Reihe 6.4 Gesundheit. Available at: Accessed February 6,2020
    1. Universitätsklinikum Bonn Geschäftsbericht 2017. Available at: $FILE/Inhalt_Geschaeftsbericht_2017_2018-09-04-Ansicht.pdf Accessed February 6,2020
    1. Portuondo JI, Shah SR, Singh H, Massarweh NN. Failure to Rescue as a Surgical Quality Indicator: Current Concepts and Future Directions for Improving Surgical Outcomes. Anesthesiology 2019; 131(2):426–437 10.1097/ALN.0000000000002602
    1. Froehner M, Koch R, Hubler M, Heberling U, Novotny V, Zastrow S, et al. Validation of the Preoperative Score to Predict Postoperative Mortality in Patients Undergoing Radical Cystectomy. European Urology Focus 2019; 5 (2), pp. 197–200 10.1016/j.euf.2017.05.003
    1. Niessen R, Bihin B, Gourdin M, Yombi JC, Cornu O, Forget P. Prediction of postoperative mortality in elderly patient with hip fractures: a single-centre, retrospective cohort study. BMC Anesthesiol 2018; 18, 183 10.1186/s12871-018-0646-x
    1. Juul S, Kokotovic D, Degett TH, Oreskov JO, Ekeloef S, Gögenur I, et al. Validation of the preoperative score to predict postoperative mortality (POSPOM) in patients undergoing major emergency abdominal surgery. Eur J Trauma Emerg Surg 2019. 10.1007/s00068-019-01153-x
    1. Reis P, Lopes AI, Leite D, Moreira J, Mendes L, Ferraz S, et al. Predicting mortality in patients admitted to the intensive care unit after open vascular surgery. Surg Today 2019; 49, 836–842 10.1007/s00595-019-01805-w

Source: PubMed

3
Předplatit