Association of Checklist Use in Endotracheal Intubation With Clinically Important Outcomes: A Systematic Review and Meta-analysis

Joseph S Turner, Antonino W Bucca, Steven L Propst, Timothy J Ellender, Elisa J Sarmiento, Laura M Menard, Benton R Hunter, Joseph S Turner, Antonino W Bucca, Steven L Propst, Timothy J Ellender, Elisa J Sarmiento, Laura M Menard, Benton R Hunter

Abstract

Importance: Endotracheal intubation of critically ill patients is a high-risk procedure. Checklists have been advocated to improve outcomes.

Objective: To assess whether the available evidence supports an association of use of airway checklists with improved clinical outcomes in patients undergoing endotracheal intubation.

Data sources: For this systematic review and meta-analysis, PubMed (OVID), Embase, Cochrane, CINAHL, and SCOPUS were searched without limitations using the Medical Subject Heading terms and keywords airway; management; airway management; intubation, intratracheal; checklist; and quality improvement to identify studies published between January 1, 1960, and June 1, 2019. A supplementary search of the gray literature was performed, including conference abstracts and clinical trial registries.

Study selection: Full-text reviews were performed to determine final eligibility for inclusion. Included studies were randomized clinical trials or observational human studies that compared checklist use with any comparator for endotracheal intubation and assessed 1 of the predefined outcomes.

Data extraction and synthesis: Data extraction and quality assessment were performed using the Newcastle-Ottawa Scale for observational studies and Cochrane risk of bias tool for randomized clinical trials. Study results were meta-analyzed using a random-effects model. Reporting of this study follows the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline.

Main outcomes and measures: The primary outcome was mortality. Secondary outcomes included first-pass success and known complications of endotracheal intubation, including esophageal intubation, hypoxia, hypotension, and cardiac arrest.

Results: The search identified 1649 unique citations of which 11 (3261 patients) met the inclusion criteria. One randomized clinical trial and 3 observational studies had a low risk of bias. Checklist use was not associated with decreased mortality (5 studies [2095 patients]; relative risk, 0.97; 95% CI, 0.80-1.18; I2 = 0%). Checklist use was associated with a decrease in hypoxic events (8 studies [3010 patients]; relative risk, 0.75; 95% CI, 0.59-0.95; I2 = 33%) but no other secondary outcomes. Studies with a low risk of bias did not demonstrate decreased hypoxia associated with checklist use.

Conclusions and relevance: The findings suggest that use of airway checklists is not associated with improved clinical outcomes during and after endotracheal intubation, which may affect practitioners' decision to use checklists in this setting.

Conflict of interest statement

Conflict of Interest Disclosures: No disclosures were reported.

Figures

Figure 1.. Study Identification
Figure 1.. Study Identification
Figure 2.. Summary Estimates of Relative Risks…
Figure 2.. Summary Estimates of Relative Risks (RRs) for Binary Outcomes
Squares indicate RR estimates, with horizonal lines representing 95% CIs. Diamonds represent pooled estimates, with points indicating 95% CIs. Shaded boxes represent the contribution weight of each study to the meta-analysis. Vertical dashed lines represent the relationship of the 95% CIs around each individual study result with the pooled mean. Weights are from random-effects analysis. A, E, and F, The study by Smith et al was not included in the analysis.
Figure 3.. Low Risk of Bias Sensitivity…
Figure 3.. Low Risk of Bias Sensitivity Analysis
Squares indicate relative risk (RR) estimates, with horizonal lines representing 95% CIs. Diamonds represent pooled estimates, with points indicating 95% CIs. Vertical dashed lines represent the relationship of the 95% CIs around each individual study result with the pooled mean. Weights are from random-effects analysis. A, E, and F, The study by Smith et al was not included in the analysis.

References

    1. Lewis CT, Brown J, Inglis AC, Naumann DN, Crombie N. Emergency intubation in trauma in KwaZulu-Natal Province, South Africa. S Afr Med J. 2018;108(8):660-666. doi:10.7196/SAMJ.2018.v108i8.12670
    1. Durbin CG Jr, Bell CT, Shilling AM. Elective intubation. Respir Care. 2014;59(6):825-846. doi:10.4187/respcare.02802
    1. Bowles TM, Freshwater-Turner DA, Janssen DJ, Peden CJ; RTIC Severn Group . Out-of-theatre tracheal intubation: prospective multicentre study of clinical practice and adverse events. Br J Anaesth. 2011;107(5):687-692. doi:10.1093/bja/aer251
    1. Cook TM, Woodall N, Harper J, Benger J; Fourth National Audit Project . Major complications of airway management in the UK: results of the Fourth National Audit Project of the Royal College of Anaesthetists and the Difficult Airway Society, part 2: intensive care and emergency departments. Br J Anaesth. 2011;106(5):632-642. doi:10.1093/bja/aer059
    1. Kim WY, Kwak MK, Ko BS, et al. . Factors associated with the occurrence of cardiac arrest after emergency tracheal intubation in the emergency department. PLoS One. 2014;9(11):e112779. doi:10.1371/journal.pone.0112779
    1. Löllgen RMC, Pontin J, Gow M, McCaskill ME. Adverse events and risk factors during emergency intubation in a tertiary paediatric emergency department. Eur J Emerg Med. 2018;25(3):209-215. doi:10.1097/MEJ.0000000000000439
    1. Manthous CA. Avoiding circulatory complications during endotracheal intubation and initiation of positive pressure ventilation. J Emerg Med. 2010;38(5):622-631. doi:10.1016/j.jemermed.2009.01.018
    1. Carlos WG, Patel DG, Vannostrand KM, Gupta S, Cucci AR, Bosslet GT. Intensive care unit rounding checklist implementation: effect of accountability measures on physician compliance. Ann Am Thorac Soc. 2015;12(4):533-538. doi:10.1513/AnnalsATS.201410-494OC
    1. Chen C, Kan T, Li S, Qiu C, Gui L. Use and implementation of standard operating procedures and checklists in prehospital emergency medicine: a literature review. Am J Emerg Med. 2016;34(12):2432-2439. doi:10.1016/j.ajem.2016.09.057
    1. Haugen AS, Søfteland E, Almeland SK, et al. . Effect of the World Health Organization checklist on patient outcomes: a stepped wedge cluster randomized controlled trial. Ann Surg. 2015;261(5):821-828. doi:10.1097/SLA.0000000000000716
    1. Hazelton JP, Orfe EC, Colacino AM, et al. . The impact of a multidisciplinary safety checklist on adverse procedural events during bedside bronchoscopy-guided percutaneous tracheostomy. J Trauma Acute Care Surg. 2015;79(1):111-115. doi:10.1097/TA.0000000000000700
    1. Sharma S, Peters MJ; PICU/NICU Risk Action Group . ‘Safety by DEFAULT’: introduction and impact of a paediatric ward round checklist. Crit Care. 2013;17(5):R232. doi:10.1186/cc13055
    1. Howie WO, Dutton RP. Implementation of an evidence-based extubation checklist to reduce extubation failure in patients with trauma: a pilot study. AANA J. 2012;80(3):179-184.
    1. Lockey DJ, Crewdson K, Davies G, et al. . AAGBI: safer pre-hospital anaesthesia 2017: Association of Anaesthetists of Great Britain and Ireland. Anaesthesia. 2017;72(3):379-390. doi:10.1111/anae.13779
    1. Neily J, Silla ES, Sum-Ping SJT, et al. . Anesthesia adverse events voluntarily reported in the Veterans Health Administration and lessons learned. Anesth Analg. 2018;126(2):471-477. doi:10.1213/ANE.0000000000002149
    1. Sherren PB, Tricklebank S, Glover G. Development of a standard operating procedure and checklist for rapid sequence induction in the critically ill. Scand J Trauma Resusc Emerg Med. 2014;22:41. doi:10.1186/s13049-014-0041-7
    1. Davis KF, Napolitano N, Li S, et al. ; National Airway Emergency for Children (NEAR4KIDS) and Pediatric Acute Lung Injury and Sepsis Investigators (PALISI) Network . Promoters and barriers to implementation of tracheal intubation airway safety bundle: a mixed-method analysis. Pediatr Crit Care Med. 2017;18(10):965-972. doi:10.1097/PCC.0000000000001251
    1. Leape LL. The checklist conundrum. N Engl J Med. 2014;370(11):1063-1064. doi:10.1056/NEJMe1315851
    1. Stock CT, Sundt T. Timeout for checklists? Ann Surg. 2015;261(5):841-842. doi:10.1097/SLA.0000000000001141
    1. Williams AK, Cotter RA, Bompadre V, Goldberg MJ, Steinman SS. Patient safety checklists: do they improve patient safety for supracondylar humerus fractures? J Pediatr Orthop. 2019;39(5):232-236. doi:10.1097/BPO.0000000000000928
    1. Al Ashry HS, Abuzaid AS, Walters RW, Modrykamien AM. Effect of compliance with a nurse-led intensive care unit checklist on clinical outcomes in mechanically and nonmechanically ventilated patients. J Intensive Care Med. 2016;31(4):252-257. doi:10.1177/0885066614533910
    1. Higgins JP, Altman DG, Gøtzsche PC, et al. ; Cochrane Bias Methods Group; Cochrane Statistical Methods Group . The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. doi:10.1136/bmj.d5928
    1. Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol. 2010;25(9):603-605. doi:10.1007/s10654-010-9491-z
    1. Conroy MJ, Weingart GS, Carlson JN. Impact of checklists on peri-intubation care in ED trauma patients. Am J Emerg Med. 2014;32(6):541-544. doi:10.1016/j.ajem.2014.02.006
    1. Corl KA, Dado C, Agarwal A, et al. . A modified Montpellier protocol for intubating intensive care unit patients is associated with an increase in first-pass intubation success and fewer complications. J Crit Care. 2018;44:191-195. doi:10.1016/j.jcrc.2017.11.014
    1. Fogg T, Alkhouri H, Vassiliadis J. The Royal North Shore Hospital Emergency Department airway registry: closing the audit loop. Emerg Med Australas. 2016;28(1):27-33. doi:10.1111/1742-6723.12496
    1. Hatch LD, Grubb PH, Lea AS, et al. . Interventions to improve patient safety during intubation in the neonatal intensive care unit. Pediatrics. 2016;138(4):e20160069. doi:10.1542/peds.2016-0069
    1. Janz DR, Semler MW, Joffe AM, et al. ; Check-UP Investigators*; Pragmatic Critical Care Research Group . A multicenter randomized trial of a checklist for endotracheal intubation of critically ill adults. Chest. 2018;153(4):816-824. doi:10.1016/j.chest.2017.08.1163
    1. Kerrey BT, Mittiga MR, Rinderknecht AS, et al. . Reducing the incidence of oxyhaemoglobin desaturation during rapid sequence intubation in a paediatric emergency department. BMJ Qual Saf. 2015;24(11):709-717. doi:10.1136/bmjqs-2014-003713
    1. Long E, Cincotta DR, Grindlay J, et al. . A quality improvement initiative to increase the safety of pediatric emergency airway management. Paediatr Anaesth. 2017;27(12):1271-1277. doi:10.1111/pan.13275
    1. Powell E, Alkhouri H, McCarthy S, et al. . A sequential case series of 23 intubations in a rural emergency department in New Zealand. Aust J Rural Health. 2018;26(1):48-55. doi:10.1111/ajr.12366
    1. Smith KA, High K, Collins SP, Self WH. A preprocedural checklist improves the safety of emergency department intubation of trauma patients. Acad Emerg Med. 2015;22(8):989-992. doi:10.1111/acem.12717
    1. Szűcs ZP, Farkas J, Schimert P, Baranyai Z, Dinya E. The impact of a checklist on the short-term complications of airway management in adults [in Hungarian]. Orv Hetil. 2019;160(26):1025-1035.
    1. Jaber S, Jung B, Corne P, et al. . An intervention to decrease complications related to endotracheal intubation in the intensive care unit: a prospective, multiple-center study. Intensive Care Med. 2010;36(2):248-255. doi:10.1007/s00134-009-1717-8
    1. Pronovost P, Needham D, Berenholtz S, et al. . An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med. 2006;355(26):2725-2732. doi:10.1056/NEJMoa061115
    1. Weingart S, Hua A. An Intubation Checklist for Emergency Department Physicians. Vol 33. ACEP Now; 2014.
    1. Cabrini L, Landoni G, Baiardo Redaelli M, et al. . Tracheal intubation in critically ill patients: a comprehensive systematic review of randomized trials. Crit Care. 2018;22(1):6. doi:10.1186/s13054-017-1927-3
    1. Hardy G, Horner D. BET 2: should real resuscitationists use airway checklists? Emerg Med J. 2016;33(6):439-441. doi:10.1136/emermed-2016-205871.2
    1. Shanmugasundaram P, Wilson G, Parke T. Improving intubation safety in critically ill patients. J Intensive Care Soc. 2014;15(1):1751-437.
    1. Goodacre S. Uncontrolled before-after studies: discouraged by Cochrane and the EMJ. Emerg Med J. 2015;32(7):507-508. doi:10.1136/emermed-2015-204761

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe