Development and reliability of the explicit professional oral communication observation tool to quantify the use of non-technical skills in healthcare

Peter F Kemper, Inge van Noord, Martine de Bruijne, Dirk L Knol, Cordula Wagner, Cathy van Dyck, Peter F Kemper, Inge van Noord, Martine de Bruijne, Dirk L Knol, Cordula Wagner, Cathy van Dyck

Abstract

Background: A lack of non-technical skills is increasingly recognised as an important underlying cause of adverse events in healthcare. The nature and number of things professionals communicate to each other can be perceived as a product of their use of non-technical skills. This paper describes the development and reliability of an instrument to measure and quantify the use of non-technical skills by direct observations of explicit professional oral communication (EPOC) in the clinical situation.

Methods: In an iterative process we translated, tested and refined an existing checklist from the aviation industry, called self, human interaction, aircraft, procedures and environment, in the context of healthcare, notably emergency departments (ED) and intensive care units (ICU). The EPOC comprises six dimensions: assertiveness, working with others; task-oriented leadership; people-oriented leadership; situational awareness; planning and anticipation. Each dimension is specified into several concrete items reflecting verbal behaviours. The EPOC was evaluated in four ED and six ICU.

Results: In the ED and ICU, respectively, 378 and 1144 individual and 51 and 68 contemporaneous observations of individual staff members were conducted. All EPOC dimensions occur frequently, apart from assertiveness, which was hardly observed. Intraclass correlations for the overall EPOC score ranged between 0.85 and 0.91 and for underlying EPOC dimensions between 0.53 and 0.95.

Conclusions: The EPOC is a new instrument for evaluating the use of non-technical skills in healthcare, which is reliable in two highly different settings. By quantifying professional behaviour the instrument facilitates measurement of behavioural change over time. The results suggest that EPOC can also be translated to other settings.

Keywords: Communication; Patient safety; Quality measurement; Team training; Teamwork.

Figures

Figure 1
Figure 1
Chronological display of the development of the explicit professional oral communication. CRM, crew resource management; ED, emergency department; EPOC, explicit professional oral communication; ICU, intensive care unit.

References

    1. Helmreich RL. On error management: lessons from aviation. BMJ 2000;320:781–5
    1. Sevdalis N, Brett SJ. Improving care by understanding the way we work: human factors and behavioural science in the context of intensive care. Crit Care 2009;13:139.
    1. Flin R, Patey R, Glavin R, et al. Anaesthetists’ non-technical skills. Br J Anaesth 2010;105:38–44
    1. Reader T, Flin R, Lauche K, et al. Non-technical skills in the intensive care unit. Br J Anaesth 2006;96:551–9
    1. Yule S, Flin R, Paterson-Brown S, et al. Non-technical skills for surgeons in the operating room: a review of the literature. Surgery 2006;139:140–9
    1. Helmreich RL, Foushee HC. Why crew resource management? Empirical and theoretical bases of human factors training in aviation. In: Wiener EL, Kanki BG, Helmreich RL.eds. Cockpit resource management. San Francisco: Academic Press Inc, 1993: 3–45
    1. Catchpole K, Mishra A, Handa A, et al. Teamwork and error in the operating room: analysis of skills and roles. Ann Surg 2008;247:699–706
    1. Flin R, Maran N. Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care 2004;13:i80–4
    1. McConaughey E. Crew resource management in healthcare: the evolution of teamwork training and MedTeams. J Perinat Neonatal Nurs 2008;22:96–104
    1. Ostergaard D, Dieckmann P, Lippert A. Simulation and CRM. Best Pract Res Clin Anaesthesiol 2011;25:239–49
    1. Rabol LI, Ostergaard D, Mogensen T. Outcomes of classroom-based team training interventions for multiprofessional hospital staff. A systematic review. Qual Saf Health Care 2010;19:e27.
    1. Sax HC, Browne P, Mayewski RJ, et al. Can aviation-based team training elicit sustainable behavioral change? Arch Surg 2009;144:1133–7
    1. Halverson AL, Andersson JL, Anderson K, et al. Surgical team training: the Northwestern Memorial Hospital experience. Arch Surg 2009;144:107–12
    1. Undre S, Healey AN, Darzi A, et al. Observational assessment of surgical teamwork: a feasibility study. World J Surg 2006;30:1774–83
    1. Mishra A, Catchpole K, McCulloch P. The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre. Qual Saf Health Care 2009;18:104–8
    1. Yule S, Flin R, Maran N, et al. Surgeons’ non-technical skills in the operating room: reliability testing of the NOTSS behavior rating system. World J Surg 2008;32:548–56
    1. Weaver SJ, Rosen MA, DiazGranados D, et al. Does teamwork improve performance in the operating room? A multilevel evaluation. Jt Comm J Qual Patient Saf 2010;36:133–42
    1. McCulloch P, Mishra A, Handa A, et al. The effects of aviation-style non-technical skills training on technical performance and outcome in the operating theatre. Qual Saf Health Care 2009;18:109–15
    1. Antersijn PAM, Verhoef MC. Assessment of non-technical skills: is it possible? In: McDonald N, Johnston N, Fuller R.eds. Applications of psychology to the aviation system: Proceedings of the 21st Conference of the European Association for Aviation Psychology (EAAP), Vol. 1 Aldershot, UK: Avebury Aviation, 1995: 243–50
    1. Klampfer B, Flin R, Helmreich R, et al. Group interactions in high risk environments: behavioural markers workshop. 2001. (accessed 10 Mar 2012).
    1. Hart SG, Staveland LE. Development of the NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock A, Meshkati N.eds. Human mental workload. Amsterdam: North Holland Press, 1988
    1. Kemper PF, De Bruyne M, Van Dyck C, et al. Effectiveness of classroom based crew resource management training in the intensive care unit: study design of a controlled trial. BMC Health Serv Res 2011;11:304.
    1. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996;1:30–46
    1. Euser AM, Le Cessie S, Finken MJ, et al. Reliability studies can be designed more efficiently by using variance components estimates from different sources. J Clin Epidemiol 2007;60:1010–14
    1. Molenberghs G, Laenen A, Vangeneugden T. Estimating reliability and generalizability from hierarchical biomedical data. J Biopharm Stat 2007;17:595–627
    1. Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010;63:737–45
    1. De Vet HC, Terwee CB, Mokkink LB, et al. Measurement in medicine. Cambridge: Cambridge University Press, 2011
    1. Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res 1998;7:301–17
    1. Altman DG. Practical statistics for medical research. London: Chapman & Hall, 1991
    1. Yule S, Flin R, Paterson-Brown S, et al. Development of a rating system for surgeons’ non-technical skills. Med Educ 2006;40:1098–104
    1. Stachowski AA, Kaplan SA, Waller MJ. The benefits of flexible team interaction during crises. J Appl Psychol 2009;94:1536–43
    1. Flin R, O'Conner P, Crichton M. Safety at the sharp end: a guide to non-technical skills. Farnham: Ashgate, 2008

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever