Wisdom of the caregivers: pooling individual subjective reports to diagnose states of consciousness in brain-injured patients, a monocentric prospective study

Bertrand Hermann, Gwen Goudard, Karine Courcoux, Mélanie Valente, Sébastien Labat, Lucienne Despois, Julie Bourmaleau, Louise Richard-Gilis, Frédéric Faugeras, Sophie Demeret, Jacobo D Sitt, Lionel Naccache, Benjamin Rohaut, Pitié-Salpétrière hospital Neuro-ICU, Jérémie Abitbol, Fatiha Ait Yata Azzi, Fatoumata Bah, Francis Bolgert, Sandrine Briand, Sandra Coelho, Alexia Camuzat, Jan Claassen, Marie-Chantal Colmar, Flora Cherruault, Cecile Chordi, Véronique Cottin, Bintou Coulibaly, Mélanie Dalibard, Athena Demertzi, Estelle Dumarey, Bouchra El Aouni, Atef El Ouarghi, Denis Engemann, Helene Espiand, Cécilia Eltebert, Fabrice Fanhan, Agnès Flament, Marie-Suzelle Fontano, Pascale Fournier, Céline Frammezelle, Alexandra Grinéa, Nouara Harchaoui, Marie Harmancij, Claire Jacqueminet, Charlotte Janvier, Jamila Kebli, Aurélie Lemoal, Kim Louis-joseph, Brice Lucas, Valérie Maes, Sophie Maillard, Romain Maurel, Madely Petit, Floriane Pépin, Pauline Pérez, Isabelle Picot, Raphael Porcher, Eva Proneur, Federico Raimondo, Manuela Roselmac, Sylviane Saintini, Mélody Seidel, Johan Stender, Yolène Sully, Kelly Tcha, Laura Verbaux, Nicolas Weiss, Kelly Yanganju, Bertrand Hermann, Gwen Goudard, Karine Courcoux, Mélanie Valente, Sébastien Labat, Lucienne Despois, Julie Bourmaleau, Louise Richard-Gilis, Frédéric Faugeras, Sophie Demeret, Jacobo D Sitt, Lionel Naccache, Benjamin Rohaut, Pitié-Salpétrière hospital Neuro-ICU, Jérémie Abitbol, Fatiha Ait Yata Azzi, Fatoumata Bah, Francis Bolgert, Sandrine Briand, Sandra Coelho, Alexia Camuzat, Jan Claassen, Marie-Chantal Colmar, Flora Cherruault, Cecile Chordi, Véronique Cottin, Bintou Coulibaly, Mélanie Dalibard, Athena Demertzi, Estelle Dumarey, Bouchra El Aouni, Atef El Ouarghi, Denis Engemann, Helene Espiand, Cécilia Eltebert, Fabrice Fanhan, Agnès Flament, Marie-Suzelle Fontano, Pascale Fournier, Céline Frammezelle, Alexandra Grinéa, Nouara Harchaoui, Marie Harmancij, Claire Jacqueminet, Charlotte Janvier, Jamila Kebli, Aurélie Lemoal, Kim Louis-joseph, Brice Lucas, Valérie Maes, Sophie Maillard, Romain Maurel, Madely Petit, Floriane Pépin, Pauline Pérez, Isabelle Picot, Raphael Porcher, Eva Proneur, Federico Raimondo, Manuela Roselmac, Sylviane Saintini, Mélody Seidel, Johan Stender, Yolène Sully, Kelly Tcha, Laura Verbaux, Nicolas Weiss, Kelly Yanganju

Abstract

Objectives: The clinical distinction between vegetative state/unresponsive wakefulness syndrome (UWS) and minimally conscious state (MCS) is a key step to elaborate a prognosis and formulate an appropriate medical plan for any patient suffering from disorders of consciousness (DoC). However, this assessment is often challenging and may require specialised expertise. In this study, we hypothesised that pooling subjective reports of the level of consciousness of a given patient across several nursing staff members can be used to clinically detect MCS.

Setting and participants: Patients referred to consciousness assessment were prospectively screened. MCS (target condition) was defined according to the best Coma Recovery Scale-Revised score (CRS-R) obtained from expert physicians (reference standard). 'DoC-feeling' score was defined as the median of individual subjective reports pooled from multiple staff members during a week of hospitalisation (index test). Individual ratings were collected at the end of each shift using a 100 mm Visual Analogue Scale, blinded from the reference standard. Diagnostic accuracy was evaluated using area under the receiver operating characteristic curve (AUC), sensitivity and specificity metrics.

Results: 692 ratings performed by 83 nursing staff members were collected from 47 patients. Twenty patients were diagnosed with UWS and 27 with MCS. DoC-feeling scores obtained by pooling all individual ratings obtained for a given patient were significantly greater in patients with MCS than with UWS (59.2 mm (IQR: 27.3-77.3) vs 7.2 mm (IQR: 2.4-11.4); p<0.001) yielding an AUC of 0.92 (95% CI 0.84 to 0.99).

Conclusions: DoC-feeling capitalises on the expertise of nursing staff to evaluate patients' consciousness. Together with the CRS-R as well as with brain imaging, DoC-feeling might improve diagnostic and prognostic accuracy of patients with DoC.

Keywords: clinical assessment; coma recovery scale - revised; diagnosis; disorders of consciousness; group decision making; minimally conscious state.

Conflict of interest statement

Competing interests: None declared.

© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Figures

Figure 1
Figure 1
Disorders of consciousness (DoC)-feeling score. Each patient was evaluated around three times by DoC experts using the Coma Recovery Scale-Revised (CRS-R). In parallel, nursing staff members reported their daily observations using the DoC-feeling Visual Analogue Scale. The reference standard was defined as the best state of consciousness observed during one of the CRS-R and the patient was coded as being in an unresponsive wakefulness syndrome (UWS) or a minimally conscious state (MCS) accordingly (reference standard). All individual DoC-feeling scores obtained during the whole hospital stay were pooled and the median value (represented by the vertical dashed line) of the polled results was defined as the DoC-feeling score (index test).
Figure 2
Figure 2
Flow chart. Flow chart representing the repartition of patients while using a disorder of consciousness (DoC)-feeling score (index test) cut-off value of 16.7 mm. Exit-MCS: Patient able to communicate reliably or to use objects functionally. CRS-R, Coma Recovery Scale-Revised; MCS, minimally conscious state; UWS, unresponsive wakefulness syndrome.
Figure 3
Figure 3
Individual disorders of consciousness (DoC)-feeling ratings. DoC-feeling ratings tended to be smaller in patients with unresponsive wakefulness syndrome (UWS) when compared with patients with minimally conscious state (MCS). All individual ratings are shown (dots, n=692), alongside boxplots helping to visualise the median and the IQR for both UWS (on the left in red) and MCS (on the right in blue) patients.
Figure 4
Figure 4
DoC-feeling scores. DoC-feeling scores were obtained by pooling individual ratings obtained for each patient. DoC-feeling scores were smaller for patients with UWS than for MCS (A, B) and also correlated with the CRS-R score (A). Area under the ROC curve (C), sensitivity (Se) and specificity (Sp) for several cut-offs (D) revealed very good performances at identifying the MCS. ***P

References

    1. Naccache L. Minimally conscious state or cortically mediated state? Brain 2018;141:949–60. 10.1093/brain/awx324
    1. Bayne T, Hohwy J, Owen AM. Reforming the taxonomy in disorders of consciousness. Ann Neurol 2017;82:866–72. 10.1002/ana.25088
    1. Bernat JL. Nosologic considerations in disorders of consciousness. Ann Neurol 2017;82:863–5. 10.1002/ana.25089
    1. Luauté J, Maucort-Boulch D, Tell L, et al. . Long-term outcomes of chronic minimally conscious and vegetative states. Neurology 2010;75:246–52. 10.1212/WNL.0b013e3181e8e8df
    1. Noé E, Olaya J, Navarro MD, et al. . Behavioral recovery in disorders of consciousness: a prospective study with the Spanish version of the Coma Recovery Scale-Revised. Arch Phys Med Rehabil 2012;93:428–33. 10.1016/j.apmr.2011.08.048
    1. Bruno M-A, Ledoux D, Vanhaudenhuyse A, et al. . Prognosis of patients with altered state of consciousness : Coma and disorders of consciousness: Springer, 2012:11–23.
    1. Klein AM, Howell K, Vogler J, et al. . Rehabilitation outcome of unconscious traumatic brain injury patients. J Neurotrauma 2013;30:1476–83. 10.1089/neu.2012.2735
    1. Faugeras F, Rohaut B, Valente M, et al. . Survival and consciousness recovery are better in the minimally conscious state than in the vegetative state. Brain Inj 2018;32:72–7. 10.1080/02699052.2017.1364421
    1. Giacino JT, Fins JJ, Laureys S, et al. . Disorders of consciousness after acquired brain injury: the state of the science. Nat Rev Neurol 2014;10:99–114. 10.1038/nrneurol.2013.279
    1. Giacino JT, Ashwal S, Childs N, et al. . The minimally conscious state: definition and diagnostic criteria. Neurology 2002;58:349–53. 10.1212/WNL.58.3.349
    1. Schnakers C, Vanhaudenhuyse A, Giacino J, et al. . Diagnostic accuracy of the vegetative and minimally conscious state: clinical consensus versus standardized neurobehavioral assessment. BMC Neurol 2009;9:35 10.1186/1471-2377-9-35
    1. Wannez S, Heine L, Thonnard M, et al. . The repetition of behavioral assessments in diagnosis of disorders of consciousness. Ann Neurol 2017;81:883–9. 10.1002/ana.24962
    1. Giacino JT, Katz DI, Schiff ND, et al. . Practice guideline update recommendations summary: Disorders of consciousness. Neurology 2018;91:450–60. 10.1212/WNL.0000000000005926
    1. Kurvers RH, Herzog SM, Hertwig R, et al. . Boosting medical diagnostics by pooling independent judgments. Proc Natl Acad Sci U S A 2016;113:8777–82. 10.1073/pnas.1601827113
    1. Bang D, Frith CD. Making better decisions in groups. R Soc Open Sci 2017;4:170193 10.1098/rsos.170193
    1. Hermann B, Goudard G, Courcoux K, et al. . “DoC-feeling”: a new behavioural tool to help diagnose the Minimally Conscious State. bioRxiv 2018:370775 10.1101/370775
    1. Giacino JT, Kalmar K, Whyte J. The JFK Coma recovery scale-revised: measurement characteristics and diagnostic utility. Arch Phys Med Rehabil 2004;85:2020–9.
    1. Wijdicks EF, Bamlet WR, Maramattom BV, et al. . Validation of a new coma scale: the FOUR score. Ann Neurol 2005;58:585–93. 10.1002/ana.20611
    1. R Development Core Team. R: A language and environment for statistical computing. R Found. Stat. Comput 2017.
    1. Pinheiro J, Bates D, DebRoy S, et al. . nlme: Linear and Nonlinear Mixed Effects Models. R Package Version 2017.
    1. Robin X, Turck N, Hainard A, et al. . pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 2011;12:77 10.1186/1471-2105-12-77
    1. Cohen JF, Korevaar DA, Altman DG, et al. . STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open 2016;6:e012799 10.1136/bmjopen-2016-012799
    1. Bruno MA, Vanhaudenhuyse A, Thibaut A, et al. . From unresponsive wakefulness to minimally conscious PLUS and functional locked-in syndromes: recent advances in our understanding of disorders of consciousness. J Neurol 2011;258:1373–84. 10.1007/s00415-011-6114-x
    1. Wolf M, Krause J, Carney PA, et al. . Collective intelligence meets medical decision-making: the collective outperforms the best radiologist. PLoS One 2015;10:e0134269 10.1371/journal.pone.0134269
    1. Kurvers RH, Krause J, Argenziano G, et al. . Detection accuracy of collective intelligence assessments for skin cancer diagnosis. JAMA Dermatol 2015;151:1346–53. 10.1001/jamadermatol.2015.3149
    1. Hautz WE, Kämmer JE, Schauber SK, et al. . Diagnostic performance by medical students working individually or in teams. JAMA 2015;313:303–4. 10.1001/jama.2014.15770
    1. Navajas J, Niella T, Garbulsky G, et al. . Aggregated knowledge from a small number of debates outperforms the wisdom of large crowds. Nat Hum Behav 2018;2:126–32. 10.1038/s41562-017-0273-4
    1. Rohaut B, Claassen J. Decision making in perceived devastating brain injury: a call to explore the impact of cognitive biases. Br J Anaesth 2018;120:5–9. 10.1016/j.bja.2017.11.007
    1. Rohaut B, Faugeras F, Naccache L. Neurology of consciousness impairments : Stevens RD, Sharshar T, Ely EW, Brain disorders in critical illness: Cambridge University Press, 2013:59–67.

Source: PubMed

3
S'abonner