Wisdom of the caregivers: pooling individual subjective reports to diagnose states of consciousness in brain-injured patients, a monocentric prospective study
Bertrand Hermann, Gwen Goudard, Karine Courcoux, Mélanie Valente, Sébastien Labat, Lucienne Despois, Julie Bourmaleau, Louise Richard-Gilis, Frédéric Faugeras, Sophie Demeret, Jacobo D Sitt, Lionel Naccache, Benjamin Rohaut, Pitié-Salpétrière hospital Neuro-ICU, Jérémie Abitbol, Fatiha Ait Yata Azzi, Fatoumata Bah, Francis Bolgert, Sandrine Briand, Sandra Coelho, Alexia Camuzat, Jan Claassen, Marie-Chantal Colmar, Flora Cherruault, Cecile Chordi, Véronique Cottin, Bintou Coulibaly, Mélanie Dalibard, Athena Demertzi, Estelle Dumarey, Bouchra El Aouni, Atef El Ouarghi, Denis Engemann, Helene Espiand, Cécilia Eltebert, Fabrice Fanhan, Agnès Flament, Marie-Suzelle Fontano, Pascale Fournier, Céline Frammezelle, Alexandra Grinéa, Nouara Harchaoui, Marie Harmancij, Claire Jacqueminet, Charlotte Janvier, Jamila Kebli, Aurélie Lemoal, Kim Louis-joseph, Brice Lucas, Valérie Maes, Sophie Maillard, Romain Maurel, Madely Petit, Floriane Pépin, Pauline Pérez, Isabelle Picot, Raphael Porcher, Eva Proneur, Federico Raimondo, Manuela Roselmac, Sylviane Saintini, Mélody Seidel, Johan Stender, Yolène Sully, Kelly Tcha, Laura Verbaux, Nicolas Weiss, Kelly Yanganju, Bertrand Hermann, Gwen Goudard, Karine Courcoux, Mélanie Valente, Sébastien Labat, Lucienne Despois, Julie Bourmaleau, Louise Richard-Gilis, Frédéric Faugeras, Sophie Demeret, Jacobo D Sitt, Lionel Naccache, Benjamin Rohaut, Pitié-Salpétrière hospital Neuro-ICU, Jérémie Abitbol, Fatiha Ait Yata Azzi, Fatoumata Bah, Francis Bolgert, Sandrine Briand, Sandra Coelho, Alexia Camuzat, Jan Claassen, Marie-Chantal Colmar, Flora Cherruault, Cecile Chordi, Véronique Cottin, Bintou Coulibaly, Mélanie Dalibard, Athena Demertzi, Estelle Dumarey, Bouchra El Aouni, Atef El Ouarghi, Denis Engemann, Helene Espiand, Cécilia Eltebert, Fabrice Fanhan, Agnès Flament, Marie-Suzelle Fontano, Pascale Fournier, Céline Frammezelle, Alexandra Grinéa, Nouara Harchaoui, Marie Harmancij, Claire Jacqueminet, Charlotte Janvier, Jamila Kebli, Aurélie Lemoal, Kim Louis-joseph, Brice Lucas, Valérie Maes, Sophie Maillard, Romain Maurel, Madely Petit, Floriane Pépin, Pauline Pérez, Isabelle Picot, Raphael Porcher, Eva Proneur, Federico Raimondo, Manuela Roselmac, Sylviane Saintini, Mélody Seidel, Johan Stender, Yolène Sully, Kelly Tcha, Laura Verbaux, Nicolas Weiss, Kelly Yanganju
Abstract
Objectives: The clinical distinction between vegetative state/unresponsive wakefulness syndrome (UWS) and minimally conscious state (MCS) is a key step to elaborate a prognosis and formulate an appropriate medical plan for any patient suffering from disorders of consciousness (DoC). However, this assessment is often challenging and may require specialised expertise. In this study, we hypothesised that pooling subjective reports of the level of consciousness of a given patient across several nursing staff members can be used to clinically detect MCS.
Setting and participants: Patients referred to consciousness assessment were prospectively screened. MCS (target condition) was defined according to the best Coma Recovery Scale-Revised score (CRS-R) obtained from expert physicians (reference standard). 'DoC-feeling' score was defined as the median of individual subjective reports pooled from multiple staff members during a week of hospitalisation (index test). Individual ratings were collected at the end of each shift using a 100 mm Visual Analogue Scale, blinded from the reference standard. Diagnostic accuracy was evaluated using area under the receiver operating characteristic curve (AUC), sensitivity and specificity metrics.
Results: 692 ratings performed by 83 nursing staff members were collected from 47 patients. Twenty patients were diagnosed with UWS and 27 with MCS. DoC-feeling scores obtained by pooling all individual ratings obtained for a given patient were significantly greater in patients with MCS than with UWS (59.2 mm (IQR: 27.3-77.3) vs 7.2 mm (IQR: 2.4-11.4); p<0.001) yielding an AUC of 0.92 (95% CI 0.84 to 0.99).
Conclusions: DoC-feeling capitalises on the expertise of nursing staff to evaluate patients' consciousness. Together with the CRS-R as well as with brain imaging, DoC-feeling might improve diagnostic and prognostic accuracy of patients with DoC.
Keywords: clinical assessment; coma recovery scale - revised; diagnosis; disorders of consciousness; group decision making; minimally conscious state.
Conflict of interest statement
Competing interests: None declared.
© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
Figures
References
- Naccache L. Minimally conscious state or cortically mediated state? Brain 2018;141:949–60. 10.1093/brain/awx324
- Bayne T, Hohwy J, Owen AM. Reforming the taxonomy in disorders of consciousness. Ann Neurol 2017;82:866–72. 10.1002/ana.25088
- Bernat JL. Nosologic considerations in disorders of consciousness. Ann Neurol 2017;82:863–5. 10.1002/ana.25089
- Luauté J, Maucort-Boulch D, Tell L, et al. . Long-term outcomes of chronic minimally conscious and vegetative states. Neurology 2010;75:246–52. 10.1212/WNL.0b013e3181e8e8df
- Noé E, Olaya J, Navarro MD, et al. . Behavioral recovery in disorders of consciousness: a prospective study with the Spanish version of the Coma Recovery Scale-Revised. Arch Phys Med Rehabil 2012;93:428–33. 10.1016/j.apmr.2011.08.048
- Bruno M-A, Ledoux D, Vanhaudenhuyse A, et al. . Prognosis of patients with altered state of consciousness : Coma and disorders of consciousness: Springer, 2012:11–23.
- Klein AM, Howell K, Vogler J, et al. . Rehabilitation outcome of unconscious traumatic brain injury patients. J Neurotrauma 2013;30:1476–83. 10.1089/neu.2012.2735
- Faugeras F, Rohaut B, Valente M, et al. . Survival and consciousness recovery are better in the minimally conscious state than in the vegetative state. Brain Inj 2018;32:72–7. 10.1080/02699052.2017.1364421
- Giacino JT, Fins JJ, Laureys S, et al. . Disorders of consciousness after acquired brain injury: the state of the science. Nat Rev Neurol 2014;10:99–114. 10.1038/nrneurol.2013.279
- Giacino JT, Ashwal S, Childs N, et al. . The minimally conscious state: definition and diagnostic criteria. Neurology 2002;58:349–53. 10.1212/WNL.58.3.349
- Schnakers C, Vanhaudenhuyse A, Giacino J, et al. . Diagnostic accuracy of the vegetative and minimally conscious state: clinical consensus versus standardized neurobehavioral assessment. BMC Neurol 2009;9:35 10.1186/1471-2377-9-35
- Wannez S, Heine L, Thonnard M, et al. . The repetition of behavioral assessments in diagnosis of disorders of consciousness. Ann Neurol 2017;81:883–9. 10.1002/ana.24962
- Giacino JT, Katz DI, Schiff ND, et al. . Practice guideline update recommendations summary: Disorders of consciousness. Neurology 2018;91:450–60. 10.1212/WNL.0000000000005926
- Kurvers RH, Herzog SM, Hertwig R, et al. . Boosting medical diagnostics by pooling independent judgments. Proc Natl Acad Sci U S A 2016;113:8777–82. 10.1073/pnas.1601827113
- Bang D, Frith CD. Making better decisions in groups. R Soc Open Sci 2017;4:170193 10.1098/rsos.170193
- Hermann B, Goudard G, Courcoux K, et al. . “DoC-feeling”: a new behavioural tool to help diagnose the Minimally Conscious State. bioRxiv 2018:370775 10.1101/370775
- Giacino JT, Kalmar K, Whyte J. The JFK Coma recovery scale-revised: measurement characteristics and diagnostic utility. Arch Phys Med Rehabil 2004;85:2020–9.
- Wijdicks EF, Bamlet WR, Maramattom BV, et al. . Validation of a new coma scale: the FOUR score. Ann Neurol 2005;58:585–93. 10.1002/ana.20611
- R Development Core Team. R: A language and environment for statistical computing. R Found. Stat. Comput 2017.
- Pinheiro J, Bates D, DebRoy S, et al. . nlme: Linear and Nonlinear Mixed Effects Models. R Package Version 2017.
- Robin X, Turck N, Hainard A, et al. . pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 2011;12:77 10.1186/1471-2105-12-77
- Cohen JF, Korevaar DA, Altman DG, et al. . STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open 2016;6:e012799 10.1136/bmjopen-2016-012799
- Bruno MA, Vanhaudenhuyse A, Thibaut A, et al. . From unresponsive wakefulness to minimally conscious PLUS and functional locked-in syndromes: recent advances in our understanding of disorders of consciousness. J Neurol 2011;258:1373–84. 10.1007/s00415-011-6114-x
- Wolf M, Krause J, Carney PA, et al. . Collective intelligence meets medical decision-making: the collective outperforms the best radiologist. PLoS One 2015;10:e0134269 10.1371/journal.pone.0134269
- Kurvers RH, Krause J, Argenziano G, et al. . Detection accuracy of collective intelligence assessments for skin cancer diagnosis. JAMA Dermatol 2015;151:1346–53. 10.1001/jamadermatol.2015.3149
- Hautz WE, Kämmer JE, Schauber SK, et al. . Diagnostic performance by medical students working individually or in teams. JAMA 2015;313:303–4. 10.1001/jama.2014.15770
- Navajas J, Niella T, Garbulsky G, et al. . Aggregated knowledge from a small number of debates outperforms the wisdom of large crowds. Nat Hum Behav 2018;2:126–32. 10.1038/s41562-017-0273-4
- Rohaut B, Claassen J. Decision making in perceived devastating brain injury: a call to explore the impact of cognitive biases. Br J Anaesth 2018;120:5–9. 10.1016/j.bja.2017.11.007
- Rohaut B, Faugeras F, Naccache L. Neurology of consciousness impairments : Stevens RD, Sharshar T, Ely EW, Brain disorders in critical illness: Cambridge University Press, 2013:59–67.
Source: PubMed