Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements

Adam Cheng, David Kessler, Ralph Mackinnon, Todd P Chang, Vinay M Nadkarni, Elizabeth A Hunt, Jordan Duval-Arnould, Yiqun Lin, David A Cook, Martin Pusic, Joshua Hui, David Moher, Matthias Egger, Marc Auerbach, International Network for Simulation-based Pediatric Innovation, Research, and Education (INSPIRE) Reporting Guidelines Investigators, Adam Cheng, David Kessler, Ralph Mackinnon, Todd P Chang, Vinay M Nadkarni, Elizabeth A Hunt, Jordan Duval-Arnould, Yiqun Lin, David A Cook, Martin Pusic, Joshua Hui, David Moher, Matthias Egger, Marc Auerbach, International Network for Simulation-based Pediatric Innovation, Research, and Education (INSPIRE) Reporting Guidelines Investigators

Abstract

Background: Simulation-based research (SBR) is rapidly expanding but the quality of reporting needs improvement. For a reader to critically assess a study, the elements of the study need to be clearly reported. Our objective was to develop reporting guidelines for SBR by creating extensions to the Consolidated Standards of Reporting Trials (CONSORT) and Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statements.

Methods: An iterative multistep consensus-building process was used on the basis of the recommended steps for developing reporting guidelines. The consensus process involved the following: (1) developing a steering committee, (2) defining the scope of the reporting guidelines, (3) identifying a consensus panel, (4) generating a list of items for discussion via online premeeting survey, (5) conducting a consensus meeting, and (6) drafting reporting guidelines with an explanation and elaboration document.

Results: The following 11 extensions were recommended for CONSORT: item 1 (title/abstract), item 2 (background), item 5 (interventions), item 6 (outcomes), item 11 (blinding), item 12 (statistical methods), item 15 (baseline data), item 17 (outcomes/ estimation), item 20 (limitations), item 21 (generalizability), and item 25 (funding). The following 10 extensions were recommended for STROBE: item 1 (title/abstract), item 2 (background/rationale), item 7 (variables), item 8 (data sources/measurement), item 12 (statistical methods), item 14 (descriptive data), item 16 (main results), item 19 (limitations), item 21 (generalizability), and item 22 (funding). An elaboration document was created to provide examples and explanation for each extension.

Conclusions: We have developed extensions for the CONSORT and STROBE Statements that can help improve the quality of reporting for SBR (Sim Healthcare 00:00-00, 2016).

Keywords: Extension; Health care; Reporting guidelines; Research; Simulation.

References

    1. Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306:978–988.
    1. Zendejas B, Brydges R, Wang AT, et al. Patient outcomes in simulation-based medical education: a systematic review. J Gen Intern Med. 2013;28:1078–1089. doi: 10.1007/s11606-012-2264-5.
    1. Brydges R, Hatala R, Zendejas B, et al. Linking simulation-based educational assessments and patient-related outcomes: a systematic review and meta-analysis. Acad Med. 2015;90:246–256. doi: 10.1097/ACM.0000000000000549.
    1. Cheng A, Grant V, Auerbach M. Using simulation to improve patient safety: dawn of a new era. JAMA Pediatr. 2015;169:419–420. doi: 10.1001/jamapediatrics.2014.3817.
    1. Cook DA. How much evidence does it take? A cumulative meta-analysis of outcomes of simulation-based education. Med Educ. 2014;48:750–760. doi: 10.1111/medu.12473.
    1. McGaghie WC, Issenberg SB, Petrusa ER, et al. A critical review of simulation-based medical education research: 2003–2009. Med Educ. 2010;44:50–63. doi: 10.1111/j.1365-2923.2009.03547.x.
    1. McGaghie WC, Issenberg SB, Cohen ER, et al. Translational educational research: a necessity for effective health-care improvement. Chest. 2012;142:1097–1103. doi: 10.1378/chest.12-0148.
    1. Issenberg SB, McGaghie WC, Petrusa ER, et al. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28. doi: 10.1080/01421590500046924.
    1. Cheng A, Lockey A, Bhanji F, et al. The use of high-fidelity manikins for advanced life support training – a systematic review and meta-analysis. Resuscitation. 2015;93:142-9. Accessed 14 Apr 2015.
    1. Cheng A, Lang T, Starr S, et al. Technology-enhanced simulation and pediatric education: a meta-analysis. Pediatrics. 2014;133:e1313–e1323. doi: 10.1542/peds.2013-2139.
    1. Cheng A, Eppich W, Grant V, et al. Debriefing for technology-enhanced simulation: a systematic review and meta-analysis. Med Educ. 2014;48:657–666. doi: 10.1111/medu.12432.
    1. Ilgen JS, Sherbino J, Cook DA. Technology-enhanced simulation in emergency medicine: a systematic review and meta-analysis. Acad Emerg Med. 2013;20:117–127. doi: 10.1111/acem.12076.
    1. Lorello GR, Cook DA, Johnson RL, et al. Simulation-based training in anaesthesiology: a systematic review and meta-analysis. Br J Anaesth. 2014;112:231–245. doi: 10.1093/bja/aet414.
    1. Zendejas B, Brydges R, Hamstra SJ, et al. State of the evidence on simulation-based training for laparoscopic surgery: a systematic review. Ann Surg. 2013;257:586–593. doi: 10.1097/SLA.0b013e318288c40b.
    1. Dilaveri CA, Szostek JH, Wang AT, et al. Simulation training for breast and pelvic physical examination: a systematic review and meta-analysis. BJOG. 2013;120:1171–1182. doi: 10.1111/1471-0528.12289.
    1. Cheng A, Auerbach M, Chang T, et al. Designing and conducting simulation-based research. Pediatrics. 2014;133:1091–1101. doi: 10.1542/peds.2013-3267.
    1. LeBlanc VR, Manser T, Weinger MB, et al. The study of factors affecting human and systems performance in healthcare using simulation. Simul Healthc. 2011;6:S24–S29. doi: 10.1097/SIH.0b013e318229f5c8.
    1. Raemer D, Anderson M, Cheng A, et al. Research regarding debriefing as part of the learning process. Simul Healthc. 2011;6:S52–S57. doi: 10.1097/SIH.0b013e31822724d0.
    1. Cook DA, Hamstra SJ, Brydges R, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35:e867–e898. doi: 10.3109/0142159X.2012.714886.
    1. Glasziou P, Altman DG, Bossuyt P, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383:267–276. doi: 10.1016/S0140-6736(13)62228-X.
    1. Cook DA, Beckman TJ, Bordage G. A systematic review of titles and abstracts of experimental studies in medical education: many informative elements missing. Med Educ. 2007;41:1074–1081. doi: 10.1111/j.1365-2923.2007.02861.x.
    1. Cook DA, Beckman TJ, Bordage G. Quality of reporting of experimental studies in medical education: a systematic review. Med Educ. 2007;41:737–745. doi: 10.1111/j.1365-2923.2007.02777.x.
    1. Cook DA, Levinson AJ, Garside S. Method and reporting quality in health professions education research: a systematic review. Med Educ. 2011;45:227–238. doi: 10.1111/j.1365-2923.2010.03890.x.
    1. Jüni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ. 2001;323:42–46. doi: 10.1136/bmj.323.7303.42.
    1. Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276:637–639. doi: 10.1001/jama.1996.03540080059030.
    1. Begley CG, Ioannidis JP. Reproducibility in science: improving the standard for basic and preclinical research. Circ Res. 2015;116:116–126. doi: 10.1161/CIRCRESAHA.114.303819.
    1. Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Lancet. 2001;357:1191–1194. doi: 10.1016/S0140-6736(00)04337-3.
    1. Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. doi: 10.1136/bmj.c869.
    1. Moher D, Altman DG, Schulz KF. Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond. CMAJ. 2004;171:349–350. doi: 10.1503/cmaj.1040031.
    1. Plint AC, Moher D, Morrison A, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006;185:263–267.
    1. Von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med. 2007;147:573–577. doi: 10.7326/0003-4819-147-8-200710160-00010.
    1. Vandenbroucke JP, von Elm E, Altman DG, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007;4:e297. doi: 10.1371/journal.pmed.0040297.
    1. Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1. doi: 10.1186/2046-4053-4-1.
    1. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151:264–269. doi: 10.7326/0003-4819-151-4-200908180-00135.
    1. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151:W65–W94. doi: 10.7326/0003-4819-151-4-200908180-00136.
    1. Enhancing the Quality and Transparency of Health Research. Equator Network library for health research reporting. Available at: . Accessed 28 May 2015.
    1. Golub RM, Fontanarosa PB. Researchers, readers, and reporting guidelines: writing between the lines. JAMA. 2015;313:1625–1626. doi: 10.1001/jama.2015.3837.
    1. Campbell MK, Elbourne DR, Altman DG, CONSORT group CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328:702–708. doi: 10.1136/bmj.328.7441.702.
    1. Piaggio G, Elbourne DR, Altman DG, et al. Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. JAMA. 2006;295:1152–1160. doi: 10.1001/jama.295.10.1152.
    1. Boutron I, Moher D, Altman DG, et al. Methods and processes of the CONSORT group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 2008;148:W60–W66.
    1. Little J, Higgins JP, Ioannidis JP, et al. Strengthening the reporting of genetic association studies (STREGA)Van extension of the STROBE statement. Eur J Clin Invest. 2009;39:247–266. doi: 10.1111/j.1365-2362.2009.02125.x.
    1. Moher D, Schulz KF, Simera I, et al. Guidance for Developers of Health Research Reporting Guidelines. PLoS Med 2010;7(2):e1000217. Available at: doi:10.1371/journal.pmed.1000217
    1. Cheng A, Hunt EA, Donoghue A, et al. Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter, randomized-controlled trial. JAMA Pediatr. 2013;167:528–536. doi: 10.1001/jamapediatrics.2013.1389.
    1. Cheng A, Brown LL, Duff JP, et al. Improving cardiopulmonary resuscitation with a CPR feedback device and refresher simulations (CPR CARES Study): a randomized clinical trial. JAMA Pediatr. 2015;169(2):137–144. doi: 10.1001/jamapediatrics.2014.2616.
    1. Cheng A, Overly F, Kessler D, et al. Perception of CPR quality: influence of CPR feedback, just-in-time training and provider role. Resuscitation. 2015;87:44–50. doi: 10.1016/j.resuscitation.2014.11.015.
    1. Kessler DO, Arteaga G, Ching K, et al. Interns’ success with clinical procedures in infants after simulation training. Pediatrics. 2013;131:e811–e820. doi: 10.1542/peds.2012-0607.
    1. Gerard JM, Kessler DO, Braun C, et al. Validation of global rating scale and checklist instruments for the infant lumbar puncture procedure. Simul Healthc. 2013;8:148–154. doi: 10.1097/SIH.0b013e3182802d34.
    1. Kessler D, Pusic M, Chang TP, et al. Impact of Just-in-Time and Just-in-Place simulation on intern success with infant lumbar puncture. Pediatrics. 2015;135:e1237–e1246. doi: 10.1542/peds.2014-1911.
    1. Chang TP, Kessler D, McAninch B, et al. Script concordance testing: assessing residents’ clinical decision-making skills for infant lumbar punctures. Acad Med. 2014;89:128–135. doi: 10.1097/ACM.0000000000000059.
    1. Haubner LY, Barry JS, Johnston LC, et al. Neonatal intubation performance: room for improvement in tertiary neonatal intensive care units. Resuscitation. 2013;84:1359–1364. doi: 10.1016/j.resuscitation.2013.03.014.
    1. Common guidelines for education research and development. A Report from the Institute for Education Sciences, US Department of Education and the National Science Foundation. Available at: . Accessed 10 Jan 2015.
    1. Cobo E, Cortes J, Ribera JM, et al. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ. 2011;343:d6783. doi: 10.1136/bmj.d6783.
    1. Egger M, Schneider M, Davey Smith G. Spurious precision? Meta-analysis of observational studies. BMJ. 1998;316:140–144. doi: 10.1136/bmj.316.7125.140.
    1. American Education Research Association Standards for reporting on empirical social science research in AERA publications. Educ Res. 2006;35:33–40.
    1. Bossuyt PM, Reitsma JB, Bruns DE, Standards for Reporting of Diagnostic Accuracy Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ. 2003;326:41–44. doi: 10.1136/bmj.326.7379.41.
    1. Cook DA, Brydges R, Zendejas B, et al. Technology-enhanced simulation to assess health professionals: a systematic review of validity evidence, research methods, and reporting quality. Acad Med. 2013;88:872–883. doi: 10.1097/ACM.0b013e31828ffdcf.
    1. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–357. doi: 10.1093/intqhc/mzm042.
    1. Davidoff F, Batalden P, Stevens D, et al. Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. Ann Intern Med. 2008;149(9):670–676. doi: 10.7326/0003-4819-149-9-200811040-00009.

Source: PubMed

赞助者和合作者

医疗条件

药物干预

3
订阅