Methods and processes for development of a CONSORT extension for reporting pilot randomized controlled trials

Lehana Thabane, Sally Hopewell, Gillian A Lancaster, Christine M Bond, Claire L Coleman, Michael J Campbell, Sandra M Eldridge, Lehana Thabane, Sally Hopewell, Gillian A Lancaster, Christine M Bond, Claire L Coleman, Michael J Campbell, Sandra M Eldridge

Abstract

Background: Feasibility and pilot studies are essential components of planning or preparing for a larger randomized controlled trial (RCT). They are intended to provide useful information about the feasibility of the main RCT-with the goal of reducing uncertainty and thereby increasing the chance of successfully conducting the main RCT. However, research has shown that there are serious inadequacies in the reporting of pilot and feasibility studies. Reasons for this include a lack of explicit publication policies for pilot and feasibility studies in many journals, unclear definitions of what constitutes a pilot or feasibility RCT/study, and a lack of clarity in the objectives and methodological focus. All these suggest that there is an urgent need for new guidelines for reporting pilot and feasibility studies.

Objectives: The aim of this paper is to describe the methods and processes in our development of an extension to the Consolidated Standards of Reporting Trials (CONSORT) Statement for reporting pilot and feasibility RCTs, that are executed in preparation for a future, more definitive RCT.

Methods/design: There were five overlapping parts to the project: (i) the project launch-which involved establishing a working group and conducting a review of the literature; (ii) stakeholder engagement-which entailed consultation with the CONSORT group, journal editors and publishers, the clinical trials community, and funders; (iii) a Delphi process-used to assess the agreement of experts on initial definitions and to generate a reporting checklist for pilot RCTs, based on the 2010 CONSORT statement extension applicable to reporting pilot studies; (iv) a consensus meeting-to discuss, add, remove, or modify checklist items, with input from experts in the field; and (v) write-up and implementation-which included a guideline document which gives an explanation and elaboration (E&E) and which will provide advice for each item, together with examples of good reporting practice. This final part also included a plan for dissemination and publication of the guideline.

Conclusions: We anticipate that implementation of our guideline will improve the reporting completeness, transparency, and quality of pilot RCTs, and hence benefit several constituencies, including authors of journal manuscripts, funding agencies, educators, researchers, and end-users.

Keywords: CONSORT extension; Pilot randomized controlled trial; Reporting guideline.

Figures

Fig. 1
Fig. 1
Development of the CONSORT extension to pilot trials guideline
Fig. 2
Fig. 2
An example of Delphi presentation for the two checklists

References

    1. Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004;10(2):307–12. doi: 10.1111/j..2002.384.doc.x.
    1. Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10(1):1. doi: 10.1186/1471-2288-10-1.
    1. Arain M, Campbell MJ, Cooper CL, Lancaster GA. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010;10(1):67. doi: 10.1186/1471-2288-10-67.
    1. Shanyinde M, Pickering RM, Weatherall M. Questions asked and answered in pilot and feasibility randomized controlled trials. BMC Med Res Methodol. 2011;11(1):117. doi: 10.1186/1471-2288-11-117.
    1. Loscalzo J. Pilot trials in clinical research: of what value are they? Circulation. 2009;119(13):1694–6. doi: 10.1161/CIRCULATIONAHA.109.861625.
    1. Arnold DM, Burns KE, Adhikari NK, Kho ME, Meade MO, Cook DJ. The design and interpretation of pilot trials in clinical research in critical care. Crit Care Med. 2009;37(1):S69–74. doi: 10.1097/CCM.0b013e3181920e33.
    1. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ (Clinical research ed) 2010;340:c332. doi: 10.1136/bmj.c332.
    1. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276(8):637–9. doi: 10.1001/jama.1996.03540080059030.
    1. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ (Clinical research ed) 2012;345:e5661.
    1. Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG, Group C. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012;308(24):2594–604. doi: 10.1001/jama.2012.87802.
    1. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ (Clinical research ed). 2008;337:a2390.
    1. Vohra S, Shamseer L, Sampson M, Bukutu C, Schmid CH, Tate R, et al. CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement. BMJ (Clinical research ed) 2015;350:h1738.
    1. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med. 2006;144(5):364–7. doi: 10.7326/0003-4819-144-5-200603070-00013.
    1. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 2008;148(4):W-60-W-6.
    1. MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7(6):e1000261. doi: 10.1371/journal.pmed.1000261.
    1. Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD, et al. Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA. 2013;309(8):814–22. doi: 10.1001/jama.2013.879.
    1. LOANNIDIS J, EVANS SJ, GØTZSCHE PC, O'NEILL RT, ALTMAN DG, SCHULZ K, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781–8. doi: 10.7326/0003-4819-141-10-200411160-00009.
    1. Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, et al. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008;5(1):e20. doi: 10.1371/journal.pmed.0050020.
    1. Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ (Clinical research ed) 2013;346:e7586.
    1. Montgomery P, Grant S, Hopewell S, Macdonald G, Moher D, Michie S, et al. Protocol for CONSORT-SPI: an extension for social and psychological interventions. Implement Sci. 2013;8(1):99. doi: 10.1186/1748-5908-8-99.
    1. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217. doi: 10.1371/journal.pmed.1000217.
    1. Simera I, Altman DG, Moher D, Schulz KF, Hoey J. Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors. PLoS Med. 2008;5:869–74. doi: 10.1371/journal.pmed.0050139.
    1. National Institute for Health Research. NIHR evaluation, trials and studies | Pilot studies 2015 [cited 2015 17 August]. Available from: .
    1. CONSORT Statement website. [Last accessed on 2015 17 August]. Available from: .
    1. Dolgin E. Publication checklist proposed to boost rigor of pilot trials. Nat Med. 2013;19(7):795–6. doi: 10.1038/nm0713-795.
    1. Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, Bond CM. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS ONE. 2016;11(3):e0150205. doi: 10.1371/journal.pone.0150205.
    1. Samaan Z, Mbuagbaw L, Kosa D, Borg Debono V, Dillenburg R, Zhang S, et al. A systematic scoping review of adherence to reporting guidelines in health care literature. J Multidiscip Healthc. 2013;6:169–88.
    1. The EQUATOR network. [Last accessed on 2015 17 August]. Available from: .
    1. Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CFB, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2:1–88.

Source: PubMed

Подписаться