Improving the reporting of pragmatic trials: an extension of the CONSORT statement

Merrick Zwarenstein, Shaun Treweek, Joel J Gagnier, Douglas G Altman, Sean Tunis, Brian Haynes, Andrew D Oxman, David Moher, CONSORT group, Pragmatic Trials in Healthcare (Practihc) group, Merrick Zwarenstein, Shaun Treweek, Joel J Gagnier, Douglas G Altman, Sean Tunis, Brian Haynes, Andrew D Oxman, David Moher, CONSORT group, Pragmatic Trials in Healthcare (Practihc) group

Abstract

The CONSORT statement is intended to improve reporting of randomised controlled trials and focuses on minimising the risk of bias (internal validity). The applicability of a trial's results (generalisability or external validity) is also important, particularly for pragmatic trials. A pragmatic trial (a term first used in 1967 by Schwartz and Lellouch) can be broadly defined as a randomised controlled trial whose purpose is to inform decisions about practice. This extension of the CONSORT statement is intended to improve the reporting of such trials and focuses on applicability. Methods At two, two-day meetings held in Toronto in 2005 and 2008, we reviewed the CONSORT statement and its extensions, the literature on pragmatic trials and applicability, and our experiences in conducting pragmatic trials. Recommendations We recommend extending eight CONSORT checklist items for reporting of pragmatic trials: the background, participants, interventions, outcomes, sample size, blinding, participant flow, and generalisability of the findings. These extensions are presented, along with illustrative examples of reporting, and an explanation of each extension. Adherence to these reporting criteria will make it easier for decision makers to judge how applicable the results of randomised controlled trials are to their own conditions. Empirical studies are needed to ascertain the usefulness and comprehensiveness of these CONSORT checklist item extensions. In the meantime we recommend that those who support, conduct, and report pragmatic trials should use this extension of the CONSORT statement to facilitate the use of trial results in decisions about health care.

Conflict of interest statement

Competing interests: None declared.

Provenance and peer review: Not commissioned; externally peer reviewed.

References

    1. Altman DG, Bland JM. Statistics notes. Treatment allocation in controlled trials: why randomise? BMJ 1999;318:1209.
    1. Guyatt GH, Haynes RB, Jaeschke RZ, Cook DJ, Green L, Naylor CD, et al. Users’ guides to the medical literature: XXV. Evidence-based medicine: principles for applying the users’ guides to patient care. JAMA 2000;284:1290-6.
    1. Chan AW, Altman DG. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet 2005;365:1159-62.
    1. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne DG, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001;134:663-94.
    1. Gluud LL. Bias in clinical intervention research. Am J Epidemiol 2006;163:493-501.
    1. Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis 1967;20:637-48.
    1. North American Symptomatic Carotid Endarterectomy Trial Collaborators. Beneficial effect of carotid endarterectomy in symptomatic patients with high-grade carotid stenosis. N Engl J Med 1991;325:445-53.
    1. Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, et al. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ 2006;333:623-8.
    1. Coca SG, Krumholz HM, Garg AX, Parikh CR. Underrepresentation of renal disease in randomized controlled trials of cardiovascular disease. JAMA 2006;296:1377-84.
    1. Lee PY, Alexander KP, Hammill BG, Pasquali SK, Peterson ED. Representation of elderly persons and women in published randomized trials of acute coronary syndromes. JAMA 2001;286:708-13.
    1. Zarin DA, Young JL, West JC. Challenges to evidence-based medicine: a comparison of patients and treatments in randomized controlled trials with patients and treatments in a practice research network. Soc Psychiatry Psychiatr Epidemiol 2005;40:27-35.
    1. Liberati A. The relationship between clinical trials and clinical practice: the risks of underestimating its complexity. Stat Med 1994;13:1485-91.
    1. Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 2003;290:1624-32.
    1. Marson A, Kadir Z, Chadwick D. Large pragmatic randomised studies of new antiepileptic drugs are needed. BMJ 1997;314:1764.
    1. Williams H. Fungal infections of skin and nails of feet. Pragmatic clinical trial is now needed. BMJ 1999;319:1070-1.
    1. Lieberman JA, Stroup TS. Guest editors’ introduction: what can large pragmatic clinical trials do for public mental health care? Schizophr Bull 2003;29:1-6.
    1. Roland M, Torgerson DJ. What are pragmatic trials? BMJ 1998;316:285.
    1. Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?” Lancet 2005;365:82-93.
    1. Macpherson H. Pragmatic clinical trials. Complement Ther Med 2004;12:136-40.
    1. Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, et al. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol 2003;3:28.
    1. Hotopf M, Churchill R, Lewis G. Pragmatic randomised controlled trials in psychiatry. Br J Psychiatry 1999;175:217-23.
    1. Engel CC. Explanatory and pragmatic perspectives regarding idiopathic physical symptoms and related syndromes. CNS Spectr 2006;11:225-32.
    1. Whittaker K, Sutton C, Burton C. Pragmatic randomised controlled trials in parenting research: the issue of intention to treat. J Epidemiol Community Health 2006;60:858-64.
    1. Coutinho ES, Huf G, Bloch KV. [Pragmatic clinical trials: an option in the construction of health-related evidence]. Cad Saude Publica 2003;19:1189-93.
    1. Ernst E, Canter PH. Limitations of “pragmatic” trials. Postgrad Med J 2005;81:203.
    1. Vallve C. [A critical review of the pragmatic clinical trial]. Med Clin (Barc) 2003;121:384-8.
    1. Thompson SG, Barber JA. How should cost data in pragmatic randomised trials be analysed? BMJ 2000;320:1197-200.
    1. Silverman WA. Sample size, representativeness, and credibility in pragmatic neonatal trials. Am J Perinatol 1987;4:129-30.
    1. Andersen B. [Principles of medical statistics. XII. Causal or pragmatic clinical research?]. Nord Med 1971;86:1434-6.
    1. Flamant R. [From the explanatory to the pragmatic]. Bull Cancer 1987;74:169-76.
    1. Eschwege E, Bouvenot G. [Explanatory or pragmatic trials, the dualism]. Rev Med Interne 1994;15:357-61.
    1. Califf RM, Woodlief LH. Pragmatic and mechanistic trials. Eur Heart J 1997;18:367-70.
    1. Resch K. Pragmatic randomised controlled trials for complex therapies. Forsch Komplementarmed 1998;5(suppl S1):136-9.
    1. Charlton BG. Understanding randomized controlled trials: explanatory or pragmatic? Fam Pract 1994;11:243-4.
    1. Algra A, van der Graff Y. [Roaming through methodology. XII. Pragmatic and pathophysiologic trials: a question of goal formulation]. Ned Tijdschr Geneeskd 1999. 6;143:514-7.
    1. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof 2006;29:126-53.
    1. Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA. Practical clinical trials for translating research to practice: design and measurement recommendations. Med Care 2005;43:551-7.
    1. Tansella M, Thornicroft G, Barbui C, Cipriani A, Saraceno B. Seven criteria for improving effectiveness trials in psychiatry. Psychol Med 2006;36:711-20.
    1. CONSORT Group. CONSORT statement 2007. .
    1. Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 2001;357:1191-4.
    1. CONSORT Group. CONSORT endorsers—journals. 2007. .
    1. Davidoff F. News from the International Committee of Medical Journal Editors. Ann Intern Med 2000;133:229-31.
    1. CONSORT Group. CONSORT translations. 2007. .
    1. Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 2006;185:263-7.
    1. Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJ. Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. JAMA 2006;295:1152-60.
    1. Campbell MK, Elbourne DR, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ 2004;328:702-8.
    1. Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, et al. CONSORT for reporting randomised trials in journal and conferences abstracts. Lancet 2008;371:281-3.
    1. Ioannidis JP, Evans SJ, Gotzsche PC, O’Neill RT, Altman DG, Schulz K, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med 2004;141:781-8.
    1. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med 2006;144:364-7.
    1. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, the CONSORT Group. Reporting of nonpharmacological treatment interventions: an extension of the CONSORT statement. Ann Intern Med 2008;w60-66.
    1. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, the CONSORT Group. Extending the CONSORT statement to trials reporting nonpharmacological treatments: extension and elaboration. Ann Intern Med 2008;148:295-309.
    1. Pragmatic Randomized Controlled Trials in HealthCare. .
    1. Wu JY, Leung WY, Chang S, Lee B, Zee B, Tong PC, et al. Effectiveness of telephone counselling by a pharmacist in reducing mortality in patients receiving polypharmacy: randomised controlled trial. BMJ 2006;333:522.
    1. Wright NM, Sheard L, Tompkins CN, Adams CE, Allgar VL, Oldham NS. Buprenorphine versus dihydrocodeine for opiate detoxification in primary care: a randomised controlled trial. BMC Fam Pract 2007;8:3.
    1. Figueiras A, Herdeiro MT, Polonia J, Gestal-Otero JJ. An educational intervention to improve physician reporting of adverse drug reactions: a cluster-randomized controlled trial. JAMA 2006;296:1086-93.
    1. Crotty M, Whitehead CH, Wundke R, Giles LC, Ben-Tovim D, Phillips PA. Transitional care facility for elderly people in hospital awaiting a long term care bed: randomised controlled trial. BMJ 2005;331:1110.
    1. Juurlink DN, Mamdani MM, Lee DS, Kopp A, Austin PC, Laupacis A, et al. Rates of hyperkalemia after publication of the randomized aldactone evaluation study. N Engl J Med 2004;351:543-51.
    1. Van Spall HG, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA 2007;297:1233-40.
    1. Hutchings J, Gardner F, Bywater T, Daley D, Whitaker C, Jones K, et al. Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial. BMJ 2007;334:678.
    1. Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ 2004;328:1561-3.
    1. Schroter S, Glasziou PP, Heneghan CJ. Quality of descriptions of treatments: a review of published randomised controlled trials. BMJ (in press).
    1. Hay EM, Paterson SM, Lewis M, Hosie G, Croft P. Pragmatic randomised controlled trial of local corticosteroid injection and naproxen for treatment of lateral epicondylitis of elbow in primary care. BMJ 1999;319:964-8.
    1. Mutrie N, Campbell AM, Whyte F, McConnachie A, Emslie C, Lee L, et al. Benefits of supervised group exercise programme for women being treated for early stage breast cancer: pragmatic randomised controlled trial. BMJ 2007;334:517.
    1. Edwards A, Elwyn G, Hood K, Atwell C, Robling M, Houston H, et al. Patient-based outcome results from a cluster randomized trial of shared decision making skill development and use of risk communication aids in general practice. Fam Pract 2004;21:347-54.
    1. Scheel IB, Hagen KB, Herrin J, Carling C, Oxman AD. Blind faith? The effects of promoting active sick leave for back pain patients. A cluster-randomised trial. Spine 2002;27:2734-40.
    1. Roland M, Torgerson D. Understanding controlled trials: what outcomes should be measured? BMJ 1998;317:1075.
    1. Steinsbekk A, Fonnebo V, Lewith G, Bentzen N. Homeopathic care for the prevention of upper respiratory tract infections in children: a pragmatic, randomised, controlled trial comparing individualised homeopathic care and waiting-list controls. Complement Ther Med 2005;13:231-8.
    1. Schulz KF, Altman DG, Moher D. Blinding is better than masking. BMJ 2007:334:918.
    1. Jarman B, Hurwitz B, Cook A, Bajekal M, Lee A. Effects of community based nurses specialising in Parkinson’s disease on health outcome and costs: randomised controlled trial. BMJ 2002;324:1072-5.
    1. Loeb M, Carusone SC, Goeree R, Walter SD, Brazil K, Krueger P, et al. Effect of a clinical pathway to reduce hospitalizations in nursing home residents with pneumonia: a randomized controlled trial. JAMA 2006;295:2503-10.
    1. Thorpe KE, Zwarenstein M, Oxman A, Treweek S, Furberg CD, Altman DG, et al. A proposal for graphing randomized controlled trials within the pragmatic-explanatory continuum: PRECIS. J Clin Epidemiol (in press).

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe