Reporting methods of blinding in randomized trials assessing nonpharmacological treatments

Isabelle Boutron, Lydia Guittet, Candice Estellat, David Moher, Asbjørn Hróbjartsson, Philippe Ravaud, Isabelle Boutron, Lydia Guittet, Candice Estellat, David Moher, Asbjørn Hróbjartsson, Philippe Ravaud

Abstract

Background: Blinding is a cornerstone of treatment evaluation. Blinding is more difficult to obtain in trials assessing nonpharmacological treatment and frequently relies on "creative" (nonstandard) methods. The purpose of this study was to systematically describe the strategies used to obtain blinding in a sample of randomized controlled trials of nonpharmacological treatment.

Methods and findings: We systematically searched in Medline and the Cochrane Methodology Register for randomized controlled trials (RCTs) assessing nonpharmacological treatment with blinding, published during 2004 in high-impact-factor journals. Data were extracted using a standardized extraction form. We identified 145 articles, with the method of blinding described in 123 of the reports. Methods of blinding of participants and/or health care providers and/or other caregivers concerned mainly use of sham procedures such as simulation of surgical procedures, similar attention-control interventions, or a placebo with a different mode of administration for rehabilitation or psychotherapy. Trials assessing devices reported various placebo interventions such as use of sham prosthesis, identical apparatus (e.g., identical but inactivated machine or use of activated machine with a barrier to block the treatment), or simulation of using a device. Blinding participants to the study hypothesis was also an important method of blinding. The methods reported for blinding outcome assessors relied mainly on centralized assessment of paraclinical examinations, clinical examinations (i.e., use of video, audiotape, photography), or adjudications of clinical events.

Conclusions: This study classifies blinding methods and provides a detailed description of methods that could overcome some barriers of blinding in clinical trials assessing nonpharmacological treatment, and provides information for readers assessing the quality of results of such trials.

Conflict of interest statement

Competing Interests: The authors have declared that no competing interests exist.

Figures

Figure 1. Flow of Records, Citations, and…
Figure 1. Flow of Records, Citations, and Articles through the Cross-Sectional Study
Figure 2. Sham Procedure Performed According to…
Figure 2. Sham Procedure Performed According to the Category of Treatment Assessed
Figure 3. Methods of Blinding Participants, Health…
Figure 3. Methods of Blinding Participants, Health Care Providers, or Other Caregivers That Rely on the Category of Treatment and Comparator Assessed
Figure 4. Methods of Blinding Outcome Assessors…
Figure 4. Methods of Blinding Outcome Assessors Depending on the Primary Outcome Considered

References

    1. Gluud LL. Bias in clinical intervention research. Am J Epidemiol. 2006;163:493–501.
    1. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273:408–412.
    1. Schulz KF, Chalmers I, Altman DG. The landscape and lexicon of blinding in randomized trials. Ann Intern Med. 2002;136:254–259.
    1. Schulz KF, Grimes DA, Altman DG, Hayes RJ. Blinding and exclusions after allocation in randomised controlled trials: Survey of published parallel group trials in obstetrics and gynaecology. BMJ. 1996;312:742–744.
    1. Devereaux PJ, Manns BJ, Ghali WA, Quan H, Lacchetti C, et al. Physician interpretations and textbook definitions of blinding terminology in randomized controlled trials. JAMA. 2001;285:2000–2003.
    1. Montori V, Bhandari M, Devereaux P, Manns B, Ghali W, et al. In the dark: The reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787.
    1. Hrobjartsson A. What are the main methodological problems in the estimation of placebo effects? J Clin Epidemiol. 2002;55:430–435.
    1. Hrobjartsson A, Gotzsche PC. Is the placebo powerless? An analysis of clinical trials comparing placebo with no treatment. N Engl J Med. 2001;344:1594–1602.
    1. Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, et al. The impact of blinding on the results of a randomized, placebo- controlled multiple sclerosis clinical trial. Neurology. 1994;44:16–20.
    1. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, et al. The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Ann Intern Med. 2001;134:663–694.
    1. Moher D, Pham B, Jones A, Cook DJ, Jadad AR, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352:609–613.
    1. Juni P, Altman DG, Egger M. Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ. 2001;323:42–46.
    1. Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001;135:982–989.
    1. Fergusson D, Glass KC, Waring D, Shapiro S. Turning a blind eye: The success of blinding reported in a random sample of randomised, placebo controlled trials. BMJ. 2004;328:432.
    1. Sackett DL. Turning a blind eye: Why we don't test for blindness at the end of our trials. BMJ. 2004;328:1136.
    1. Boutron I, Estellat C, Ravaud P. A review of blinding in randomized controlled trials found results inconsistent and questionable. J Clin Epidemiol. 2005;58:1220–1226.
    1. Hrobjartsson A, Forfang E, Haahr M, Als-Nielsen B, Stig B. Testing the success of blinding in randomised clinical trials [abstract]; 12th Cochrane Colloquium: Bridging the Gaps; 2004 2–6 October;; Ottawa, Ontario, Canada.. 2004. pp. 138–139.
    1. Boutron I, Tubach F, Giraudeau B, Ravaud P. Blinding was judged more difficult to achieve and maintain in non-pharmacological than pharmacological trials. J Clin Epidemiol. 2004;57:543–550.
    1. Boutron I, Tubach F, Giraudeau B, Ravaud P. Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA. 2003;290:1062–1070.
    1. McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D. Randomised trials in surgery: Problems and possible solutions. BMJ. 2002;324:1448–1451.
    1. Lilford R, Braunholtz D, Harris J, Gill T. Trials in surgery. Br J Surg. 2004;91:6–16.
    1. Devereaux PJ, Bhandari M, Clarke M, Montori VM, Cook DJ, et al. Need for expertise based randomised controlled trials. BMJ. 2005;330:88.
    1. Devereaux PJ, McKee MD, Yusuf S. Methodologic issues in randomized controlled trials of surgical interventions. Clin Orthop Relat Res. 2003. pp. 25–32.
    1. Bhandari M, Richards RR, Sprague S, Schemitsch EH. The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am. 2002;84-A:388–396.
    1. Jacquier I, Boutron I, Moher D, Roy C, Ravaud P. The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: A systematic review. Ann Surg. 2006;244:677–683.
    1. Ethgen M, Boutron I, Baron G, Giraudeau B, Sibilia J, et al. Reporting of harm in randomized, controlled trials of nonpharmacologic treatment for rheumatic disease. Ann Intern Med. 2005;143:20–25.
    1. Boutron I, Estellat C, Guittet L, Dechartres A, Sackett DL, et al. Methods of blinding in reports of randomized controlled trials assessing pharmacological treatments. A systematic review. PLoS Med. 2006;3:e425. doi: .
    1. Lee KP, Schotland M, Bacchetti P, Bero LA. Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002;287:2805–2808.
    1. Freed CR, Greene PE, Breeze RE, Tsai WY, DuMouchel W, et al. Transplantation of embryonic dopamine neurons for severe Parkinson's disease. N Engl J Med. 2001;344:710–719.
    1. Balon J, Aker PD, Crowther ER, Danielson C, Cox PG, et al. A comparison of active and simulated chiropractic manipulation as adjunctive treatment for childhood asthma. N Engl J Med. 1998;339:1013–1020.
    1. Baker KR, Nelson ME, Felson DT, Layne JE, Sarno R, et al. The efficacy of home based progressive strength training in older adults with knee osteoarthritis: A randomized controlled trial. J Rheumatol. 2001;28:1655–1665.
    1. Wolsko PM, Eisenberg DM, Simon LS, Davis RB, Walleczek J, et al. Double-blind placebo-controlled trial of static magnets for the treatment of osteoarthritis of the knee: Results of a pilot study. Altern Ther Health Med. 2004;10:36–43.
    1. Quilty B, Tucker M, Campbell R, Dieppe P. Physiotherapy, including quadriceps exercises and patellar taping, for knee osteoarthritis with predominant patello-femoral joint involvement: Randomized controlled trial. J Rheumatol. 2003;30:1311–1317.
    1. Edinger JD, Wohlgemuth WK, Radtke RA, Marsh GR, Quillian RE. Cognitive behavioral therapy for treatment of chronic primary insomnia: A randomized controlled trial. JAMA. 2001;285:1856–1864.
    1. Wang SM, Maranets I, Weinberg ME, Caldwell-Andrews AA, Kain ZN. Parental auricular acupuncture as an adjunct for parental presence during induction of anesthesia. Anesthesiology. 2004;100:1399–1404.
    1. Carbajal R, Veerapen S, Couderc S, Jugie M, Ville Y. Analgesic effect of breast feeding in term neonates: Randomised controlled trial. BMJ. 2003;326:13.
    1. Boutron I, Moher D, Tugwell P, Giraudeau B, Poiraudeau S, et al. A checklist to evaluate a report of a nonpharmacological trial (CLEAR NPT) was developed using consensus. J Clin Epidemiol. 2005;58:1233–1240.
    1. Paterson C, Dieppe P. Characteristic and incidental (placebo) effects in complex interventions such as acupuncture. BMJ. 2005;330:1202–1205.
    1. Moseley JB, O'Malley K, Petersen NJ, Menke TJ, Brody BA, et al. A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2002;347:81–88.
    1. Spigt MG, Knipschild PG, van Schayck CP, Knottnerus JA. The validity and ethics of giving placebo in a randomized nonpharmacologic trial was evaluated. J Clin Epidemiol. 2005;58:350–356.
    1. Zelen M. Randomised consent trials. Lancet. 1992;340:375.
    1. Boter H, van Delden JJ, de Haan RJ, Rinkel GJ. Patients' evaluation of informed consent to postponed information: Cohort study. BMJ. 2004;329:86.
    1. Bishop FL, Yardley L, Lewith G. Developing a measure of treatment beliefs: The complementary and alternative medicine beliefs inventory. Complement Ther Med. 2005;13:144–149.
    1. Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31:73–86.
    1. Torgerson D, Moffett JK. Patient preference and validity of randomized controlled trials. JAMA. 2005;294:41–42.
    1. Torgerson DJ, Roland M. What is Zelen's design? BMJ. 1998;316:606.
    1. McPherson K, Britton A. The impact of patient treatment preferences on the interpretation of randomised controlled trials. Eur J Cancer. 1999;35:1598–1602.
    1. McPherson K, Britton A. Preferences and understanding their effects on health. Qual Health Care 10 Suppl. 2001;1:i61–66.
    1. McPherson K, Britton AR, Wennberg JE. Are randomized controlled trials controlled? Patient preferences and unblind trials. J R Soc Med. 1997;90:652–656.
    1. McPherson K, Chalmers I. Incorporating patient preferences into clinical trials. Information about patients' preference must be obtained first. BMJ. 1998;317:78. 78–79. discussion.
    1. Halpern S. Evaluating preference effects in partially unblinded, randomized clinical trials. J Clin Epidemiol. 2003;56:109–115.
    1. Wood L. The association of allocation and blinding with estimated treatment effect varies according to type of outcome: a combined analysis of meta-epidemiological studies; 14th Cochrane Colloquium:Bridging the Gaps; 2006 23–26 October;; Dublin, Ireland.. 2006.
    1. Gerritsen AA, de Vet HC, Scholten RJ, Bertelsmann FW, de Krom MC, et al. Splinting vs surgery in the treatment of carpal tunnel syndrome: A randomized controlled trial. JAMA. 2002;288:1245–1251.
    1. Altman DG, Schulz KF, Moher D. Turning a blind eye: Testing the success of blinding and the CONSORT statement. BMJ. 2004;328:1135–1136.
    1. Sackett D, Gent M, Taylor D. Tests for the blindness of randomized trials may not. Clin Res. 1986;34:711A.
    1. Senn SJ. Turning a blind eye: Authors have blinkered view of blinding. BMJ. 2004;328:1135–1136.
    1. Pildal J, Chan AW, Hrobjartsson A, Forfang E, Altman DG, et al. Comparison of descriptions of allocation concealment in trial protocols and the published reports: Cohort study. BMJ. 2005;330:1049.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe