Randomized controlled trials: who fails run-in?

Judy R Rees, Leila A Mott, Elizabeth L Barry, John A Baron, Jane C Figueiredo, Douglas J Robertson, Robert S Bresalier, Janet L Peacock, Judy R Rees, Leila A Mott, Elizabeth L Barry, John A Baron, Jane C Figueiredo, Douglas J Robertson, Robert S Bresalier, Janet L Peacock

Abstract

Background: Early identification of participants at risk of run-in failure (RIF) may present opportunities to improve trial efficiency and generalizability.

Methods: We conducted a partial factorial-design, randomized, controlled trial of calcium and vitamin D to prevent colorectal adenoma recurrence at 11 centers in the United States. At baseline, participants completed two self-administered questionnaires (SAQs) and a questionnaire administered by staff. Participants in the full factorial randomization (calcium, vitamin D, both, or neither) received a placebo during a 3-month single-blinded run-in; women electing to take calcium enrolled in a two-group randomization (calcium with vitamin D, or calcium alone) and received calcium during the run-in. Using logistic regression models, we examined baseline factors associated with RIF in three subgroups: men (N = 1606) and women (N = 301) in the full factorial randomization and women in the two-group randomization (N = 666).

Results: Overall, 314/2573 (12 %) participants failed run-in; 211 (67 %) took fewer than 80 % of their tablets (poor adherence), and 103 (33 %) withdrew or were uncooperative. In multivariable models, 8- to 13-fold variation was seen by study center in odds of RIF risk in the two largest groups. In men, RIF decreased with age (adjusted odds ratio [OR] per 5 years 0.85 [95 % confidence interval, CI; 0.76-0.96]) and was associated with being single (OR 1.65 [95 % CI; 1.10-2.47]), not graduating from high school (OR 2.77 [95 % CI; 1.58-4.85]), and missing SAQ data (OR 1.97 [1.40-2.76]). Among women, RIF was associated primarily with health-related factors; RIF risk was lower with higher physical health score (OR 0.73 [95 % CI; 0.62-0.86]) and baseline multivitamin use (OR 0.44 [95 % CI; 0.26-0.75]). Women in the 5-year colonoscopy surveillance interval were at greater risk of RIF than those with 3-year follow-up (OR 1.91 [95 % CI; 1.08-3.37]), and the number of prescription medicines taken was also positively correlated with RIF (p = 0.03). Perceived toxicities during run-in were associated with 12- to 29-fold significantly increased odds of RIF.

Conclusions: There were few common baseline predictors of run-in failure in the three randomization groups. However, heterogeneity in run-in failure associated with study center, and missing SAQ data reflect potential opportunities for intervention to improve trial efficiency and retention.

Trial registration: ClinicalTrials.gov: NCT00153816 . Registered September 2005.

Keywords: Adherence; Generalizability; Randomized controlled trials; Run-in.

Figures

Fig. 1
Fig. 1
CONSORT flow diagram

References

    1. Ulmer M, Robinaugh D, Friedberg JP, Lipsitz SR, Natarajan S. Usefulness of a run-in period to reduce drop-outs in a randomized controlled trial of a behavioral intervention. Contemp Clin Trials. 2008;29(5):705–10. doi: 10.1016/j.cct.2008.04.005.
    1. Pablos-Mendez A, Barr RG, Shea S. Run-in periods in randomized trials: implications for the application of results in clinical practice. JAMA. 1998;279(3):222–5. doi: 10.1001/jama.279.3.222.
    1. Frost C, Kenward MG, Fox NC. Optimizing the design of clinical trials where the outcome is a rate. Can estimating a baseline rate in a run-in period increase efficiency? Stat Med. 2008;27(19):3717–31. doi: 10.1002/sim.3280.
    1. Berger VW, Rezvani A, Makarewicz VA. Direct effect on validity of response run-in selection in clinical trials. Control Clin Trials. 2003;24(2):156–66. doi: 10.1016/S0197-2456(02)00316-1.
    1. Baron JA, Barry EL, Mott LA, Rees JR, Sandler RS, Snover DC, et al. A trial of calcium and vitamin D for the prevention of colorectal adenomas. N Engl J Med. 2015;373(16):1519–30. doi: 10.1056/NEJMoa1500409.
    1. Davis CE, Applegate WB, Gordon DJ, Curtis RC, McCormick M. An empirical evaluation of the placebo run-in. Control Clin Trials. 1995;16(1):41–50. doi: 10.1016/0197-2456(94)00027-Z.
    1. Blackwelder WC, Hastings BK, Lee ML, Deloria MA. Value of a run-in period in a drug trial during pregnancy. Control Clin Trials. 1990;11(3):187–98. doi: 10.1016/0197-2456(90)90013-R.
    1. Newburg SM, Holland AE, Pearce LA. Motivation of subjects to participate in a research trial. Appl Nurs Res. 1992;5(2):89–93. doi: 10.1016/S0897-1897(05)80020-5.
    1. Cassileth BR, Lusk EJ, Miller DS, Hurwitz S. Attitudes toward clinical trials among patients and the public. JAMA. 1982;248(8):968–70. doi: 10.1001/jama.1982.03330080050028.
    1. Mattson ME, Curb JD, McArdle R. Participation in a clinical trial: the patients’ point of view. Control Clin Trials. 1985;6(2):156–67. doi: 10.1016/0197-2456(85)90121-7.
    1. Rosenbaum JR, Wells CK, Viscoli CM, Brass LM, Kernan WN, Horwitz RI. Altruism as a reason for participation in clinical trials was independently associated with adherence. J Clin Epidemiol. 2005;58(11):1109–14. doi: 10.1016/j.jclinepi.2005.03.014.
    1. Hudmon KS, Chamberlain RM, Frankowski RF. Outcomes of a placebo run-in period in a head and neck cancer chemoprevention trial. Control Clin Trials. 1997;18(3):228–40. doi: 10.1016/S0197-2456(97)00004-4.
    1. Glynn RJ, Buring JE, Manson JE, LaMotte F, Hennekens CH. Adherence to aspirin in the prevention of myocardial infarction. The Physicians’ Health Study. Arch Int Med. 1994;154(23):2649–57. doi: 10.1001/archinte.1994.00420230032005.
    1. Brittain E, Wittes J. The run-in period in clinical trials. The effect of misclassification on efficiency. [Erratum appears in Control Clin Trials 1991 Jun;12(3):456] Control Clin Trials. 1990;11(5):327–38. doi: 10.1016/0197-2456(90)90174-Z.
    1. Franciosa JA. Commentary on the use of run-in periods in clinical trials. Am J Cardiol. 1999;83(6):942–4. doi: 10.1016/S0002-9149(98)01057-1.
    1. Steering Committee of the Physicians’ Health Study Research Group Final report on the aspirin component of the ongoing Physicians’ Health Study. N Engl J Med. 1989;321(3):129–35. doi: 10.1056/NEJM198907203210301.
    1. Peto R, Gray R, Collins R, Wheatley K, Hennekens C, Jamrozik K, et al. Randomised trial of prophylactic daily aspirin in British male doctors. BMJ. 1988;296(6618):313–6. doi: 10.1136/bmj.296.6618.313.
    1. Affuso O, Kaiser KA, Carson TL, Ingram KH, Schwiers M, Robertson H, et al. Association of run-in periods with weight loss in obesity randomized controlled trials. Obes Rev. 2014;15(1):68–73. doi: 10.1111/obr.12111.
    1. Coronary Drug Project Research Group Influence of adherence to treatment and response of cholesterol on mortality in the coronary drug project. N Engl J Med. 1980;303(18):1038–41. doi: 10.1056/NEJM198010303031804.
    1. Epstein LH. The direct effects of compliance on health outcome. Health Psychol. 1984;3(4):385–93. doi: 10.1037/0278-6133.3.4.385.
    1. Horwitz RI, Viscoli CM, Berkman L, Donaldson RM, Horwitz SM, Murray CJ, et al. Treatment adherence and risk of death after a myocardial infarction. Lancet. 1990;336(8714):542–5. doi: 10.1016/0140-6736(90)92095-Y.
    1. Granger BB, Swedberg K, Ekman I, Granger CB, Olofsson B, McMurray JJ, et al. Adherence to candesartan and placebo and outcomes in chronic heart failure in the CHARM programme: double-blind, randomised, controlled clinical trial. Lancet. 2005;366(9502):2005–11. doi: 10.1016/S0140-6736(05)67760-4.
    1. Gallagher EJ, Viscoli CM, Horwitz RI. The relationship of treatment adherence to the risk of death after myocardial infarction in women. JAMA. 1993;270(6):742–4. doi: 10.1001/jama.1993.03510060088038.
    1. Martin KA, Bowen DJ, Dunbar-Jacob J, Perri MG. Who will adhere? Key issues in the study and prediction of adherence in randomized controlled trials. Control Clin Trials. 2000;21(5 Suppl):195S–9S. doi: 10.1016/S0197-2456(00)00078-7.
    1. Dunbar-Jacob J, Erlen JA, Schlenk EA, Ryan CM, Sereika SM, Doswell WM. Adherence in chronic disease. Ann Rev Nurs Res. 2000;18:48–90.
    1. Verheggen FW, Nieman FH, Reerink E, Kok GJ. Patient satisfaction with clinical trial participation. Int J Qual Health Care. 1998;10(4):319–30. doi: 10.1093/intqhc/10.4.319.
    1. Barsky AJ, Saintfort R, Rogers MP, Borus JF. Nonspecific medication side effects and the nocebo phenomenon. JAMA. 2002;287(5):622–7. doi: 10.1001/jama.287.5.622.
    1. Rief W, Avorn J, Barsky AJ. Medication-attributed adverse effects in placebo groups: implications for assessment of adverse effects. Arch Int Med. 2006;166(2):155–60. doi: 10.1001/archinte.166.2.155.
    1. Rosenzweig P, Brohier S, Zipfel A. The placebo effect in healthy volunteers: influence of experimental conditions on the adverse events profile during phase I studies. Clin Pharmacol Ther. 1993;54(5):578–83. doi: 10.1038/clpt.1993.190.
    1. van Onzenoort HA, Verberk WJ, Kessels AG, Kroon AA, Neef C, van der Kuy PH, et al. Assessing medication adherence simultaneously by electronic monitoring and pill count in patients with mild-to-moderate hypertension. Am J Hypertens. 2010;23(2):149–54. doi: 10.1038/ajh.2009.207.

Source: PubMed

3
订阅