Differential dropout and bias in randomised controlled trials: when it matters and when it may not

Melanie L Bell, Michael G Kenward, Diane L Fairclough, Nicholas J Horton, Melanie L Bell, Michael G Kenward, Diane L Fairclough, Nicholas J Horton

Abstract

Dropout in randomised controlled trials is common and threatens the validity of results, as completers may differ from people who drop out. Differing dropout rates between treatment arms is sometimes called differential dropout or attrition. Although differential dropout can bias results, it does not always do so. Similarly, equal dropout may or may not lead to biased results. Depending on the type of missingness and the analysis used, one can get a biased estimate of the treatment effect with equal dropout rates and an unbiased estimate with unequal dropout rates. We reinforce this point with data from a randomised controlled trial in patients with renal cancer and a simulation study.

Conflict of interest statement

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Figures

https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4784522/bin/belm006001.f1_default.jpg
Quality of life (QoL) stratified by treatment arm and dropout time. Possible range of QoL=0-100, with higher values indicating better QoL. If data were missing completely at random (MCAR), the within arm trajectories would be indistinguishable. As patients with lower baseline QoL are more likely drop out, these data are not MCAR

References

    1. Wood AM, White IR, Thompson SG. Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clin Trials 2004;1:368-76.
    1. Fielding S, Maclennan G, Cook JA, Ramsay CR. A review of RCTs in four medical journals to assess the use of imputation to overcome missing data in quality of life outcomes. Trials 2008;9:51.
    1. Panel on Handling Missing Data in Clinical Trials, National Research Council. The prevention and treatment of missing data in clinical trials. National Academies Press, 2010.
    1. Joly F, Vardy J, Pintilie M, Tannock IF. Quality of life and/or symptom control in randomized clinical trials for patients with advanced cancer. Ann Oncol 2007;18:1935-42.
    1. Fitzmaurice GM, Laird NM, Ware JH. Applied longitudinal analysis. 2nd ed. Wiley, 2011.
    1. Fairclough DF. Design and analysis of quality of life studies in clincial trials. 2nd ed. Chapman & Hall/CRC, 2010.
    1. Au HJ, Ringash J, Brundage M, Palmer M, Richardson H, Meyer RM, for the NCIC CTG Quality of Life Committee. Added value of health-related quality of life measurement in cancer clinical trials: the experience of the NCIC CTG. Expert Rev Pharmacoecon Outcomes Res 2010;10:119-28.
    1. Rubin DB. Inference and missing data. Biometrika 1976;63:581-92.
    1. Carpenter J, Kenward M. Missing data in randomised controlled trials—a practical guide. National Institute for Health Research, 2008.
    1. Carpenter JR, Kenward MG, Vansteelandt S. A comparison of multiple imputation and doubly robust estimation for analyses with missing data. J R Stat Soc Series A Statistics in Society 2006;169:571-84.
    1. Molenberghs G, Thijs H, Jansen I, Beunckens C, Kenward MG, Mallinckrodt C, et al. Analyzing incomplete longitudinal clinical trial data. Biostatistics 2004;5:445-64.
    1. Mallinckrodt CH, Clark WS, Carroll RJ, Molenberghs G. Assessing response profiles from incomplete longitudinal clinical trial data under regulatory considerations. J Biopharm Stat 2003;13:179-90.
    1. Robins JM, Rotnitzky A, Zhao LP. Analysis of semiparametric regression models for repeated outcomes in the presence of missing data. J Am Stat Assoc 1995;90:106-21.
    1. Molnar FJ, Man-Son-Hing M, Hutton B, Fergusson DA. Have last-observation-carried-forward analyses caused us to favour more toxic dementia therapies over less toxic alternatives? A systematic review. Open Med 2009;3:e31-50.
    1. Carpenter J, Roger J, Kenward M. Analysis of longitudinal trials with protocol deviations: a framework for relevant, accessible assumptions and inference via multiple imputation. J Biopharm Stat [forthcoming].
    1. White IR, Horton NJ, Carpenter J, Pocock SJ. Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ 2011;342:d40.
    1. Thomas RE, Wilson D, Sheps S. A literature review of randomized controlled trials of the organization of care at the end of life. Can J Aging 2006;25:271-93.
    1. Heneghan C, Perera R, Ward AA, Fitzmaurice D, Meats E, Glasziou P. Assessing differential attrition in clinical trials: self-monitoring of oral anticoagulation and type II diabetes. BMC Med Res Methodol 2007;7:18.
    1. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:c869.

Source: PubMed

3
Tilaa