Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs

Karla Hemming, Richard Lilford, Alan J Girling, Karla Hemming, Richard Lilford, Alan J Girling

Abstract

Stepped-wedge cluster randomised trials (SW-CRTs) are being used with increasing frequency in health service evaluation. Conventionally, these studies are cross-sectional in design with equally spaced steps, with an equal number of clusters randomised at each step and data collected at each and every step. Here we introduce several variations on this design and consider implications for power. One modification we consider is the incomplete cross-sectional SW-CRT, where the number of clusters varies at each step or where at some steps, for example, implementation or transition periods, data are not collected. We show that the parallel CRT with staggered but balanced randomisation can be considered a special case of the incomplete SW-CRT. As too can the parallel CRT with baseline measures. And we extend these designs to allow for multiple layers of clustering, for example, wards within a hospital. Building on results for complete designs, power and detectable difference are derived using a Wald test and obtaining the variance-covariance matrix of the treatment effect assuming a generalised linear mixed model. These variations are illustrated by several real examples. We recommend that whilst the impact of transition periods on power is likely to be small, where they are a feature of the design they should be incorporated. We also show examples in which the power of a SW-CRT increases as the intra-cluster correlation (ICC) increases and demonstrate that the impact of the ICC is likely to be smaller in a SW-CRT compared with a parallel CRT, especially where there are multiple levels of clustering. Finally, through this unified framework, the efficiency of the SW-CRT and the parallel CRT can be compared.

Keywords: cluster; multiple levels of clustering; sample size; stepped-wedge.

© 2014 The Authors. Statistics in Medicine Published by John Wiley & Sons Ltd.

Figures

Figure 1
Figure 1
Illustration of a stepped-wedge study of complete design.
Figure 2
Figure 2
Illustration of a stepped-wedge study of incomplete design with one before and two after measurements.
Figure 3
Figure 3
Illustration of a stepped-wedge study of incomplete design with an implementation period.
Figure 4
Figure 4
Illustrative example of staggered, but parallel, CRT.
Figure 5
Figure 5
Illustrative example of SW-CRT with two layers of clustering (wards within a hospital).
Figure 6
Figure 6
Design effects for parallel CRT (solid line) and before and after (dashed line) designs.
Figure 7
Figure 7
The sweeping study, an illustrative example of stepped-wedge study of incomplete design (Example 1).
Figure 8
Figure 8
Influence of clustering within clustering in a parallel CRT.
Figure 9
Figure 9
Influence of clustering within clustering in a SW-CRT.
Figure 10
Figure 10
The nursery study, an illustrative example of a staggered but parallel cluster trial (Example 3)

References

    1. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Medical Research Methodology. 2006;6:54.
    1. Mdege ND, Man MS, Brown CATN, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. Journal of Clinical Epidemiology. 2011;64:936–948.
    1. Murray DM. The Design and Analysis of Group-Randomized Trials. London: Oxford, University Press; 1998.
    1. Donner A, Klar N. Design and Analysis of Cluster Randomised Trials in Health Research. London: Arnold; 2000.
    1. Campbell MK, Thomson S, Ramsay CR, MacLennan GS, Grimshaw JM. Sample size calculator for cluster randomised trials. Computers in Biology and Medicine. 2004;34:113–125.
    1. Bland JM. Cluster randomised trials in the medical literature: two bibliometric surveys. BMC Research Methodology. 2004;13:4–21.
    1. Hemming K, Girling AJ, Sitch AJ, Marsh J, Lilford RJ. Sample size calculations for cluster randomised controlled trials with a fixed number of clusters. BMC Medical Research Methodology. 2011;11:102.
    1. Taljaard M, McRae AD, Weijer C, Bennett C, Dixon S, Taleban J, Skea Z, Eccles MP, Brehaut JC, Donner A, Saginur R, Boruch RF, Grimshaw JM. Inadequate reporting of research ethics review and informed consent in cluster randomised trials: review of random sample of published trials. BMJ. 2011;342 . DOI:10.1136/bmj.d2496.
    1. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemporary Clinical Trials. 2007;28:182–191.
    1. Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. Journal of Clinical Epidemiology. 2013;66(7):752–758.
    1. Priestley G, Watson W, Rashidian A, Mozley C, Russell D, Wilson J, Cope J, Hart D, Kay D, Cowley K, Pateraki J. Introducing critical care outreach: a ward-randomised trial of phased introduction in a general hospital. Intensive Care Medicine. 2004;7:1398–1404.
    1. Marshall T, Caley M, Hemming K, Gill P, Gale N, Jolly K. Mixed methods evaluation of targeted case finding for cardiovascular disease prevention using a stepped wedged cluster RCT. BMC Public Health. 2012;12:908.
    1. Teerenstra S, Eldridge S, Graff M, de Hoop E, Borm GF. A simple sample size formula for analysis of covariance in cluster randomized trials. Statistics in Medicine. 2012;31(20):2169–2178.
    1. Heo M, Leon AC. Statistical power and sample size requirements for three level hierarchical cluster randomised trials. Biometrics. 2008;64:1256–1262.
    1. Teerenstra S, Moerbeek M, van Achterberg T, Pelzer BJ, Borm GF. Sample size calculations for 3-level cluster randomized trials. Clinical Trials. 2008;5(5):486–495.
    1. Moerbeek M. The consequence of ignoring a level of nesting in multilevel analysis. Multivariate Behavioral Research. 2004;39(1):129–149.
    1. Hemming K, Girling A, Martin J, Bond SJ. Stepped wedge cluster randomized trials are efficient and provide a method of evaluation without which some interventions would not be evaluated. Journal of Clinical Epidemiology. 2013;66(9):1058–1059.
    1. Hemming K, Girling AJ. A menu-driven facility for power and detectable difference calculations in stepped-wedge randomized trials. The Stata Journal. 2014;14(2):363–380.
    1. Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. Journal of Clinical Epidemiology. 2004;57(8):785–794.
    1. Eldridge S, Kerry S, Torgerson DJ. Bias in identifying and recruiting participants in cluster randomised trials: what can be done? BMJ. 2009;339 doi:10.1136/bmj.b4006.
    1. Khunti K, Gray LJ, Skinner T, Carey ME, Realf K, Dallosso H, Fisher H, Campbell M, Heller S, Davies MJ. Effectiveness of a diabetes education and self management programme (desmond) for people with newly diagnosed type 2 diabetes mellitus: three year follow-up of a cluster randomised controlled trial in primary care. BMJ. 2012;344:e2333 . DOI:10.1136/bmj.e2333.
    1. Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. Use of the stepped wedge design cannot be recommended: a critical appraisal and comparison with the classic cluster randomized controlled trial design. Journal of Clinical Epidemiology. 2012;65(12):1249–1252.
    1. Mdege ND, Man MS, nee Brown CAT, Torgerson DJ. There are some circumstances where the stepped-wedge cluster randomized trial is preferable to the alternative: no randomized trial at all. Journal of Clinical Epidemiology. 2012;65(12)
    1. Hemming K, Girling A, Martin J, Bond S. Stepped wedge cluster randomised trials are efficient and provide a method of evaluation without which some interventions would not be evaluated. Journal of Clinical Epidemiology. 2013;66(9):1058–9.
    1. Kotz D, Spigt M, Arts IC, Crutzen R, Viechtbauer W. Researchers should convince policy makers to perform a classic cluster randomized controlled trial instead of a stepped wedge design when an intervention is rolled out. Journal of Clinical Epidemiology. 2012;65(12)
    1. Haines T, O'Brien L, McDermott F, Markham D, Mitchell D, Watterson D, Skinner E. A novel research design can aid disinvestment from existing health technologies with uncertain effectiveness, cost-effectiveness, and/or safety. Journal of Clinical Epidemiology. 2014;67(2):144–151.
    1. Reich NG, Milstone AM. Improving efficiency in cluster-randomized study design and implementation: taking advantage of a crossover. Open Access Journal of Clinical Trials. 2013;6:11–15.
    1. Rasmussen CDN, Holtermann A, Mortensen OS, SÃÿgaard K, JÃÿrgensen MB. Prevention of low back pain and its consequences among nurses' aides in elderly care: a stepped-wedge multi-faceted cluster-randomized controlled trial. BMC Public Health. 2013;13(1)
    1. Knottnerus JA, Tugwell P. Improving the quality of quality of care research. Journal of Clinical Epidemiology. 2013;66(12):1317–1318.
    1. Hemming K, Girling A. The efficiency of stepped wedge vs. cluster randomized trials: stepped wedge studies do not always require a smaller sample size. Journal of Clinical Epidemiology. 2013;66(12):1427–1429.
    1. de Hoop E, Teerenstra S, Woertman W. The stepped wedge cluster randomized trial always requires fewer clusters but not always fewer measurements, that is, participants than a parallel cluster randomized trial in a cross-sectional design. Journal of Clinical Epidemiology. 2013;66(12):1428.

Source: PubMed

3
S'abonner