Optimal allocations for two treatment comparisons within the proportional odds cumulative logits model

Mirjam Moerbeek, Mirjam Moerbeek

Abstract

This paper studies optimal treatment allocations for two treatment comparisons when the outcome is ordinal and analyzed by a proportional odds cumulative logits model. The variance of the treatment effect estimator is used as optimality criterion. The optimal design is sought so that this variance is minimal for a given total sample size or a given budget, meaning that the power for the test on treatment effect is maximal, or it is sought so that a required power level is achieved at a minimal total sample size or budget. Results are presented for three, five and seven ordered response categories, three treatment effect sizes and a skewed, bell-shaped or polarized distribution of the response probabilities. The optimal proportion subjects in the intervention condition decreases with the number of response categories and the costs for the intervention relative to those for the control. The relation between the optimal proportion and effect size depends on the distribution of the response probabilities. The widely used balanced design is not always the most efficient; its efficiency as compared to the optimal design decreases with increasing cost ratio. The optimal design is highly robust to misspecification of the response probabilities and treatment effect size. The optimal design methodology is illustrated using two pharmaceutical examples. A Shiny app is available to find the optimal treatment allocation, to evaluate the efficiency of the balanced design and to study the relation between budget or sample size and power.

Conflict of interest statement

The author has declared that no competing interests exist.

Figures

Fig 1. Response probabilities in the control…
Fig 1. Response probabilities in the control condition.
Fig 2. Estimated probabilities in the placebo…
Fig 2. Estimated probabilities in the placebo and drug condition for the schizophrenia example.
Fig 3. Efficiency graph for the schizophrenia…
Fig 3. Efficiency graph for the schizophrenia example.
Fig 4. Power graph for the schizophrenia…
Fig 4. Power graph for the schizophrenia example.
Fig 5. Estimated probabilities in the placebi…
Fig 5. Estimated probabilities in the placebi and medium dose group in the trauma example.
Fig 6. Efficiency graph for the trauma…
Fig 6. Efficiency graph for the trauma example.
Fig 7. Power graph for the trauma…
Fig 7. Power graph for the trauma example.

References

    1. Jadad AR, Enkin M. Randomized controlled trials: Questions, answers and musings. Malden, MA: Blackwell; 2007.
    1. Torgerson DJ, Torgerson CJ. Designing Randomised Trials in Health, Education and the Social Sciences: An Introduction. Basingstoke: Palgrave Macmillan; 2008.
    1. Sverdlov O, Ryeznik Y. Implementing unequal randomization in clinical trials with heterogeneous treatment costs. Stat Med. 2019;38(16):2905–27. 10.1002/sim.8160
    1. Morgenstern H, Winn DM. A method for determining the sampling ratio in epidemiologic studies. Stat Med. 1983;2(3):387–96. 10.1002/sim.4780020311
    1. Singer J. A simple procedure to compute the sample size needed to compare two independent groups when the population variances are unequal. Stat Med. 2001;20(7):1089–95. 10.1002/sim.722
    1. Jan SL, Shieh G. Optimal sample sizes for Welch’s test under various allocation and cost considerations. Behav Res Methods. 2011;43(3):1014–1022. 10.3758/s13428-011-0095-7
    1. Schouten HJA. Sample size formula with a continuous outcome for unequal group sizes and unequal variances. Stat Med [Internet]. 1999. January 15;18(1):87–91. 10.1002/(sici)1097-0258(19990115)18:1<87::aid-sim958>;2-k
    1. Wong WK, Zhu W. Optimum treatment allocation rules under a variance heterogeneity model. Stat Med. 2008;27(22):4581–4595. 10.1002/sim.3318
    1. Zhu W, Wong WK. Optimal treatment allocation in comparative biomedical studies. Stat Med. 2000;19(5):639–48. 10.1002/(sici)1097-0258(20000315)19:5<639::aid-sim380>;2-k
    1. Guo J, Luh W. Efficient sample size allocation with cost constraints for heterogeneous-variance group comparison. J Appl Stat. 2013;40(12):2549–2563. 10.1080/02664763.2013.819417
    1. Zhang J, Zhang J. Statistical efficiency in multiple-to-one comparison trials with optimal allocation ratio. J Biopharm Stat. 2010;21(1):125–35. 10.1080/10543401003642629
    1. Lemme F, van Breukelen GJP, Berger MPF. Efficient treatment allocation in two-way nested designs. Stat Methods Med Res. 2015;24(5):494–512. 10.1177/0962280213502145
    1. Lemme F, Van Breukelen GJP, Candel MJJM. Efficient treatment allocation in 2 x 2 multicenter trials when costs and variances are heterogeneous. Stat Med. 2018;2018(1):12–27. 10.1002/sim.7499
    1. van Breukelen GJP, Candel MJJM. Efficient design of cluster randomized trials with treatment-dependent costs and treatment-dependent unknown variances. Stat Med. 2018;37(21):3027–46. 10.1002/sim.7824
    1. Candel MJJM, van Breukelen GJP. Sample size calculation for treatment effects in randomized trials with fixed cluster sizes and heterogeneous intraclass correlations and variances. Stat Methods Med Res. 2015;24(5):557–73. 10.1177/0962280214563100
    1. Lemme F, van Breukelen G, Candel M, Berger M. The effect of heterogeneous variance on efficiency and power of cluster randomized trials with a balanced 2 × 2 factorial design. Stat Methods Med Res. 2015;24(5):574–93. 10.1177/0962280215583683
    1. Moerbeek M. Cost-efficient designs for three-arm trials with treatment delivered by health professionals: Sample sizes for a combination of nested and crossed designs. Clin Trials. 2018;15(2):169–77. 10.1177/1740774517750622
    1. Moerbeek M, Wong WK. Sample size formulae for trials comparing group and individual treatments in a multilevel model. Stat Med. 2008;27(15):2850–64. 10.1002/sim.3115
    1. Heo M, Litwin AH, Blackstock O, Kim N, Arnsten JH. Sample size determinations for group-based randomized clinical trials with different levels of data hierarchy between experimental and control arms. Stat Methods Med Res. 2017;26(1):399–413. 10.1177/0962280214547381
    1. Roberts C, Roberts SA. Design and analysis of clinical trials with clustering effects due to treatment. In: Clinical Trials. 2005. p. 152–62. 10.1191/1740774505cn076oa
    1. Demidenko E. Sample size determination for logistic regression revisited. Stat Med. 2007;26(18):3385–97. 10.1002/sim.2771
    1. Demidenko E. Sample size and optimal design for logistic regression with binary interaction. Stat Med. 2008;27(1):36–46. 10.1002/sim.2980
    1. Dette H. On robust and efficient designs for risk estimation in epidemiological studies. Scand J Stat. 2004;31(3):319–31. 10.1111/j.1467-9469.2004.03_037.x
    1. Zhu W, Wong WK. Optimum treatment allocation for dual-objective clinical trials with binary outcomes. Commun Stat Theory Methods. 2000;29(5–6):957–74. 10.1080/03610920008832526
    1. Bandyopadhyay U, Bhattacharya R. An optimal three treatment allocation for binary treatment responses. Stat Biopharm Res. 2018;10(4):287–300. 10.1080/19466315.2018.1460277
    1. Yang J, Mandal A, Majumdar D. Optimal designs for two-level factorial experiments with binary response. Stat Sin. 2010;22(2):885–907. 10.5705/ss.2010.080
    1. Yang J, Mandal A, Majumdar D. Optimal designs for 2^k factorial experiments with binary response. Stat Sin. 2016;26(1):385–411. 10.5705/ss.2013.265
    1. Wu S, Wong WK, Crespi CM. Maximin optimal designs for cluster randomized trials. Biometrics. 2017;73(3):916–26. 10.1111/biom.12659
    1. Roberts C, Batistatou E, Roberts SA. Design and analysis of trials with a partially nested design and a binary outcome measure. Stat Med. 2016;35(10):1616–36. 10.1002/sim.6828
    1. Sposto R, Krailo MD. Use of unequal allocation in survival trials. Stat Med. 1987;6(2):119–25. 10.1002/sim.4780060204
    1. Kalish LA, Harrington DP. Efficiency of balanced treatment allocation for survival analysis. Biometrics. 1988;44(3):815–21.
    1. Jóźwiak K, Moerbeek M. Optimal treatment allocation and study duration for trials with discrete-time survival endpoints. J Stat Plan Inference. 2013;143(5):971–82. 10.1016/j.jspi.2012.11.006
    1. Hedeker D, Gibbons RD. Longitudinal data analysis. Hoboken: Wiley; 2006.
    1. Chuang-Stein C, Agresti A. A review of tests for detecting a monotone dose-response relationship with ordinal response data. Stat Med. 1997;16(22):2599–618. 10.1002/(sici)1097-0258(19971130)16:22<2599::aid-sim734>;2-9
    1. Yang J, Tong L, Mandal A. D-optimal designs with ordered categorical data. Stat Sin. 2017;27(4):1879–902. 10.5705/ss.202016.0210
    1. Bu X, Majumdar D, Yang J. D-optimal designs for multinomial logistic models. Ann Stat. 2020;48(2):983–1000. 10.1214/19-AOS1834
    1. Whitehead J. Sample size calculation for ordered categorical data. Stat Med. 1993;12(24):2257–71. 10.1002/sim.4780122404
    1. McCullagh P, Nelder JA. Generalized Linear Models. London: Chapman & Hall; 1989.
    1. Agresti A. Analysis of Ordinal Categorical Data. Hoboken: Wiley; 2010.
    1. Tutz G. Regression for Categorical Data. Cambridge: Cambridge University Press; 2012.
    1. Brant R. Assessing proportionality in the proportional odds model for ordinal logistic regression. Biometrics. 1990;46(4):1171–8. 10.2307/2532457
    1. Glonek G, McCullagh P. Multivariate logistic models. J R Stat Soc Ser A. 1995;57(3):533–46. 10.1111/j.2517-6161.1995.tb02046.x
    1. Atkinson AC, Donev AN, Tobias RD. Optimum Experimental Design, with SAS. Oxford: Clarendon; 2007.
    1. Berger MPF, Wong WK. An Introduction to Optimal Designs for Social and Biomedical Research. Chichester: Wiley; 2009.
    1. Goos P, Jones B. Optimal Design of Experiments. A Case Study Approach. Chichester: Wiley; 2011.
    1. Bauer DJ, Sterba SK. Fitting multilevel models with ordinal outcomes: performance of alternative specifications and methods of estimation. Psychol Methods. 2011;16(4):373–90. 10.1037/a0025813
    1. Chen H, Cohen P, Chen S. How big is a big odds ratio? Interpreting the magnitudes of odds ratios in epidemiological studies. Commun Stat Simul Comput. 2010;39(4):860–4. 10.1080/03610911003650383
    1. Chernoff H. Locally optimal designs for estimating parameters. Ann Math Stat. 1953;24(4):586–602.
    1. Chaloner K, Larntz K. Optimal Bayesian design applied to logistic regression experiments. J Stat Plan Inference. 1989;21(2):191–208. 10.1016/0378-3758(89)90004-9
    1. Wittes J, Brittain E. The role of internal pilot studies in increasing the efficiency of clinical trials. Stat Med. 1990;9(1):65–72. 10.1002/sim.4780090113

Source: PubMed

3
Abonner