Unifying the analysis of continuous and categorical measures of weight loss and incorporating group effect: a secondary re-analysis of a large cluster randomized clinical trial using Bayesian approach

Fengming Tang, Christie A Befort, Jo Wick, Byron J Gajewski, Fengming Tang, Christie A Befort, Jo Wick, Byron J Gajewski

Abstract

Background: Although frequentist paradigm has been the predominant approach to clinical studies for decades, some limitations associated with the frequentist null hypothesis significance testing have been recognized. Bayesian approaches can provide additional insights into data interpretation and inference by deriving posterior distributions of model parameters reflecting the clinical interest. In this article, we sought to demonstrate how Bayesian approaches can improve the data interpretation by reanalyzing the Rural Engagement in Primary Care for Optimizing Weight Reduction (REPOWER).

Methods: REPOWER is a cluster randomized clinical trial comparing three care delivery models: in-clinic individual visits, in-clinic group visits, and phone-based group visits. The primary endpoint was weight loss at 24 months and the secondary endpoints included the proportions of achieving 5 and 10% weight loss at 24 months. We reanalyzed the data using a three-level Bayesian hierarchical model. The posterior distributions of weight loss at 24 months for each arm were obtained using Hamiltonian Monte Carlo. We then estimated the probability of having a higher weight loss and the probability of having greater proportion achieving 5 and 10% weight loss between groups. Additionally, a four-level hierarchical model was used to assess the partially nested intervention group effect which was not investigated in the original REPOWER analyses.

Results: The Bayesian analyses estimated 99.5% probability that in-clinic group visits, compared with in-clinic individual visits, resulted in a higher percent weight loss (posterior mean difference: 1.8%[95% CrI: 0.5,3.2%]), a greater probability of achieving 5% threshold (posterior mean difference: 9.2% [95% CrI: 2.4, 16.0%]) and 10% threshold (posterior mean difference: 6.6% [95% CrI: 1.7, 11.5%]). The phone-based group visits had similar result. We also concluded that including intervention group did not impact model fit significantly.

Conclusions: We unified the analyses of continuous (the primary endpoint) and categorical measures (the secondary endpoints) of weight loss with one single Bayesian hierarchical model. This approach gained statistical power for the dichotomized endpoints by leveraging the information in the continuous data. Furthermore, the Bayesian analysis enabled additional insights into data interpretation and inference by providing posterior distributions for parameters of interest and posterior probabilities of different hypotheses that were not available with the frequentist approach.

Trial registration: ClinicalTrials.gov Identifier NCT02456636 ; date of registry: May 28, 2015.

Keywords: Bayesian paradigm; Hierarchical model; Randomized clinical trial.

Conflict of interest statement

None.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Posterior distributions of the expected weight loss(%) (A) and posterior distributions of the absolute difference in weight loss(%) when compared with in-clinic individual visits (B) at 24 months
Fig. 2
Fig. 2
Posterior distributions of the probability of achieving 5% weight loss (A) and Posterior distributions of the absolute difference in the probability of achieving 5% weight loss when compared with in-clinic individual visits (B)
Fig. 3
Fig. 3
Posterior distributions of the probability of achieving 10% weight loss (A) and Posterior distributions of the absolute difference in the probability of achieving 10% weight loss when compared with in-clinic individual visits (B)

References

    1. Greenland S, Senn SJ, Rothman KJ, et al. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol. 2016;31(4):337–350. doi: 10.1007/s10654-0160149-320.
    1. Wasserstein R, Lazar N. The ASA’s statement on P values: context, process, and purpose. Am Stat. 2016;70(2):129–133. doi: 10.1080/00031305.2016.1154108.
    1. Ioannidis JPA. Why most published research findings are false. Plos Med. 2005;2(8):e124. doi: 10.1371/journal.pmed.0020124.
    1. Dienes Z. Using Bayes to get the most out of non-significant results. Front Psychol. 2014;5:781. doi: 10.3389/fpsyg.2014.00781.
    1. Befort CA, VanWormer JJ, Desouza C, Ellerbeck EF, Gajewski B, Kimminau KS, Greiner KA, Perri MG, Brown AR, Pathak RD, Huang T, Eiland L, Drincic A. Effect of behavioral therapy with in-clinic or telephone group visits vs in-clinic individual visits on weight loss among patients with obesity in rural clinical practice. JAMA. 2021;325(4):363–372. doi: 10.1001/jama.2020.25855.
    1. Centers for disease control and prevention. Prevalence of obesity and severe obesity among adults: United States, 2017–2018. . (Accessed Feb 2021).
    1. Hammond RA, Levine R. The economic impact of obesity in the United States. Diabetes Metab Syndr Obes. 2010;3:285–295. doi: 10.2147/DMSO.S7384.
    1. Centers for Medicare and Medicaid Service . Decision memo for intensive behavioral therapy for obesity. 2011.
    1. Watanabe S. A widely applicable Bayesian information criterion. J Mach Learn Res. 2013;14:867–897.
    1. Vehtari A, Gelman A, Gabry J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput. 2017;27(5):1413–1432. doi: 10.1007/s11222-016-9696-4.
    1. Betancourt M. A conceptual introduction to Hamiltonian Monte Carlo. arXiv 2017; arXiv:1701.02434. Columbia University, N Y.
    1. Stan Development Team. Stan Modeling Language User’s Guide and Reference Manual, Version 2.16.0. (Available from .)
    1. Stan Development Team. RStan: the R interface to Stan, version 2.16.1. (Available from .)
    1. Vehtari A, Gelman A, Simpson D, Carpenter B, Bürkner P. Rank-normalization, folding, and localization: An improved R-hat for assessing convergence of MCMC. arXiv. 2019.
    1. Altman DG, Royston P. The cost of dichotomising continuous variables. BMJ (Clinical research ed) 2006;332:1080. doi: 10.1136/bmj.332.7549.1080.
    1. Deyi BA, Kosinski AS, Snapinn SM. Power considerations when a continuous outcome variable is dichotomized. J Biopharm Stat. 1998;8:337–352. doi: 10.1080/10543409808835243.
    1. Peacock JL, et al. Dichotomising continuous data while retaining statistical power using a distributional approach. Stat Med. 2012;31:3089–3103. doi: 10.1002/sim.5354.

Source: PubMed

3
Tilaa