Optimizing clinical trial design using prospective cohort study data: a case study in neuro-urology

Collene E Anderson, Veronika Birkhäuser, Stephanie A Stalder, Lucas M Bachmann, Armin Curt, Xavier Jordan, Lorenz Leitner, Martina D Liechti, Ulrich Mehnert, Sandra Möhr, Jürgen Pannek, Martin Schubert, Stéphanie van der Lely, Thomas M Kessler, Martin W G Brinkhof, Collene E Anderson, Veronika Birkhäuser, Stephanie A Stalder, Lucas M Bachmann, Armin Curt, Xavier Jordan, Lorenz Leitner, Martina D Liechti, Ulrich Mehnert, Sandra Möhr, Jürgen Pannek, Martin Schubert, Stéphanie van der Lely, Thomas M Kessler, Martin W G Brinkhof

Abstract

Study design: Simulations using data from a prospective cohort study.

Objectives: To illustrate how prospective cohort data can be employed in randomized controlled trial (RCT) planning to assess feasibility and operational challenges, using TASCI (Transcutaneous tibial nerve stimulation in patients with Acute Spinal Cord Injury to prevent neurogenic detrusor overactivity: a nationwide randomized, sham-controlled, double-blind clinical trial) as a case study.

Setting: Spinal cord injury (SCI) rehabilitation centers in Switzerland.

Methods: TASCI is nested in the multicenter Swiss Spinal Cord Injury Cohort Study (SwiSCI), which prospectively includes patients with acute SCI. In simulations, data from 640 patients, collected by SwiSCI, were used to investigate different scenarios of patient eligibility and study consent, as well as the performance of the randomization list. Descriptive analysis was used to describe the population of interest and the simulation results; multivariable logistic regression analysis was performed to identify predictors of discharge within the TASCI intervention time period.

Results: The recruitment target of 114 patients is obtainable within the originally envisioned 3-year time period under the most favorable recruitment scenario examined. The distribution of the primary prognostic factor produced imbalance in the randomization lists and informed further discussion of the cut-off values used in stratification. Influxes of patients resulted in overlapping intervention periods for multiple participants, which guided resource allocation. Early discharge was related to the primary prognostic factor and study center, but is only anticipated in about 8% of participants.

Conclusions: Prospective cohort data are a very valuable resource for planning RCTs.

Conflict of interest statement

Statement of Ethics:

Ethical approval was granted by all responsible ethics committees: Ethics Committee of Northwest/Central Switzerland (PB 2016-00183), Ethics Committee Vaud (032/13), and Ethics Committee Zürich (2013-0249). We certify that all applicable institutional and governmental regulations concerning the ethical use of human volunteers were followed during the course of this research.

Conflicts of Interest:

The authors declare that there are no conflicts of interest.

© 2020. The Author(s), under exclusive licence to International Spinal Cord Society.

Figures

Figure 1
Figure 1
Simulation flowchart. * = assignment to treatment groups is identical for all centers; LEMS = lower extremity motor score; SwiSCI = Swiss Spinal Cord Injury Cohort Study; TTNS = transcutaneous tibial nerve stimulation.
Figure 2
Figure 2
LEMS: distribution in the patient population, and imbalance in the simulations. Distribution of LEMS in the population of patients eligible for TASCI (A) and across study centers, grouped according to LEMS Model 1 (B). In simulations, imbalance was seen in the middle LEMS categories across all models, but was especially pronounced in Model 1 (C). LEMS models represent different cut-off values that are categorized based on the percent probability of urinary continence and complete bladder emptying one year after SCI: Model 1: 66% (LEMS 33-50) (black in B); Model 2: 75% (LEMS 36-50); or Model 3: 80% (38-50). LEMS = lower extremity motor score.
Figure 3
Figure 3
Description of patient flow. 3A – Number of eligible patients in the intervention window per day, in all study centers. 3B-F – In simulations, count of the mean number of weeks with a given number of participants receiving the TTNS intervention, in all four centers (B) and in each individual study center (C-F, centers 1-4, respectively), under the most favorable recruitment rate scenario. N = number; TTNS = transcutaneous tibial nerve stimulation.

References

    1. Bothwell LE, Greene JA, Podolsky SH, Jones DS. Assessing the Gold Standard--Lessons from the History of RCTs. N Engl J Med. 2016;374(22):2175–81.
    1. Fogel DB. Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: A review. Contemp Clin Trials Commun. 2018;11:156–164.
    1. Kasenda B, von Elm E, You J, Blumle A, Tomonaga Y, Saccilotto R, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311(10):1045–51.
    1. Williams RJ, Tse T, DiPiazza K, Zarin DA. Terminated Trials in the Results Database: Evaluation of Availability of Primary Outcome Data and Reasons for Termination. PLoS One. 2015;10(5):e0127242.
    1. Guinn D, Wilhelm EE, Shoulson I. Reasons for Premature Conclusion of Late Phase Clinical Trials: An Analysis of Registered Phase III Trials. Ther Innov Regul Sci. 2019 2168479019830648.
    1. Amstutz A, Schandelmaier S, Frei R, Surina J, Agarwal A, Olu KK, et al. Discontinuation and non-publication of randomised clinical trials supported by the main public funding body in Switzerland: a retrospective cohort study. BMJ Open. 2017;7(7):e016216.
    1. Briel M, Olu KK, von Elm E, Kasenda B, Alturki R, Agarwal A, et al. A systematic review of discontinued trials suggested that most reasons for recruitment failure were preventable. J Clin Epidemiol. 2016;80:8–15.
    1. Ioannidis JP. Clinical trials: what a waste. BMJ. 2014;349:g7089.
    1. Briel M, Elger B, von Elm E, Satalkar P. Insufficient recruitment and premature discontinuation of clinical trials in Switzerland: qualitative study with trialists and other stakeholders. Swiss Med Wkly. 2017;147:w14556.
    1. Cook D, Heyland D, Marshall J. On the need for observational studies to design and interpret randomized trials in ICU patients: a case study in stress ulcer prophylaxis. Intensive Care Med. 2001;27(2):347–54.
    1. Li G, Sajobi TT, Menon BK, Korngut L, Lowerison M, James M, et al. Registry-based randomized controlled trials-what are the advantages, challenges, and areas for future research? J Clin Epidemiol. 2016;80:16–24.
    1. Liu A, Menon K. Contributions of a survey and retrospective cohort study to the planning of a randomised controlled trial of corticosteroids in the treatment of paediatric septic shock. Trials. 2018;19(1):283.
    1. Liechti MD, van der Lely S, Stalder SA, Anderson CE, Birkhauser V, Bachmann LM, et al. Update from TASCI, a Nationwide, Randomized, Sham-controlled, Double-blind Clinical Trial on Transcutaneous Tibial Nerve Stimulation in Patients with Acute Spinal Cord Injury to Prevent Neurogenic Detrusor Overactivity. Eur Urol Focus. 2019 doi: 10.1016/j.euf.2019.09.019.
    1. Birkhäuser V, Liechti MD, Anderson CE, Bachmann LM, Baumann S, Baumberger M, et al. TASCI-transcutaneous tibial nerve stimulation in patients with acute spinal cord injury to prevent neurogenic detrusor overactivity: protocol for a nationwide, randomised, sham-controlled, double-blind clinical trial. BMJ Open. 2020;10(8):e039164.
    1. Post MW, Brinkhof MW, von Elm E, Boldt C, Brach M, Fekete C, et al. Design of the Swiss Spinal Cord Injury Cohort Study. Am J Phys Med Rehabil. 2011;90(11 Suppl 2):S5–16.
    1. Bywater M, Tornic J, Mehnert U, Kessler TM. Detrusor Acontractility after Acute Spinal Cord Injury-Myth or Reality? J Urol. 2018;199(6):1565–1570.
    1. Maynard FM, Jr, Bracken MB, Creasey G, Ditunno JF, Jr, Donovan WH, Ducker TB, et al. International Standards for Neurological and Functional Classification of Spinal Cord Injury. American Spinal Injury Association. Spinal Cord. 1997;35(5):266–74.
    1. Pavese C, Schneider MP, Schubert M, Curt A, Scivoletto G, Finazzi-Agro E, et al. Prediction of Bladder Outcomes after Traumatic Spinal Cord Injury: A Longitudinal Cohort Study. PLoS Med. 2016;13(6):e1002041.
    1. Elliott CS, Dallas KB, Zlatev D, Comiter CV, Crew J, Shem K. Volitional Voiding of the Bladder after Spinal Cord Injury: Validation of Bilateral Lower Extremity Motor Function as a Key Predictor. J Urol. 2018;200(1):154–160.
    1. Catz A, Itzkovich M, Tesio L, Biering-Sorensen F, Weeks C, Laramee MT, et al. A multicenter international study on the Spinal Cord Independence Measure, version III: Rasch psychometric validation. Spinal Cord. 2007;45(4):275–91.
    1. Biering-Sorensen F, Craggs M, Kennelly M, Schick E, Wyndaele JJ. International lower urinary tract function basic spinal cord injury data set. Spinal Cord. 2008;46(5):325–30.
    1. Schneider MP, Gross T, Bachmann LM, Blok BF, Castro-Diaz D, Del Popolo G, et al. Tibial nerve stimulation for treating neurogenic lower urinary tract dysfunction: a systematic review. Eur Urol. 2015;68(5):859–67.
    1. Chu R, Walter SD, Guyatt G, Devereaux PJ, Walsh M, Thorlund K, et al. Assessment and implication of prognostic imbalance in randomized controlled trials with a binary outcome--a simulation study. PLoS One. 2012;7(5):e36677.
    1. Feinstein AR. Principles of Medical Statistics. Chapman & Hall/CRC; Boca Raton Florida, USA: 2002.
    1. Knottnerus JA, Tugwell P. Prevention of premature trial discontinuation: how to counter Lasagna’s law. J Clin Epidemiol. 2016;80:1–2.
    1. Lasagna L. Problems in publication of clinical trial methodology. Clin Pharmacol Ther. 1979;25(5 Pt 2):751–3.
    1. Hunninghake DB, Darby CA, Probstfield JL. Recruitment experience in clinical trials: literature summary and annotated bibliography. Control Clin Trials. 1987;8(4):6S–30S.
    1. Babbs CF. Choosing inclusion criteria that minimize the time and cost of clinical trials. World J Methodol. 2014;4(2):109–22.
    1. Blight AR, Hsieh J, Curt A, Fawcett JW, Guest JD, Kleitman N, et al. The challenge of recruitment for neurotherapeutic clinical trials in spinal cord injury. Spinal Cord. 2019;57(5):348–359.
    1. Scott IA, Attia J. Cautionary tales in the interpretation of observational studies of effects of clinical interventions. Intern Med J. 2017;47(2):144–157.
    1. Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10:1.
    1. Holford N, Ma SC, Ploeger BA. Clinical trial simulation: a review. Clin Pharmacol Ther. 2010;88(2):166–82.
    1. Carlisle B, Kimmelman J, Ramsay T, MacKinnon N. Unsuccessful trial accrual and human subjects protections: an empirical analysis of recently closed trials. Clin Trials. 2015;12(1):77–83.

Source: PubMed

3
購読する