Randomized and non-randomized designs for causal inference with longitudinal data in rare disorders

Rima Izem, Robert McCarter, Rima Izem, Robert McCarter

Abstract

In the United States, approximately 7000 rare diseases affect 30 million patients, and only 10% of these diseases have existing therapies. Sound study design and causal inference methods are essential to demonstrate the therapeutic efficacy, safety, and effectiveness of new therapies. In the rare diseases setting, several factors challenge the use of typical parallel control designs: the small patient population size, genotypic and phenotypic diversity, and the complexity and incomplete understanding of the disorder's progression. Repeated measures, when spaced appropriately relative to disease progression and exploited in design and analysis, can increase study power and reduce variability in treatment effect estimation. This paper reviews these longitudinal designs and draws the parallel between some new and existing randomized studies in rare diseases and their less well-known controlled observational study designs. We show that self-controlled randomized crossover and N-of-1 designs have similar considerations as the observational case series and case-crossover designs. Also, randomized sequential designs have similar considerations to longitudinal cohort studies using sequential matching or weighting to control confounding. We discuss design and analysis considerations for valid causal inference and illustrate them with examples of analyses in multiple rare disorders, including urea cycle disorder and cystic fibrosis.

Conflict of interest statement

The authors declare that they have no competing interests.

© 2021. The Author(s).

Figures

Fig. 1
Fig. 1
Self-controlled study design
Fig. 2
Fig. 2
Sequential designs

References

    1. National Institutes of Health. FAQs about rare diseases. 2020; Available from .
    1. IQVIA Institute for Human Data Science, Orphan Drugs in the United States: Exclusivity, Pricing and Treated Populations. December 2018. . Accessed Nov 2021.
    1. Kempf L, Goldsmith JC, Temple R. Challenges of developing and conducting clinical trials in rare disorders. Am J Med Genet A. 2018;176(4):773–783.
    1. Fonseca DA, et al. Orphan drugs: major development challenges at the clinical stage. Drug Discov Today. 2019;24(3):867–872.
    1. The Food and Drug Administration. Pediatric rare diseases—a collaborative approach for drug development using Gaucher disease as a model; draft guidance for industry. 2017 Dec 2017; Available from .
    1. The Food and Drug Administration. Rare diseases: common issues in drug development guidance for industry, draft guidance for industry. 2019; Available from .
    1. The Food and Drug Administration. Rare diseases: natural history studies for drug development, guidance document. 2019; Available from .
    1. The Food and Drug Administration. Framework for FDA's Real-World Evidence Program. 2018 Dec 2018; Available from .
    1. Bell SA, Tudur SC. A comparison of interventional clinical trials in rare versus non-rare diseases: an analysis of . Orphanet J Rare Dis. 2014;9:170.
    1. Richter T, et al. Rare disease terminology and definitions—a systematic global review: report of the ISPOR rare disease special interest group. Value Health. 2015;18(6):906–914.
    1. O'Sullivan BP, Freedman SD. Cystic fibrosis. Lancet. 2009;373(9678):1891–1904.
    1. Summar ML, et al. The incidence of urea cycle disorders. Mol Genet Metab. 2013;110(1–2):179–180.
    1. Merritt JL, 2nd, et al. Newborn screening for proximal urea cycle disorders: current evidence supporting recommendations for newborn screening. Mol Genet Metab. 2018;124(2):109–113.
    1. Brusilow SW, Valle DL, Batshaw M. New pathways of nitrogen excretion in inborn errors of urea synthesis. Lancet. 1979;2(8140):452–454.
    1. Maestri NE, Clissold D, Brusilow SW. Neonatal onset ornithine transcarbamylase deficiency: a retrospective analysis. J Pediatr. 1999;134(3):268–272.
    1. Batshaw ML, et al. Cerebral dysfunction in asymptomatic carriers of ornithine transcarbamylase deficiency. N Engl J Med. 1980;302(9):482–485.
    1. Wechsler D. Wechsler preschool and primary scale of intelligence—fourth edition. San Antonio: The Psychological Corporation; 2012.
    1. Wechsler D. WISC-III: Wechsler intelligence scale for children. San Antonio: Psychological Corporation, Harcourt Brace Jovanovich; 1991.
    1. Cystic Fibrosis Foundation Patient Registry. Annual data report 2018. 2019. Bethesda.
    1. Waisbren SE, et al. Improving long term outcomes in urea cycle disorders-report from the Urea Cycle Disorders Consortium. J Inherit Metab Dis. 2016;39(4):573–584.
    1. Diggle P, et al. Analysis of longitudinal data. Oxford: Oxford University Press; 2002.
    1. Korn EL, McShane LM, Freidlin B. Statistical challenges in the evaluation of treatments for small patient populations. Sci Transl Med. 2013;5(178):178sr3.
    1. Smith CT, Williamson PR, Beresford MW. Methodology of clinical trials for rare diseases. Best Pract Res Clin Rheumatol. 2014;28(2):247–262.
    1. Chow S-C, Chang Y-W. Statistical considerations for rare diseases drug development. J Biopharm Stat. 2019;29(5):874–886.
    1. Van der Lee J, et al. Efficient ways exist to obtain the optimal sample size in clinical trials in rare diseases. J Clin Epidemiol. 2008;61(4):324–330.
    1. Senn S. Sample size considerations for n-of-1 trials. Stat Methods Med Res. 2019;28(2):372–383.
    1. Cornu C, et al. Experimental designs for small randomised clinical trials: an algorithm for choice. Orphanet J Rare Dis. 2013;8:48.
    1. Ballmann M, von der Hardt H. Hypertonic saline and recombinant human DNase: a randomised cross-over pilot study in patients with cystic fibrosis. J Cyst Fibros. 2002;1(1):35–37.
    1. Hackett A, Gillard J, Wilcken B. n of 1 trial for an ornithine transcarbamylase deficiency carrier. Mol Genet Metab. 2008;94(2):157–161.
    1. Whitaker HJ, et al. Tutorial in biostatistics: the self-controlled case series method. Stat Med. 2006;25(10):1768–1797.
    1. Schneeweiss S, Sturmer T, Maclure M. Case-crossover and case-time-control designs as alternatives in pharmacoepidemiologic research. Pharmacoepidemiol Drug Saf. 1997;6(Suppl 3):S51–S59.
    1. Madigan D, Schuemie MJ, Ryan PB. Empirical performance of the case-control method: lessons for developing a risk identification and analysis system. Drug Saf. 2013;36(Suppl 1):S73–82.
    1. Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133(2):144–153.
    1. Maclure M. 'Why me?' versus ‘why now?'—differences between operational hypotheses in case-control versus case-crossover studies. Pharmacoepidemiol Drug Saf. 2007;16(8):850–853.
    1. Harmatz P, et al. A novel Blind Start study design to investigate vestronidase alfa for mucopolysaccharidosis VII, an ultra-rare genetic disease. Mol Genet Metab. 2018;123(4):488–494.
    1. Harding CO, et al. Pegvaliase for the treatment of phenylketonuria: a pivotal, double-blind randomized discontinuation phase 3 clinical trial. Mol Genet Metab. 2018;124(1):20–26.
    1. Copas AJ, et al. Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches. Trials. 2015;16:352–352.
    1. Quittner AL, et al. Clustered randomized controlled trial of a clinic-based problem-solving intervention to improve adherence in adolescents with cystic fibrosis. J Cyst Fibros. 2019;18(6):879–885.
    1. Kidwell KM. SMART designs in cancer research: past, present, and future. Clin Trials. 2014;11(4):445–456.
    1. Kidwell KM, Hyde LW. Adaptive interventions and SMART designs: application to child behavior research in a community setting. Am J Eval. 2016;37(3):344–363.
    1. Hernan MA, et al. Observation plans in longitudinal studies with time-varying treatments. Stat Methods Med Res. 2009;18(1):27–52.
    1. Li YFP, Propert KJ, Rosenbaum PR. Balanced risk set matching. J Am Stat Assoc. 2001;96(455):870–882.
    1. Ah Mew N, et al. Comparing treatment options for urea cycle disorders. Washington: Patient Centered Outcome Research; 2020.
    1. Hernan MA, et al. Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease. Epidemiology. 2008;19(6):766–779.
    1. Imbens G, Rubin D. Causal inference for statistics, social, and biomedical sciences: an introduction. Cambridge: Cambridge University Press; 2015.
    1. Hernan MA, Robins JM. Causal inference: what if. Boca Raton: Chapman & Hall/CRC; 2020.
    1. Patient Reported Outcome Research Institute. Comparing treatment options for urea cycle disorders. 2015; Available from .
    1. Hilgers RD, et al. Design and analysis of clinical trials for small rare disease populations. J Rare Dis Res Treatment. 2016;1(1):53–60.
    1. Hilgers R-D, et al. Lessons learned from IDeAl—33 recommendations from the IDeAl-net about design and analysis of small population clinical trials. Orphanet J Rare Dis. 2018;13(1):1–17.
    1. Maclure M, Mittleman MA. Case-crossover designs compared with dynamic follow-up designs. Epidemiology. 2008;19(2):176–178.
    1. Hampson LV, et al. Bayesian methods for the design and interpretation of clinical trials in very rare diseases. Stat Med. 2014;33(24):4186–4201.
    1. Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11(5):550–560.
    1. Mansournia MA, et al. Handling time varying confounding in observational research. BMJ. 2017;359:j4587.
    1. Farmer RE, et al. Application of causal inference methods in the analyses of randomised controlled trials: a systematic review. Trials. 2018;19(1):23.
    1. Deakin CT, et al. Efficacy and safety of cyclophosphamide treatment in severe juvenile dermatomyositis shown by marginal structural modeling. Arthritis Rheumatol. 2018;70(5):785–793.
    1. Gagne JJ, et al. Innovative research methods for studying treatments for rare diseases: methodological review. BMJ. 2014;349:g6802.
    1. Jansen-Van Der Weide MC, et al. Rare disease registries: potential applications towards impact on development of new drug treatments. Orphanet J Rare Dis. 2018;13(1):1–11.
    1. Krischer JP, et al. The Rare Diseases Clinical Research Network's organization and approach to observational research and health outcomes research. J Gen Intern Med. 2014;29(Suppl 3):S739–S744.
    1. Putkowski S. National Organization for Rare Disorders (NORD): providing advocacy for people with rare disorders. NASN Sch Nurse. 2010;25(1):38–41.
    1. Canterberry M, et al. The patient-centered outcomes research network antibiotics and childhood growth study: implementing patient data linkage. Popul Health Manag. 2020;23(6):438–444.

Source: PubMed

Szponzorok és közreműködők

Egészségi állapot

Kábítószer-beavatkozások

3
Iratkozz fel