The use of segmented regression in analysing interrupted time series studies: an example in pre-hospital ambulance care

Monica Taljaard, Joanne E McKenzie, Craig R Ramsay, Jeremy M Grimshaw, Monica Taljaard, Joanne E McKenzie, Craig R Ramsay, Jeremy M Grimshaw

Abstract

Background: An interrupted time series design is a powerful quasi-experimental approach for evaluating effects of interventions introduced at a specific point in time. To utilize the strength of this design, a modification to standard regression analysis, such as segmented regression, is required. In segmented regression analysis, the change in intercept and/or slope from pre- to post-intervention is estimated and used to test causal hypotheses about the intervention. We illustrate segmented regression using data from a previously published study that evaluated the effectiveness of a collaborative intervention to improve quality in pre-hospital ambulance care for acute myocardial infarction (AMI) and stroke. In the original analysis, a standard regression model was used with time as a continuous variable. We contrast the results from this standard regression analysis with those from segmented regression analysis. We discuss the limitations of the former and advantages of the latter, as well as the challenges of using segmented regression in analysing complex quality improvement interventions.

Findings: Based on the estimated change in intercept and slope from pre- to post-intervention using segmented regression, we found insufficient evidence of a statistically significant effect on quality of care for stroke, although potential clinically important effects for AMI cannot be ruled out.

Conclusions: Segmented regression analysis is the recommended approach for analysing data from an interrupted time series study. Several modifications to the basic segmented regression analysis approach are available to deal with challenges arising in the evaluation of complex quality improvement interventions.

Figures

Figure 1
Figure 1
Segmented logistic regression analysis of care bundle for AMI: all sites combined.
Figure 2
Figure 2
Segmented logistic regression analysis of care bundle for stroke: all sites combined.

References

    1. Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin; 2002.
    1. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309. doi: 10.1046/j.1365-2710.2002.00430.x.
    1. Gebski V, Ellingson K, Edwards J, Jernigan J, Kleinbaum D. Modelling interrupted time series to evaluate prevention and control of infection in healthcare. Epidemiol Infect. 2012;140(12):2131–2141. doi: 10.1017/S0950268812000179.
    1. Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Academic Pediatrics. 2013;13:S38–S44. doi: 10.1016/j.acap.2013.08.002.
    1. Ramsay CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE. Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategies. Int J Tech Assess Health Care. 2003;19(4):613–623.
    1. Ansari F, Gray K, Nathwani D, Phillips G, Ogston S, Ramsay C, Davey P. Outcomes of an intervention to improve hospital antibiotic prescribing: interrupted time series with segmented regression analysis. J. Antimicrob. Chemother. 2003;52(5):842–848. doi: 10.1093/jac/dkg459.
    1. Foy R, Ramsay CR, Grimshaw JM, Penney GC, Vale L, Thomson A, Greer IA. The impact of guidelines on mild hypertension in pregnancy: time series analysis. BJOG. 2004;111(8):765–770. doi: 10.1111/j.1471-0528.2004.00212.x.
    1. Siriwardena AN, Shaw D, Essam N, Togher FJ, Davy Z, Spaight A, Dewey M. ASCQI Core Group. The effect of a national quality improvement collaborative on prehospital care for acute myocardial infarction and stroke in England. Implement Sci. 2014;9(1):17. doi: 10.1186/1748-5908-9-17.
    1. Implementation Science, Additional files. .
    1. Serumaga B, Ross-Degnan D, Avery AJ, Elliott RA, Majumdar SR, Zhang F, Soumerai SB. Effect of pay for performance on the management and outcomes of hypertension in the United Kingdom: interrupted time series study. BMJ. 2011;342:d108. doi: 10.1136/bmj.d108.
    1. Normand SL. Tutorial in biostatistics: Meta-analysis: formulating, evaluating, combining, and reporting. Stat Med. 1999;18(3):321–359. doi: 10.1002/(SICI)1097-0258(19990215)18:3<321::AID-SIM28>;2-P.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe