The protocol-guided rapid evaluation of veterans experiencing new transient neurological symptoms (PREVENT) quality improvement program: rationale and methods

D M Bravata, L J Myers, B Homoya, E J Miech, N A Rattray, A J Perkins, Y Zhang, J Ferguson, J Myers, A J Cheatham, L Murphy, B Giacherio, M Kumar, E Cheng, D A Levine, J J Sico, M J Ward, T M Damush, D M Bravata, L J Myers, B Homoya, E J Miech, N A Rattray, A J Perkins, Y Zhang, J Ferguson, J Myers, A J Cheatham, L Murphy, B Giacherio, M Kumar, E Cheng, D A Levine, J J Sico, M J Ward, T M Damush

Abstract

Background: Transient ischemic attack (TIA) patients are at high risk of recurrent vascular events; timely management can reduce that risk by 70%. The Protocol-guided Rapid Evaluation of Veterans Experiencing New Transient Neurological Symptoms (PREVENT) developed, implemented, and evaluated a TIA quality improvement (QI) intervention aligned with Learning Healthcare System principles.

Methods: This stepped-wedge trial developed, implemented and evaluated a provider-facing, multi-component intervention to improve TIA care at six facilities. The unit of analysis was the medical center. The intervention was developed based on benchmarking data, staff interviews, literature, and electronic quality measures and included: performance data, clinical protocols, professional education, electronic health record tools, and QI support. The effectiveness outcome was the without-fail rate: the proportion of patients who receive all processes of care for which they are eligible among seven processes. The implementation outcomes were the number of implementation activities completed and final team organization level. The intervention effects on the without-fail rate were analyzed using generalized mixed-effects models with multilevel hierarchical random effects. Mixed methods were used to assess implementation, user satisfaction, and sustainability.

Discussion: PREVENT advanced three aspects of a Learning Healthcare System. Learning from Data: teams examined and interacted with their performance data to explore hypotheses, plan QI activities, and evaluate change over time. Learning from Each Other: Teams participated in monthly virtual collaborative calls. Sharing Best Practices: Teams shared tools and best practices. The approach used to design and implement PREVENT may be generalizable to other clinical conditions where time-sensitive care spans clinical settings and medical disciplines.

Trial registration: clinicaltrials.gov: NCT02769338 [May 11, 2016].

Keywords: Audit and feedback; Cerebrovascular disease; Implementation science; Learning healthcare system; Quality of care; Systems redesign; Transient ischemic attack.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Intervention Components Mapped onto Barriers to Providing Quality Care. Figure 1 displays the barriers to providing excellent quality of care for patients with transient ischemic attack (TIA) or minor stroke that were identified through interviews with front-line clinicians as well as the components of the PREVENT program that were designed to overcome each barrier
Fig. 2
Fig. 2
The PREVENT Web-Based Hub. The home page of the web-based PREVENT Hub included a prominent display of the facility without-fail rate (upper left red box) and the pass rates for each of the seven key processes of care (in blue text)
Fig. 3
Fig. 3
PREVENT Stepped-wedge Design. The stepped-wedge design included two sites per wave and a total of three waves. The study included: a 12-month baseline period (yellow); a12-month post-implementation period (orange), which began with a kick-off (brown), and during which the site teams participated in monthly virtual collaborative sessions (telephone symbol); and a sustainability period (blue)
Fig. 4
Fig. 4
PREVENT Sample Size Design. The panels display how the power curves vary with changes in the coefficient of variation (CV)

References

    1. Hysong SJ, Francis J, Petersen LA. Motivating and engaging frontline providers in measuring and improving team clinical performance. BMJ Quality Safety. 2019.
    1. Revised Standards for Quality Improvement Reporting Excellence (SQUIRE 2.0). The Health Foundation. . Published 2018. Accessed June 27, 2018.
    1. Davies L, Donnelly KZ, Goodman DJ, Ogrinc G. Findings from a novel approach to publication guideline revision: user road testing of a draft version of SQUIRE 2.0. BMJ Quality Safety. 2016;25(4):265–272. doi: 10.1136/bmjqs-2015-004117.
    1. Williams L. VA Stroke Quality Enhancement Research Initiave (QUERI) Annual Report and Strategic Plan. VA Health Services Research and Development Service. . Published 2013. Updated November 17, 2017. Accessed November 17, 2017.
    1. Easton J, Saver J, Albers G, et al. Definition and evaluation of transient ischemic attack. Stroke. 2009;40(6):2276–2293. doi: 10.1161/STROKEAHA.108.192218.
    1. Johnston KC, Connors AF, Wagner DP, Knaus WA, Wang XQ, Haley EC. A predictive risk model for outcomes of ischemic stroke. Stroke. 2000;31:448–455. doi: 10.1161/01.STR.31.2.448.
    1. Johnston S. Short-term prognosis after a TIA: a simple score predicts risk. Cleve Clin J Med. 2007;74(10):729–736. doi: 10.3949/ccjm.74.10.729.
    1. Rothwell P, Johnston S. Transient ischemic attacks: stratifying risk. Stroke. 2006;37(2):320–322. doi: 10.1161/01.STR.0000200555.89117.d2.
    1. Kernan WN, Ovbiagele B, Black HR, et al. Guidelines for the prevention of stroke in patients with stroke and transient ischemic attack: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(7):2160–2236. doi: 10.1161/STR.0000000000000024.
    1. Lavallée P, Meseguer E, Abboud H, et al. A transient ischaemic attack clinic with round-the-clock access (SOS-TIA): feasibility and effects. Lancet Neurol. 2007;6(11):953–960. doi: 10.1016/S1474-4422(07)70248-X.
    1. Luengo-Fernandez R, Gray A, Rothwell P. Effect of urgent treatment for transient ischaemic attack and minor stroke on disability and hospital costs (EXPRESS study): a prospective population-based sequential comparison. Lancet Neurol. 2009;8(3):235–243. doi: 10.1016/S1474-4422(09)70019-5.
    1. Giles M, Rothwell P. Risk of stroke early after transient ischaemic attack: a systematic review and meta-analysis. Lancet Neurol. 2007;6(12):1063–1072. doi: 10.1016/S1474-4422(07)70274-0.
    1. O'Brien EC, Zhao X, Fonarow GC, et al. Quality of care and ischemic stroke risk after hospitalization for transient ischemic attack: findings from get with the guidelines-stroke. Circ Cardiovasc Qual Outcomes. 2015;8(6 Suppl 3):S117–S124. doi: 10.1161/CIRCOUTCOMES.115.002048.
    1. Bravata D, Myers L, Arling G, et al. The quality of Care for Veterans with transient ischemic attack and minor stroke. JAMA Neurology. 2018;75(4):419–427. doi: 10.1001/jamaneurol.2017.4648.
    1. Damush TM, Miech EJ, Sico JJ, et al. Barriers and facilitators to provide quality TIA care in the veterans healthcare administration. Neurology. 2017;89(24):2422–2430. doi: 10.1212/WNL.0000000000004739.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi: 10.1186/1748-5908-4-50.
    1. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x.
    1. Atkins D, Kilbourne AM, Shulkin D. Moving from discovery to system-wide change: the role of research in a learning health care system: experience from three decades of health systems research in the veterans health administration. Annu Rev Public Health. 2017;38:467–487. doi: 10.1146/annurev-publhealth-031816-044255.
    1. Kizer KW, Dudley RA. Extreme makeover: transformation of the veterans health care system. Annu Rev Public Health. 2009;30:313–339. doi: 10.1146/annurev.publhealth.29.020907.090940.
    1. Hagg H, Workman-Germann J, Flanagan M, et al. Implementation of systems redesign: approaches to spread and sustain adoption. Rockville, MD (USA): Agency for Healthcare Research and Quality; 2008.
    1. Redfern J, McKevitt C, Wolfe CD. Development of complex interventions in stroke care: a systematic review. Stroke. 2006;37(9):2410–2419. doi: 10.1161/01.STR.0000237097.00342.a9.
    1. Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ (Clinical research ed) 2008;337:a1655.
    1. Campbell M, Fitzpatrick R, Haines A, et al. Framework for design and evaluation of complex interventions to improve health. BMJ (Clinical research ed) 2000;321(7262):694–696. doi: 10.1136/bmj.321.7262.694.
    1. Medical Research Council (MRC). A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London2000.
    1. Bosworth H, Olsen M, Grubber J, et al. Two self-management interventions to improve hypertension control: a randomized trial. Ann Intern Med. 2009;151(10):687–695. doi: 10.7326/0000605-200911170-00148.
    1. Bosworth H, Powers B, Olsen M, et al. Home blood pressure management and improved blood pressure control: results from a randomized controlled trial. Arch Intern Med. 2011;171(13):1173–1180. doi: 10.1001/archinternmed.2011.276.
    1. Ranta A, Dovey S, Weatherall M, O'Dea D, Gommans J, Tilyard M. Cluster randomized controlled trial of TIA electronic decision support in primary care. Neurology. 2015;84(15):1545–1551. doi: 10.1212/WNL.0000000000001472.
    1. Rothwell P, Giles M, Chandratheva A, et al. Effect of urgent treatment of transient ischaemic attack and minor stroke on early recurrent stroke (EXPRESS study): a prospective population-based sequential comparison. Lancet (London, England) 2007;370(9596):1432–1442. doi: 10.1016/S0140-6736(07)61448-2.
    1. Bravata DM, Myers LJ, Arling G, et al. Quality of Care for Veterans with Transient Ischemic Attack and Minor Stroke. JAMA Neurol. 2018;75(4):419–427. doi: 10.1001/jamaneurol.2017.4648.
    1. Bravata DM, Myers LJ, Cheng E, et al. Development and Validation of Electronic Quality Measures to Assess Care for Patients With Transient Ischemic Attack and Minor Ischemic Stroke. Circ Cardiovasc Qual Outcomes. 2017;10(9).
    1. Ayers LR, Beyea SC, Godfrey MM, Harper DC, Nelson EC, Batalden PB. Quality improvement learning collaboratives. Qual Manag Health Care. 2005;14(4):234–247. doi: 10.1097/00019514-200510000-00010.
    1. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54. doi: 10.1186/1471-2288-6-54.
    1. Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–948. doi: 10.1016/j.jclinepi.2010.12.003.
    1. Curran G, Bauer M, Mittman B, Pyne J, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812.
    1. Barker D, McElduff P, D'Este C, Campbell MJ. Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol. 2016;16:69. doi: 10.1186/s12874-016-0176-5.
    1. Li J, Zhang Y, Myers LJ, Bravata DM. Power calculation in stepped-wedge cluster randomized trial with reduced intervention sustainability effect. J Biopharm Stat. 2019;29(4):663–674. doi: 10.1080/10543406.2019.1633658.
    1. Bravata DM, Myers LJ, Reeves M, et al. Processes of care associated with risk of mortality and recurrent stroke among patients with transient ischemic attack and nonsevere ischemic stroke. JAMA Netw Open. 2019;2(7):e196716. doi: 10.1001/jamanetworkopen.2019.6716.
    1. Man S, Zhao X, Uchino K, et al. Comparison of acute ischemic stroke care and outcomes between comprehensive stroke centers and primary stroke centers in the United States. Circ Cardiovasc Qual Outcomes. 2018;11(6):e004512. doi: 10.1161/CIRCOUTCOMES.117.004512.
    1. Fonarow GC, Reeves MJ, Smith EE, et al. Characteristics, performance measures, and in-hospital outcomes of the first one million stroke and transient ischemic attack admissions in get with the guidelines-stroke. Circ Cardiovasc Qual Outcomes. 2010;3(3):291–302. doi: 10.1161/CIRCOUTCOMES.109.921858.
    1. Li J, Zhang Y, Myers L, Bravata D. Power Calculation in Stepped-Wedge Cluster Randomized Trial with Reduced Intervention Sustainability Effect. J Biopharm Stat. 2019;In Press.
    1. Hamilton A, Brunner J, Cain C, et al. Engaging multilevel stakeholders in an implementation trial of evidence-based quality improvement in VA women’s health primary care. TBM. 2017;7(3):478–485.
    1. Ritchie MJ, Parker LE, Edlund CN, Kirchner JE. Using implementation facilitation to foster clinical practice quality and adherence to evidence in challenged settings: a qualitative study. BMC Health Serv Res. 2017;17(1):294. doi: 10.1186/s12913-017-2217-0.
    1. Jung TST, Davies HTO, Bower P, Whalley D, et al. Instruments for exploring organizational culture: a review of the literature. Public Adm Rev. 2009;69:1087–1096. doi: 10.1111/j.1540-6210.2009.02066.x.
    1. Heritage B, Pollock C, Roberts L. Validation of the organizational culture assessment instrument. PLoS One. 2014;9(3):e92879. doi: 10.1371/journal.pone.0092879.
    1. Miech E. The GO Score: A New Context-Sensitive Instrument to Measure Group Organization Level for Providing and Improving Care. Washington DC.2015.
    1. Rattray NA, Damush TM, Luckhurst C, Bauer-Martinez CJ, Homoya BJ, Miech EJ. Prime movers: advanced practice professionals in the role of stroke coordinator. J Am Assoc Nurse Pract. 2017;29(7):392–402.
    1. IOM. Institute of Medicine. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, DC: The National Academies Press; 2013.
    1. President’s Council of Advisors on Science and Technology. Realizing the full potential of health information technology to improve healthcare for Americans: the path forward, Report to the President. In. Washington, DC 2010:1–108.
    1. Etheredge LM. A rapid-learning health system. Health Aff. 2007;26(2):w107–w118. doi: 10.1377/hlthaff.26.2.w107.
    1. Tuti T, Nzinga J, Njoroge M, et al. A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. Implement Sci. 2017;12(1):61. doi: 10.1186/s13012-017-0590-z.
    1. Basaraba JE, Picard M, George-Phillips K, Mysak T. Pharmacists as care providers for stroke patients: a systematic review. Can J Neurol Sci. 2018;45(1):49–55. doi: 10.1017/cjn.2017.233.

Source: PubMed

3
Iratkozz fel