Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: quantitative examination of variation between practices in recruitment, implementation and effectiveness

Tobias Dreischulte, Aileen Grant, Adrian Hapca, Bruce Guthrie, Tobias Dreischulte, Aileen Grant, Adrian Hapca, Bruce Guthrie

Abstract

Objectives: The cluster randomised trial of the Data-driven Quality Improvement in Primary Care (DQIP) intervention showed that education, informatics and financial incentives for general medical practices to review patients with ongoing high-risk prescribing of non-steroidal anti-inflammatory drugs and antiplatelets reduced the primary end point of high-risk prescribing by 37%, where both ongoing and new high-risk prescribing were significantly reduced. This quantitative process evaluation examined practice factors associated with (1) participation in the DQIP trial, (2) review activity (extent and nature of documented reviews) and (3) practice level effectiveness (relative reductions in the primary end point).

Setting/participants: Invited practices recruited (n=33) and not recruited (n=32) to the DQIP trial in Scotland, UK.

Outcome measures: (1) Characteristics of recruited versus non-recruited practices. Associations of (2) practice characteristics and 'adoption' (self-reported implementation work done by practices) with documented review activity and (3) of practice characteristics, DQIP adoption and review activity with effectiveness.

Results: (1) Recruited practices had lower performance in the quality and outcomes framework than those declining participation. (2) Not being an approved general practitioner training practice and higher self-reported adoption were significantly associated with higher review activity. (3) Effectiveness ranged from a relative increase in high-risk prescribing of 24.1% to a relative reduction of 77.2%. High-risk prescribing and DQIP adoption (but not documented review activity) were significantly associated with greater effectiveness in the final multivariate model, explaining 64.0% of variation in effectiveness.

Conclusions: Intervention implementation and effectiveness of the DQIP intervention varied substantially between practices. Although the DQIP intervention primarily targeted review of ongoing high-risk prescribing, the finding that self-reported DQIP adoption was a stronger predictor of effectiveness than documented review activity supports that reducing initiation and/or re-initiation of high-risk prescribing is key to its effectiveness.

Trial registration number: NCT01425502; Post-results.

Keywords: Adverse Events; Primary Care; Quality In Health Care.

Conflict of interest statement

Competing interests: None declared.

© Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Figures

Figure 1
Figure 1
Framework model for designing process evaluations of cluster-randomised controlled trials applied to the Data-driven Quality Improvement in Primary Care (DQIP) trial.
Figure 2
Figure 2
Findings from two adoption questionnaires completed by the general practitioner (GP) leading on Data-driven Quality Improvement in Primary Care (DQIP) in each practice.
Figure 3
Figure 3
Variation among practices in effectiveness (A) and review activity (B).

References

    1. Hakkarainen KM, Hedna K, Petzold M, et al. . Percentage of patients with preventable adverse drug reactions and preventability of adverse drug reactions–a meta-analysis. PLoS One 2012;7:e33236 10.1371/journal.pone.0033236
    1. Howard R, Avery A, Bissell P. Causes of preventable drug-related hospital admissions: a qualitative study. Qual Saf Health Care 2008;17:109–16. 10.1136/qshc.2007.022681
    1. National Institute for Health and Care Excellence (NICE). Costing statement: Medicines optimisation - Implementing the NICE guideline on medicines information (NG5). 2015. (accessed 11 May 2016).
    1. IMS Institute for health care informatics. Avoidable Costs in U.S. Healthcare. 2013.
    1. Howard RL, Avery AJ, Slavenburg S, et al. . Which drugs cause preventable admissions to hospital? A systematic review. Br J Clin Pharmacol 2007;63:136–47. 10.1111/j.1365-2125.2006.02698.x
    1. Budnitz DS, Lovegrove MC, Shehab N, et al. . Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med 2011;365:2002–12. 10.1056/NEJMsa1103053
    1. Leendertse AJ, Egberts AC, Stoker LJ, et al. . Frequency of and risk factors for preventable medication-related hospital admissions in the Netherlands. Arch Intern Med 2008;168:1890–6. 10.1001/archinternmed.2008.3
    1. Grant AM, Guthrie B, Dreischulte T. Developing a complex intervention to improve prescribing safety in primary care: mixed methods feasibility and optimisation pilot study. BMJ Open 2014;4:e004153 10.1136/bmjopen-2013-004153
    1. Dreischulte T, Grant AM, McCowan C, et al. . Quality and safety of medication use in primary care: consensus validation of a new set of explicit medication assessment criteria and prioritisation of topics for improvement. BMC Clin Pharmacol 2012;12:5 10.1186/1472-6904-12-5
    1. Guthrie B, McCowan C, Davey P, et al. . High risk prescribing in primary care patients particularly vulnerable to adverse drug events: cross sectional population database analysis in Scottish general practice. BMJ 2011;342:d3514 10.1136/bmj.d3514
    1. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol 2006;6:54 10.1186/1471-2288-6-54
    1. Dreischulte T, Donnan P, Grant A, et al. . Safer prescribing–a trial of education, informatics, and financial incentives. N Engl J Med 2016;374:1053–64. 10.1056/NEJMsa1508955
    1. Dopson S, Locock L, Chambers D, et al. . Implementation of evidence-based medicine: evaluation of the Promoting Action on Clinical Effectiveness programme. J Health Serv Res Policy 2001;6:23–31. 10.1258/1355819011927161
    1. Glasziou P, Meats E, Heneghan C, et al. . What is missing from descriptions of treatment in trials and reviews? BMJ 2008;336:1472–4. 10.1136/bmj.39590.732037.47
    1. Hoffmann TC, Glasziou PP, Boutron I, et al. . Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ 2014;348:g1687 10.1136/bmj.g1687
    1. Shekelle PG, Pronovost PJ, Wachter RM, et al. . Advancing the science of patient safety. Ann Intern Med 2011;154:693–6. 10.7326/0003-4819-154-10-201105170-00011
    1. Grant A, Dreischulte T, Treweek S, et al. . Study protocol of a mixed-methods evaluation of a cluster randomized trial to improve the safety of NSAID and antiplatelet prescribing: data-driven quality improvement in primary care. Trials 2012;13:1–6. 10.1186/1745-6215-13-154
    1. Glasgow RE, McKay HG, Piette JD, et al. . The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns 2001;44:119–27. 10.1016/S0738-3991(00)00186-5
    1. Grant A, Dreischulte T, Guthrie B. Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: case study evaluation of adoption and maintenance of a complex intervention to reduce high-risk primary care prescribing. BMJ Open 2017;7:e015281 10.1136/bmjopen-2016-015281
    1. Grant A, Dreischulte T, Guthrie B. Process evaluation of the data-driven quality improvement in primary care (DQIP) trial: active and less active ingredients of a multi-component complex intervention to reduce high-risk primary care prescribing. Implement Sci 2017;12:4 10.1186/s13012-016-0531-2
    1. Information Services Scotland. General practice. (accessed 12 Nov 2015).
    1. May C, Finch T. Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory. Sociology 2009;43:535–54. 10.1177/0038038509103208
    1. Lynn MR. Determination and quantification of content validity. Nurs Res 1986;35:382–6. 10.1097/00006199-198611000-00017
    1. Austin PC, Steyerberg EW. The number of subjects per variable required in linear regression analyses. J Clin Epidemiol 2015;68:627–36. 10.1016/j.jclinepi.2014.12.014
    1. Guthrie B, Donnan PT, Murphy DJ, et al. . Bad apples or spoiled barrels? Multilevel modelling analysis of variation in high-risk prescribing in Scotland between general practitioners and between the practices they work in. BMJ Open 2015;5:e008270 10.1136/bmjopen-2015-008270
    1. Finch TL, Rapley T, Girling M, et al. . Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol. Implement Sci 2013;8:1–8. 10.1186/1748-5908-8-43
    1. MacKinnon DP, Fairchild AJ, Fritz MS. Mediation analysis. Annu Rev Psychol 2007;58:593–614. 10.1146/annurev.psych.58.110405.085542

Source: PubMed

3
Abonner