Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: case study evaluation of adoption and maintenance of a complex intervention to reduce high-risk primary care prescribing

Aileen Grant, Tobias Dreischulte, Bruce Guthrie, Aileen Grant, Tobias Dreischulte, Bruce Guthrie

Abstract

Objective: To explore how different practices responded to the Data-driven Quality Improvement in Primary Care (DQIP) intervention in terms of their adoption of the work, reorganisation to deliver the intended change in care to patients, and whether implementation was sustained over time.

Design: Mixed-methods parallel process evaluation of a cluster trial, reporting the comparative case study of purposively selected practices.

Setting: Ten (30%) primary care practices participating in the trial from Scotland, UK.

Results: Four practices were sampled because they had large rapid reductions in targeted prescribing. They all had internal agreement that the topic mattered, made early plans to implement including assigning responsibility for work and regularly evaluated progress. However, how they internally organised the work varied. Six practices were sampled because they had initial implementation failure. Implementation failure occurred at different stages depending on practice context, including internal disagreement about whether the work was worthwhile, and intention but lack of capacity to implement or sustain implementation due to unfilled posts or sickness. Practice context was not fixed, and most practices with initial failed implementation adapted to deliver at least some elements. All interviewed participants valued the intervention because it was an innovative way to address on an important aspect of safety (although one of the non-interviewed general practitioners in one practice disagreed with this). Participants felt that reviewing existing prescribing did influence their future initiation of targeted drugs, but raised concerns about sustainability.

Conclusions: Variation in implementation and effectiveness was associated with differences in how practices valued, engaged with and sustained the work required. Initial implementation failure varied with practice context, but was not static, with most practices at least partially implementing by the end of the trial. Practices organised their delivery of changed care to patients in ways which suited their context, emphasising the importance of flexibility in any future widespread implementation.

Trial registration number: NCT01425502.

Keywords: General Practice; PRIMARY CARE; Prescribing; Process Evaluation; Quality and Safety; Randomised Controlled Trials.

Conflict of interest statement

Competing interests: None declared.

Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Figures

Figure 1
Figure 1
DQIP process evaluation framework. DQIP, Data-driven Quality Improvement in Primary Care.
Figure 2
Figure 2
All trial practices ranked in order of intervention effectiveness, with case study practices identified. Practices marked in green were sampled because they were judged to have initially rapidly reduced the targeted prescribing; practices marked in red were sampled because they were judged to have not initially reduced the targeted prescribing.

References

    1. Hakkarainen KM, Hedna K, Petzold M et al. . Percentage of patients with preventable adverse drug reactions and preventability of adverse drug reactions--a meta-analysis. PLOS ONE 2012;7:e33236 10.1371/journal.pone.0033236
    1. Howard R, Avery A, Bissell P. Causes of preventable drug-related hospital admissions: a qualitative study. Qual Saf Health Care 2008;17:109–16. 10.1136/qshc.2007.022681
    1. National Institute for Health and Care Excellence (NICE). Costing statement: Medicines optimisation—Implementing the NICE guideline on medicines information (NG5), 2015. (accessed 11 05 2016).
    1. Institute for Health Care Informatics, IMS. Responsible Use of Medicines Report, 2012.
    1. Howard RL, Avery AJ, Slavenburg S et al. . Which drugs cause preventable admissions to hospital? A systematic review. Br J Clin Pharmacol 2007;63:136–47. 10.1111/j.1365-2125.2006.02698.x
    1. Budnitz DS, Lovegrove MC, Shehab N et al. . Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med 2011;365:2002–12. 10.1056/NEJMsa1103053
    1. Leendertse AJ, Egberts ACG, Stoker LJ et al. . Frequency of and risk factors for preventable medication-related hospital admissions in the Netherlands. Arch Intern Med 2008;168:1890–6. 10.1001/archinternmed.2008.3
    1. Dreischulte T, Grant A, Donnan P et al. . A cluster randomised stepped wedge trial to evaluate the effectiveness of a multifaceted information technology-based intervention in reducing high-risk prescribing of non-steroidal anti-inflammatory drugs and antiplatelets in primary medical care: the DQIP study protocol. Implement Sci 2012;7:24 10.1186/1748-5908-7-24
    1. Grant AM, Guthrie B, Dreischulte T. Developing a complex intervention to improve prescribing safety in primary care: mixed methods feasibility and optimisation pilot study. BMJ Open 2014;4:e004153 10.1136/bmjopen-2013-004153
    1. Guthrie B, McCowan C, Davey P et al. . High risk prescribing in primary care patients particularly vulnerable to adverse drug events: cross sectional population database analysis in Scottish general practice. BMJ 2011;342:d3514.
    1. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol 2006;6:54 10.1186/1471-2288-6-54
    1. Dreischulte T, Donnan P, Grant A et al. . Safer prescribing--a trial of education, informatics and financial incentives. N Engl J Med 2016;374:1053–64. 10.1056/NEJMsa1508955
    1. Medical Research Council. Developing and evaluating complex interventions: new guidance, 2008. (accessed 4 Mar 2017).
    1. Medical Research Council. Process evaluation of complex interventions: UK Medical Research Council (MRC) guidance, 2015. (accessed 4 Mar 2017).
    1. Grant A, Treweek S, Dreischulte T et al. . Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials 2013;14:15 10.1186/1745-6215-14-15
    1. Stake R. The Art of Case Study Research. Thousand Oaks: Sage Publications, 1995.
    1. Crowe S, Cresswell K, Robertson A et al. . The case study approach. BMC Med Res Methodol 2011;11:100 10.1186/1471-2288-11-100
    1. Grant A, Dreischulte T, Treweek S et al. . Study protocol of a mixed-methods evaluation of a cluster randomized trial to improve the safety of NSAID and antiplatelet prescribing: data-driven quality improvement in primary care. Trials 2012;13:154 10.1186/1745-6215-13-154
    1. Grant A, Dreischulte T, Guthrie B. Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: active and less active ingredients of a multi-component complex intervention to reduce high-risk primary care prescribing. Implement Sci 2017;12:4 10.1186/s13012-016-0531-2
    1. May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology 2009;43:535. 10.1177/0038038509103208
    1. Glaser B, Strauss A. The discovery of grounded theory: strategies for qualitative research. Chicago: Aldine Publishing Co, 1967.
    1. Ritchie J, Spencer L, O'Connor W. Carrying out Qualitative Analysis. In: Ritchie J, Lewis J, ds. Qualitative research practice, a guide for social science students and researchers . London: Sage Publications Ltd, 2003:219–62.
    1. Avery AJ, Rodgers S, Cantrill JA et al. . A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. The Lancet 2012;379:1310–19. 10.1016/S0140-6736(11)61817-5
    1. Cresswell KM, Sadler S, Rodgers S et al. . An embedded longitudinal multi-faceted qualitative evaluation of a complex cluster randomized controlled trial aiming to reduce clinically important errors in medicines management in general practice. Trials 2012;13:78 10.1186/1745-6215-13-78
    1. Kennedy A, Rogers A, Chew-Graham C et al. . Implementation of a self-management support approach (WISE) across a health system: a process evaluation explaining what did and did not work for organisations, clinicians and patients. Implementation Science 2014;9:129 10.1186/s13012-014-0129-5
    1. Berendsen BAJ, Kremers SPJ, Savelberg HHCM et al. . The implementation and sustainability of a combined lifestyle intervention in primary care: mixed method process evaluation. BMC Family Practice 2015;16:37 10.1186/s12875-015-0254-5
    1. Moore GF, Moore L, Murphy S. Facilitating adherence to physical activity: exercise professionals’ experiences of The National Exercise Referral Scheme in Wales a qualitative study. BMC Public Health 2011;11:935 10.1186/1471-2458-11-935
    1. Murdoch J, Varley A, Fletcher E et al. . Implementing telephone triage in general practice: a process evaluation of a cluster randomised controlled trial. BMC Fam Pract 2015;16:47 10.1186/s12875-015-0263-4

Source: PubMed

3
購読する