Optimizing responsiveness to feedback about antibiotic prescribing in primary care: protocol for two interrelated randomized implementation trials with embedded process evaluations

Jennifer Shuldiner, Kevin L Schwartz, Bradley J Langford, Noah M Ivers, Ontario Healthcare Implementation Laboratory study team, Monica Taljaard, Jeremy M Grimshaw, Meagan Lacroix, Mina Tadrous, Valerie Leung, Kevin Brown, Andrew M Morris, Gary Garber, Justin Presseau, Kednapa Thavorn, Jerome A Leis, Holly O Witteman, Jamie Brehaut, Nick Daneman, Michael Silverman, Michelle Greiver, Tara Gomes, Michael R Kidd, Jillian J Francis, Merrick Zwarenstein, Jonathan Lam, Cara Mulhall, Sharon Gushue, Sukhleen Uppal, Andrew Wong, Jennifer Shuldiner, Kevin L Schwartz, Bradley J Langford, Noah M Ivers, Ontario Healthcare Implementation Laboratory study team, Monica Taljaard, Jeremy M Grimshaw, Meagan Lacroix, Mina Tadrous, Valerie Leung, Kevin Brown, Andrew M Morris, Gary Garber, Justin Presseau, Kednapa Thavorn, Jerome A Leis, Holly O Witteman, Jamie Brehaut, Nick Daneman, Michael Silverman, Michelle Greiver, Tara Gomes, Michael R Kidd, Jillian J Francis, Merrick Zwarenstein, Jonathan Lam, Cara Mulhall, Sharon Gushue, Sukhleen Uppal, Andrew Wong

Abstract

Background: Audit and feedback (A&F) that shows how health professionals compare to those of their peers, can be an effective intervention to reduce unnecessary antibiotic prescribing among family physicians. However, the most impactful design approach to A&F to achieve this aim is uncertain. We will test three design modifications of antibiotic A&F that could be readily scaled and sustained if shown to be effective: (1) inclusion of case-mix-adjusted peer comparator versus a crude comparator, (2) emphasizing harms, rather than lack of benefits, and (3) providing a viral prescription pad.

Methods: We will conduct two interrelated pragmatic randomized trials in January 2021. One trial will include family physicians in Ontario who have signed up to receive their MyPractice: Primary Care report from Ontario Health ("OH Trial"). These physicians will be cluster-randomized by practice, 1:1 to intervention or control. The intervention group will also receive a Viral Prescription Pad mailed to their office as well as added emphasis in their report on use of the pad. Ontario family physicians who have not signed up to receive their MyPractice: Primary Care report will be included in the other trial administered by Public Health Ontario ("PHO Trial"). These physicians will be allocated 4:1 to intervention or control. The intervention group will be further randomized by two factors: case-mix adjusted versus unadjusted comparator and emphasis or not on harms of antibiotics. Physicians in the intervention arm of this trial will receive one of four versions of a personalized antibiotic A&F letter from PHO. For both trials, the primary outcome is the antibiotic prescribing rate per 1000 patient visits, measured at 6 months post-randomization, the primary analysis will use Poisson regression and we will follow the intention to treat principle. A mixed-methods process evaluation will use surveys and interviews with family physicians to explore potential mechanisms underlying the observed effects, exploring targeted constructs including intention, self-efficacy, outcome expectancies, descriptive norms, and goal prioritization.

Discussion: This protocol describes the rationale and methodology of two interrelated pragmatic trials testing variations of theory-informed components of an audit and feedback intervention to determine how to optimize A&F interventions for antibiotic prescribing in primary care.

Trial registration: NCT04594200, NCT05044052. CIHR Grant ID: 398514.

Keywords: Antibiotic prescribing; Antimicrobial resistance; Audit and feedback; Process evaluation; Protocol.

Conflict of interest statement

JP is an associate editor of implementation science. JG and NMI are members of the editorial board of implementation science.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Study design of two linked trials
Fig. 2
Fig. 2
Viral prescription pad
Fig. 3
Fig. 3
Emphasis on viral prescription pad inserted in MyPractice: Primary Care report dissemination email
Fig. 4
Fig. 4
Case-mix adjusted comparator and unadjusted comparator
Fig. 5
Fig. 5
Infographic to be included in the emphases on risk harms of antibiotic group
Fig. 6
Fig. 6
Proposed mechanisms of action, informed by the health action process approach [34, 35]
Fig. 7
Fig. 7
Multiple mediation regression models examining the effect of viral prescription pad, prescribing comparator, and harms information [34]

References

    1. Schwartz KL, Brown KA, Etches J, Langford BJ, Daneman N, Tu K, Johnstone J, Achonu C, Garber G. Predictors and variability of antibiotic prescribing amongst family physicians. J Antimicrob Chemother. 2019;74(7):2098–2105.
    1. Jones BE, Sauer B, Jones MM, Campo J, Damal K, He T, Ying J, Greene T, Goetz MB, Neuhauser MM, et al. Variation in outpatient antibiotic prescribing for acute respiratory infections in the veteran population: a cross-sectional study. Ann Intern Med. 2015;163(2):73–80.
    1. Public Health Agency of Canada . Canadian Antimicrobial Resistance Surveillance System report. Public Health Agency of Canada Ottawa, ON, Canada; 2020.
    1. Hallsworth M, Chadborn T, Sallis A, Sanders M, Berry D, Greaves F, Clements L, Davies SC. Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial. Lancet. 2016;387(10029):1743–1752.
    1. Nudge vs Superbugs . a behavioural economics trial to reduce the overprescribing of antibiotics. Australian Government Department of Health; 2018.
    1. Meeker D, Linder JA, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, Knight TK, Hay JW, Doctor JN. Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial. JAMA. 2016;315(6):562–570.
    1. Chung GW, Wu JE, Yeo CL, Chan D, Hsu LY. Antimicrobial stewardship: a review of prospective audit and feedback systems and an objective evaluation of outcomes. Virulence. 2013;4(2):151–157.
    1. Daneman N, Lee SM, Bai H, Bell CM, Bronskill SE, Campitelli MA, et al. Population-wide peer comparison audit and feedback to reduce antibiotic initiation and duration in long-term care facilities with embedded randomized controlled trial. Clin Infect Dis. 2021.
    1. Ivers NM, Sales A, Colquhoun HL, Michie S, Foy R, Francis JJ, Grimshaw JM. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implementation Sci. 2014;9(1):14.
    1. Malcolm W, Seaton RA, Haddock G, Baxter L, Thirlwell S, Russell P, Cooper L, Thomson A, Sneddon J. Impact of the COVID-19 pandemic on community antibiotic prescribing in Scotland. JAC-Antimicrobial Resistance. 2020;2(4):dlaa105.
    1. Buehrle DJ, Nguyen MH, Wagener MM, Clancy CJ: Impact of the coronavirus disease 2019 pandemic on outpatient antibiotic prescriptions in the United States. In: Open forum infectious diseases: 2020: Oxford University Press US; 2020: ofaa575
    1. Kitano T, Brown KA, Daneman N, MacFadden DR, Langford BJ, Leung V, So M, Leung E, Burrows L, Manuel D. Open Forum Infectious Diseases. 2021. The impact of COVID-19 on outpatient antibiotic prescriptions in Ontario, Canada; An interrupted time series analysis.
    1. Knight BD, Shurgold J, Smith G, MacFadden DR, Schwartz KL, Daneman N, et al. The impact of COVID-19 on community antibiotic use in Canada: an ecological study. Clin Microbiol Infection. 2021.
    1. Grimshaw JM, Ivers N, Linklater S, Foy R, Francis JJ, Gude WT, Hysong SJ. Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback. BMJ Quality Safety. 2019;28(5):416–423.
    1. Schwartz KL, Ivers N, Langford BJ, Taljaard M, Neish D, Brown KA, et al. Effect of antibiotic-prescribing feedback to high-volume primary care physicians on number of antibiotic prescriptions: a randomized clinical trial. JAMA. Internal Med. 2021.
    1. Marchildon GP. Canada, Health System of. International Encyclopedia of. Public Health. 2008;381.
    1. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. Bmj. 2015;350.
    1. Collins LM, Murphy SA, Nair VN, Strecher VJ. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005;30(1):65–73.
    1. Schwartz KL, Langford BJ, Daneman N, Chen B, Brown KA, McIsaac W, Tu K, Candido E, Johnstone J, Leung V. Unnecessary antibiotic prescribing in a Canadian primary care setting: a descriptive analysis using routinely collected electronic medical record data. CMAJ open. 2020;8(2):E360.
    1. Elouafkaoui P, Young L, Newlands R, Duncan EM, Elders A, Clarkson JE, Ramsay CR. An audit and feedback intervention for reducing antibiotic prescribing in general dental practice: The RAPiD Cluster Randomised Controlled Trial. PLoS Med. 2016;13(8):e1002115.
    1. Desveaux L, Ivers NM, Devotta K, Ramji N, Weyman K, Kiran T. Unpacking the intention to action gap: a qualitative study understanding how physicians engage with audit and feedback. Implementation Science. 2021;16(1):19.
    1. Steinman MA, Landefeld CS, Gonzales R. Predictors of broad-spectrum antibiotic prescribing for acute respiratory tract infections in adult primary care. Jama. 2003;289(6):719–725.
    1. Silverman M, Povitz M, Sontrop JM, Li L, Richard L, Cejic S, Shariff SZ. Antibiotic prescribing for nonbacterial acute upper respiratory infections in elderly persons. Ann Intern Med. 2017;166(11):765–774.
    1. Ontario Drug Benefit: Exceptional Access Program []
    1. Levy AR, O'Brien BJ, Sellors C, Grootendorst P, Willison D: Coding accuracy of administrative drug claims in the Ontario Drug Benefit database. The Canadian journal of clinical pharmacology= J Can Pharmacologie clinique 2003, 10(2):67-71.
    1. Levy AR, O'Brien BJ, Sellors C, Grootendorst P, Willison D. Coding accuracy of administrative drug claims in the Ontario Drug Benefit database. Can J Clin Pharmacol. 2003;10(2):67–71.
    1. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux P, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surgery. 2012;10(1):28–55.
    1. Collins LM, Dziak JJ, Kugler KC, Trail JB. Factorial experiments: efficient tools for evaluation of intervention components. Am J Prev Med. 2014;47(4):498–504.
    1. Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, Sweeney J. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood) 2013;32(2):223–231.
    1. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443–451.
    1. Borrelli B, Sepinwall D, Ernst D, Bellg AJ, Czajkowski S, Breger R, DeFrancesco C, Levesque C, Sharp DL, Ogedegbe G, et al. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–860.
    1. Grava-Gubins I, Scott S. Effects of various methodologic strategies: survey response rates among Canadian physicians and physicians-in-training. Can Fam Physician. 2008;54(10):1424–1430.
    1. Presseau J, McCleary N, Lorencatto F, Patey AM, Grimshaw JM, Francis JJ. Action, actor, context, target, time (AACTT): a framework for specifying behaviour. Implementation Sci. 2019;14(1):102.
    1. Schwarzer R. Health action process approach (HAPA) as a theoretical framework to understand behavior change. Actualidades en Psicología. 2016;30(121):119–130.
    1. Schwarzer R, Lippke S, Luszczynska A. Mechanisms of health behavior change in persons with chronic illness or disability: the Health Action Process Approach (HAPA) Rehabil Psychol. 2011;56(3):161–170.
    1. Gude WT, Brown B, van der Veer SN, Colquhoun HL, Ivers NM, Brehaut JC, Landis-Lewis Z, Armitage CJ, de Keizer NF, Peek N. Clinical performance comparators in audit and feedback: a review of theory and evidence. Implementation Sci. 2019;14(1):39.
    1. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Services Res. 2017;17(1):88.
    1. McCleary N, Ivers NM, Schwalm JD, Witteman HO, Taljaard M, Desveaux L, Bouck Z, Grace SL, Natarajan MK, Grimshaw JM, et al. Interventions supporting cardiac rehabilitation completion: Process evaluation investigating theory-based mechanisms of action. Health Psychol. 2020;39(12):1048–1061.
    1. Olejnik S, Algina J. Generalized eta and omega squared statistics: measures of effect size for some common research designs. Psychological Methods. 2003;8(4):434.
    1. Hayes AF, Preacher KJ. Statistical mediation analysis with a multicategorical independent variable. Br J Math Stat Psychol. 2014;67(3):451–470.
    1. Hayes AF, Rockwood NJ. Regression-based statistical mediation and moderation analysis in clinical research: observations, recommendations, and implementation. Behav Res Ther. 2017;98:39–57.
    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):Cd000259.
    1. Brown B, Gude WT, Blakeman T, van der Veer SN, Ivers N, Francis JJ, Lorencatto F, Presseau J, Peek N, Daker-White G. Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research. Implementation Sci. 2019;14(1):40.
    1. Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, Ivers N, Grimshaw JM. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164(6):435–441.
    1. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
    1. Fusch PI, Ness LR. Are we there yet? Data saturation in qualitative research. Qual Rep. 2015;20(9):1408.
    1. Hopf Y, Francis J, Helms P, Haughney J, Bond C. Core requirements for successful data linkage: an example of a triangulation method. BMJ Open. 2016;6(10):e011879.
    1. Caracelli VJ, Greene JC. Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1993;15(2):195–207.
    1. McConney A, Rudd A, Ayres R. Getting to the bottom line: a method for synthesizing findings within mixed-method program evaluations. Am J Evaluation. 2002;23(2):121–140.
    1. Seung SJ, Hurry M, Hassan S, Walton R, Evans W. Cost-of-illness study for non-small-cell lung cancer using real-world data. Curr Oncol. 2019;26(2):102–107.
    1. Canadian Agency for Drugs Technologies in Health: Guidelines for the economic evaluation of health technologies: Canada. In.: Ottawa: Canadian Agency for Drugs and Technologies in Health; 2006.
    1. Glick HA, Doshi JA, Sonnad SS, Polsky D. Economic evaluation in clinical trials. OUP Oxford. 2014.
    1. Sullivan SD, Mauskopf JA, Augustovski F, Caro JJ, Lee KM, Minchin M, Orlewska E, Penna P. Barrios J-MR, Shau W-Y: Budget impact analysis—principles of good practice: report of the ISPOR 2012 Budget Impact Analysis Good Practice II Task Force. Value in health. 2014;17(1):5–14.

Source: PubMed

3
Sottoscrivi