Providing Antibiotic Prescribing Feedback to Primary Care Physicians: The Ontario Program To Improve AntiMicrobial USE (OPTIMISE)

Ontario Healthcare Implementation Laboratory: A Learning Health System Approach That Leverages Data to Improve Quality in Primary Care: Stage 1

Antibiotic overuse occurs in multiple jurisdictions and is associated with rising rates of antimicrobial resistance. Mailing letters to the highest antibiotic prescribing physicians is a potentially effective method to optimize antibiotic use. The objectives of this study are to improve enrollment to Health Quality Ontario's Primary Care Practice report and reduce unnecessary antibiotic use. The investigators are conducting a randomized controlled trial recruiting the 3500 highest antibiotic prescribing primary care physicians in Ontario. The investigators have incorporated behavioural science theory into designing letters to modify prescribing behaviour. Letter 1 is testing change ideas related to antibiotic initiation and letter 2 is testing change ideas related to antibiotic duration. There will be 1500 physicians receiving letter 1, 1500 receiving letter 2, and 500 will serve as controls. Twelve months later all 3500 physicians will receive a letter.

Study Overview

• Status: Completed
• Conditions: Antibiotic Prescribing Audit and Feedback
• Intervention / Treatment: Other: Antibiotic use feedback letter

Detailed Description

Background: Antibiotic overuse is the major driver of rising antimicrobial resistance rates. Unnecessary antibiotic use is associated with adverse medication side effects and rising rates of resistance. Mailing letters to high antibiotic prescribers in other countries have shown variables effects on reducing antibiotic prescribing.1-3

Objective: To evaluate the impact of a letter to the 25% of primary care physicians who prescribe the most antibiotics in Ontario on increasing enrollment for HQO primary care practice reports.

Secondary objectives: To test the impact of different formats of a notification letter on antibiotic prescribing. Our primary hypothesis is that notifying physicians that antibiotic use is being monitored will decrease use of antibiotics. The investigators further hypothesize that targeted change ideas on antibiotic initiation or duration will have varying impacts on these different prescribing behaviours highlighting the importance of targeted messaging.

Methods: The effect of letter mail outs to the top 25% prescribing primary care physicians will be evaluated using a randomized controlled trial (RCT) design. The investigators will allocate physicians to intervention versus control arms in a 3:3:1 ratio to maximize the number of physicians exposed to the intervention. The investigators are using the IQVIA Xponent database from March 2017 to February 2018 to identify the top 25% of primary care physician antibiotic prescribers in Ontario (family physicians or general practitioners) defined by total numbers of antibiotic prescriptions. They will be mailed a letter to indicate that they prescribe more antibiotics than 75% of Ontario primary care physicians, based on total numbers of antibiotic prescriptions per year. The letter will encourage them to sign up for HQO My Practice primary care reports which in the future may include antibiotic indicators.

The letter was designed using proven theoretical frameworks of behaviour change to improve antibiotic prescribing by physicians. Most physicians are aware of the global public health threat of antimicrobial resistance, however many underestimate its importance locally. Furthermore, unnecessary antibiotic prescribing is frequently attributed to external factors out of their control, such as patient expectations and patient adherence to medication.4 For this intervention the investigators focused on two behaviour change theories previously demonstrated to be associated with prescribing behaviour; Theory of Planned Behaviour (TBP) and Operant Learning Theory (OLT).5 The letter will provide some social normative comparison by indicating to these physicians that they prescribe more antibiotics than their peers (TPB). By providing change ideas and information on the consequences of unnecessary antibiotic use, the investigators are attempting to change the physicians' risk perception (TPB) and anticipated consequences (OLT) of prescribing antibiotics for acute respiratory tract infections. This letter represents a form of persuasive communication behaviour change technique (BCT). This form of BCT has shown to be effective in modifying OLT driven behaviours.6, 7

To test different change ideas, the investigators will simultaneously evaluate two types of letters to be randomly distributed to the physicians in the top 25% of prescribers allocated in 3:3:1 ratios; a) Providing change ideas from Choosing Wisely Canada on appropriate initiation of antibiotics for acute respiratory conditions; b) Providing change ideas on appropriate duration of antibiotics.

Designs of the letters went through user testing and were iteratively refined by a sample of Ontario primary care physicians. The letters will be co-branded with the Ontario Medical Association (OMA) Section of General and Family Practice and Choosing Wisely Ontario. The letters were also reviewed by the Ontario College of Family Physicians, HQO and members of the study team to provide input and edits to the language and content. Based on the trial results the investigators will send a letter to all 3500 physicians the following year (12 months later).

Sample Size: Sample size calculations are based on Antibiotic outcome 1. A total of 3500 primary care physicians will be included in the randomized controlled trial: 3000 will receive a letter and 500 will not receive a letter. In an analysis of covariance (ANCOVA), sample sizes of 500, 1500, and 1500 physicians achieve >80% power to detect a 1% absolute difference in the primary antibiotic outcome between the average of the three intervention arms versus control using an F-Test at the 5% level of significance. The calculations assumed a standard deviation of 12 calculated using routinely collected data available within March 1 2017 and February 28 2018, and accounted for the baseline measure of the primary outcome assuming a correlation of 0.8.

The primary outcome will be an intention to treat analysis of the RCT at 12 months for both outcomes 1 and 2. The unit of analysis will be the physician. The primary analysis will use the modified robust Poisson regression approach of Zou and Donner.(Zou and Donner 2013) The dependent variable will be the numerator for each outcome, with the log of the denominator specified as an offset term. The distribution will be Poisson and the link function will be the log-link. The model will include a fixed term for time (pre/post), and the interaction between time and group (intervention). Note that, in order to constrain the differences between the arms at baseline to 0, the model will omit the main effect for the intervention. Pairwise least square mean differences will be obtained from the model (each intervention arm versus control) and expressed as Relative Risk (RR) and 97.5% confidence intervals. Statistical significance will be assessed at the Bonferroni-corrected level of 0.05/3. Robust standard errors will be used, with the correlation structure specified as Exchangeable. Secondary pairwise comparisons will also be obtained from the model (e.g., the average of the two letter versus control, and direct comparison between the two letters).

The investigators will use the same approach for the quarterly data, except that the least square mean pairwise differences will be obtained at the first, second, third and final quarters after randomization, to examine short and long-term effects of the intervention. The investigators will evaluate subgroups including baseline physician prescribing (>90th %ile vs 75-90th %ile), years in medical practice (<10y, 11-24y, vs 25y), physician gender (M vs F), rural vs urban practice, and patient age/sex groupings (<18yM, <18yF, 18-64yM, 18-64yF, 65+M, and 65+F) using IQVIA data.

A secondary outcome will be new physician enrollment into HQO primary care practice reports. Working with HQO, the investigators will track physicians in our study that sign up in response to receiving the letter from Public Health Ontario (PHO) by February 28, 2019. Physicians will be invited to sign up via a special weblink created for this study. The primary analysis will calculate the absolute difference between the proportions of new sign ups in the two intervention arms versus the control arm together with 95% confidence interval. Multiplicity-adjusted pairwise comparisons will also be made between each of the intervention arms versus the control and between the different versions of the letters. The investigators will evaluate predictor variables of new enrollment including baseline physician prescribing (>90th %ile vs 75-90th %ile), years in medical practice (<10y, 11-24y, vs 25y), physician gender (M vs F), rural vs urban practice, and patient age/sex groupings (<18yM, <18yF, 18-64yM, 18-64yF, 65+M, and 65+F) using logistic regression analysis.

To evaluate the overall effect of receiving any letter, compared to no letter, on prescribing outcomes in Ontario, The investigators will use a regression discontinuity design (RDD) by including antibiotic prescribing data from the rest of Ontario's primary care physicians. In the traditional RDD, subjects are assigned to treatment or control based on a cut-off value of a continuous assignment variable. The investigators will use the 3000 primary care physicians who received letters (excluding the 500 physicians in the control arm) as the treatment group and compare them to the remainder of Ontario physicians as controls. The assignment variable in our design is the antibiotic prescription rate (defined as antibiotics per 100 total medications over the year before the intervention).The investigators will present effects graphically by plotting the continuous assignment variable on the x-axis and the continuous outcome variable (antibiotic prescription rate over the year after the intervention) on the y-axis. Different regression lines are then fit to the data on each site of the cut-off. If the intervention is effective, there will be a discontinuity in the regression lines at the value of the cut-off. The intervention effect is expressed as the vertical displacement at the point of discontinuity.8 The investigators will also conduct this analysis for antibiotic duration.

Limitations: The investigators can only monitor antibiotics prescribed per 100 total medications with this dataset, instead of per patient volume. This measure appears to be a reasonable antibiotic use measure within a physician as it is stable over time in high prescribing physicians in our datasets.

Ethical considerations: Antimicrobial stewardship and combating antimicrobial resistance is a provincial and national priority. The Xponent database with prescribing data at an individual prescriber level is already held by PHO and is kept in a secure location. The agreement with IQVIA allows PHO to provide direct feedback to physicians. The letters will be addressed to the physician and marked confidential. The only data within them will be that they have been identified as a high antibiotic prescriber. No specific prescription counts or any patient-level data are being provided.

The investigators have designed this study to maximize HQO sign up and potential impact through a 6:1 allocation. Furthermore, the investigators will send a debrief and follow-up letter to all physicians the following year so that all high prescribing physicians will have the opportunity to receive this information and sign up for HQO reports. Physicians will be given an email address to contact PHO with any questions or concerns regarding the letter. All results will be aggregated and reports will not divulge any prescriber details.

A waiver of consent for this study was provided. This intervention involves minimal risk and burden to participants (letters are sent to physicians from government agencies routinely; these letters do not require an immediate response). There is no anticipated impact on the welfare of physicians by receiving this letter. The intervention would be impractical if consent were required. A consent process even if feasible, would likely create selection bias and make it impossible to answer the research question posed. In addition, the consent process would include a greater burden to physicians than this single letter intervention itself. This quality improvement initiate has the potential to benefit physicians by providing helpful recommendations on optimal antibiotic prescribing practices. A PHO contact email will be provided on the letter to provide physicians the opportunity to contact PHO and opt-out of future letters.

• Study Type: Interventional
• Enrollment (Actual): 3500
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Canada
  • Ontario
    • Toronto, Ontario, Canada, M5G 1V2
      • Public Health Ontario

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: ADULT; OLDER_ADULT; CHILD
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• Ontario primary care physicians
• Prescribe more antibiotics by volume than 75% of Ontario primary care physicians
• A College of Physicians and Surgeons of Ontario number in 2017-2018

Exclusion Criteria:

• None

Study Plan

How is the study designed?

Design Details

• Primary Purpose: HEALTH_SERVICES_RESEARCH
• Allocation: RANDOMIZED
• Interventional Model: PARALLEL
• Masking: SINGLE

Number of Arms

3

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
ACTIVE_COMPARATOR: Antibiotic use feedback letter 1; Antibiotic use feedback letter 1 provides physicians with information on their antibiotic use plus change ideas on appropriate antibiotic prescribing for acute respiratory conditions	Other: Antibiotic use feedback letter; Mailed letters indicating that the physician prescribes more antibiotics than 75% of their peers
ACTIVE_COMPARATOR: Antibiotic use feedback letter 2; Antibiotic use feedback letter 2 provides physicians with information on their antibiotic use plus change ideas on appropriate antibiotic durations for common infections	Other: Antibiotic use feedback letter; Mailed letters indicating that the physician prescribes more antibiotics than 75% of their peers
NO_INTERVENTION: Control; Controls will not receive a letter

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Antibiotic prescribing rate	Number of antibiotics prescribed per 100 total prescriptions	12 months
Prolonged duration prescribing rate	Proportion of antibiotic prescriptions that are >7 days per 100 total prescriptions	12 months

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
New enrollment for Health Quality Ontario primary care practice reports	Proportion of new sign ups for Health Quality Ontario primary care practice reports	24 months

Other Outcome Measures

Outcome Measure	Measure Description	Time Frame
New enrollment for Health Quality Ontario primary care practice reports	Proportion of new sign ups for Health Quality Ontario primary care practice reports	6 months
New enrollment for Health Quality Ontario primary care practice reports	Proportion of new sign ups for Health Quality Ontario primary care practice reports	12 months
Antibiotic prescribing rate	Number of antibiotics prescribed per 100 total prescriptions	3 months
Antibiotic prescribing rate	Number of antibiotics prescribed per 100 total prescriptions	6 months
Antibiotic prescribing rate	Number of antibiotics prescribed per 100 total prescriptions	9 months
Antibiotic prescribing rate	Number of antibiotics prescribed per 100 total prescriptions	24 months
Prolonged duration prescribing	Proportion of antibiotic prescriptions that are >7 days per 100 total prescriptions	3 months
Prolonged duration prescribing	Proportion of antibiotic prescriptions that are >7 days per 100 total prescriptions	6 months
Prolonged duration prescribing	Proportion of antibiotic prescriptions that are >7 days per 100 total prescriptions	9 months
Prolonged duration prescribing	Proportion of antibiotic prescriptions that are >7 days per 100 total prescriptions	24 months

Collaborators and Investigators

• Sponsor: Ontario Agency for Health Protection and Promotion
• Collaborators: Canadian Institutes of Health Research (CIHR); Health Quality Ontario
• Investigators: Principal Investigator: Kevin Schwartz, MD MSc, Ontario Agency for Health Protection and Promotion

Publications and helpful links

General Publications

• Hallsworth M, Chadborn T, Sallis A, Sanders M, Berry D, Greaves F, Clements L, Davies SC. Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial. Lancet. 2016 Apr 23;387(10029):1743-52. doi: 10.1016/S0140-6736(16)00215-4. Epub 2016 Feb 18.
• Hemkens LG, Saccilotto R, Reyes SL, Glinz D, Zumbrunn T, Grolimund O, Gloy V, Raatz H, Widmer A, Zeller A, Bucher HC. Personalized prescription feedback to reduce antibiotic overuse in primary care: rationale and design of a nationwide pragmatic randomized trial. BMC Infect Dis. 2016 Aug 17;16:421. doi: 10.1186/s12879-016-1739-0.
• Nudge vs Superbugs: A behavioural economics trial to reduce the overprescribing of antibiotics, Available online at: http://behaviouraleconomics.pmc.gov.au/sites/default/files/projects/report-nudge-vs-superbugs.pdf (accessed June 27, 2018).
• McCullough AR, Rathbone J, Parekh S, Hoffmann TC, Del Mar CB. Not in my backyard: a systematic review of clinicians' knowledge and beliefs about antibiotic resistance. J Antimicrob Chemother. 2015 Sep;70(9):2465-73. doi: 10.1093/jac/dkv164. Epub 2015 Jun 20.
• Eccles MP, Grimshaw JM, Johnston M, Steen N, Pitts NB, Thomas R, Glidewell E, Maclennan G, Bonetti D, Walker A. Applying psychological theories to evidence-based clinical practice: identifying factors predictive of managing upper respiratory tract infections without antibiotics. Implement Sci. 2007 Aug 3;2:26. doi: 10.1186/1748-5908-2-26.
• Hrisos S, Eccles M, Johnston M, Francis J, Kaner EF, Steen N, Grimshaw J. Developing the content of two behavioural interventions: using theory-based interventions to promote GP management of upper respiratory tract infection without prescribing antibiotics #1. BMC Health Serv Res. 2008 Jan 14;8:11. doi: 10.1186/1472-6963-8-11.
• Pennell ML, Hade EM, Murray DM, Rhoda DA. Cutoff designs for community-based intervention studies. Stat Med. 2011 Jul 10;30(15):1865-82. doi: 10.1002/sim.4237. Epub 2011 Apr 17. Erratum In: Stat Med. 2011 Sep 20;30(21):2669.
• Schwartz KL, Ivers N, Langford BJ, Taljaard M, Neish D, Brown KA, Leung V, Daneman N, Alloo J, Silverman M, Shing E, Grimshaw JM, Leis JA, Wu JHC, Garber G. Effect of Antibiotic-Prescribing Feedback to High-Volume Primary Care Physicians on Number of Antibiotic Prescriptions: A Randomized Clinical Trial. JAMA Intern Med. 2021 Sep 1;181(9):1165-1173. doi: 10.1001/jamainternmed.2021.2790.

Study record dates

Study Major Dates

• Study Start (ACTUAL): December 14, 2018
• Primary Completion (ACTUAL): November 30, 2019
• Study Completion (ACTUAL): November 30, 2020

Study Registration Dates

• First Submitted: December 12, 2018
• First Submitted That Met QC Criteria: December 13, 2018
• First Posted (ACTUAL): December 14, 2018

Study Record Updates

• Last Update Posted (ACTUAL): March 3, 2021
• Last Update Submitted That Met QC Criteria: March 2, 2021
• Last Verified: March 1, 2021

More Information

Terms related to this study

• Keywords: implementation science; Antibiotic use; Antimicrobial stewardship; Audit and feedback
• Additional Relevant MeSH Terms: Anti-Infective Agents; Anti-Bacterial Agents
• Other Study ID Numbers: 2018-046.01

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO
• IPD Plan Description: The data are proprietary and private and cannot be shared with external parties. Study results will be aggregated for publication

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No