Open access
Antimicrobial Chemotherapy
Research Article
27 February 2024

Evaluation of an automated feedback intervention to improve antibiotic prescribing among primary care physicians (OPEN Stewardship): a multinational controlled interrupted time-series study

ABSTRACT

Tools to advance antimicrobial stewardship in the primary health care setting, where most antimicrobials are prescribed, are urgently needed. The aim of this study was to evaluate OPEN Stewarship (Online Platform for Expanding aNtibiotic Stewardship), an automated feedback intervention, among a cohort of primary care physicians. We performed a controlled, interrupted time-series study of 32 intervention and 725 control participants, consisting of primary care physicians from Ontario, Canada and Southern Israel, from October 2020 to December 2021. Intervention participants received three personalized feedback reports targeting several aspects of antibiotic prescribing. Study outcomes (overall prescribing rate, prescribing rate for viral respiratory conditions, prescribing rate for acute sinusitis, and mean duration of therapy) were evaluated using multilevel regression models. We observed a decrease in the mean duration of antibiotic therapy (IRR = 0.94; 95% CI: 0.90, 0.99) in intervention participants during the intervention period. We did not observe a significant decline in overall antibiotic prescribing (OR = 1.01; 95% CI: 0.94, 1.07), prescribing for viral respiratory conditions (OR = 0.87; 95% CI: 0.73, 1.03), or prescribing for acute sinusitis (OR = 0.85; 95% CI: 0.67, 1.07). In this antimicrobial stewardship intervention among primary care physicians, we observed shorter durations of therapy per antibiotic prescription during the intervention period. The COVID-19 pandemic may have hampered recruitment; a dramatic reduction in antibiotic prescribing rates in the months before our intervention may have made physicians less amenable to further reductions in prescribing, limiting the generalizability of the estimates obtained.

IMPORTANCE

Antibiotic overprescribing contributes to antibiotic resistance, a major threat to our ability to treat infections. We developed the OPEN Stewardship (Online Platform for Expanding aNtibiotic Stewardship) platform to provide automated feedback on antibiotic prescribing in primary care, where most antibiotics for human use are prescribed but where the resources to improve antibiotic prescribing are limited. We evaluated the platform among a cohort of primary care physicians from Ontario, Canada and Southern Israel from October 2020 to December 2021. The results showed that physicians who received personalized feedback reports prescribed shorter courses of antibiotics compared to controls, although they did not write fewer antibiotic prescriptions. While the COVID-19 pandemic presented logistical and analytical challenges, our study suggests that our intervention meaningfully improved an important aspect of antibiotic prescribing. The OPEN Stewardship platform stands as an automated, scalable intervention for improving antibiotic prescribing in primary care, where needs are diverse and technical capacity is limited.

INTRODUCTION

Antimicrobial resistance is a major global health challenge, leading to untreatable infections, rising health-care costs, and hindering efforts to reduce poverty (1, 2). In 2019, it was estimated that 1.27 million deaths were directly attributable to antimicrobial resistance in bacterial infections (3). With current trends, the expected mortality burden of antimicrobial resistance is expected to grow dramatically over the coming decades (4). Given the slow pace of antibiotic development since the 1980s (5), it is critical to preserve the efficacy of existing drugs by reducing inappropriate prescribing.
Antimicrobial stewardship refers to the effort to optimize the selection, dose, and duration of antimicrobial therapy while minimizing adverse effects and the spread of antimicrobial resistance (6). Stewardship interventions take many forms, including measures targeting providers (e.g., audit and feedback, decision support tools) (79), laboratories (e.g., selective reporting of susceptibility testing results), and hospital formularies (6). Feedback interventions (such as reports comparing the prescribing rate of providers to their peers) have been shown to be effective across a variety of clinical settings (7, 1015).
While significant progress has been made in hospital-based stewardship in recent years, further improvement is needed for antimicrobial stewardship in the community setting (1618), where the vast majority of antimicrobials for human use are prescribed [e.g., over 90% in Canada (19)] and inappropriate prescribing is common (2022). The U.S. Centers for Disease Control and Prevention identifies individualized tracking and reporting as a key element of outpatient stewardship, but the lack of capacity and information technology support remains a major barrier (23, 24). To address this deficit, we developed OPEN Stewardship (Online Platform for Expanding aNtibiotic Stewardship), a web-based platform capable of generating automated, personalized feedback reports based on local prescribing data (2527). Following a One Health approach, the platform was developed for use in both human and veterinary care providers. In this study, we describe a quasi-experimental study of the OPEN Stewardship platform on antibiotic prescribing among primary care providers in Canada and Israel.

MATERIALS AND METHODS

Study design

This study used a controlled interrupted time-series design to assess the impact of an automated feedback intervention on prescribing rates and duration of therapy while accounting for secular trends (28). The intervention and recruitment process are described in detail in our published protocol (25) and summarized below; changes from the protocol are outlined in the Supplementary Methods.

Setting and participants

We enrolled primary care physicians in Ontario, Canada and Southern Israel. Canadian participants were recruited from primary care practices sharing data with the University of Toronto Practice-Based Research Network (UTOPIAN), which included over 500 physicians as of Q4 of 2019 (29). Israeli participants were recruited from Clalit Health Services (CHS), the largest of Israel’s four nationally mandated health maintenance organizations, which covers the majority of residents in Southern Israel through a network of family care practices. Physicians were eligible for enrollment in the intervention if they had prescribing data available in the UTOPIAN or CHS databases; non-participating physicians with prescribing data in the UTOPIAN and CHS databases were used as controls. Further details on recruitment are available in the Supplementary Methods.

Intervention

The intervention consisted of three personalized reports delivered by email at the beginning of the first, fourth, and seventh months of the intervention period (Fig. 1). Emails were sent to participants individually by collaborators at each study site. Each topic-specific report contained locally relevant guidelines and one or two figures benchmarking the intervention participant’s prescribing against the average and 25th percentile of other intervention participants at the same site (see summary of report contents in Table S1). To generate benchmarking figures, we used prescribing data from 2019.
Fig 1
Fig 1 Study timeline showing intervention periods and sub-periods for the two study waves. Intervention wave 1 included only participants from Canada; intervention wave 2 included participants from both Canada and Israel.
The first report covered overall prescribing and duration of therapy and included two benchmarking figures: (i) the overall antibiotic prescribing rate per 100 visits and (ii) the percentage of antibiotic prescriptions with a duration greater than 7 days (Canada only). Guidelines described how most outpatient bacterial infections do not require more than 7 days of therapy. The second report targeted viral respiratory conditions and included a benchmarking figure on the antibiotic prescribing rate per 100 visits for viral respiratory conditions. The third report targeted acute sinusitis and included a benchmarking figure on the antibiotic prescribing rate per 100 visits for acute sinusitis. An example report is included as Supplementary File 2.

Study period

The study period spanned from January 2019 to December 2021. Three reports were sent to intervention participants over the course of the intervention period: one at the beginning of the first month, another at the beginning of the fourth month, and the last at the beginning of the seventh month, with reports spaced three months apart (Fig. 1). We defined each 3-month period following the receipt of a report as an intervention sub-period, for a 9-month total intervention period (Fig. 1). Two waves of intervention participants were recruited: wave 1 (reports sent between October 2020 and April 2021; total intervention period: October 2020–June 2021) included only participants from Canada, whereas wave 2 (reports sent between April 2021 and October 2021; total intervention period: April 2021–December 2021) included participants from both sites (Fig. 1).

Outcomes

We evaluated four outcomes related to the content of the feedback reports:
1.
Overall antibiotic prescribing rate (percentage of total visits with an antibiotic prescription).
2.
Mean duration of therapy per antibiotic prescription.
3.
Antibiotic prescribing rate for viral respiratory conditions (percentage of visits for viral respiratory conditions with an antibiotic prescription).
4.
Antibiotic prescribing rate for acute sinusitis (percentage of visits for acute sinusitis with an antibiotic prescription).
All outcomes were available as aggregated monthly data. Due to data set differences between our two study sites, we defined the duration of therapy in Canada as days of therapy and in Israel as Defined Daily Doses (DDDs). Table S2 gives the ICD-9 codes used to define viral respiratory conditions (and associated indications) and acute sinusitis. Note that COVID-19 was not included in the definition for viral respiratory conditions.

Data acquisition and cleaning

Details regarding data acquisition and cleaning are given in the Supplementary Methods.

Statistical analysis

We performed multilevel regression modeling of our four outcomes with terms for site, study month, the interaction between study site and month, and temporal autocorrelation. The effect of the intervention during the 9-month intervention period was estimated as βtotal. For overall and indication-specific prescribing, we used logistic models, and for the mean duration of therapy, we used a zero-truncated Poisson model. We fit all models in R version 4.1.3 (30) using maximum likelihood estimation via glmmTMB version 1.1.5 (31). Further details, including the assessment of pre-intervention trends in intervention participants and controls, are described in the Supplementary Methods.

Sensitivity analyses

We fit an alternative set of models to estimate separate intervention effects for each of the three intervention sub-periods (β1, β2, and β3) (Fig. 1). For Canada only (due to data availability), we considered an alternative metric for the duration of therapy outcome: the percentage of antibiotic prescriptions with a duration greater than 7 days (further described in the Supplementary Methods). For the four main outcomes, we also fit site-stratified models using data from only a single site at a time.

RESULTS

Complete follow-up data were available for 11 intervention participants and 361 controls in Canada and 21 intervention participants and 364 controls in Israel. Some physicians in Canada received the intervention, but their data could not be included in the analysis (Supplementary Methods). In Canada, intervention participants had higher baseline (2019) antibiotic prescribing rates than controls; they were also younger, more likely to be male, and had more monthly visits (Table 1). In Israel, intervention participants had slightly lower baseline prescribing rates than controls; they were also more likely to be male and had more monthly visits (Table 1). Intervention and control participants showed similar temporal trends in prescribing prior to the intervention period (Fig. S1).
TABLE 1
TABLE 1 Baseline characteristics of intervention participants (n = 32) and controls (n = 725) based on 2019 overall antibiotic prescribing data
GroupnMedian and Q1, Q3 of overall prescribing (% of visits)Mean monthly visits% maleMean age
Canada     
 Intervention118.4 (6.3, 11.0)34354.541.0
 Control3615.2 (3.8, 6.9)27638.546.5a
Israel     
 Intervention216.5 (4.9, 7.7)78361.953.9
 Control3647.4 (5.9, 9.5)64951.153.2
a
Age was missing for 21 Canadian controls.
The onset of the COVID-19 pandemic led to large drops in overall antibiotic prescribing per visit in both Canada and Israel, with the prescribing rate from March 2020 to February 2021 dropping by 21.0% and 26.9%, respectively, compared to the same period the year prior (Fig. 2). By the end of 2021, overall prescribing rates were trending toward pre-pandemic levels in Israel but remained depressed in Canada. The prescribing rate for viral respiratory conditions per visit also declined in both sites in 2020. The mean duration of therapy in Israel rose after the onset of the pandemic. Average monthly patient visits per physician dipped in 2020 in Canada but not in Israel (Fig. S2). Visits for viral respiratory conditions and acute sinusitis declined in both sites in 2020 and began to increase in 2021.
Fig 2
Fig 2 Fitted values for the control period, wave 1 intervention period, and wave 2 intervention period for (A) overall prescribing, (B) mean duration of therapy, (C) prescribing for viral respiratory conditions, and (D) prescribing for acute sinusitis among primary care physicians in Canada and Israel, 2019–2021. Vertical bars identify the beginning of the 9-month intervention periods (wave 1 in Canada and wave 2 in Canada and Israel).
Across the 9-month intervention period, overall antibiotic prescribing did not decline among intervention participants (OR = 1.01; 95% CI: 0.94, 1.07) (Fig. 2), but the mean duration of therapy did decline (IRR = 0.94; 95% CI: 0.90, 0.99) (Fig. 2). In the site-stratified sensitivity analysis, this effect appeared to differ between Canada (IRR = 0.89; 95% CI: 0.82, 0.98) (Table S3) and Israel (IRR = 0.97; 95% CI: 0.92, 1.02) (Table S4). There was a trend toward reduced antibiotic prescribing for viral respiratory conditions (OR = 0.87; 95% CI: 0.73, 1.03) and acute sinusitis (OR = 0.85; 95% CI: 0.67, 1.07) (Fig. 2), but neither decline was statistically significant. Effect estimates varied in the sensitivity analysis using three intervention sub-periods (Table S5).
In a sensitivity analysis using Canadian data only, we observed a non-significant reduction in the percentage of antibiotic prescriptions with a duration of 7 days or more (OR = 0.83; 95% CI: 0.68, 1.01) (Table S3), although the direction of the point estimate was consistent with the observed decline in the mean duration of therapy.

DISCUSSION

We conducted a quasi-experimental study to assess the impact of an automated feedback intervention on antibiotic prescribing. We found that the intervention was associated with a decrease in the mean duration of therapy per prescription. While there was no change in overall prescribing, we did observe non-significant trends toward reduced prescribing for viral respiratory conditions and acute sinusitis. Our data support the use of an open, low-resource, automated feedback tool to improve antibiotic prescribing among primary care physicians.
The reduction in the mean duration of therapy we observed during the intervention period was equivalent to approximately half a day per prescription, which translated to a median reduction of 14 days of therapy (Q1, Q3: 7, 22) per month during the intervention period compared to what was expected in the absence of the intervention. Since most common infections do not require more than 5–7 days of therapy (32), and the mean duration of therapy per prescription was still greater than 7 days even during the intervention period, it is very likely that this reduction represented a positive improvement for stewardship without compromising patient care. The results of our trial are consistent with the results of other interventions targeting duration of therapy for specific conditions such as community-acquired pneumonia and urinary tract infections (33, 34), or as part of a multifaceted stewardship intervention to reduce overall antibiotic prescribing (35).
A recent meta-analysis of 10 antimicrobial stewardship programs in outpatient/primary care practice settings found a 6% (95% CI: −13%–1%) average reduction in the fraction of patients receiving an antibiotic (36). These interventions included a variety of countries and metrics (such as overall prescribing or prescribing for respiratory infections), including contexts where pre-intervention prescribing rates were significantly higher than those that existed in our study population. Although our intervention was unsuccessful at reducing overall prescribing, the observed reductions in indication-specific prescribing rates, while not statistically significant, imply absolute reductions in prescribing among patients with viral respiratory conditions or acute sinusitis between 1% and 4%. Randomized trials by Hallsworth et al. (14) and Schwartz et al. (15) provide evidence that a simple intervention (a peer comparison letter sent to high-prescribing physicians) can deliver a small but significant reduction in antibiotic prescribing, demonstrating the meaningful role low-resource interventions can play in advancing antimicrobial stewardship.
It is important to recognize that our study took place during a period of unprecedented disruption to primary care due to the COVID-19 pandemic, which began in most parts of the world in March 2020. In the months that followed, many countries transitioned to telemedicine, diverted resources to caring for COVID-19 patients, and experienced disruptions to civil society and workplaces. Contrary to initial fears, this confluence of factors led to a very large reduction in antimicrobial prescribing in primary care in many countries (19, 3740). These observations are consistent with the large reductions in prescribing following the onset of the COVID-19 pandemic seen in our own study cohort.
These unusual circumstances may have affected our antimicrobial stewardship intervention in several ways. This dramatic reduction in antibiotic prescribing rates in the months before our intervention period may have made physicians less amenable to further reductions in prescribing. Additionally, while a key part of our messaging was focused on prescribing for seasonal viral conditions, the first 2 years of the pandemic were marked by the suppression of many seasonal viruses, most notably the near-total disappearance of the 2020–2021 influenza season (41, 42).
We must also acknowledge several other limitations that may have impacted our findings. First, recruitment was more difficult than anticipated due to the onset of the COVID-19 pandemic, and a greater number of intervention participants may have added precision to our effect estimates. Second, we estimated a common intervention effect across study sites, although the type of participants in the intervention groups may have differed (in Canada, intervention participants had higher than average baseline prescribing, whereas in Israel, they had slightly lower than average prescribing). We were also unable to deliver the peer benchmarking figure for the duration of therapy in the first intervention report to Israeli participants (Supplementary Methods). These factors may have resulted in heterogeneity in the intervention effects. Finally, our use of two study waves meant that some study reports, particularly those related to prescribing for viral respiratory conditions, may not have been delivered at the optimal time (cold and influenza season). However, the importance of this was unclear due to the disruption of regular seasonal trends of respiratory viruses during the COVID-19 pandemic.
While our intervention did not demonstrate a reduction in overall prescribing, we did observe a decrease in the mean duration of therapy per prescription, an important component for a successful antimicrobial stewardship program (43). As the drought of new antibiotic agents persists, the need for innovative solutions for antimicrobial stewardship, particularly within primary care, is more critical than ever. The ability to track, evaluate, and report on antimicrobial prescribing is a core element of outpatient stewardship (17). Despite the proven success of bespoke interventions for reducing antimicrobial prescribing, the technical capacity to carry out the basic activities of stewardship in a sustainable way remains a significant barrier to long-term progress in implementing best practices in the community setting (23, 24). OPEN Stewardship is part of a new generation of accessible, low-resource tools for advancing stewardship across heterogeneous, resource-constrained outpatient health care settings (another example is OASIS (44), which uses the common statistical software SAS). Going forward, it is critical that we continue to develop and deploy automated, scalable antimicrobial stewardship interventions targeted at reducing outpatient prescribing, in order to safeguard the efficacy of antimicrobial therapy into the future.

ACKNOWLEDGMENTS

We thank Jessica D. Visentin, Aashka Bhatt, and Babak Aliarzadeh for their assistance with the study.
Jean-Paul R. Soucy acknowledges the support of a Vanier Canada Graduate Scholarship.

SUPPLEMENTAL MATERIAL

Supplemental material - spectrum.00017-24-s0001.pdf
Supplemental methods, tables, and figures.
Supplemental File 2 - spectrum.00017-24-s0002.pdf
An example of an OPEN Stewardship report.
ASM does not own the copyrights to Supplemental Material that may be linked to, or accessed through, an article. The authors have granted ASM a non-exclusive, world-wide license to publish the Supplemental Material files. Please contact the corresponding author directly for reuse.

REFERENCES

1.
World Health Organization. 2021. WHO strategic priorities on antimicrobial resistance: preserving antimicrobials for today and tomorrow. World Health Organization. Available from: https://apps.who.int/iris/bitstream/handle/10665/351719/9789240041387-eng.pdf. Retrieved 13 Jan 2023.
2.
Interagency Coordination Group on Antimicrobial Resistance. 2019. No time to wait: securing the future from drug-resistant infections. Interagency Coordination Group on Antimicrobial Resistance. Available from: https://www.who.int/antimicrobial-resistance/interagency-coordination-group/IACG_final_report_EN.pdf. Retrieved 18 Jul 2019.
3.
Murray CJL, Ikuta KS, Sharara F, Swetschinski L, Robles Aguilar G, Gray A, Han C, Bisignano C, Rao P, Wool E, et al. 2022. Global burden of bacterial antimicrobial resistance in 2019: a systematic analysis. Lancet 399:629–655.
4.
The Review on Antimicrobial Resistance. 2016. Tackling drug-resistant infections globally: final report and recommendations. Available from: https://amr-review.org/sites/default/files/160518_Final%20paper_with%20cover.pdf. Retrieved 27 May 2018.
5.
Årdal C, Balasegaram M, Laxminarayan R, McAdams D, Outterson K, Rex JH, Sumpradit N. 2020. Antibiotic development — economic, regulatory and societal challenges. Nat Rev Microbiol 18:267–274.
6.
Dyar OJ, Huttner B, Schouten J, Pulcini C, ESGAP (ESCMID Study Group for Antimicrobial stewardshiP). 2017. What is antimicrobial stewardship?Clin Microbiol Infect 23:793–798.
7.
Tonkin-Crine SK, Tan PS, van Hecke O, Wang K, Roberts NW, McCullough A, Hansen MP, Butler CC, Del Mar CB. 2017. Clinician-targeted interventions to influence antibiotic prescribing behaviour for acute respiratory infections in primary care: an overview of systematic reviews. Cochrane Database Syst Rev 9:CD012252.
8.
Elligsen M, Walker SAN, Simor A, Daneman N. 2012. Prospective audit and feedback of antimicrobial stewardship in critical care: program implementation, experience, and challenges. Can J Hosp Pharm 65:31–36.
9.
Daneman N, Lee S, Bai H, Bell CM, Bronskill SE, Campitelli MA, Dobell G, Fu L, Garber G, Ivers N, Kumar M, Lam JMC, Langford B, Laur C, Morris AM, Mulhall CL, Pinto R, Saxena FE, Schwartz KL, Brown KA. 2022. Behavioral Nudges to improve audit and feedback report opening among antibiotic prescribers: a randomized controlled trial. Open Forum Infect Dis 9:ofac111.
10.
King LM, Fleming-Dutra KE, Hicks LA. 2018. Advances in optimizing the prescription of antibiotics in outpatient settings. BMJ 363:k3047.
11.
Davey P, Marwick CA, Scott CL, Charani E, McNeil K, Brown E, Gould IM, Ramsay CR, Michie S. 2017. Interventions to improve antibiotic prescribing practices for hospitalinpatients. Cochrane Database Syst Rev 2:CD003543.
12.
Gerber JS, Prasad PA, Fiks AG, Localio AR, Grundmeier RW, Bell LM, Wasserman RC, Keren R, Zaoutis TE. 2013. Effect of an outpatient antimicrobial stewardship intervention on broad-spectrum antibiotic prescribing by primary care pediatricians: a randomized trial. JAMA 309:2345–2352.
13.
Meeker D, Linder JA, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, Knight TK, Hay JW, Doctor JN. 2016. Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial. JAMA 315:562–570.
14.
Hallsworth M, Chadborn T, Sallis A, Sanders M, Berry D, Greaves F, Clements L, Davies SC. 2016. Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial. Lancet 387:1743–1752.
15.
Schwartz KL, Ivers N, Langford BJ, Taljaard M, Neish D, Brown KA, Leung V, Daneman N, Alloo J, Silverman M, Shing E, Grimshaw JM, Leis JA, Wu JHC, Garber G. 2021. Effect of antibiotic-prescribing feedback to high-volume primary care physicians on number of antibiotic prescriptions: a randomized clinical trial. JAMA Intern Med 181:1165–1173.
16.
Marcelin JR, Chung P, Van Schooneveld TC. 2020. Antimicrobial stewardship in the outpatient setting: a review and proposed framework. Infect Control Hosp Epidemiol 41:833–840.
17.
Sanchez GV, Fleming-Dutra KE, Roberts RM, Hicks LA. 2016. Core elements of outpatient antibiotic stewardship. MMWR Recomm Rep 65:1–12.
18.
Langford BJ, Schwartz KL, Garber GE. 2018. Antimicrobial stewardship by family physicians. Can Fam Physician 64:168–169.
19.
Public Health Agency of Canada. Canadian antimicrobial resistance surveillance system (CARSS) report 2022. Available from: https://www.canada.ca/en/public-health/services/publications/drugs-health-products/canadian-antimicrobial-resistance-surveillance-system-report-2022.html. Retrieved 1818 FebFebruary 2023. Accessed, 1818 FebFebruary 2023
20.
Fleming-Dutra KE, Hersh AL, Shapiro DJ, Bartoces M, Enns EA, File TM Jr, Finkelstein JA, Gerber JS, Hyun DY, Linder JA, Lynfield R, Margolis DJ, May LS, Merenstein D, Metlay JP, Newland JG, Piccirillo JF, Roberts RM, Sanchez GV, Suda KJ, Thomas A, Woo TM, Zetts RM, Hicks LA. 2016. Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010-2011. JAMA 315:1864.
21.
Shively NR, Buehrle DJ, Clancy CJ, Decker BK. 2018. Prevalence of inappropriate antibiotic prescribing in primary care clinics within a veterans affairs health care system. Antimicrob Agents Chemother 62:e00337–18.
22.
Schwartz KL, Langford BJ, Daneman N, Chen B, Brown KA, McIsaac W, Tu K, Candido E, Johnstone J, Leung V, Hwee J, Silverman M, Wu JHC, Garber G. 2020. Unnecessary antibiotic prescribing in a Canadian primary care setting: a descriptive analysis using routinely collected electronic medical record data. CMAJ Open 8:E360–E369.
23.
Frost HM, Andersen LM, Fleming-Dutra KE, Norlin C, Czaja CA. 2020. Sustaining outpatient antimicrobial stewardship: do we need to think further outside the box? Infect Control Hosp Epidemiol 41:382–384.
24.
Zetts RM, Stoesz A, Garcia AM, Doctor JN, Gerber JS, Linder JA, Hyun DY. 2020. Primary care physicians’ attitudes and perceptions towards antibiotic resistance and outpatient antibiotic stewardship in the USA: a qualitative study. BMJ Open 10:e034983.
25.
Soucy J-PR, Low M, Acharya KR, Ellen M, Hulth A, Löfmark S, Garber GE, Watson W, Moran-Gilad J, Fisman DN, MacFadden DR. 2021. Evaluation of an automated feedback intervention to improve antimicrobial prescribing among primary care physicians (OPEN stewardship): protocol for an interrupted time-series and usability analysis in Ontario, Canada and Southern Israel. BMJ Open 11:e039810.
26.
Acharya KR, Brankston G, Soucy J-PR, Cohen A, Hulth A, Löfmark S, Davidovitch N, Ellen M, Fisman DN, Moran-Gilad J, Steinman A, MacFadden DR, Greer AL. 2021. Evaluation of an OPEN Stewardship generated feedback intervention to improve antibiotic prescribing among primary care veterinarians in Ontario, Canada and Israel: protocol for evaluating usability and an interrupted time-series analysis. BMJ Open 11:e039760.
27.
Hulth A, Lofmark S, Andre J, Chorney R, Cohn E, Ellen M, Davidovitch N, Moran-Gilad J, Greer A, Fishman D, Brownstein J, MacFadden D. 2019. A tool for promoting responsible antibiotic prescribing across settings and sectors. OJPHI 11.
28.
Lopez Bernal J, Cummins S, Gasparrini A. 2018. The use of controls in interrupted time series studies of public health interventions. Int J Epidemiol 47:2082–2093.
29.
University of Toronto Practice-Based Research Network. 2023. UTOPIAN data safe haven. Available from: http://www.dfcm.utoronto.ca/utopian-data-safe-haven. Retrieved 3 Mar 2022.
30.
R Core Team. 2021. R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/.
31.
Brooks M, Kristensen K, Benthem K, Magnusson A, Berg C, Nielsen A, Skaug H, Mächler M, Bolker B. 2017. glmmTMB balances speed and flexibility among packages for zero-inflated generalized linear mixed modeling. The R Journal 9:378.
32.
Spellberg B, Rice LB. 2019. Duration of antibiotic therapy: shorter is better. Ann Intern Med 171:210–211.
33.
McCormick JZ, Cardwell SM, Wheelock C, Wong CM, Vander Weide LA. 2020. Impact of ambulatory antimicrobial stewardship on prescribing patterns for urinary tract infections. J Clin Pharm Ther 45:1312–1319.
34.
Foolad F, Huang AM, Nguyen CT, Colyer L, Lim M, Grieger J, Li J, Revolinski S, Mack M, Gandhi T, Wainaina JN, Eschenauer G, Patel TS, Marshall VD, Nagel J. 2018. A multicentre stewardship initiative to decrease excessive duration of antibiotic therapy for the treatment of community-acquired pneumonia. J Antimicrob Chemother 73:1402–1407.
35.
McIsaac W, Kukan S, Huszti E, Szadkowski L, O’Neill B, Virani S, Ivers N, Lall R, Toor N, Shah M, Alvi R, Bhatt A, Nakamachi Y, Morris AM. 2021. A pragmatic randomized trial of a primary care antimicrobial stewardship intervention in Ontario, Canada. BMC Fam Pract 22:185.
36.
Zay Ya K, Win PTN, Bielicki J, Lambiris M, Fink G. 2023. Association between antimicrobial stewardship programs and antibiotic use globally: a systematic review and meta-analysis. JAMA Netw Open 6:e2253806.
37.
Centers for Disease Control and Prevention. 2022. COVID-19: U.S. impact on antimicrobial resistance, special report 2022. National Center for Emerging and Zoonotic Infectious Diseases. Available from: https://stacks.cdc.gov/view/cdc/117915. Retrieved 23 Nov 2022.
38.
Rawson TM, Moore LSP, Castro-Sanchez E, Charani E, Davies F, Satta G, Ellington MJ, Holmes AH. 2020. COVID-19 and the potential long-term impact on antimicrobial resistance. J Antimicrob Chemother 75:1681–1684.
39.
Gottesman BS, Low M, Netzer D, Almog R, Chowers M. 2022. Community antibiotic prescriptions during COVID-19 era: a population-based cohort study among adults. Clin Microbiol Infect 28:1134–1139.
40.
Zhu N, Aylin P, Rawson T, Gilchrist M, Majeed A, Holmes A. 2021. Investigating the impact of COVID-19 on primary care antibiotic prescribing in north west London across two epidemic waves. Clin Microbiol Infect 27:762–768.
41.
Zipfel CM, Colizza V, Bansal S. 2021. The missing season: the impacts of the COVID-19 pandemic on influenza. Vaccine 39:3645–3648.
42.
Tang JW, Bialasiewicz S, Dwyer DE, Dilcher M, Tellier R, Taylor J, Hua H, Jennings L, Kok J, Levy A, Smith D, Barr IG, Sullivan SG. 2021. Where have all the viruses gone? Disappearance of seasonal respiratory viruses during the COVID‐19 pandemic. J Med Virol 93:4099–4101.
43.
Spellberg B. 2018. The maturing antibiotic mantra: “shorter is still better” J Hosp Med 13:361.
44.
Frost HM, Munsiff SS, Lou Y, Jenkins TC. 2022. Simplifying outpatient antibiotic stewardship. Infect Control Hosp Epidemiol 43:260–261.

Information & Contributors

Information

Published In

cover image Microbiology Spectrum
Microbiology Spectrum
Volume 12Number 42 April 2024
eLocator: e00017-24
Editor: Siu-Kei Chow, MultiCare Health System, Tacoma, Washington, USA
PubMed: 38411087

History

Received: 22 January 2024
Accepted: 6 February 2024
Published online: 27 February 2024

Keywords

  1. antimicrobial stewardship
  2. audit and feedback
  3. antibiotic prescribing
  4. primary care
  5. interrupted time series

Data Availability

Primary care data relating to physicians and their patients cannot be shared in compliance with our agreements with our data partners (UTOPIAN and Clalit Health Services). However, other parties can apply to UTOPIAN and Clalit Health Services for research data access.

Contributors

Authors

Division of Epidemiology, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
Author Contributions: Conceptualization, Formal analysis, Investigation, Writing – original draft, and Writing – review and editing.
Marcelo Low
Chief Physician’s Office, Clalit Health Services, Tel Aviv, Israel
Author Contributions: Conceptualization, Investigation, and Writing – review and editing.
Kamal R. Acharya
Department of Population Medicine, University of Guelph Ontario Veterinary College, Guelph, Ontario, Canada
Author Contributions: Writing – review and editing and Conceptualization.
Moriah Ellen
Department of Health Policy and Management, Guilford Glazer Faculty of Business and Management and Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva, Israel
Author Contributions: Conceptualization, Investigation, and Writing – review and editing.
Anette Hulth
The Public Health Agency of Sweden, Stockholm, Sweden
Author Contributions: Conceptualization and Writing – review and editing.
Sonja Löfmark
The Public Health Agency of Sweden, Stockholm, Sweden
Author Contributions: Conceptualization and Writing – review and editing.
Gary E. Garber
Public Health Ontario, Toronto, Ontario, Canada
Author Contributions: Conceptualization and Writing – review and editing.
William Watson
Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
Author Contributions: Investigation and Writing – review and editing.
Jacob Moran-Gilad
Department of Health Policy and Management, School of Public Health, Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva, Israel
Author Contributions: Conceptualization and Writing – review and editing.
Nadav Davidovitch
Department of Health Policy and Management, Guilford Glazer Faculty of Business and Management and Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva, Israel
Author Contributions: Conceptualization and Writing – review and editing.
Tamar Amar
Department of Epidemiology, Biostatistics, and Community Health Sciences, Ben-Gurion University of the Negev, Beer Sheva, Israel
Author Contributions: Investigation and Writing – review and editing.
Janine McCready
Division of Infectious Diseases, Department of Medicine, Michael Garron Hospital, Toronto, Ontario, Canada
Author Contributions: Investigation and Writing – review and editing.
Matthew Orava
Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
Barrie and Community Family Health Team, Barrie, Ontario, Canada
Author Contributions: Investigation and Writing – review and editing.
John S. Brownstein
Computational Epidemiology Lab, Boston Children’s Hospital, Boston, Massachusetts, USA
Author Contributions: Conceptualization and Writing – review and editing.
Division of Epidemiology, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
Public Health Ontario, Toronto, Ontario, Canada
Author Contribution: Writing – review and editing.
David N. Fisman
Division of Epidemiology, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
Author Contributions: Conceptualization and Writing – review and editing.
Clinical Epidemiology Program, The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
Author Contributions: Conceptualization, Investigation, Writing – review and editing, and Supervision.

Editor

Siu-Kei Chow
Editor
MultiCare Health System, Tacoma, Washington, USA

Notes

The authors declare no conflict of interest.

Ethics Approval

This study was approved by the University of Toronto Research Ethics Board (RIS Human Protocol Number 35844) and also received ethics approval from each participating site (Canada: Michael Garron Hospital, St. Michael’s Hospital; Israel: Clalit Health Services, Ben-Gurion University of the Negev).

Metrics & Citations

Metrics

Note:

  • For recently published articles, the TOTAL download count will appear as zero until a new month starts.
  • There is a 3- to 4-day delay in article usage, so article usage will not appear immediately after publication.
  • Citation counts come from the Crossref Cited by service.

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. For an editable text file, please select Medlars format which will download as a .txt file. Simply select your manager software from the list below and click Download.

View Options

Figures

Tables

Media

Share

Share

Share the article link

Share with email

Email a colleague

Share on social media

American Society for Microbiology ("ASM") is committed to maintaining your confidence and trust with respect to the information we collect from you on websites owned and operated by ASM ("ASM Web Sites") and other sources. This Privacy Policy sets forth the information we collect about you, how we use this information and the choices you have about how we use such information.
FIND OUT MORE about the privacy policy