Applying STOPP Guidelines in Primary Care Through Electronic Medical Record Decision Support: Randomized Control Trial Highlighting the Importance of Data Quality

Morgan Price, Iryna Davies, Raymond Rusk, Mary Lesperance, Jens Weber, Morgan Price, Iryna Davies, Raymond Rusk, Mary Lesperance, Jens Weber

Abstract

Background: Potentially Inappropriate Prescriptions (PIPs) are a common cause of morbidity, particularly in the elderly.

Objective: We sought to understand how the Screening Tool of Older People's Prescriptions (STOPP) prescribing criteria, implemented in a routinely used primary care Electronic Medical Record (EMR), could impact PIP rates in community (non-academic) primary care practices.

Methods: We conducted a mixed-method, pragmatic, cluster, randomized control trial in research naïve primary care practices. Phase 1: In the randomized controlled trial, 40 fully automated STOPP rules were implemented as EMR alerts during a 16-week intervention period. The control group did not receive the 40 STOPP rules (but received other alerts). Participants were recruited through the OSCAR EMR user group mailing list and in person at user group meetings. Results were assessed by querying EMR data PIPs. EMR data quality probes were included. Phase 2: physicians were invited to participate in 1-hour semi-structured interviews to discuss the results.

Results: In the EMR, 40 STOPP rules were successfully implemented. Phase 1: A total of 28 physicians from 8 practices were recruited (16 in intervention and 12 in control groups). The calculated PIP rate was 2.6% (138/5308) (control) and 4.11% (768/18,668) (intervention) at baseline. No change in PIPs was observed through the intervention (P=.80). Data quality probes generally showed low use of problem list and medication list. Phase 2: A total of 5 physicians participated. All the participants felt that they were aware of the alerts but commented on workflow and presentation challenges.

Conclusions: The calculated PIP rate was markedly less than the expected rate found in literature (2.6% and 4.0% vs 20% in literature). Data quality probes highlighted issues related to completeness of data in areas of the EMR used for PIP reporting and by the decision support such as problem and medication lists. Users also highlighted areas for better integration of STOPP guidelines with prescribing workflows. Many of the STOPP criteria can be implemented in EMRs using simple logic. However, data quality in EMRs continues to be a challenge and was a limiting step in the effectiveness of the decision support in this study. This is important as decision makers continue to fund implementation and adoption of EMRs with the expectation of the use of advanced tools (such as decision support) without ongoing review of data quality and improvement.

Trial registration: Clinicaltrials.gov NCT02130895; https://ichgcp.net/clinical-trials-registry/NCT02130895 (Archived by WebCite at http://www.webcitation.org/6qyFigSYT).

Keywords: clinical decision support; data quality; electronic medical records; electronic prescribing; randomized control trial.

Conflict of interest statement

Conflicts of Interest: None declared.

©Morgan Price, Iryna Davies, Raymond Rusk, Mary Lesperance, Jens Weber. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 15.06.2017.

Figures

Figure 1
Figure 1
Wireframe of the CDS alerts in the EMR. (A) on the right is the panel that lists patient specific alerts. From that panel, users can click a title and get (B), the detail of the alert that pops up when clicked.
Figure 2
Figure 2
CONSORT figure. 28 physicians in 8 clinics were recruited into the study. 1 clinic declined to participate during recruitment. No clinics or physicians were lost to follow up during the trial.

References

    1. Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS. Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med. 2003 Nov 24;163(21):2625–31. doi: 10.1001/archinte.163.21.2625.
    1. Lazarou J, Pomeranz BH, Corey PN. Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. J Am Med Assoc. 1998 Apr 15;279(15):1200–5.
    1. Shah SGS, Robinson I. Benefits of and barriers to involving users in medical device technology development and evaluation. Int J Technol Assess Health Care. 2007;23(1):131–7. doi: 10.1017/S0266462307051677.
    1. Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE, Strom BL. Role of computerized physician order entry systems in facilitating medication errors. J Am Med Assoc. 2005 Mar 9;293(10):1197–203. doi: 10.1001/jama.293.10.1197.
    1. Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hébert P, Majumdar SR, O'Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R. The Canadian Adverse Events study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004 May 25;170(11):1678–86.
    1. Richardson WC, Berwick DM, Bisgard JC, Bristow LR, Buck CR, Cassel CK. Crossing the quality chasm: a new health system for the 21st century. Washington, D.C: National Academy Press; 2001.
    1. Budnitz DS, Lovegrove MC, Shehab N, Richards CL. Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med. 2011 Nov 24;365(21):2002–12. doi: 10.1056/NEJMsa1103053.
    1. Reason B, Terner M, Moses MA, Tipper B, Webster G. The impact of polypharmacy on the health of Canadian seniors. Fam Pract. 2012 Aug;29(4):427–32. doi: 10.1093/fampra/cmr124.
    1. Wu C, Bell CM, Wodchis WP. Incidence and economic burden of adverse drug reactions among elderly patients in Ontario emergency departments: a retrospective study. Drug Saf. 2012 Sep 01;35(9):769–81. doi: 10.2165/11599540-000000000-00000.
    1. Ryan C, O'Mahony D, Kennedy J, Weedle P, Byrne S. Potentially inappropriate prescribing in an Irish elderly population in primary care. Br J Clin Pharmacol. 2009 Dec;68(6):936–47. doi: 10.1111/j.1365-2125.2009.03531.x. doi: 10.1111/j.1365-2125.2009.03531.x.
    1. Hill-Taylor B, Sketris I, Hayden J, Byrne S, O'Sullivan D, Christie R. Application of the STOPP/START criteria: a systematic review of the prevalence of potentially inappropriate prescribing in older adults, and evidence of clinical, humanistic and economic impact. J Clin Pharm Ther. 2013 Oct;38(5):360–72. doi: 10.1111/jcpt.12059.
    1. Pyszka LL, Seys RT, Milhans SM. Identification of inappropriate prescribing in geriatrics at a Veterans Affairs hospital using STOPP/START screening tools. Consult Pharm. 2010 Jun;25(6):365–73. doi: 10.4140/TCP.n.2010.365.
    1. By the American Geriatrics Society 2015 Beers Criteria Update Expert Panel American Geriatrics Society 2015 updated beers criteria for potentially inappropriate medication use in older adults. J Am Geriatr Soc. 2015 Nov;63(11):2227–46. doi: 10.1111/jgs.13702.
    1. García-Gollarte F, Baleriola-Júlvez J, Ferrero-López I, Cruz-Jentoft AJ. Inappropriate drug prescription at nursing home admission. J Am Med Dir Assoc. 2012 Jan;13(1):83.e9–15. doi: 10.1016/j.jamda.2011.02.009.
    1. Liu C, Peng L, Chen Y, Lin M, Liu L, Chen L. Potentially inappropriate prescribing (IP) for elderly medical inpatients in Taiwan: a hospital-based study. Arch Gerontol Geriatr. 2012;55(1):148–51. doi: 10.1016/j.archger.2011.07.001.
    1. Parsons C, Johnston S, Mathie E, Baron N, Machen I, Amador S, Goodman C. Potentially inappropriate prescribing in older people with dementia in care homes: a retrospective analysis. Drugs Aging. 2012 Feb 01;29(2):143–55. doi: 10.2165/11598560-000000000-00000.
    1. Gallagher P, O'Mahony D. STOPP (Screening Tool of Older Persons' potentially inappropriate Prescriptions): application to acutely ill elderly patients and comparison with Beers' criteria. Age Ageing. 2008 Nov;37(6):673–9. doi: 10.1093/ageing/afn197.
    1. Gallagher P, Ryan C, Byrne S, Kennedy J, O'Mahony D. STOPP (Screening Tool of Older Person's Prescriptions) and START (Screening Tool to Alert doctors to Right Treatment). Consensus validation. Int J Clin Pharmacol Ther. 2008 Feb;46(2):72–83.
    1. O'Mahony D, O'Sullivan D, Byrne S, O'Connor MN, Ryan C, Gallagher P. STOPP/START criteria for potentially inappropriate prescribing in older people: version 2. Age Ageing. 2015 Mar;44(2):213–8. doi: 10.1093/ageing/afu145.
    1. Hamilton HJ, Gallagher PF, O'Mahony D. Inappropriate prescribing and adverse drug events in older people. BMC Geriatr. 2009 Jan 28;9:5. doi: 10.1186/1471-2318-9-5.
    1. Yayla ME, Bilge U, Binen E, Keskin A. The use of START/STOPP criteria for elderly patients in primary care. ScientificWorldJournal. 2013;2013:165873. doi: 10.1155/2013/165873. doi: 10.1155/2013/165873.
    1. Conejos MM, Sánchez CM, Delgado SE, Sevilla MI, González-Blazquez S, Montero EB. Potentially inappropriate drug prescription in older subjects across health care settings. Eur Geriatr Med. 2010 Feb 01;1(1):9–14. doi: 10.1016/j.eurger.2009.12.002.
    1. Gurwitz JH, Field TS, Harrold LR, Rothschild J, Debellis K, Seger AC, Cadoret C, Fish LS, Garber L, Kelleher M, Bates DW. Incidence and preventability of adverse drug events among older persons in the ambulatory setting. J Am Med Assoc. 2003 Mar 5;289(9):1107–16.
    1. Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. J Am Med Assoc. 2005 Mar 9;293(10):1223–38. doi: 10.1001/jama.293.10.1223.
    1. Lau F, Kuziemsky C, Price M, Gardner J. A review on systematic reviews of health information system studies. J Am Med Inform Assoc. 2010;17(6):637–45. doi: 10.1136/jamia.2010.004838.
    1. Lau F, Price M, Boyd J, Partridge C, Bell H, Raworth R. Impact of electronic medical record on physician practice in office settings: a systematic review. BMC Med Inform Decis Mak. 2012 Feb 24;12:10. doi: 10.1186/1472-6947-12-10.
    1. Tamblyn R, Huang A, Taylor L, Kawasumi Y, Bartlett G, Grad R, Jacques A, Dawes M, Abrahamowicz M, Perreault R, Winslade N, Poissant L, Pinsonneault A. A randomized trial of the effectiveness of on-demand versus computer-triggered drug decision support in primary care. J Am Med Inform Assoc. 2008;15(4):430–8. doi: 10.1197/jamia.M2606.
    1. Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc. 2004 Apr;11(2):104–12. doi: 10.1197/jamia.M1471.
    1. Yu P, Zhang Y, Gong Y, Zhang J. Unintended adverse consequences of introducing electronic health records in residential aged care homes. Int J Med Inform. 2013 Sep;82(9):772–88. doi: 10.1016/j.ijmedinf.2013.05.008.
    1. Sittig DF, Wright A, Osheroff JA, Middleton B, Teich JM, Ash JS, Campbell E, Bates DW. Grand challenges in clinical decision support. J Biomed Inform. 2008 Apr;41(2):387–92. doi: 10.1016/j.jbi.2007.09.003.
    1. Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM, Payne TH, Rosenbloom ST, Weaver C, Zhang J, American Medical Informatics Association Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc. 2013 Jun;20(e1):e2–8. doi: 10.1136/amiajnl-2012-001458.
    1. Sittig DF, Ash JS, Singh H. The SAFER guides: empowering organizations to improve the safety and effectiveness of electronic health records. Am J Manag Care. 2014 May;20(5):418–23.
    1. Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013 Jan 1;20(1):144–51. doi: 10.1136/amiajnl-2011-000681.
    1. McCormack JL, Ash JS. Clinician perspectives on the quality of patient data used for clinical decision support: a qualitative study. AMIA Annu Symp Proc. 2012;2012:1302–9.
    1. Giguere A, Labrecque M, Grad R, Cauchon M, Greenway M, Légaré F, Pluye P, Turcotte S, Dolovich L, Haynes RB. Barriers and facilitators to implementing Decision Boxes in primary healthcare teams to facilitate shared decisionmaking: a study protocol. BMC Med Inform Decis Mak. 2012 Aug 06;12:85. doi: 10.1186/1472-6947-12-85.
    1. Price M, Weber J, McCallum G. SCOOP - The Social Collaboratory for Outcome Oriented Primary Care. IEEE International Conference on Healthcare Informatics (ICHI); 2014; Verona. IEEE; 2014. p. 210.
    1. Halekoh U, Højsgaard S, Yan J. The R package geepack for generalized estimating equations. J Stat Soft. 2006;15(2) doi: 10.18637/jss.v015.i02.
    1. Wagner MM, Hogan WR. The accuracy of medication data in an outpatient electronic medical record. J Am Med Inform Assoc. 1996;3(3):234–44.
    1. Cohen B, Vawdrey DK, Liu J, Caplan D, Furuya EY, Mis FW, Larson E. Challenges associated with using large data sets for quality assessment and research in clinical settings. Policy Polit Nurs Pract. 2015 Aug;16(3-4):117–24. doi: 10.1177/1527154415603358.
    1. Walker KL, Kirillova O, Gillespie SE, Hsiao D, Pishchalenko V, Pai AK, Puro JE, Plumley R, Kudyakov R, Hu W, Allisany A, McBurnie M, Kurtz SE, Hazlehurst BL. Using the CER Hub to ensure data quality in a multi-institution smoking cessation study. J Am Med Inform Assoc. 2014;21(6):1129–35. doi: 10.1136/amiajnl-2013-002629.
    1. Sukumar SR, Natarajan R, Ferrell RK. Quality of Big Data in health care. Int J Health Care Qual Assur. 2015;28(6):621–34. doi: 10.1108/IJHCQA-07-2014-0080.
    1. Price M, Lau F. The clinical adoption meta-model: a temporal meta-model describing the clinical adoption of health information systems. BMC Med Inform Decis Mak. 2014 May 29;14:43. doi: 10.1186/1472-6947-14-43.
    1. Berner ES, Kasiraman RK, Yu F, Ray MN, Houston TK. Data quality in the outpatient setting: impact on clinical decision support systems. AMIA Annu Symp Proc. 2005:41–5.
    1. Price M, Singer A, Kim J. Adopting electronic medical records: are they just electronic paper records? Can Fam Physician. 2013 Jul;59(7):e322–9.
    1. Weber JH, Price M, Davies I. Taming the data quality dragon--a theory and method for data quality by design. Stud Health Technol Inform. 2015;216:928.
    1. Price M, Weber JH, Davies I, Bellwood P. Lead user design: medication management in electronic medical records. Stud Health Technol Inform. 2015;216:237–41.

Source: PubMed

Sponsorzy i współpracownicy

Warunki medyczne

Interwencje lekowe

3
Subskrybuj