Impact of Implementing a Wiki to Develop Structured Electronic Order Sets on Physicians' Intention to Use Wiki-Based Order Sets

Patrick Michel Archambault, Pierre Beaupré, Laura Bégin, Audrey Dupuis, Mario Côté, France Légaré, Patrick Michel Archambault, Pierre Beaupré, Laura Bégin, Audrey Dupuis, Mario Côté, France Légaré

Abstract

Background: Wikis have the potential to promote best practices in health systems by sharing order sets with a broad community of stakeholders. However, little is known about the impact of using a wiki on clinicians' intention to use wiki-based order sets.

Objective: The aims of this study were: (1) to describe the use of a wiki to create structured order sets for a single emergency department; (2) to evaluate whether the use of this wiki changed emergency physicians' future intention to use wiki-based order sets; and (3) to understand the impact of using the wiki on the behavioral determinants for using wiki-based order sets.

Methods: This was a pre/post-intervention mixed-methods study conducted in one hospital in Lévis, Quebec. The intervention was comprised of receiving access to and being motivated by the department head to use a wiki for 6 months to create electronic order sets designed to be used in a computer physician order entry system. Before and after our intervention, we asked participants to complete a previously validated questionnaire based on the Theory of Planned Behavior. Our primary outcome was the intention to use wiki-based order sets in clinical practice. We also assessed participants' attitude, perceived behavioral control, and subjective norm to use wiki-based order sets. Paired pre- and post-Likert scores were compared using Wilcoxon signed-rank tests. The post-questionnaire also included open-ended questions concerning participants' comments about the wiki, which were then classified into themes using an existing taxonomy.

Results: Twenty-eight emergency physicians were enrolled in the study (response rate: 100%). Physicians' mean intention to use a wiki-based reminder was 5.42 (SD 1.04) before the intervention, and increased to 5.81 (SD 1.25) on a 7-point Likert scale (P =.03) after the intervention. Participants' attitude towards using a wiki-based order set also increased from 5.07 (SD 0.90) to 5.57 (SD 0.88) (P =.003). Perceived behavioral control and subjective norm did not change. Easier information sharing was the most frequently positive impact raised. In order of frequency, the three most important facilitators reported were: ease of use, support from colleagues, and promotion by the departmental head. Although participants did not mention any perceived negative impacts, they raised the following barriers in order of frequency: poor organization of information, slow computers, and difficult wiki access.

Conclusions: Emergency physicians' intention and attitude to use wiki-based order sets increased after having access to and being motivated to use a wiki for 6 months. Future studies need to explore if this increased intention will translate into sustained actual use and improve patient care. Certain barriers need to be addressed before implementing a wiki for use on a larger scale.

Keywords: Theory of Planned Behavior; collaborative writing applications; computer physician order entry; decision support tools; emergency medicine; health informatics; knowledge translation; wiki.

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Number of wiki sessions per day between February 1 and June 25, 2013 (narrow arrows: monthly departmental meetings; bold arrow: simulation in new ED).

References

    1. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003 Oct 11;362(9391):1225–30. doi: 10.1016/S0140-6736(03)14546-1.
    1. Holroyd BR, Bullard MJ, Graham Timothy A D. Rowe BH. Decision support technology in knowledge translation. Acad Emerg Med. 2007 Nov;14(11):942–8. doi: 10.1197/j.aem.2007.06.023.
    1. Sahota N, Lloyd R, Ramakrishna A, Mackay JA, Prorok JC, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, CCDSS Systematic Review Team Computerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011;6:91. doi: 10.1186/1748-5908-6-91.
    1. Black A, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, McKinstry Brian, Procter Rob, Majeed Azeem, Sheikh Aziz. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med. 2011;8(1):e1000387. doi: 10.1371/journal.pmed.1000387.
    1. Berner ES. [2013-09-15]. Clinical Decision Support Systems: State of the Art .
    1. Wright A, Bates DW, Middleton B, Hongsermeier T, Kashyap V, Thomas SM, Sittig DF. Creating and sharing clinical decision support content with Web 2.0: Issues and examples. J Biomed Inform. 2009 Apr;42(2):334–46. doi: 10.1016/j.jbi.2008.09.003.
    1. Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS. Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med. 2003 Nov 24;163(21):2625–31. doi: 10.1001/archinte.163.21.2625.
    1. Chan Julie, Shojania Kaveh G, Easty Anthony C, Etchells Edward E. Does user-centred design affect the efficiency, usability and safety of CPOE order sets? J Am Med Inform Assoc. 2011 May 1;18(3):276–81. doi: 10.1136/amiajnl-2010-000026.
    1. Archambault PM, Bilodeau A, Gagnon M, Aubin K, Lavoie A, Lapointe J, Poitras J, Croteau S, Pham-Dinh M, Légaré F. Health care professionals' beliefs about using wiki-based reminders to promote best practices in trauma care. J Med Internet Res. 2012;14(2):e49. doi: 10.2196/jmir.1983.
    1. Theal J, Protti D. CPOE with evidence-based clinical decision support improves patient outcomes: the journey to date for a Canadian hospital. Healthc Q. 2014;17(1):24–9.
    1. Archambault P, Turgeon A, Witteman H, Lauzier F, Moore L, Lamontagne F, Horsley Tanya, Gagnon Marie-Pierre, Droit Arnaud, Weiss Matthew, Tremblay Sébastien, Lachaine Jean, Le Sage Natalie, Émond Marcel, Berthelot Simon, Plaisance Ariane, Lapointe Jean, Razek Tarek, van de Belt Tom H. Brand Kevin, Bérubé Mélanie, Clément Julien, Grajales III Francisco Jose. Eysenbach Gunther, Kuziemsky Craig, Friedman Debbie, Lang Eddy, Muscedere John, Rizoli Sandro, Roberts Derek J, Scales Damon C, Sinuff Tasnim, Stelfox Henry T, Gagnon Isabelle, Chabot Christian, Grenier Richard, Légaré France, Canadian Critical Care Trials Group Implementation and Evaluation of a Wiki Involving Multiple Stakeholders Including Patients in the Promotion of Best Practices in Trauma Care: The WikiTrauma Interrupted Time Series Protocol. JMIR Res Protoc. 2015;4(1):e21. doi: 10.2196/resprot.4024.
    1. Archambault P, van de Belt T. Faber M, Plaisance A, Kuziemsky C, Gagnon M, Turgeon A, Aubin K, Poitras J, Horsley T, Lapointe J, Brand K, Witteman W, Lachaise J, Légaré F. Cochrane Database Syst Rev. [2016-03-12]. Collaborative writing applications in healthcare: effects on professional practice and healthcare outcomes (Protocol) .
    1. Archambault PM, van de Belt Tom H. Grajales FJ, Faber MJ, Kuziemsky CE, Gagnon S, Bilodeau A, Rioux S, Nelen Willianne L D M. Gagnon M, Turgeon AF, Aubin K, Gold I, Poitras J, Eysenbach G, Kremer Jan A M. Légaré F. Wikis and collaborative writing applications in health care: a scoping review. J Med Internet Res. 2013 Oct;15(10):e210. doi: 10.2196/jmir.2787.
    1. Brulet A, Llorca Guy, Letrilliart Laurent. Medical Wikis Dedicated to Clinical Practice: A Systematic Review. J Med Internet Res. 2015;17(2):e48. doi: 10.2196/jmir.3574.
    1. Heilman JM, Kemmann E, Bonert M, Chatterjee A, Ragar B, Beards GM, Iberri DJ, Harvey M, Thomas B, Stomp W, Martone MF, Lodge DJ, Vondracek A, de Wolff Jacob F. Liber C, Grover SC, Vickers TJ, Meskó B, Laurent MR. Wikipedia: a key tool for global public health promotion. J Med Internet Res. 2011;13(1):e14. doi: 10.2196/jmir.1589.
    1. Meenan C, King A, Toland C, Daly M, Nagy P. Use of a wiki as a radiology departmental knowledge management system. J Digit Imaging. 2010 Apr;23(2):142–51. doi: 10.1007/s10278-009-9180-1.
    1. Yu R, Crotty B. Journal of Hospital Medicine. Grapevine, TX: Society of Hospital Medicine. Research, Innovations, Clinical Vignettes Competition; May, 2011; Resort and Convention Center; 2011. [2016-04-29]. Wikis to better manage shared information in a hospitalist group
    1. Riley J, McGowan M, Rozmovits L. Exploring the value of technology to stimulate interprofessional discussion and education: a needs assessment of emergency medicine professionals. J Med Internet Res Internet. 2014 doi: 10.2196/jmir.3482.
    1. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24. doi: 10.1002/chp.47.
    1. Archambault P, Légaré F, Lavoie A, Gagnon M, Lapointe J, St-Jacques S. Healthcare professionals' intentions to use wiki-based reminders to promote best practices in trauma care: a survey protocol. Implement Sci Internet. 2010 doi: 10.1186/1748-5908-5-45.
    1. Archambault PM, Gagnon S, Gagnon M, Turcotte S, Lapointe J, Fleet R, Côté M, Beaupré P, Le SN, Emond M, Légaré F. Development and validation of questionnaires exploring health care professionals' intention to use wiki-based reminders to promote best practices in trauma. JMIR Res Protoc. 2014;3(3):e50. doi: 10.2196/resprot.3762.
    1. McGowan BS, Wasko M, Vartabedian BS, Miller RS, Freiherr DD, Abdolrasulnia M. Understanding the factors that influence the adoption and meaningful use of social media by physicians to share medical information. J Med Internet Res. 2012;14(5):e117. doi: 10.2196/jmir.2138.
    1. West J, West M. Using wikis for online collaboration: the power of the read-write web. San Francisco, CA: Jossey-Bass; 2009.
    1. Karasavvidis I. Wiki uses in higher education: exploring barriers to successful implementation. Interactive Learning Environments. 2010 Sep;18(3):219–231. doi: 10.1080/10494820.2010.500514.
    1. Weinberger D. Everything is miscellaneous: the power of the new digital disorder. United States: Henry Holt & Company; 2008.
    1. Zhang X, Zhu F. Work Inf Syst Econ (WISE), Chicago, IL Internet. [2016-03-12]. Intrinsic Motivation of Open Content Contributions: The Case of Wikipedia .
    1. Cheshire C, Antin J. The social psychological effects of feedback on the production of Internet information pools. J Comput Commun. 2008;13(3):705–27. doi: 10.1111/j.1083-6101.2008.00416.x.
    1. Cheshire C, Antin J. None of us is as lazy as all of us. Information, Communication & Society. 2010 Jun;13(4):537–555. doi: 10.1080/13691181003639858.
    1. Cress U, Kimmerle J. A systemic and cognitive view on collaborative knowledge building with wikis. Computer Supported Learning. 2008 Jan 10;3(2):105–122. doi: 10.1007/s11412-007-9035-z.
    1. Yates D, Wagner C, Majchrzak A. Factors affecting shapers of organizational wikis. J. Am. Soc. Inf. Sci. 2010;61(3):543–544. doi: 10.1002/asi.21266.
    1. Vroom R, Vossen L, Geers A. World Acad Sci Eng Technol 57. 2009. [2016-04-29]. Aspects to Motivate users of a Design Engineering Wiki to Share their Knowledge .
    1. Tapscott D, Williams A. Wikinomics: How Mass Collaboration Changes Everything. New York: Portfolio: Portfolio Trade; 2008.
    1. Varga-Atkins T, Prescott D, Dangerfield P. Encycl Cyber Behav. Pennsylvania, United States: IGI Global; 2012. Cyber Behavior with Wikis.
    1. Okoli C, Mehdi M, Mesgari M, Nielsen F, Lanamäki A. Soc Sci Res Netw Internet. [2013-05-05]. The people's encyclopedia under the gaze of the sages: A systematic review of scholarly research on Wikipedia .
    1. Archambault P. WikiBuild: a new application to support patient and health care professional involvement in the development of patient support tools. J Med Internet Res. 2011;13(4):e114. doi: 10.2196/jmir.1961.
    1. Archambault PM, Thanh J, Blouin D, Gagnon S, Poitras J, Fountain R, Fleet R, Bilodeau A, van de Belt Tom H. Légaré F. Emergency medicine residents' beliefs about contributing to an online collaborative slideshow. CJEM. 2015 Jul;17(4):374–86. doi: 10.1017/cem.2014.49.
    1. Ajzen I. Attitudes, personality and behavior. Maidenhead: Open University Press; 2005. Attitudes, personality and behavior.
    1. Godin G, Boyer R, Duval B, Fortin C, Nadeau D. Understanding physicians' decision to perform a clinical examination on an HIV seropositive patient. Med Care. 1992 Mar;30(3):199–207.
    1. Gagnon M, Godin G, Gagné C, Fortin J, Lamothe L, Reinharz D, Cloutier A. An adaptation of the theory of interpersonal behaviour to the study of telemedicine adoption by physicians. Int J Med Inform. 2003 Sep;71(2-3):103–15.
    1. Beaupré P, Archambault P. cited. 2015. Jun 14, [2015-06-14]. Urgence HDL Informatisation Internet
    1. Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003 May;41(5):582–92. doi: 10.1097/01.MLR.0000062554.74615.4C.
    1. Kohli MD, Bradshaw JK. What is a wiki, and how can it be used in resident education? J Digit Imaging. 2011 Feb;24(1):170–5. doi: 10.1007/s10278-010-9292-7.
    1. Bartholomew LK, Parcel GS, Kok G. Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ Behav. 1998 Oct;25(5):545–63.
    1. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From Theory to Intervention: Mapping Theoretically Derived Behavioural Determinants to Behaviour Change Techniques. Appl Psychol Internet. 2008 doi: 10.1111/j.1464-0597.2008.00341.x.
    1. French S, Green S, O'Connor Denise A, McKenzie J, Francis J, Michie S, Buchbinder Rachelle, Schattner Peter, Spike Neil, Grimshaw Jeremy M. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38. doi: 10.1186/1748-5908-7-38.
    1. Godin G, Bélanger-Gravel Ariane, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36. doi: 10.1186/1748-5908-3-36.
    1. Nilsen P, Roback K, Broström Anders, Ellström Per-Erik. Creatures of habit: accounting for the role of habit in implementation research on clinical behaviour change. Implement Sci. 2012;7:53. doi: 10.1186/1748-5908-7-53.
    1. Hughes B, Joshi I, Lemonde H, Wareham J. Junior physician's use of Web 2.0 for information seeking and medical education: a qualitative study. Int J Med Inform. 2009 Oct;78(10):645–55. doi: 10.1016/j.ijmedinf.2009.04.008.
    1. Godin G, Sheeran P, Conner M, Germain M. Asking questions changes behavior: mere measurement effects on frequency of blood donation. Health Psychol. 2008 Mar;27(2):179–84. doi: 10.1037/0278-6133.27.2.179.
    1. Brokowski L, Sheehan AH. Evaluation of pharmacist use and perception of Wikipedia as a drug information resource. Ann Pharmacother. 2009 Nov;43(11):1912–3. doi: 10.1345/aph.1M340.
    1. Rothman KJ. No adjustments are needed for multiple comparisons. Epidemiology. 1990 Jan;1(1):43–6.
    1. Perneger TV. What's wrong with Bonferroni adjustments. BMJ. 1998 Apr 18;316(7139):1236–8.
    1. Huijg J, Gebhardt WA, Crone M, Dusseldorp E, Presseau J. Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research. Implement Sci. 2014;9:11. doi: 10.1186/1748-5908-9-11.
    1. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, "Psychological Theory" Group Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005 Feb;14(1):26–33. doi: 10.1136/qshc.2004.011155.
    1. Archambault PM, Blouin D, Poitras J, Fountain R, Fleet R, Bilodeau A, Légaré F. Emergency medicine residents' beliefs about contributing to a Google Docs presentation: a survey protocol. Inform Prim Care. 2011;19(4):207–16.
    1. Windle J, Van-Milligan G, Duffy S, McClay J, Campbell J. Web-based physician order entry: an open source solution with broad physician involvement. AMIA Annu Symp Proc. 2003:724–7.

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa