Impact of a Web-Based Electronic Health Record on Behavioral Health Service Delivery for Children and Adolescents: Randomized Controlled Trial

Eric J Bruns, Alyssa N Hook, Elizabeth M Parker, Isabella Esposito, April Sather, Ryan M Parigoris, Aaron R Lyon, Kelly L Hyde, Eric J Bruns, Alyssa N Hook, Elizabeth M Parker, Isabella Esposito, April Sather, Ryan M Parigoris, Aaron R Lyon, Kelly L Hyde

Abstract

Background: Electronic health records (EHRs) have been widely proposed as a mechanism for improving health care quality. However, rigorous research on the impact of EHR systems on behavioral health service delivery is scant, especially for children and adolescents.

Objective: The current study evaluated the usability of an EHR developed to support the implementation of the Wraparound care coordination model for children and youth with complex behavioral health needs, and impact of the EHR on service processes, fidelity, and proximal outcomes.

Methods: Thirty-four Wraparound facilitators working in two programs in two states were randomized to either use the new EHR (19/34, 56%) or to continue to implement Wraparound services as usual (SAU) using paper-based documentation (15/34, 44%). Key functions of the EHR included standard fields such as youth and family information, diagnoses, assessment data, and progress notes. In addition, there was the maintenance of a coordinated plan of care, progress measurement on strategies and services, communication among team members, and reporting on services, expenditures, and outcomes. All children and youth referred to services for eight months (N=211) were eligible for the study. After excluding those who were ineligible (69/211, 33%) and who declined to participate (59/211, 28%), a total of 83/211 (39%) children and youth were enrolled in the study with 49/211 (23%) in the EHR condition and 34/211 (16%) in the SAU condition. Facilitators serving these youth and families and their supervisors completed measures of EHR usability and appropriateness, supervision processes and activities, work satisfaction, and use of and attitudes toward standardized assessments. Data from facilitators were collected by web survey and, where necessary, by phone interviews. Parents and caregivers completed measures via phone interviews. Related to fidelity and quality of behavioral health care, including Wraparound team climate, working alliance with providers, fidelity to the Wraparound model, and satisfaction with services.

Results: EHR-assigned facilitators from both sites demonstrated the robust use of the system. Facilitators in the EHR group reported spending significantly more time reviewing client progress (P=.03) in supervision, and less time overall sending reminders to youth/families (P=.04). A trend toward less time on administrative tasks (P=.098) in supervision was also found. Facilitators in both groups reported significantly increased use of measurement-based care strategies overall, which may reflect cross-group contamination (given that randomization of staff to the EHR occurred within agencies and supervisors supervised both types of staff). Although not significant at P<.05, there was a trend (P=.10) toward caregivers in the EHR group reporting poorer shared agreement on tasks on the measure of working alliance with providers. No other significant between-group differences were found.

Conclusions: Results support the proposal that use of EHR systems can promote the use of client progress data and promote efficiency; however, there was little evidence of any impact (positive or negative) on overall service quality, fidelity, or client satisfaction. The field of children's behavioral health services would benefit from additional research on EHR systems using designs that include larger sample sizes and longer follow-up periods.

Trial registration: ClinicalTrials.gov NCT02421874; https://ichgcp.net/clinical-trials-registry/NCT02421874 (Archived by WebCite at http://www.webcitation.org/6yyGPJ3NA).

Keywords: adolescent; care coordination; child; electronic health records; integrated care; medical informatics; mental health.

Conflict of interest statement

Conflicts of Interest: KLH is the founder, CEO, and majority owner of FidelityEHR, the company that created and maintains the EHR used in the trial presented in this manuscript. The other authors have no conflicts to disclose.

©Eric J Bruns, Alyssa N Hook, Elizabeth M Parker, Isabella Esposito, April Sather, Ryan M Parigoris, Aaron R Lyon, Kelly L Hyde. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.06.2018.

Figures

Figure 1
Figure 1
Participant flow through the study.

References

    1. Chase HS, Mitrani LR, Lu GG, Fulgieri DJ. Early recognition of multiple sclerosis using natural language processing of the electronic health record. BMC Med Inform Decis Mak. 2017 Feb 28;17(1):24. doi: 10.1186/s12911-017-0418-4.
    1. Francis DB, Cates JR, Wagner KPG, Zola T, Fitter JE, Coyne-Beasley T. Communication technologies to improve HPV vaccination initiation and completion: A systematic review. Patient Educ Couns. 2017 Jul;100(7):1280–1286. doi: 10.1016/j.pec.2017.02.004.
    1. Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013 Jan 1;20(1):144–51. doi: 10.1136/amiajnl-2011-000681.
    1. US Department of Health and Human Services, Office of the National Council of Health Information Technology Using Information Technology to Integrate Behavioral Health and Primary Care. 2012. [2017-12-07]. .
    1. Bardach SH, Real K, Bardach DR. Perspectives of healthcare practitioners: An exploration of interprofessional communication using electronic medical records. J Interprof Care. 2017 May;31(3):300–306. doi: 10.1080/13561820.2016.1269312.
    1. Elias B, Barginere M, Berry PA, Selleck CS. Implementation of an electronic health records system within an interprofessional model of care. J Interprof Care. 2015;29(6):551–4. doi: 10.3109/13561820.2015.1021001.
    1. Jensen RE, Chan KS, Weiner JP, Fowles JB, Neale SM. Implementing electronic health record-based quality measures for developmental screening. Pediatrics. 2009 Oct;124(4):e648–54. doi: 10.1542/peds.2008-3091.
    1. Chiu S, Fitzgerald KM. Electronic medical/health record and pediatric behavioral health providers: progress and problems. Arch Psychiatr Nurs. 2013 Apr;27(2):108–9. doi: 10.1016/j.apnu.2013.01.001.
    1. Lowes Linda P, Noritz Garey H, Newmeyer Amy, Embi Peter J, Yin Han, Smoyer William E, ‘Learn from Every Patient’ Study Group 'Learn From Every Patient': implementation and early results of a learning health system. Dev Med Child Neurol. 2017 Feb;59(2):183–191. doi: 10.1111/dmcn.13227. doi: 10.1111/dmcn.13227.
    1. Ose D, Kunz A, Pohlmann S, Hofmann H, Qreini M, Krisam J, Uhlmann L, Jacke C, Winkler EC, Salize H, Szecsenyi J. A Personal Electronic Health Record: Study Protocol of a Feasibility Study on Implementation in a Real-World Health Care Setting. JMIR Res Protoc. 2017 Mar 02;6(3):e33. doi: 10.2196/resprot.6314.
    1. The National Council for Community Behavioral Healthcare. 2012. [2017-12-05]. HIT Adoption and Readiness for Meaningful Use in Community Behavioral Health: Report on the 2012 National Council Survey .
    1. Cowie MR, Blomster JI, Curtis LH, Duclaux S, Ford I, Fritz F, Goldman S, Janmohamed S, Kreuzer J, Leenay M, Michel A, Ong S, Pell JP, Southworth MR, Stough WG, Thoenes M, Zannad F, Zalewski A. Electronic health records to facilitate clinical research. Clin Res Cardiol. 2017 Jan;106(1):1–9. doi: 10.1007/s00392-016-1025-6.
    1. Sakata KK, Stephenson LS, Mulanax A, Bierman J, Mcgrath K, Scholl G, McDougal A, Bearden DT, Mohan V, Gold JA. Professional and interprofessional differences in electronic health records use and recognition of safety issues in critically ill patients. J Interprof Care. 2016 Sep;30(5):636–42. doi: 10.1080/13561820.2016.1193479.
    1. Cellucci LW, Cellucci T, Stanton M, Kerrigan D, Madrake M. Current status and future directions of EMR use in psychology clinics. Health Policy and Technology. 2015 Jun;4(2):91–99. doi: 10.1016/j.hlpt.2015.02.005.
    1. Lau F, Price M, Boyd J, Partridge C, Bell H, Raworth R. Impact of electronic medical record on physician practice in office settings: a systematic review. BMC Med Inform Decis Mak. 2012 Feb 24;12:10. doi: 10.1186/1472-6947-12-10.
    1. Holroyd-Leduc JM, Lorenzetti D, Straus SE, Sykes L, Quan H. The impact of the electronic medical record on structure, process, and outcomes within primary care: a systematic review of the evidence. J Am Med Inform Assoc. 2011;18(6):732–7. doi: 10.1136/amiajnl-2010-000019.
    1. Larrison CR, Xiang X, Gustafson M, Lardiere MR, Jordan N. Implementation of Electronic Health Records Among Community Mental Health Agencies. J Behav Health Serv Res. 2018 Jan;45(1):133–142. doi: 10.1007/s11414-017-9556-9.
    1. Fleming NS, Becker ER, Culler SD, Cheng D, McCorkle R, da GB, Ballard DJ. The impact of electronic health records on workflow and financial measures in primary care practices. Health Serv Res. 2014 Feb;49(1 Pt 2):405–20. doi: 10.1111/1475-6773.12133.
    1. Ser G, Robertson A, Sheikh A. A qualitative exploration of workarounds related to the implementation of national electronic health records in early adopter mental health hospitals. PLoS One. 2014;9(1):e77669. doi: 10.1371/journal.pone.0077669.
    1. Lutterman T, Phelan B, Berhane A, Shaw R, Rana V. Substance Abuse and Mental Health Services Administration. Rockville, MD: 2008. [2018-05-03]. Characteristics of state mental health agency data systems .
    1. Boonstra A, Broekhuis M. Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res. 2010;10:231. doi: 10.1186/1472-6963-10-231.
    1. Cifuentes M, Davis M, Fernald D, Gunn R, Dickinson P, Cohen DJ. Electronic Health Record Challenges, Workarounds, and Solutions Observed in Practices Integrating Behavioral Health and Primary Care. J Am Board Fam Med. 2015 Oct;28 Suppl 1:S63–72. doi: 10.3122/jabfm.2015.S1.150133.
    1. Kobus AM, Harman JS, Do HD, Garvin RD. Challenges to depression care documentation in an EHR. Fam Med. 2013 Apr;45(4):268–71.
    1. Lawlor T, Barrows E. Behavioral health electronic medical record. Psychiatr Clin North Am. 2008 Mar;31(1):95–103. doi: 10.1016/j.psc.2007.11.009.
    1. Matthews EB. Integrating the Electronic Health Record into Behavioral Health Encounters: Strategies, Barriers, and Implications for Practice. Adm Policy Ment Health. 2017 Jul;44(4):512–523. doi: 10.1007/s10488-015-0676-3.
    1. Bruns EJ, Pullmann MD, Sather A, Denby BR, Ramey M. Effectiveness of wraparound versus case management for children and adolescents: results of a randomized study. Adm Policy Ment Health. 2015 May;42(3):309–22. doi: 10.1007/s10488-014-0571-3.
    1. Schurer Coldiron J, Bruns EJ, Quick H. A Comprehensive Review of Wraparound Care Coordination Research, 1986–2014. J Child Fam Stud. 2017 Jan 28;26(5):1245–1265. doi: 10.1007/s10826-016-0639-7.
    1. McGregor B, Mack D, Wrenn G, Shim RS, Holden K, Satcher D. Improving Service Coordination and Reducing Mental Health Disparities Through Adoption of Electronic Health Records. Psychiatr Serv. 2015 Sep;66(9):985–7. doi: 10.1176/appi.ps.201400095.
    1. Brooke J. System usability scale (SUS). Usability Evaluation in Industry. London: Taylor and Francis; 1996.
    1. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies. 2009;4(3):114–23.
    1. Cherry BJ, Ford EW, Peterson LT. Experiences with electronic health records: early adopters in long-term care facilities. Health Care Manage Rev. 2011;36(3):265–74. doi: 10.1097/HMR.0b013e31820e110f.
    1. Bruns EJ, Hyde KL, Sather A, Hook AN, Lyon AR. Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination. Adm Policy Ment Health. 2016 May;43(3):350–68. doi: 10.1007/s10488-015-0658-5.
    1. Matiz LA, Robbins-Milne L, Krause MC, Peretz PJ, Rausch JC. Evaluating the Impact of Information Technology Tools to Support the Asthma Medical Home. Clin Pediatr (Phila) 2016 Feb;55(2):165–70. doi: 10.1177/0009922815596070.
    1. King J, Patel V, Jamoom E, DesRoches C. The role of health IT and delivery system reform in facilitating advanced care delivery. Am J Manag Care. 2016 Apr;22(4):258–65.
    1. Hsiao C, King J, Hing E, Simon AE. The role of health information technology in care coordination in the United States. Med Care. 2015 Feb;53(2):184–90. doi: 10.1097/MLR.0000000000000276.
    1. Bruns EJ, Walker JS, Bernstein A, Daleiden E, Pullmann MD, Chorpita BF. Family voice with informed choice: coordinating wraparound with research-based treatment for children and adolescents. J Clin Child Adolesc Psychol. 2014;43(2):256–69. doi: 10.1080/15374416.2013.859081.
    1. Bruns EJ, Hoagwood KE, Rivard JC, Wotring J, Marsenich L, Carter B. State implementation of evidence-based practice for youths, part II: recommendations for research and policy. J Am Acad Child Adolesc Psychiatry. 2008 May;47(5):499–504. doi: 10.1097/CHI.0b013e3181684557.
    1. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders (DSM-5) Washington, DC: American Psychiatric Association; 2013.
    1. Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001 Nov;40(11):1337–45. doi: 10.1097/00004583-200111000-00015.
    1. Walker J, Bruns E, Penn M. Stroul BA, Blau GM, editors. The system of care handbook: Transforming mental health services for children, youth, families. Baltimore, MD: Paul H Brookes Publishing; 2008. Individualized services in systems of care: The wraparound process; pp. 127–53.
    1. Walker JS, Bruns EJ. Building on practice-based evidence: using expert perspectives to define the wraparound process. Psychiatr Serv. 2006 Nov;57(11):1579–85. doi: 10.1176/ps.2006.57.11.1579.
    1. Sauro J. A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices. N/A: Measuring Usability LLC; 2011.
    1. Brooke J. System usability scale (SUS): a quick-and-dirty method of system evaluation user information. Reading, UK: Digital Equipment Co Ltd; 1986.
    1. Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction. 2008 Jul 30;24(6):574–594. doi: 10.1080/10447310802205776.
    1. Peres SC, Pham T, Phillips R. Validation of the System Usability Scale (SUS). Proceedings of the Human Factors and Ergonomics Society Annual Meeting; Proc Hum Factors Ergon Soc Annu Meet. ;57; 2013; Los Angeles, CA. 2013. Sep 30, pp. 192–196.
    1. Chafouleas S, Briesch A, Neugebauer S, Riley-Tillman T. Usage Rating Profile-Intervention (Revised) Storrs, CT: University of Connecticut; 2011.
    1. Reimers TM, Lee J. Parental acceptability of treatments for children's hypercholesterolemia. J Behav Med. 1991 Jun;14(3):225–39.
    1. Martens BK, Witt JC, Elliott SN, Darveaux DX. Teacher judgments concerning the acceptability of school-based interventions. Professional Psychology: Research and Practice. 1985;16(2):191–198. doi: 10.1037/0735-7028.16.2.191.
    1. Cook CR, Zhang Y. Merging measures to develop a more robust measure of perceptual predictors of implementation. Annual Conference on Advancing School Mental Health; September 18-20, 2014; Pittsburgh, PA. 2014.
    1. Accurso EC, Taylor RM, Garland AF. Evidence-based Practices Addressed in Community-based Children's Mental Health Clinical Supervision. Train Educ Prof Psychol. 2011 May 01;5(2):88–96. doi: 10.1037/a0023537.
    1. Dorsey S, Pullmann MD, Deblinger E, Berliner L, Kerns SE, Thompson K, Unützer J, Weisz JR, Garland AF. Improving practice in community-based settings: a randomized trial of supervision - study protocol. Implement Sci. 2013 Aug 10;8:89. doi: 10.1186/1748-5908-8-89.
    1. Jensen-Doss A, Hawley KM. Understanding barriers to evidence-based assessment: clinician attitudes toward standardized assessment tools. J Clin Child Adolesc Psychol. 2010;39(6):885–96. doi: 10.1080/15374416.2010.517169.
    1. Strating MMH, Nieboer AP. Psychometric test of the Team Climate Inventory-short version investigated in Dutch quality improvement teams. BMC Health Serv Res. 2009 Jul 24;9:126. doi: 10.1186/1472-6963-9-126.
    1. Pullmann MD, Bruns EJ, Sather AK. Evaluating fidelity to the wraparound service model for youth: application of item response theory to the Wraparound Fidelity Index. Psychol Assess. 2013 Jun;25(2):583–98. doi: 10.1037/a0031864.
    1. Sather A, Hook A, Esposito I. The WFAS: A history of national means and other psychometrics. Annual Research and Policy Conference for Child, Adolescent, and Youth Adult Behavioral Health; March 13-16, 2016; Tampa, FL. 2016.
    1. Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology. 1989;36(2):223. doi: 10.1037/0022-0167.36.2.223.
    1. Hanson WE, Curry KT, Bandalos DL. Reliability Generalization of Working Alliance Inventory Scale Scores. Educational and Psychological Measurement. 2016 Jul 02;62(4):659–673. doi: 10.1177/0013164402062004008.
    1. Nguyen TD, Attkisson CC, Stegner BL. Assessment of patient satisfaction: development and refinement of a service evaluation questionnaire. Eval Program Plann. 1983;6(3-4):299–313.
    1. Attkisson CC, Zwick R. The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–7.
    1. Chorpita BF, Park A, Tsai K, Korathu-Larson P, Higa-McMillan CK, Nakamura BJ, Weisz JR, Krull J, Research Network on Youth Mental Health Balancing effectiveness with responsiveness: Therapist satisfaction across different treatment designs in the Child STEPs randomized effectiveness trial. J Consult Clin Psychol. 2015 Aug;83(4):709–18. doi: 10.1037/a0039301.
    1. Raudenbush S, Bryk A. Hierarchical Linear Models: Applications and Data Analysis Methods (Advanced Quantitative Techniques in the Social Sciences) Newbury Park, CA: Sage; 2002.
    1. Chorpita BF, Reise S, Weisz JR, Grubbs K, Becker KD, Krull JL, Research Network on Youth Mental Health Evaluation of the Brief Problem Checklist: child and caregiver interviews to measure clinical progress. J Consult Clin Psychol. 2010 Aug;78(4):526–36. doi: 10.1037/a0019602.
    1. Lyon AR, Pullmann MD, Whitaker K, Ludwig K, Wasse JK, McCauley E. A Digital Feedback System to Support Implementation of Measurement-Based Care by School-Based Mental Health Clinicians. J Clin Child Adolesc Psychol. 2017 Mar 02;:1–12. doi: 10.1080/15374416.2017.1280808.
    1. Persons JB, Koerner K, Eidelman P, Thomas C, Liu H. Increasing psychotherapists' adoption and implementation of the evidence-based practice of progress monitoring. Behav Res Ther. 2016 Jan;76:24–31. doi: 10.1016/j.brat.2015.11.004.
    1. Fortney JC, Unützer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, Harbin HT. A Tipping Point for Measurement-Based Care. Psychiatr Serv. 2017 Feb 01;68(2):179–188. doi: 10.1176/appi.ps.201500439.
    1. Cohen D. Assessing the Effect of an Electronic Decision Support System on Children's Mental Health Service Outcomes. Journal of Technology in Human Services. 2015 Aug 12;33(3):225–240. doi: 10.1080/15228835.2015.1039687.
    1. Ruud T. Routine outcome measures in Norway: Only partly implemented. Int Rev Psychiatry. 2015;27(4):338–44.
    1. Mohr DC, Lyon AR, Lattie EG, Reddy M, Schueller SM. Accelerating Digital Mental Health Research From Early Design and Creation to Successful Implementation and Sustainment. J Med Internet Res. 2017 May 10;19(5):e153. doi: 10.2196/jmir.7725.
    1. Lyon AR, Lewis CC, Melvin A, Boyd M, Nicodimos S, Liu FF, Jungbluth N. Health Information Technologies-Academic and Commercial Evaluation (HIT-ACE) methodology: description and application to clinical feedback systems. Implement Sci. 2016 Sep 22;11(1):128. doi: 10.1186/s13012-016-0495-2.
    1. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012 Apr;69(2):123–57. doi: 10.1177/1077558711430690.
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015 Feb 12;10:21. doi: 10.1186/s13012-015-0209-1.
    1. McGeorge NM, Hegde S, Guarrera TK, Zhou Y, Lin L, Crane PW, Fairbanks Rj, Kaushal R, Bisantz Am. Studying the impact of interoperable electronic health records on workflow in ambulatory care. International Journal of Industrial Ergonomics. 2015 Sep;49:144–155. doi: 10.1016/j.ergon.2013.10.005.
    1. Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006 May 16;144(10):742–52.
    1. Lyon AR, Stirman SW, Kerns SEU, Bruns EJ. Developing the mental health workforce: review and application of training approaches from multiple disciplines. Adm Policy Ment Health. 2011 Jul;38(4):238–53. doi: 10.1007/s10488-010-0331-y.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012 Mar;50(3):217–26. doi: 10.1097/MLR.0b013e3182408812.

Source: PubMed

Спонсоры и соавторы

Заболевания

Медикаментозные вмешательства

Подписаться