A framework for characterizing eHealth literacy demands and barriers

Connie V Chan, David R Kaufman, Connie V Chan, David R Kaufman

Abstract

Background: Consumer eHealth interventions are of a growing importance in the individual management of health and health behaviors. However, a range of access, resources, and skills barriers prevent health care consumers from fully engaging in and benefiting from the spectrum of eHealth interventions. Consumers may engage in a range of eHealth tasks, such as participating in health discussion forums and entering information into a personal health record. eHealth literacy names a set of skills and knowledge that are essential for productive interactions with technology-based health tools, such as proficiency in information retrieval strategies, and communicating health concepts effectively.

Objective: We propose a theoretical and methodological framework for characterizing complexity of eHealth tasks, which can be used to diagnose and describe literacy barriers and inform the development of solution strategies.

Methods: We adapted and integrated two existing theoretical models relevant to the analysis of eHealth literacy into a single framework to systematically categorize and describe task demands and user performance on tasks needed by health care consumers in the information age. The method derived from the framework is applied to (1) code task demands using a cognitive task analysis, and (2) code user performance on tasks. The framework and method are applied to the analysis of a Web-based consumer eHealth task with information-seeking and decision-making demands. We present the results from the in-depth analysis of the task performance of a single user as well as of 20 users on the same task to illustrate both the detailed analysis and the aggregate measures obtained and potential analyses that can be performed using this method.

Results: The analysis shows that the framework can be used to classify task demands as well as the barriers encountered in user performance of the tasks. Our approach can be used to (1) characterize the challenges confronted by participants in performing the tasks, (2) determine the extent to which application of the framework to the cognitive task analysis can predict and explain the problems encountered by participants, and (3) inform revisions to the framework to increase accuracy of predictions.

Conclusions: The results of this illustrative application suggest that the framework is useful for characterizing task complexity and for diagnosing and explaining barriers encountered in task completion. The framework and analytic approach can be a potentially powerful generative research platform to inform development of rigorous eHealth examination and design instruments, such as to assess eHealth competence, to design and evaluate consumer eHealth tools, and to develop an eHealth curriculum.

Conflict of interest statement

None declared

Figures

Figure 1
Figure 1
Process of employing a framework to characterize eHealth demands and barriers.
Figure 2
Figure 2
Representation of the aggressive/conservative scale. The rows are as they appear in the actual table on the webpage except for the top row, which is included for clarity.
Figure 3
Figure 3
Hospital ratings task: distribution of participants’ scores on questions A, B, and C, and average (Avg) scores for each question.
Figure 4
Figure 4
Number of barriers encountered by participants in each step, with labels for the steps that constitute questions A, B, and C.
Figure 5
Figure 5
Barriers encountered by participants (n = 20) in steps 10–16, categorized by literacy (color in legend) and complexity level (number in the graph).

References

    1. Eysenbach G. What is e-health? J Med Internet Res. 2001;3(2):E20. doi: 10.2196/jmir.3.2.e20.
    1. Jimison H, Gorman P, Woods S, Nygren P, Walker M, Norris S, Hersh W. Barriers and drivers of health information technology use for the elderly, chronically ill, and underserved. Evid Rep Technol Assess (Full Rep) 2008 Nov;(175):1–1422.
    1. Demiris G, Afrin LB, Speedie S, Courtney KL, Sondhi M, Vimarlund V, Lovis C, Goossen W, Lynch C. Patient-centered applications: use of information technology to promote disease management and wellness. A white paper by the AMIA knowledge in motion working group. J Am Med Inform Assoc. 2008;15(1):8–13. doi: 10.1197/jamia.M2492. M2492
    1. Karkalis GI, Koutsouris DD. E-health and the Web 2.0. Proceedings of the ITAB; The International Special Topic Conference on Information Technology in Biomedicine; Oct 26-28, 2006; Ioannina, Greece. 2006.
    1. Giustini D. How Web 2.0 is changing medicine. BMJ. 2006 Dec 23;333(7582):1283–4. doi: 10.1136/bmj.39062.555405.80.333/7582/1283
    1. Viswanath K, Kreuter MW. Health disparities, communication inequalities, and eHealth. Am J Prev Med. 2007 May;32(5 Suppl):S131–3. doi: 10.1016/j.amepre.2007.02.012.S0749-3797(07)00100-6
    1. Fox S. The engaged e-patient population. Washington, DC: Pew Internet & American Life Project; 2008. Aug 26, [2011-01-29]. .
    1. Chapman G, Elstein A. Cognitive processes and biases in medical decision making. In: Chapman G, Sonnenberg F, editors. Decision Making in Health Care: Theory, Psychology, and Applications. New York, NY: Cambridge University Press; 2000. p. 183.
    1. Eysenbach G, Powell J, Kuss O, Sa ER. Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002;287(20):2691–700. jrv10005
    1. Jaffery JB, Becker BN. Evaluation of eHealth web sites for patients with chronic kidney disease. Am J Kidney Dis. 2004 Jul;44(1):71–6.S0272638604005086
    1. McCray AT. Promoting health literacy. J Am Med Inform Assoc. 2005;12(2):152–63. doi: 10.1197/jamia.M1687. M1687
    1. McNeill LH, Puleo E, Bennett GG, Emmons KM. Exploring social contextual correlates of computer ownership and frequency of use among urban, low-income, public housing adult residents. J Med Internet Res. 2007;9(4):e35. doi: 10.2196/jmir.9.4.e35. v9i4e35
    1. Cashen MS, Dykes P, Gerber B. eHealth technology and Internet resources: barriers for vulnerable populations. J Cardiovasc Nurs. 2004;19(3):209–14; quiz 215.
    1. Fox S. Digital divisions. Washington, DC: Pew Internet & American Life Project; 2005. Oct 05, [2011-09-22]. .
    1. Zeng QT, Kogan S, Plovnick RM, Crowell J, Lacroix EM, Greenes RA. Positive attitudes and failed queries: an exploration of the conundrums of consumer health information retrieval. Int J Med Inform. 2004 Feb;73(1):45–55. doi: 10.1016/j.ijmedinf.2003.12.015.S1386505603002211
    1. Kim EH, Stolyar A, Lober WB, Herbaugh AL, Shinstrom SE, Zierler BK, Soh CB, Kim Y. Challenges to using an electronic personal health record by a low-income elderly population. J Med Internet Res. 2009;11(4):e44. doi: 10.2196/jmir.1256. v11i4e44
    1. Kaufman DR, Patel VL, Hilliman C, Morin PC, Pevzner J, Weinstock RS, Goland R, Shea S, Starren J. Usability in the real world: assessing medical information technologies in patients' homes. J Biomed Inform. 2003 Apr;36(1-2):45–60.S153204640300056X
    1. McCaffery KJ, Smith SK, Wolf M. The challenge of shared decision making among patients with lower literacy: a framework for research and development. Med Decis Making. 2010;30(1):35–44. doi: 10.1177/0272989X09342279.0272989X09342279
    1. Kamel Boulos MN, Wheeler S. The emerging Web 2.0 social software: an enabling suite of sociable technologies in health and health care education. Health Info Libr J. 2007 Mar;24(1):2–23. doi: 10.1111/j.1471-1842.2007.00701.x.HIR701
    1. Eng TR, Maxfield A, Patrick K, Deering MJ, Ratzan SC, Gustafson DH. Access to health information and support: a public highway or a private road? JAMA. 1998 Oct 21;280(15):1371–5.jpp80018
    1. Botts N, Horan TA. Bridging care communication and health management within diverse and underserved populations. Proceedings; 14th Americas Conference on Information Systems; Aug 14-17, 2008; Toronto, ON, Canada. 2008.
    1. Chan CV, Matthews LA, Kaufman DR. A taxonomy characterizing complexity of consumer eHealth Literacy. AMIA Annu Symp Proc. 2009;2009:86–90.
    1. Norman CD, Skinner HA. eHealth Literacy: Essential Skills for Consumer Health in a Networked World. J Med Internet Res. 2006;8(2):e9. doi: 10.2196/jmir.8.2.e9. v8i2e9
    1. Larkin BG, Burton KJ. Evaluating a case study using Bloom's Taxonomy of Education. AORN J. 2008 Sep;88(3):390–402. doi: 10.1016/j.aorn.2008.04.020.S0001-2092(08)00324-4
    1. Pickard M. The new Bloom's taxonomy: an overview for family and consumer sciences. J Fam Consum Sci Educ. 2007;25(1):45–55.
    1. Reeves M. An application of Bloom's taxonomy to the teaching of business ethics. J Bus Ethics. 1990;9(7):609–16. doi: 10.1007/BF00383217.
    1. Catts R, Lau J. UNESCO. 2008. [2011-01-29]. Towards Information Literacy Indicators .
    1. Thoman E. Skills and strategies for media education. Educ Leadership. 1999;56(5):50–4.
    1. Ancker JS, Kaufman D. Rethinking health numeracy: a multidisciplinary literature review. J Am Med Inform Assoc. 2007;14(6):713–21. doi: 10.1197/jamia.M2464. M2464
    1. Rudd RE, Moeykens BA, Colton TC. Health and literacy: a review of medical and public health literature. In: Comings J, Garners B, Smith C, editors. Annual Review of Adult Learning and Literacy. San Francisco, CA: Jossey-Bass; 2000. pp. 158–99.
    1. Laugksch RC. Scientific literacy: a conceptual overview. Sci Educ. 2000;84(1):71–94. doi: 10.1002/(SICI)1098-237X(200001)84:1<71::AID-SCE6>;2-C.
    1. Rudd R, Kirsch I, Yamamoto K. Policy Information Center, Educational Testing Service. 2004. [2011-01-29]. Literacy and Health in America: Policy Information Report .
    1. Krathwohl DR. A revision of Bloom's taxonomy: an overview. Theory Into Pract. 2002;41(4):212–8.
    1. Amer A. Reflections on Bloom's revised taxonomy. [2011-05-31];Electronic J Res Educ Psychol. 2006 (1):213–30. .
    1. Roth E, Patterson E, Mumaw R. Marciniak JJ. Encyclopedia of Software Engineering. 2nd edition. New York, NY: John Wiley; 2002. Cognitive engineering: issues in user-centered system design; pp. 163–79.
    1. Patel VL, Arocha JF, Kaufman DR. A primer on aspects of cognition for medical informatics. J Am Med Inform Assoc. 2001;8(4):324–43.
    1. Patel V, Kaufman D. Cognitive science and biomedical informatics. In: Shortliffe E, Cimino J, editors. Biomedical Informatics: Computer Applications in Health Care and Biomedicine. 3rd edition. New York, NY: Springer; 2006. pp. 133–85.
    1. Schraagen J, Chipman S, Shalin V. Cognitive Task Analysis. Mahwah, NJ: Erlbaum; 2000.
    1. Ericsson KA, Simon HA. Protocol Analysis: Verbal Reports as Data. Revised edition. Cambridge, MA: MIT Press; 1993.
    1. Cotton D, Gresty K. Reflecting on the think-aloud method for evaluating e-learning. Br J Educ Technol. 2006;37(1):45–54. doi: 10.1111/j.1467-8535.2005.00521.x.
    1. Clark MC, Czaja SJ, Weber RA. Older adults and daily living task profiles. Hum Factors. 1990 Oct;32(5):537–49.
    1. Zarcadoolas C, Pleasant A, Greer DS. Understanding health literacy: an expanded model. Health Promot Int. 2005 Jun;20(2):195–203. doi: 10.1093/heapro/dah609. dah609
    1. Nielsen-Bohlman L, Panzer AM, Kindig DA. Health Literacy: A Prescription to End Confusion. Washington, DC: National Academies Press; 2004.
    1. Britto MT, Jimison HB, Munafo JK, Wissman J, Rogers ML, Hersh W. Usability testing finds problems for novice users of pediatric portals. J Am Med Inform Assoc. 2009;16(5):660–9. doi: 10.1197/jamia.M3154. M3154
    1. Epstein RM, Alper BS, Quill TE. Communicating evidence for participatory decision making. JAMA. 2004 May 19;291(19):2359–66. doi: 10.1001/jama.291.19.2359. 291/19/2359
    1. National Science Board . Science and Engineering Indicators 2006. Arlington, VA: National Science Foundation; 2006. [2011-05-31]. .
    1. Nielsen J. Heuristic evaluation. In: Nielsen J, Mack RL, editors. Usability Inspection Methods. New York, NY: Wiley; 1994. pp. 25–62.

Source: PubMed

3
購読する