Quality of Web-Based Educational Interventions for Clinicians on Human Papillomavirus Vaccine: Content and Usability Assessment

Brittany L Rosen, James M Bishop, Skye L McDonald, Jessica A Kahn, Gary L Kreps, Brittany L Rosen, James M Bishop, Skye L McDonald, Jessica A Kahn, Gary L Kreps

Abstract

Background: Human papillomavirus (HPV) vaccination rates fall far short of Healthy People 2020 objectives. A leading reason is that clinicians do not recommend the vaccine consistently and strongly to girls and boys in the age group recommended for vaccination. Although Web-based HPV vaccine educational interventions for clinicians have been created to promote vaccination recommendations, rigorous evaluations of these interventions have not been conducted. Such evaluations are important to maximize the efficacy of educational interventions in promoting clinician recommendations for HPV vaccination.

Objective: The objectives of our study were (1) to expand previous research by systematically identifying HPV vaccine Web-based educational interventions developed for clinicians and (2) to evaluate the quality of these Web-based educational interventions as defined by access, content, design, user evaluation, interactivity, and use of theory or models to create the interventions.

Methods: Current HPV vaccine Web-based educational interventions were identified from general search engines (ie, Google), continuing medical education search engines, health department websites, and professional organization websites. Web-based educational interventions were included if they were created for clinicians (defined as individuals qualified to deliver health care services, such as physicians, clinical nurses, and school nurses, to patients aged 9 to 26 years), delivered information about the HPV vaccine and how to increase vaccination rates, and provided continuing education credits. The interventions' content and usability were analyzed using 6 key indicators: access, content, design, evaluation, interactivity, and use of theory or models.

Results: A total of 21 interventions were identified, out of which 7 (33%) were webinars, 7 (33%) were videos or lectures, and 7 (33%) were other (eg, text articles, website modules). Of the 21 interventions, 17 (81%) identified the purpose of the intervention, 12 (57%) provided the date that the information had been updated (7 of these were updated within the last 6 months), 14 (67%) provided the participants with the opportunity to provide feedback on the intervention, and 5 (24%) provided an interactive component. None of the educational interventions explicitly stated that a theory or model was used to develop the intervention.

Conclusions: This analysis demonstrates that a substantial proportion of Web-based HPV vaccine educational interventions has not been developed using established health education and design principles. Interventions designed using these principles may increase strong and consistent HPV vaccination recommendations by clinicians.

Keywords: health personnel; internet; papillomavirus vaccines; program evaluation.

Conflict of interest statement

Conflicts of Interest: None declared.

©Brittany L Rosen, James M Bishop, Skye L McDonald, Jessica A Kahn, Gary L Kreps. Originally published in JMIR Cancer (http://cancer.jmir.org), 16.02.2018.

References

    1. CDC. 2017. Mar 06, HPV-Associated Cancer Statistics .
    1. Brown LM, Check DP, Devesa SS. Oropharyngeal cancer incidence trends: diminishing racial disparities. Cancer Causes Control. 2011 May;22(5):753–63. doi: 10.1007/s10552-011-9748-1.
    1. Hocking JS, Stein A, Conway EL, Regan D, Grulich A, Law M, Brotherton JM. Head and neck cancer in Australia between 1982 and 2005 show increasing incidence of potentially HPV-associated oropharyngeal cancers. Br J Cancer. 2011 Mar 1;104(5):886–91. doi: 10.1038/sj.bjc.6606091. doi: 10.1038/sj.bjc.6606091.
    1. Reddy VM, Cundall-Curry D, Bridger MW. Trends in the incidence rates of tonsil and base of tongue cancer in England, 1985-2006. Ann R Coll Surg Engl. 2010 Nov;92(8):655–9. doi: 10.1308/003588410X12699663904871.
    1. Petrosky E, Bocchini Jr JA, Hariri S, Chesson H, Curtis CR, Saraiya M, Unger ER, Markowitz LE, Centers for Disease Control and Prevention (CDC) Use of 9-valent human papillomavirus (HPV) vaccine: updated HPV vaccination recommendations of the advisory committee on immunization practices. MMWR Morb Mortal Wkly Rep. 2015 Mar 27;64(11):300–4.
    1. Saraiya M. Population-based HPV genotype attribution in HPV-associated cancers. Proceedings of the Anal Intraepithelial Neoplasia Society Conference; March 13-15, 2015; Atlanta, Georgia. 2017.
    1. Reagan-Steiner S, Yankey D, Jeyarajah J, Elam-Evans LD, Curtis CR, MacNeil J, Markowitz LE, Singleton JA. National, regional, state, and selected local area vaccination coverage among adolescents aged 13-17 years - United States, 2015. MMWR Morb Mortal Wkly Rep. 2016 Aug 26;65(33):850–8. doi: 10.15585/mmwr.mm6533a4. doi: 10.15585/mmwr.mm6533a4.
    1. Healthy People. [2017-09-21]. Immunization and infectious diseases .
    1. Centers for Disease Control and Prevention (CDC) Human papillomavirus vaccination coverage among adolescent girls, 2007-2012, and postlicensure vaccine safety monitoring, 2006-2013 - United States. MMWR Morb Mortal Wkly Rep. 2013 Jul 26;62(29):591–5.
    1. Quinn GP, Murphy D, Malo TL, Christie J, Vadaparampil ST. A national survey about human papillomavirus vaccination: what we didn't ask, but physicians wanted us to know. J Pediatr Adolesc Gynecol. 2012 Aug;25(4):254–8. doi: 10.1016/j.jpag.2012.02.007.
    1. Vadaparampil ST, Murphy D, Rodriguez M, Malo TL, Quinn GP. Qualitative responses to a national physician survey on HPV vaccination. Vaccine. 2013 Apr 26;31(18):2267–72. doi: 10.1016/j.vaccine.2013.02.063.
    1. Daley MF, Crane LA, Markowitz LE, Black SR, Beaty BL, Barrow J, Babbel C, Gottlieb SL, Liddon N, Stokley S, Dickinson LM, Kempe A. Human papillomavirus vaccination practices: a survey of US physicians 18 months after licensure. Pediatrics. 2010 Sep;126(3):425–33. doi: 10.1542/peds.2009-3500.
    1. Perkins RB, Clark JA. What affects human papillomavirus vaccination rates? A qualitative analysis of providers' perceptions. Womens Health Issues. 2012;22(4):e379–86. doi: 10.1016/j.whi.2012.04.001.
    1. McCave EL. Influential factors in HPV vaccination uptake among providers in four states. J Community Health. 2010 Dec;35(6):645–52. doi: 10.1007/s10900-010-9255-4.
    1. Perkins RB, Clark JA. Providers' attitudes toward human papillomavirus vaccination in young men: challenges for implementation of 2011 recommendations. Am J Mens Health. 2012 Jul;6(4):320–3. doi: 10.1177/1557988312438911.
    1. Yarnall KS, Pollak KI, Østbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003 Apr;93(4):635–41.
    1. Solberg LI, Nordin JD, Bryant TL, Kristensen AH, Maloney SK. Clinical preventive services for adolescents. Am J Prev Med. 2009 Nov;37(5):445–54. doi: 10.1016/j.amepre.2009.06.017.
    1. Yarnall KS, Østbye T, Krause KM, Pollak KI, Gradison M, Michener JL. Family physicians as team leaders: “time” to share the care. Prev Chronic Dis. 2009 Apr;6(2):A59.
    1. Holman DM, Benard V, Roland KB, Watson M, Liddon N, Stokley S. Barriers to human papillomavirus vaccination among US adolescents: a systematic review of the literature. JAMA Pediatr. 2014 Jan;168(1):76–82. doi: 10.1001/jamapediatrics.2013.2752.
    1. Kimmel SR. Adolescent vaccination: physician challenges and solutions. J Adolesc Health. 2010 Feb;46(2):S16–S23. doi: 10.1016/j.jadohealth.2009.11.219.
    1. Constantine NA, Jerman P. Acceptance of human papillomavirus vaccination among Californian parents of daughters: a representative statewide analysis. J Adolesc Health. 2007 Feb;40(2):108–15. doi: 10.1016/j.jadohealth.2006.10.007.
    1. Guerry SL, De Rosa CJ, Markowitz LE, Walker S, Liddon N, Kerndt PR, Gottlieb SL. Human papillomavirus vaccine initiation among adolescent girls in high-risk communities. Vaccine. 2011 Mar 9;29(12):2235–41. doi: 10.1016/j.vaccine.2011.01.052.
    1. Perkins RB, Pierre-Joseph N, Marquez C, Iloka S, Clark JA. Why do low-income minority parents choose human papillomavirus vaccination for their daughters? J Pediatr. 2010 Oct;157(4):617–22. doi: 10.1016/j.jpeds.2010.04.013.
    1. Litton AG, Desmond RA, Gilliland J, Huh WK, Franklin FA. Factors associated with intention to vaccinate a daughter against HPV: a statewide survey in Alabama. J Pediatr Adolesc Gynecol. 2011 Jun;24(3):166–71. doi: 10.1016/j.jpag.2011.01.004.
    1. Dorell C, Yankey D, Strasser S. Parent-reported reasons for nonreceipt of recommended adolescent vaccinations, national immunization survey: teen, 2009. Clin Pediatr (Phila) 2011 Dec;50(12):1116–24. doi: 10.1177/0009922811415104.
    1. Rosenthal SL, Weiss TW, Zimet GD, Ma L, Good MB, Vichnin MD. Predictors of HPV vaccine uptake among women aged 19-26: importance of a physician's recommendation. Vaccine. 2011 Jan 29;29(5):890–5. doi: 10.1016/j.vaccine.2009.12.063.
    1. Saraiya M, Rosser JI, Cooper CP. Cancers that U.S. physicians believe the HPV vaccine prevents: findings from a physician survey, 2009. J Womens Health (Larchmt) 2012 Feb;21(2):111–7. doi: 10.1089/jwh.2011.3313.
    1. Gowda C, Schaffer S, Dombkowski K, Dempsey A. Understanding attitudes toward adolescent vaccination and the decision-making dynamic among adolescents, parents and providers. BMC Public Health. 2012;12:509.
    1. Bruno DM, Wilson TE, Gany F, Aragones A. Identifying human papillomavirus vaccination practices among primary care providers of minority, low-income and immigrant patient populations. Vaccine. 2014;32(33):4149–54.
    1. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med. 2010 May;85(5):909–22. doi: 10.1097/ACM.0b013e3181d6c319.
    1. Olivieri JJ, Knoll MB, Arn PH. Education format and resource preferences among registrants of a pediatric-focused CME website. Med Teach. 2009;31(8):e333–7.
    1. Shaw T, Barnet S, Mcgregor D, Avery J. Using the knowledge, process, practice (KPP) model for driving the design and development of online postgraduate medical education. Med Teach. 2015;37(1):53–8.
    1. Goldberg H, McKhann G. Students test scores are improved in a virtual learning environment. Adv Physiol Educ. 2000;23(1):59–66.
    1. Harris JM, Novalis-Marine C, Harris RB. Women physicians are early adopters of on-line continuing medical education. J Contin Educ Health Prof. 2003;23(4):221–8.
    1. Neuhauser L, Paul K. Readability, comprehension and usability. In: Fischhoff B, Brewer NT, Downs JS, editors. Communicating Risks and Benefits: An Evidence Based User's Guide. Silver Spring, MD: US Department of Health and Human Services; 2011. pp. 129–48.
    1. Kreps GL. Strategic use of communication to market cancer prevention and control to vulnerable populations. Health Mark Q. 2008;25(1-2):204–16. doi: 10.1080/07359680802126327.
    1. Fordis M, King JE, Ballantyne CM, Jones PH, Schneider KH, Spann SJ, Greenberg SB, Greisinger AJ. Comparison of the instructional efficacy of Internet-based CME with live interactive CME workshops: a randomized controlled trial. J Am Med Assoc. 2005 Sep 7;294(9):1043–51. doi: 10.1001/jama.294.9.1043.
    1. Allison JJ, Kiefe CI, Wall T, Casebeer L, Ray MN, Spettell CM, Hook 3rd EW, Oh MK, Person SD, Weissman NW. Multicomponent Internet continuing medical education to promote chlamydia screening. Am J Prev Med. 2005 Apr;28(3):285–90. doi: 10.1016/j.amepre.2004.12.013.
    1. Casebeer LL, Strasser SM, Spettell CM, Wall TC, Weissman N, Ray MN, Allison JJ. Designing tailored Web-based instruction to improve practicing physicians' preventive practices. J Med Internet Res. 2003;5(3):e20. doi: 10.2196/jmir.5.3.e20.
    1. Carney PA, Dietrich AJ, Freeman Jr DH, Mott LA. A standardized-patient assessment of a continuing medical education program to improve physicians' cancer-control clinical skills. Acad Med. 1995 Jan;70(1):52–8.
    1. Harris Jr JM, Kutob RM, Surprenant ZJ, Maiuro RD, Delate TA. Can Internet-based education improve physician confidence in dealing with domestic violence? Fam Med. 2002 Apr;34(4):287–92.
    1. Marinopoulos SS, Dorman T, Ratanawongsa N, Wilson LM, Ashar BH, Magaziner JL, Miller RG, Thomas PA, Prokopowicz GP, Qayyum R, Bass EB. AHRQ. 2007. [2018-02-07]. Effectiveness of Continuing Medical Education .
    1. Rosen BL, Kreps G, Shepard A. Content and usability evaluation of HPV vaccine online educational interventions for clinicians. Proceeding of the American Academy of Health Behavior 2017 Annual Scientific Meeting; March 19-22, 2017; Tucson, Arizona. 2017.
    1. Kreps GL. Translating health communication research into practice: the importance of implementing and sustaining evidence-based health communication interventions. Atlantic J Commun. 2012 Jan 25;20(1):5–15. doi: 10.1080/15456870.2012.637024.
    1. Kreps GL. Evaluating new health information technologies: expanding the frontiers of health care delivery and health promotion. Stud Health Technol Inform. 2002;80:205–12.
    1. Kreps GL. Translating health communication research into practice: the influence of health communication scholarship on health policy, pratice, and outcomes. In: Thompson TL, Parrott R, Nussbaum JF, editors. The handbook of health communication. 2nd edition. New York, NY: Routledge; 2011. pp. 595–608.
    1. Kreps GL. Epilogue: lessons learned about evaluating health communication programs. J Health Commun. 2014 Dec;19(12):1510–4. doi: 10.1080/10810730.2014.954085.
    1. Cho H, Salmon CT. Unintended effects of health communication campaigns. J Commun. 2007 Jun;57(2):293–317. doi: 10.1111/j.1460-2466.2007.00344.x.
    1. Ringold DJ. Boomerang effects in response to public health interventions: some unintended consequences in the alcoholic beverage market. J Consumer Policy. 2002;25(1):27–63. doi: 10.1023/A:1014588126336.
    1. Neuhauser L, Kreps GL. Integrating design science theory and methods to improve the development and evaluation of health communication programs. J Health Commun. 2014;19(12):1460–71. doi: 10.1080/10810730.2014.954081.
    1. Centers for Medicare and Medicaid Services . National health care expenditures data. Report. Baltimore, MD: CMS. Office of the Actuary, National Health Statistics Group; 2012.
    1. Kreps GL. Evaluating health communication programs to enhance health care and health promotion. J Health Commun. 2014;19(12):1449–59. doi: 10.1080/10810730.2014.954080.
    1. Kim P, Eng TR, Deering MJ, Maxfield A. Review of published criteria for evaluating health-related websites. West J Med. 1999;170(6):329–32.
    1. Evers KE, Prochaska JM, Prochaska JO, Driskell M, Cummins CO, Velicer WF. Strengths and weaknesses of health behavior change programs on the internet. J Health Psychol. 2003 Jan;8(1):63–70. doi: 10.1177/1359105303008001435.
    1. Cummins CO, Prochaska JO, Driskell MM, Evers KE, Wright JA, Prochaska JM, Velicer WF. Development of review criteria to evaluate health behavior change websites. J Health Psychol. 2003 Jan;8(1):55–62. doi: 10.1177/1359105303008001434.
    1. Yen P, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc. 2012 Jun;19(3):413–22. doi: 10.1136/amiajnl-2010-000020.
    1. De Swert K. [2017-09-21]. Calculating inter-coder reliability in media content analysis using Krippendorff’s Alpha .
    1. Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007 Apr;1(1):77–89. doi: 10.1080/19312450709336664.
    1. Caskey R, Lindau ST, Alexander GC. Knowledge and early adoption of the HPV vaccine among girls and young women: results of a national survey. J Adolesc Health. 2009 Nov;45(5):453–62. doi: 10.1016/j.jadohealth.2009.04.021.
    1. Conroy K, Rosenthal SL, Zimet GD, Jin Y, Bernstein DI, Glynn S, Kahn JA. Human papillomavirus vaccine uptake, predictors of vaccination, and self-reported barriers to vaccination. J Womens Health (Larchmt) 2009 Oct;18(10):1679–86. doi: 10.1089/jwh.2008.1329.
    1. Gamble HL, Klosky JL, Parra GR, Randolph ME. Factors influencing familial decision-making regarding human papillomavirus vaccination. J Pediatr Psychol. 2010 Aug;35(7):704–15. doi: 10.1093/jpepsy/jsp108.
    1. Do H, Seng P, Talbot J, Acorda E, Coronado GD, Taylor VM. HPV vaccine knowledge and beliefs among Cambodian American parents and community leaders. Asian Pac J Cancer Prev. 2009;10(3):339–44.
    1. Pickering LK, Baker CJ, Freed GL, Gall SA, Grogg SE, Poland GA, Rodewald LE, Schaffner W, Stinchfield P, Tan L, Zimmerman RK, Orenstein WA, Infectious Diseases Society of America Immunization programs for infants, children, adolescents, and adults: clinical practice guidelines by the Infectious Diseases Society of America. Clin Infect Dis. 2009 Sep 15;49(6):817–40. doi: 10.1086/605430.
    1. Hillenbrand KM. What is going on with vaccines: keeping up with the childhood immunization schedule. J Public Health Manag Pract. 2007;13(6):544–52. doi: 10.1097/01.PHH.0000296128.54767.d7.
    1. Bynum SA, Malo TL, Lee J, Guiliano AR, Vadaparampil ST. HPV vaccine information-seeking behaviors among US physicians: government, media, or colleagues? Vaccine. 2011 Jul 18;29(32):5090–3. doi: 10.1016/j.vaccine.2011.04.134.
    1. Verhoeven F, Steehouder MF, Hendrix RM, van Germert-Pijnen JE. Factors affecting health care workers' adoption of a website with infection control guidelines. Int J Med Inform. 2009 Oct;78(10):663–78. doi: 10.1016/j.ijmedinf.2009.06.001.
    1. Harris JK, Provan KG, Johnson KJ, Leischow SJ. Drawbacks and benefits associated with inter-organizational collaboration along the discovery-development-delivery continuum: a cancer research network case study. Implement Sci. 2012 Jul 25;7:69. doi: 10.1186/1748-5908-7-69.
    1. Rosen BL, Ashwood D, Richardson GB. School nurses' professional practice in the HPV vaccine decision making process. J Sch Nurs. 2016 Apr;32(2):138–48. doi: 10.1177/1059840515583312.
    1. Alexander AB, Best C, Stupiansky N, Zimet GD. A model of health care provider decision making about HPV vaccination in adolescent males. Vaccine. 2015 Aug 7;33(33):4081–6. doi: 10.1016/j.vaccine.2015.06.085.
    1. Young JL, Bernheim RG, Korte JE, Stoler MH, Guterbock TM, Rice LW. Human papillomavirus vaccination recommendation may be linked to reimbursement: a survey of Virginia family practitioners and gynecologists. J Pediatr Adolesc Gynecol. 2011 Dec;24(6):380–5. doi: 10.1016/j.jpag.2011.06.016.
    1. Henrikson NB, Tuzzio L, Gilkey MB, McRee AL. “You're never really off time”: Healthcare providers' interpretations of optimal timing for HPV vaccination. Prev Med Rep. 2016;4:94–7. doi: 10.1016/j.pmedr.2016.05.002.
    1. Boom JA, Nelson CS, Laufman LE, Kohrt AE, Kozinetz CA. Improvement in provider immunization knowledge and behaviors following a peer education intervention. Clin Pediatr (Phila) 2007 Oct;46(8):706–17. doi: 10.1177/0009922807301484.
    1. Berenson AB, Rahman M, Hirth JM, Rupp RE, Sarpong KO. A brief educational intervention increases providers' human papillomavirus vaccine knowledge. Hum Vaccin Immunother. 2015;11(6):1331–6. doi: 10.1080/21645515.2015.1022691.
    1. Moss JL, Reiter PL, Dayton A, Brewer NT. Increasing adolescent immunization by webinar: a brief provider intervention at federally qualified health centers. Vaccine. 2012 Jul 13;30(33):4960–3. doi: 10.1016/j.vaccine.2012.05.042.
    1. Gilkey MB, Dayton AM, Moss JL, Sparks AC, Grimshaw AH, Bowling JM, Brewer NT. Increasing provision of adolescent vaccines in primary care: a randomized controlled trial. Pediatrics. 2014 Aug;134(2):e346–53. doi: 10.1542/peds.2013-4257.
    1. Kreps GL, Neuhauser L. New directions in eHealth communication: opportunities and challenges. Patient Educ Couns. 2010 Mar;78(3):329–36. doi: 10.1016/j.pec.2010.01.013.
    1. Neuhauser L, Kreps GL, Morrison K, Athanasoulis M, Kirienko N, Van Brunt D. Using design science and artificial intelligence to improve health communication: chronologyMD case example. Patient Educ Couns. 2013 Aug;92(2):211–7. doi: 10.1016/j.pec.2013.04.006.

Source: PubMed

スポンサーと協力者

医学的状態

薬物療法

3
購読する