Multilevel Interventions to Enhance Provider Recommendations for HPV Vaccination

"Less Pain, Less Fuss, Right Now!" and "Make It Count!"--Multilevel Interventions for Patient, Parent, and Practice to Enhance Provider Recommendations for HPV Vaccination

Each year the human papillomavirus (HPV) causes 30,000 cancers in the United States despite the availability of very effective and safe vaccines. Uptake of the HPV vaccine has been disappointingly low and lags behind other adolescent vaccines. This study seeks to test interventions targeting health care system, provider, and patient factors to improve the population uptake of the HPV vaccine.

Study Overview

• Status: Completed
• Conditions: Papillomavirus Vaccines
• Intervention / Treatment: Behavioral: Current care; Behavioral: Reminder-recall; Behavioral: Combined reminder-recall and audit-and-feedback; Behavioral: Audit-and-feedback

Detailed Description

The broad, long-term objective is to substantially increase human papillomavirus (HPV) vaccination rates by deploying effective population-health interventions in clinical practices across the United States. As part of this effort, the investigators intend to evaluate two evidence-based interventions with innovative enhancements at six Mayo Clinic primary care practices (PCP) to evaluate their individual and combined impact on rates of HPV vaccination among female and male patients. Aim 1, "Less Pain, Less Fuss, Right Now!", will test the hypothesis that, as compared to no intervention (current practice), a practice-level intervention utilizing reminder-recalls featuring the availability of non-medication and medication anesthetics, the convenience of nurse-only visits, and the use of persuasive language for early, on-time vaccinations will improve HPV vaccine delivery rates. Aim 2, "Make It Count!", will test the hypothesis that, as compared to no intervention, a provider level intervention utilizing a missed-opportunities assessment and feedback intervention applying social pressure (specific peer-performance comparisons) and equipping providers with a strong-recommendation toolkit will improve HPV vaccine delivery rates. Aim 3 will test the hypothesis that simultaneous implementation of interventions targeting individual, interpersonal, and organizational factors will have a synergistic effect on HPV vaccine delivery rates. To accomplish Aims 1-3, the investigators will use a stepped-wedge cluster randomized trial with an integrated process evaluation. The cluster approach prevents cross-contamination between patients or providers as we allocate two separate interventions (Aims 1 and 2) in the six PCPs. The stepped-wedge design, which ensures all practices eventually receive the same set of interventions, permits the single institutional review board overseeing all six PCPs to approve the study without requiring recruitment and consent of individual patients or providers. The stepped-wedge approach also permits the investigators to test the presence of each of the interventions in each PCP, making trial participation more attractive, while also allowing each practice to serve as its own control, reducing the bias due to imbalanced risk factors across practices. The factorial design allows the investigators to use a single trial to test two interventions and assess each individually and in combination. The design also conserves sample size while maintaining power. The investigators will measure the impact separately in females and males, 11-12 years of age for the rates of receipt of HPV vaccine doses due. Rigorously tested, highly effective, population-level interventions are essential if the US is to reach the Healthy People 2020 goal for HPV vaccination. The rigor, design, and high likelihood of success of this study will provide key evidence regarding practice- and provider-level interventions to improve HPV vaccination rates. Mayo Clinic's best practices inform not only its own 70 practices across five states but its Mayo Clinic Care Network, which consists of nearly 40 health-care organizations across 26 states and Puerto Rico.

• Study Type: Interventional
• Enrollment (Actual): 9242
• Phase: Not Applicable

Contacts and Locations

Study Locations

• United States
  • Minnesota
    • Rochester, Minnesota, United States, 55905
      • Mayo Clinic

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 11 years to 12 years (Child)
• Accepts Healthy Volunteers: No

Description

Inclusion Criteria:

• Empaneled in one of the six participating primary care practices
• 11 to 12 years of age at the first day of each of the 12-month-long steps
• Due during that 12-month-long step for at least one dose of the HPV vaccine

Exclusion Criteria:

• Not empaneled in one of the six participating practices
• Empaneled in one of the six participating practices but less than 11 years of age or more than 12 years of age on the first day of each 12 month long step
• Not due during that 12-month-long step for a dose of HPV vaccine.

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Prevention
• Allocation: Randomized
• Interventional Model: Factorial Assignment
• Masking: Single

Number of Arms

6

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Other: Practice A; Practice A will consist of the eligible patients empaneled to one of the six participating practices. In the first step, Practice A will be assigned to receive the current care intervention. in the second step, Practice A will be assigned to receive the current care intervention. In the third step, Practice A will receive the reminder-recall intervention. In the fourth step, Practice A will receive the combined reminder-recall and audit-and-feedback intervention.	Behavioral: Current care; The current care arm consists of the contemporary efforts now in practice to support provider recommendation including a shared, standard immunization schedule, a shared rooming process, a shared well child visit schedule, a shared electronic prompt at point-of-care of vaccines due.; Other Names: Active control, active comparator, current practice; Behavioral: Reminder-recall; The communication will use expectant (announcement-style or presumptive) language noting the child's HPV vaccination status and stating that the child's provider strongly recommends the child receive the HPV vaccination now. The communication will also describe availability of topical anesthetics (less pain), indicate the availability and convenience of nurse visits for HPV vaccination (less fuss), and describe the immunological and logistical benefits of early vaccination (right now).; Other Names: "Less Pain, Less Fuss, Right Now!" reminder-recall; Behavioral: Combined reminder-recall and audit-and-feedback; The combination reminder-and-audit arm consists of a simultaneous application of the intervention tested in the reminder-recall arm and the intervention tested in the audit-and-feedback arm.; Other Names: "Less Pain, Less Fuss, Right Now!" and "Make It Count!"
Other: Practice B; Practice B will consist of the eligible patients empaneled to one of the six participating practices. In the first step, Practice B will be assigned to receive the current care intervention. In the second step, Practice B will be assigned to receive the reminder-recall intervention. In the third step, Practice B will receive the combined reminder-recall and audit-and-feedback intervention. In the fourth step, Practice A will receive the combined reminder-recall and audit-and-feedback intervention.	Behavioral: Current care; The current care arm consists of the contemporary efforts now in practice to support provider recommendation including a shared, standard immunization schedule, a shared rooming process, a shared well child visit schedule, a shared electronic prompt at point-of-care of vaccines due.; Other Names: Active control, active comparator, current practice; Behavioral: Reminder-recall; The communication will use expectant (announcement-style or presumptive) language noting the child's HPV vaccination status and stating that the child's provider strongly recommends the child receive the HPV vaccination now. The communication will also describe availability of topical anesthetics (less pain), indicate the availability and convenience of nurse visits for HPV vaccination (less fuss), and describe the immunological and logistical benefits of early vaccination (right now).; Other Names: "Less Pain, Less Fuss, Right Now!" reminder-recall; Behavioral: Combined reminder-recall and audit-and-feedback; The combination reminder-and-audit arm consists of a simultaneous application of the intervention tested in the reminder-recall arm and the intervention tested in the audit-and-feedback arm.; Other Names: "Less Pain, Less Fuss, Right Now!" and "Make It Count!"
Other: Practice C; Practice C will consist of the eligible patients empaneled to one of the six participating practices. In the first step, Practice C will be assigned to receive the current care intervention. In the second step, Practice C will be assigned to receive the audit-and-feedback intervention. In the third step, Practice C will receive the audit-and-feedback intervention. In the fourth step, Practice C will receive the combined reminder-recall and audit-and-feedback intervention.	Behavioral: Current care; The current care arm consists of the contemporary efforts now in practice to support provider recommendation including a shared, standard immunization schedule, a shared rooming process, a shared well child visit schedule, a shared electronic prompt at point-of-care of vaccines due.; Other Names: Active control, active comparator, current practice; Behavioral: Combined reminder-recall and audit-and-feedback; The combination reminder-and-audit arm consists of a simultaneous application of the intervention tested in the reminder-recall arm and the intervention tested in the audit-and-feedback arm.; Other Names: "Less Pain, Less Fuss, Right Now!" and "Make It Count!"; Behavioral: Audit-and-feedback; The intervention includes two components. The first is a missed opportunities audit-and-feedback. The second is a provision of a strong recommendation provider-toolkit, along with a broad education of the practice staff-nurses, medical secretaries, receptionists, and clinical assistants-regarding the nature of the intervention, its goals, and its likely impact on the practice. The broad education will be conducted through supervisory communications only to practice staff in practices allocated to the intervention at the beginning of the step.; Other Names: "Make It Count!" audit-and-feedback & provider toolkit
Other: Practice D; Practice D will consist of the eligible patients empaneled to one of the six participating practices. In the first step, Practice D will be assigned to receive the current care intervention. In the second step, Practice D will be assigned to receive the current care intervention. In the third step, Practice D will receive the audit-and-feedback intervention. In the fourth step, Practice D will receive the combined reminder-recall and audit-and-feedback intervention.	Behavioral: Current care; The current care arm consists of the contemporary efforts now in practice to support provider recommendation including a shared, standard immunization schedule, a shared rooming process, a shared well child visit schedule, a shared electronic prompt at point-of-care of vaccines due.; Other Names: Active control, active comparator, current practice; Behavioral: Combined reminder-recall and audit-and-feedback; The combination reminder-and-audit arm consists of a simultaneous application of the intervention tested in the reminder-recall arm and the intervention tested in the audit-and-feedback arm.; Other Names: "Less Pain, Less Fuss, Right Now!" and "Make It Count!"; Behavioral: Audit-and-feedback; The intervention includes two components. The first is a missed opportunities audit-and-feedback. The second is a provision of a strong recommendation provider-toolkit, along with a broad education of the practice staff-nurses, medical secretaries, receptionists, and clinical assistants-regarding the nature of the intervention, its goals, and its likely impact on the practice. The broad education will be conducted through supervisory communications only to practice staff in practices allocated to the intervention at the beginning of the step.; Other Names: "Make It Count!" audit-and-feedback & provider toolkit
Other: Practice E; Practice E will consist of the eligible patients empaneled to one of the six participating practices. In the first step, Practice E will be assigned to receive the current care intervention. In the second step, Practice E will be assigned to receive the reminder-recall intervention. In the third step, Practice E will receive the reminder-recall intervention. In the fourth step, Practice E will receive the combined reminder-recall and audit-and-feedback intervention.	Behavioral: Current care; The current care arm consists of the contemporary efforts now in practice to support provider recommendation including a shared, standard immunization schedule, a shared rooming process, a shared well child visit schedule, a shared electronic prompt at point-of-care of vaccines due.; Other Names: Active control, active comparator, current practice; Behavioral: Reminder-recall; The communication will use expectant (announcement-style or presumptive) language noting the child's HPV vaccination status and stating that the child's provider strongly recommends the child receive the HPV vaccination now. The communication will also describe availability of topical anesthetics (less pain), indicate the availability and convenience of nurse visits for HPV vaccination (less fuss), and describe the immunological and logistical benefits of early vaccination (right now).; Other Names: "Less Pain, Less Fuss, Right Now!" reminder-recall; Behavioral: Combined reminder-recall and audit-and-feedback; The combination reminder-and-audit arm consists of a simultaneous application of the intervention tested in the reminder-recall arm and the intervention tested in the audit-and-feedback arm.; Other Names: "Less Pain, Less Fuss, Right Now!" and "Make It Count!"
Other: Practice F; Practice F will consist of the eligible patients empaneled to one of the six participating practices. In the first step, Practice F will be assigned to receive the current care intervention. In the second step, Practice F will be assigned to receive the audit-and-feedback intervention. In the third step, Practice F will receive the combined reminder-recall and audit-and-feedback intervention. In the fourth step, Practice F will receive the combined reminder-recall and audit-and-feedback intervention.	Behavioral: Current care; The current care arm consists of the contemporary efforts now in practice to support provider recommendation including a shared, standard immunization schedule, a shared rooming process, a shared well child visit schedule, a shared electronic prompt at point-of-care of vaccines due.; Other Names: Active control, active comparator, current practice; Behavioral: Combined reminder-recall and audit-and-feedback; The combination reminder-and-audit arm consists of a simultaneous application of the intervention tested in the reminder-recall arm and the intervention tested in the audit-and-feedback arm.; Other Names: "Less Pain, Less Fuss, Right Now!" and "Make It Count!"; Behavioral: Audit-and-feedback; The intervention includes two components. The first is a missed opportunities audit-and-feedback. The second is a provision of a strong recommendation provider-toolkit, along with a broad education of the practice staff-nurses, medical secretaries, receptionists, and clinical assistants-regarding the nature of the intervention, its goals, and its likely impact on the practice. The broad education will be conducted through supervisory communications only to practice staff in practices allocated to the intervention at the beginning of the step.; Other Names: "Make It Count!" audit-and-feedback & provider toolkit

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Human Papillomavirus or HPV-vaccine-dose Receipt	The outcome measure was the proportion of empaneled, HPV-vaccine-dose eligible males and females in the study step who received the dose of HPV vaccine dose due by the end of the study step.	The dose had to have been received during the 12-month-long study step.

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Initiation	The outcome measure was the proportion of empaneled, HPV-vaccine-dose eligible males and females due for their first doses of the HPV vaccine series in the study step who received the first dose of HPV vaccine dose due by the end of the study step, thus initiating the HPV vaccine series.	The initiating dose had to have been received during the 12-month-long study step.
Completion	The outcome measure was the proportion of empaneled, HPV-vaccine-dose eligible males and females due for their final doses of the HPV vaccine series in the study step who received the final dose of HPV vaccine dose due by the end of the study step, thus completing the HPV vaccine series.	The final dose had to have been received during the 12-month-long study step.

Other Outcome Measures

Outcome Measure	Measure Description	Time Frame
HPV-vaccine-dose Receipt in Females	The outcome measure was the proportion of empaneled, HPV-vaccine-dose eligible females in the study step who received the dose of HPV vaccine dose due by the end of the study step.	The dose had to have been received during the 12-month-long study step.
HPV-vaccine-dose Receipt in Males	The outcome measure was the proportion of empaneled, HPV-vaccine-dose eligible males in the study step who received the dose of HPV vaccine dose due by the end of the study step.	The dose had to have been received during the 12-month-long study step.

Collaborators and Investigators

• Sponsor: Mayo Clinic
• Collaborators: National Cancer Institute (NCI)
• Investigators: Principal Investigator: Robert M Jacobson, MD, Mayo Clinic; Principal Investigator: Joan M Griffin, PhD, Mayo Clinic

Publications and helpful links

General Publications

• Finney Rutten LJ, Radecki Breitkopf C, St Sauver JL, Croghan IT, Jacobson DJ, Wilson PM, Herrin J, Jacobson RM. Evaluating the impact of multilevel evidence-based implementation strategies to enhance provider recommendation on human papillomavirus vaccination rates among an empaneled primary care patient population: a study protocol for a stepped-wedge cluster randomized trial. Implement Sci. 2018 Jul 13;13(1):96. doi: 10.1186/s13012-018-0778-x.
• Finney Rutten LJ, Griffin JM, St Sauver JL, MacLaughlin K, Austin JD, Jenkins G, Herrin J, Jacobson RM. Multilevel Implementation Strategies for Adolescent Human Papillomavirus Vaccine Uptake: A Cluster Randomized Clinical Trial. JAMA Pediatr. 2024 Jan 1;178(1):29-36. doi: 10.1001/jamapediatrics.2023.4932.

Helpful Links

• Mayo Clinic Clinical Trials

Study record dates

Study Major Dates

• Study Start (Actual): April 1, 2018
• Primary Completion (Actual): August 31, 2022
• Study Completion (Actual): September 1, 2023

Study Registration Dates

• First Submitted: January 25, 2018
• First Submitted That Met QC Criteria: April 10, 2018
• First Posted (Actual): April 18, 2018

Study Record Updates

• Last Update Posted (Actual): October 24, 2024
• Last Update Submitted That Met QC Criteria: September 30, 2024
• Last Verified: September 1, 2024

More Information

Terms related to this study

• Keywords: Child; Neoplasms; Primary health care; Vaccination; Primary prevention; Parents; Patient acceptance of health care; Papillomavirus vaccines; Health personnel
• Other Study ID Numbers: 17-010661; R01CA217889 (U.S. NIH Grant/Contract)

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No