Text and Talk: A Multi-level Intervention to Increase Provider HPV Vaccine Recommendation Effectiveness (Text&Talk)

Text and Talk: A Multi-level Intervention to Increase Provider HPV Vaccine Recommendation Effectiveness - Part 4: Randomized Controlled Trial

This study will test the effectiveness of two interventions (parent-targeted text messages and a brief clinician-targeted training) at increasing HPV vaccination among 11- to 12-year-olds living in Florida.

Study Overview

• Status: Active, not recruiting
• Conditions: HPV
• Intervention / Treatment: Behavioral: Brief Provider Training - Bundled Approach; Behavioral: Parent Interactive Text Message - Bundled Approach; Behavioral: Parent Interactive Text Message - Benefits Approach; Behavioral: Brief Provider Training - Benefits Approach

Detailed Description

Random Assignment: The study will test the hypotheses with a doubly randomized, two-level nested design for testing two nested implementation factors. Randomization will occur at two levels: the clinic and patient/parent. A group randomized trial forms the basis of randomization.

The study will randomly assign a fixed number of 30 clinics (and the providers within each clinic) equally to one of three provider trainings: (1) bundled training (n=10 clinics), (2) benefits training (n=10 clinics), and (3) no training (n=10 clinics). All providers in each clinic will be invited to participate in the assigned training. The investigators anticipate an average of 2 providers per clinic. The study will stratify by baseline vaccination rates to ensure balance across the three groups. The investigators chose to assign provider trainings at the clinic level because it is more feasible to conduct one training at each clinic and it limits the potential for contamination between providers.

The second level of randomization will occur among patients/parents. The investigators anticipate between 70-100 adolescents per clinic. The study will randomly assign parents (nested within clinic) equally to one of three text message groups: (1) bundled (n=30), (2) benefits (n=30), and (3) no messages (n=30). Inclusion criteria are: 10 , 11 , and 12-year-olds, attended the clinic in the past two years, and do not have records of changing providers or receiving the adolescent vaccines. Randomization will include 10-year-olds because text messages will be sent just prior to the adolescents' 11th birthday. The study will stratify text message assignment by patient biologic sex because of large differences in HPV vaccination and possible differential effectiveness of text messages. To ensure auditability, separate SAS programs will be written for the two levels of randomization.

Delivery of interventions: At each clinic randomized to training, providers will be invited to participate in a group-based training occurring over Zoom. Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on increasing the providers' intention to recommend the vaccine. Following best practices, each provider training will have a combination of activities (presentation, concrete skills development, role-play, and feedback), will be learner-centered, and engaging. Training will include: (A) presentation of HPV vaccination background; (B) the approach explanation, script, and a video-recorded example of a provider talking to a parent; (C) practicing prepared role play scenarios in small groups; and (D) an explanation of the follow-up, audio-recorded trainings. For part B, the bundled training will include existing nationally endorsed materials.

The study will audio-record thee visits with each provider to give individual feedback, to offer boosters (e.g., script review or barrier discussions) to providers who are lower than 80% adherent, and to evaluate provider adherence to assigned approaches. To increase the trialability, providers will be encouraged to use a standardized form to record their vaccine recommendations with their next ten patients and compare the HPV vaccination rates to their preceding ten patients.

For feasibility of scale-up and dissemination, text messages will be sent from clinics to parents by integrating our message content and timing into the clinic's existing appointment reminder system. The study will restrict recruitment to clinics with appointment reminder systems. If integration is not feasible or preferable to a clinic, study staff will facilitate texting.

Parents will be sent the interactive text messages as part of the clinics' quality improvement efforts. Each clinic will send the text messages from their appointment reminder phone number so parents are aware the messages are from the clinic. Parents who have opted-out of clinic text messages or who did not provide the clinic with a text-enabled phone number will be sent an email or automated voicemail message. Text messages will include an opt-out option.

At the beginning of the study, text messages will be sent to the parents of all 11- to 12-year-olds who have attended each clinic within the past two years and do not have records of changing providers or receiving the adolescent vaccines. Throughout the study year, we will send a text message two weeks prior to the child's 11th birthday. Additional text messages will be sent to parents of 11- to 12-year-olds who have a clinic appointment during the study period at the same time as the texted appointment reminder. Parents who respond to the text message will receive an appointment scheduling call within two business days.

Statistical analysis accounting for clustered design. Throughout the analysis, the statistical team will be blinded to study arm assignments. Initially, descriptive statistics (rates and means with 95% confidence intervals (CIs) will be compared between implementation strategies (brief provider training and interactive text messages) and recommendation approaches (bundled versus benefits).

To achieve all four study aims and evaluate the process measures, the study will account for the clustered data with generalized linear mixed models (GLMMs; e.g., SAS PROC GLIMMIX) rather than generalized estimating equations (GEE) given the relatively small number of clusters (30 clinics) and the two levels of randomization. In all four aims, the primary outcomes are HPV vaccination (initiation and up-to-date): binary variables at the patient level. The GLMMs will assume a binomial distribution and use a log link, modeling risk (i.e., rates) of initiation and up-to-date and estimating rate ratios (RRs) between implementation strategies and recommendation approaches. Staying within the framework of RR will aid analysis of additive interactions (Aim 3). If convergence failure is an issue after exploring avoidance methods, we will use the logit link and make interpretations around odds of initiation and up-to-date.

Aims 1 and 2: Main Effects of Implementation Strategies on Outcomes. The study will test the main effects of our implementation strategies on HPV vaccination rates with the inference of the fixed effects. For inference on the fixed effects, we will use the between-within DDFM. To account for the nested design, we will include random effects for provider and clinic. Initially, the study will include a multiplicative interaction between provider training and parent text messages to examine if one implementation strategy modifies the effect of the other. If not significant (P>=0.05), as hypothesized, the investigators will remove the multiplicative interaction and focus inference on the main effects (Aim 2) and additive interactions (Aim 3). Given the stratified randomization, the investigators will adjust for baseline HPV vaccination rates and patient sex. The investigators will also examine patient sex and race/ethnicity as possible effect modifiers.

The secondary outcomes of interest are provider recommendation frequency (Aim 1) and patient clinic visits (Aim 2). Clinic visits will be analyzed as binary (yes/no) with similar modeling approaches described above. The study will also model number of clinic visits per patient, most likely using a zero-inflated Poisson model (accounting for the clustered data via random effects). The investigators will carefully examine the distribution of the provider recommendation frequency, which is measured as a percentage of patient encounters and will resemble continuous outcomes, to determine the appropriate distribution/link function of the GLMM. The unit of analysis is provider, and therefore, only a random effect of clinic is needed. For Aim 1, the investigators will also perform sensitivity analyses to adjust for provider adherence score.

Aim 3: Additive Interaction of the Implementation Strategies. The investigators will calculate the synergy index (S), which measures the extent to which the RR for concordant provider and parent recommendation approaches together is greater than the sum of the provider approach RR and parent approach RR (i.e., additive interaction). An S > 1 indicates synergy and S < 1 indicates antagonism between the two approaches. Standard error calculations for S will be estimated using standard software/modules based on the delta method. S is a commonly-used measure of additive interaction of treatments/interventions. The investigators will calculate this synergy to test the hypothesis associated with Aim 3.1 (testing the combined effectiveness of any provider and parent intervention), and the investigators will calculate it separately for Aim 3.2 (testing the combined effectiveness of concordant interventions).

Aim 4: Clinical Practice-Level Moderators of Implementation. To determine if the five specified clinical practice factors modify the implementation strategies' effectiveness, we will consider fixed effects for clinical practice factors on HPV vaccination, and assess the specified interactions between clinical practice factors and the implementation strategies.

Process Evaluation Analysis Plan. The study will evaluate the effectiveness of the implementation strategies on the process measures. For the provider training, the study will evaluate changes in the primary targeted construct, provider intent to vaccinate, before, immediately after, and a year after training. Mean levels of provider intent to vaccinate (a composite of Likert-scaled questions) will be estimated and compared across the three time points and across provider training arms via GLMMs as described above. For the interactive text messages, the primary targeted construct of parent salience is measured in a one-time survey of parents in all study arms. Parent salience rates will be estimated (with 95% CIs) and compared across the parent text message arms using a similar modeling approach (with a binary variable/logit link).

• Study Type: Interventional
• Enrollment (Estimated): 21110
• Phase: Not Applicable

Contacts and Locations

• Study Contact: Name: Stephanie Staras, PhD; Phone Number: 352-294-8299; Email: sstaras@ufl.edu
• Study Contact Backup: Name: Marta D Hansen, MBA; Phone Number: 352-627-9075; Email: m.hansen1@ufl.edu

Study Locations

• United States
  • Florida
    • Gainesville, Florida, United States, 32610
      • University of Florida

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 10 years and older (Child, Adult, Older Adult)
• Accepts Healthy Volunteers: Yes

Description

Inclusion Criteria:

Adolescents

• Age 10- to 12-years-old
• Visited participating clinic in past two years
• No records of the adolescent vaccines Parents
• Parent of adolescent meeting the above criteria
• Parent of 10- to 12-year-old Providers
• Provide 11 to 12-year-old patients primary care
• Practice at a participating clinic

Exclusion Criteria:

Adolescents

• Out of the age range for participation
• Previously opted-out of text messages
• No cell phone numbers on file at clinic

Parents/Providers

• Unwilling to consent to participation

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Health Services Research
• Allocation: Randomized
• Interventional Model: Factorial Assignment
• Masking: Single

Number of Arms

9

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Bundled clinician training and bundled text messages; Clinicians will receive bundled approach training and parents will receive bundled text messages.	Behavioral: Brief Provider Training - Bundled Approach; At each clinic randomized to bundled training, providers will be invited to participate in one, in-clinic, group-based training. Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on introducing the HPV vaccine in a bundle of the other two adolescent vaccines (Tdap and MenACWY).; Behavioral: Parent Interactive Text Message - Bundled Approach; Text messages sent to parents will focus on receiving all three adolescent vaccines.
Experimental: Bundled clinician training and benefits text messages; Clinicians will receive bundled approach training and parents will receive benefits text messages.	Behavioral: Brief Provider Training - Bundled Approach; At each clinic randomized to bundled training, providers will be invited to participate in one, in-clinic, group-based training. Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on introducing the HPV vaccine in a bundle of the other two adolescent vaccines (Tdap and MenACWY).; Behavioral: Parent Interactive Text Message - Benefits Approach; Text message will state that the HPV vaccine prevents cancer, is safe and effective, and is recommended for 11- to 12-year-olds.
Experimental: Bundled clinician training and no text messages; Clinicians will receive bundled approach training and parents will not receive any intervention text messages.	Behavioral: Brief Provider Training - Bundled Approach; At each clinic randomized to bundled training, providers will be invited to participate in one, in-clinic, group-based training. Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on introducing the HPV vaccine in a bundle of the other two adolescent vaccines (Tdap and MenACWY).
Experimental: Benefits clinician training and bundled text messages; Clinicians will receive benefits approach training and parents will receive bundled text messages.	Behavioral: Parent Interactive Text Message - Bundled Approach; Text messages sent to parents will focus on receiving all three adolescent vaccines.; Behavioral: Brief Provider Training - Benefits Approach; At each clinic randomized to benefits training, providers will be invited to participate in one, in-clinic, group-based training . Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on providers presenting the HPV vaccine as safe, best if received at 11- to 12-years of age, and prevents cancer.
Experimental: Benefits clinician training and benefits text messages; Clinicians will receive benefits approach training and parents will receive benefits text messages.	Behavioral: Parent Interactive Text Message - Benefits Approach; Text message will state that the HPV vaccine prevents cancer, is safe and effective, and is recommended for 11- to 12-year-olds.; Behavioral: Brief Provider Training - Benefits Approach; At each clinic randomized to benefits training, providers will be invited to participate in one, in-clinic, group-based training . Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on providers presenting the HPV vaccine as safe, best if received at 11- to 12-years of age, and prevents cancer.
Experimental: Benefits clinician training and no text messages; Clinicians will receive benefits approach training and parents will not receive any intervention text messages.	Behavioral: Brief Provider Training - Benefits Approach; At each clinic randomized to benefits training, providers will be invited to participate in one, in-clinic, group-based training . Each training will last one-hour and providers will receive continuing medical education (CME) credit for participating. Trainings will focus on providers presenting the HPV vaccine as safe, best if received at 11- to 12-years of age, and prevents cancer.
Experimental: Deferred-clinician training and bundled text messages; Clinicians will receive training after the study and parents will receive bundled text messages.	Behavioral: Parent Interactive Text Message - Bundled Approach; Text messages sent to parents will focus on receiving all three adolescent vaccines.
Experimental: Deferred-clinician training and benefits text messages; Clinicians will receive training after the study and parents will receive benefits text messages.	Behavioral: Parent Interactive Text Message - Benefits Approach; Text message will state that the HPV vaccine prevents cancer, is safe and effective, and is recommended for 11- to 12-year-olds.
No Intervention: Deferred-clinician training and no text messages; Clinicians will receive training after the study and parents will not receive intervention text messages.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Initiation of the HPV Vaccine	Binary measure at the participant level of receipt of one or more does of the HPV vaccine	24 months
Up to date for the HPV Vaccine	Binary measure at the participant level of receipt of two or more doses of the HPV vaccine	24 months

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Frequency of Provider recommendations	Average number of visits for 11- to 12-year-old patient visits for which the provider reports recommending the HPV vaccine/ number of 11- to 12-year-old patients provider completed survey about	12 months

Other Outcome Measures

Outcome Measure	Measure Description	Time Frame
Visited the clinic	Binary measure at the participant level of record of receiving care at the clinic - considered as any visit, well visits, and acute visits	24 months

Collaborators and Investigators

• Sponsor: University of Florida
• Collaborators: National Cancer Institute (NCI)
• Investigators: Principal Investigator: Stephanie Staras, PhD, University of Florida

Study record dates

Study Major Dates

• Study Start (Actual): November 18, 2021
• Primary Completion (Estimated): February 28, 2025
• Study Completion (Estimated): August 28, 2025

Study Registration Dates

• First Submitted: August 3, 2021
• First Submitted That Met QC Criteria: August 13, 2021
• First Posted (Actual): August 16, 2021

Study Record Updates

• Last Update Posted (Estimated): February 22, 2024
• Last Update Submitted That Met QC Criteria: February 21, 2024
• Last Verified: May 1, 2023

More Information

Terms related to this study

• Other Study ID Numbers: IRB202001633 -N; R37CA234030 (U.S. NIH Grant/Contract)

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: YES
• IPD Plan Description: Due to the possibility of identifying adolescents, providers, or clinic staff, and the study investigator's access to the immunization data only under data sharing agreements, data will be available to users only under a data-sharing agreement. Through shared data agreements, de-identified data and documentation will be available to certified researchers once the main findings from the final dataset are released. Investigators will be charged a nonrefundable fee to cover administrative handling chargers and user support. The data-sharing agreements will include a commitment to: (1) use the data only for research; (2) not attempt to identify individuals; (3) secure the data using appropriate computer technology; (4) destroying the data after analyses are completed; and (5) acknowledge the source of the data.
• IPD Sharing Time Frame: Once findings from the main study have been released.
• IPD Sharing Access Criteria: Investigators will complete a data-sharing agreement and be charged a nonrefundable fee to cover administrative handling chargers and user support.
• IPD Sharing Supporting Information Type: STUDY_PROTOCOL; ICF

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No