Behavioral Economics to Improve Flu Vaccination Using EHR Nudges (BE IMMUNE)

April 2, 2025 updated by: Shivan J Mehta, University of Pennsylvania

BE IMMUNE: Behavioral Economics to IMprove and Motivate Vaccination Using Nudges Through the EHR

This study will be a multisite, cluster randomized, pragmatic trial to evaluate the effectiveness of personalized nudges to clinicians and patients, relative to a control, to increase flu vaccination rates among older adults in accordance with CDC guidelines. This will include clinician and patient level nudge interventions, with an additional, intensified nudge intervention for patients identified as high risk for not receiving a flu vaccine. Among the intervention clinics, patients will receive pre-visit text message reminders about the flu vaccine, and clinicians will receive a default pended order in the visit encounter in the EHR, along with monthly peer comparison feedback about their flu vaccine completion rate. Patients identified as high risk for noncompletion will be individually randomized to receive an additional bidirectional text message nudge or the standard text messaging.

Study Overview

Status

Status

Indicates the current recruitment status or the expanded access status.
Completed

Conditions

Conditions

The disease, disorder, syndrome, illness, or injury that is being studied. On ClinicalTrials.gov, conditions may also include other health-related issues, such as lifespan, quality of life, and health risks.

Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.

Detailed Description

Many older adults are at risk of illness, hospitalization, and death from vaccine-preventable diseases. More than half of older adults in the United States are not vaccinated for flu which has remained relatively constant over the past decade, and there are racial, ethnic, and socioeconomic disparities in care. In this study, we will evaluate personalized nudges to clinicians and patients to help increase flu vaccination rates during primary care visits among older adults, with a particular focus on population subgroups at high risk for vaccine noncompletion. In a partnership between Penn Medicine and University of Washington (UW) Medicine, this will be a 6-month, multisite, cluster randomized, pragmatic trial with an additional intensification arm for high-risk patients.

Study Type

Study Type

Describes the nature of a clinical study. Study types include interventional studies (also called clinical trials), observational studies (including patient registries), and expanded access.
Interventional

Enrollment (Actual)

Enrollment

The number of participants in a clinical study. The "anticipated" enrollment is the target number of participants that the researchers need for the study.
80039

Phase

Phase

The stage of a clinical trial studying a drug or biological product, based on definitions developed by the U.S. Food and Drug Administration (FDA). The phase is based on the study's objective, the number of participants, and other characteristics. There are five phases: Early Phase 1 (formerly listed as Phase 0), Phase 1, Phase 2, Phase 3, and Phase 4. Not Applicable is used to describe trials without FDA-defined phases, including trials of devices or behavioral interventions.
  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Contact

Study Contact

The name and contact information for the person who can answer enrollment questions for a clinical study. Each location where the study is being conducted may also have a specific contact, who may be better able to answer those questions.

Study Contact Backup

Study Locations

  • United States
    • Pennsylvania
      • Philadelphia, Pennsylvania, United States, 19104
        • University of Pennsylvania Health System
    • Washington
      • Seattle, Washington, United States, 98195
        • University of Washington

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Eligibility Criteria

The key requirements that people who want to participate in a clinical study must meet or the characteristics they must have. Eligibility criteria consist of both inclusion criteria (which are required for a person to participate in the study) and exclusion criteria (which prevent a person from participating). Types of eligibility criteria include whether a study accepts healthy volunteers, has age or age group requirements, or is limited by sex.

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Description

Patient Inclusion Criteria:

All patients must meet the following criteria to be eligible:

  1. Age >50 years
  2. A scheduled new or return (non-urgent/sick) primary care appointment at one of the study practices at the Penn Medicine, UW Medicine, or Lancaster General Hospital
  3. Have not received their annual flu vaccine during the active intervention period (September- February)
  4. Eligible to receive the flu vaccine

For the high risk intensification nudge, at least one of the following criteria must be met to be considered high risk and randomized to receive the intensification nudge:

  1. Age ≥ 70 years
  2. Living in a lower income community (lowest quartile, zip-code based)
  3. Did not receive a flu vaccine in the previous calendar year
  4. Self-identifies as Non-Hispanic Black

Patient Exclusion Criteria:

  1. Have a documented allergy to flu vaccine
  2. Have a flu vaccine exclusion modifier in Health Maintenance
  3. Have opted out of research according to individual site guidelines and policies
  4. Have no phone number (home or mobile) listed in their chart

Clinician Inclusion Criteria:

Clinicians must meet the following criteria to be eligible to receive peer comparison feedback:

  1. Practicing physician (MD, DO) or advanced practice provider (NP, PA) with the exception of residents and fellows
  2. Have a minimum patient panel of at least 50 patients, and
  3. Practicing at a clinical site randomized to receive the clinic-level nudge interventions.

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Health Services Research
  • Allocation: Randomized
  • Interventional Model: Parallel Assignment
  • Masking: Double

Arms and Interventions

Participant Group / Arm

Participant Group / Arm

A group or subgroup of participants in a clinical trial that receives a specific intervention/treatment, or no intervention, according to the trial's protocol.
Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.
No Intervention: Control
Clinics randomized to the control arm will receive standard of care.
Experimental: Intervention Arm
Clinics randomized to the intervention arm will receive the toolkit of clinician and patient facing nudges. Patient nudges will be pre-visit text message reminders (standard messaging content). Clinician nudges will be monthly peer comparison feedback and default pended orders.
Behavioral: Pre-visit patient text messaging
Patients will be sent text message reminders 3 days and 24 hours prior to their scheduled primary care visit. The messages will inform the patient that a flu shot has been reserved for them at their upcoming appointment and encouraging the patient to ask their provider about receiving the vaccine.
Behavioral: Default pended order
A default pended order for the flu vaccine will be pended to the patient's upcoming primary care encounter and will be visible to the provider during the visit encounter. Clinical staff will have the option of signing the order or dismissing it if they deem it inappropriate for a given patient.
Behavioral: Monthly peer comparison feedback
Each month, clinicians will be sent an email containing what percent of their eligible patients received the flu vaccine and how that compares to other peer clinicians in the intervention.
Experimental: High Risk Intensification Arm
Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine will be randomized 1:1 to receive the high risk intensification arm or remain in the standard intervention arm. Patients in the high risk intensification arm will receive an additional bidirectional texting component.
Behavioral: Pre-visit patient text messaging
Patients will be sent text message reminders 3 days and 24 hours prior to their scheduled primary care visit. The messages will inform the patient that a flu shot has been reserved for them at their upcoming appointment and encouraging the patient to ask their provider about receiving the vaccine.
Behavioral: Default pended order
A default pended order for the flu vaccine will be pended to the patient's upcoming primary care encounter and will be visible to the provider during the visit encounter. Clinical staff will have the option of signing the order or dismissing it if they deem it inappropriate for a given patient.
Behavioral: Monthly peer comparison feedback
Each month, clinicians will be sent an email containing what percent of their eligible patients received the flu vaccine and how that compares to other peer clinicians in the intervention.
Behavioral: High risk bidirectional pre-visit text messaging
High risk patients randomized to receive the high risk intensification nudge will receive a bidirectional text messaging component prior to their visit. This intervention will query the patient about common questions or concerns about receiving the flu vaccine. If the patient responds, it will provide additional educational materials based on the patient's specific concern(s).

What is the study measuring?

Primary Outcome Measures

Primary Outcome Measures

In a clinical study's protocol, the planned outcome measure that is the most important for evaluating the effect of an intervention/treatment. Most clinical studies have one primary outcome measure, but some have more than one.
Outcome Measure
Measure Description
Time Frame
Proportion of Patients Who Receive the Flu Vaccine at the Visit
Time Frame: 4 days from enrollment, at the eligible visit
The primary outcome is flu vaccination completion during the first eligible primary care visit.
4 days from enrollment, at the eligible visit

Secondary Outcome Measures

Secondary Outcome Measures

In a clinical study's protocol, a planned outcome measure that is not as important as the primary outcome measure for evaluating the effect of an intervention but is still of interest. Most clinical studies have more than one secondary outcome measure.
Outcome Measure
Measure Description
Time Frame
Proportion of Patients Who Receive the Flu Vaccine Within 3 Months After the Visit
Time Frame: 3 months
The secondary outcome is flu vaccination completion within 3 months after the first eligible primary care visit.
3 months

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Sponsor

The organization or person who initiates the study and who has authority and control over the study.
University of Pennsylvania

Collaborators

Collaborators

An organization other than the sponsor that provides support for a clinical study. This support may include activities related to funding, design, implementation, data analysis, or reporting.
National Institute on Aging (NIA)
University of Washington

Investigators

Investigators

A researcher involved in a clinical study. Related terms include site principal investigator, site sub-investigator, study chair, study director, and study principal investigator.
  • Principal Investigator: Shivan Mehta, MD,MBA,MSHP, University of Pennsylvania

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

Study Start

The actual date on which the first participant was enrolled in a clinical study. The "anticipated" study start date is the date that the researchers think will be the study start date.
September 25, 2023

Primary Completion (Actual)

Primary Completion

The date on which the last participant in a clinical study was examined or received an intervention to collect final data for the primary outcome measure. Whether the clinical study ended according to the protocol or was terminated does not affect this date. For clinical studies with more than one primary outcome measure with different completion dates, this term refers to the date on which data collection is completed for all the primary outcome measures. The "anticipated" primary completion date is the date that the researchers think will be the primary completion date for the study.
February 20, 2024

Study Completion (Actual)

Study Completion

The date on which the last participant in a clinical study was examined or received an intervention/treatment to collect final data for the primary outcome measures, secondary outcome measures, and adverse events (that is, the last participant's last visit). The "anticipated" study completion date is the date that the researchers think will be the study completion date.
May 20, 2024

Study Registration Dates

First Submitted

First Submitted

The date on which the study sponsor or investigator first submitted a study record to ClinicalTrials.gov. There is typically a delay of a few days between the first submitted date and the record's availability on ClinicalTrials.gov (the first posted date).
September 18, 2023

First Submitted That Met QC Criteria

First Submitted That Met QC Criteria

The date on which the study sponsor or investigator first submits a study record that is consistent with National Library of Medicine (NLM) quality control (QC) review criteria. The sponsor or investigator may need to revise and submit a study record one or more times before NLM's QC review criteria are met. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
September 25, 2023

First Posted (Actual)

First Posted

The date on which the study record was first available on ClinicalTrials.gov after National Library of Medicine (NLM) quality control (QC) review has concluded. There is typically a delay of a few days between the date the study sponsor or investigator submitted the study record and the first posted date.
September 28, 2023

Study Record Updates

Last Update Posted (Actual)

Last Update Posted

The most recent date on which changes to a study record were made available on ClinicalTrials.gov. There may be a delay between when the changes were submitted to ClinicalTrials.gov by the study's sponsor or investigator (the last update submitted date) and the last update posted date.
April 27, 2025

Last Update Submitted That Met QC Criteria

Last Update Submitted That Met QC Criteria

The most recent date on which the study sponsor or investigator submitted changes to a study record that are consistent with National Library of Medicine (NLM) quality control (QC) review criteria. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
April 2, 2025

Last Verified

Last Verified

The most recent date on which the study sponsor or investigator confirmed the information about a clinical study on ClinicalTrials.gov as accurate and current. If a study with a recruitment status of recruiting; not yet recruiting; or active, not recruiting has not been confirmed within the past 2 years, the study's recruitment status is shown as unknown.
April 1, 2025

More Information

Terms related to this study

Keywords

Other Study ID Numbers

Other Study ID Numbers

Identifiers or ID numbers other than the NCT number that are assigned to a clinical study by the study's sponsor, funders, or others. These numbers may include unique identifiers from other trial registries and National Institutes of Health grant numbers.
  • 851838
  • R33AG068945 (U.S. NIH Grant/Contract)

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

YES

IPD Plan Description

We will share our analytical code(s).

IPD Sharing Time Frame

Within one year of trial completion

IPD Sharing Access Criteria

All inquiries related to the code should be directed to the PI.

IPD Sharing Supporting Information Type

  • STUDY_PROTOCOL
  • ANALYTIC_CODE

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Cookie Settings

We use cookies to ensure that we give you the best experience on our website. For more details carefully read our Privacy and Cookies Policy. ...>>>You can change your preferences or withdraw your consent at any time by deleting the cookies from your website or computer as described in the policy. Please accept it and choose your preferences by ticking the corresponding boxes in the "Manage Settings" section below. Please carefully read our Terms of Service before you proceed with using any part of this website.
«Manage Settings