- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT07314697
Arrival Time Implementation
This is a prospective clinical trial evaluating how behaviorally informed message framing can improve patient on-time arrival for outpatient visits. This trial is being implemented in conjunction with UCLA Health's broader operational quality improvement (QI) efforts to enhance clinic flow and patient experience.
The main question it aims to answer is how displaying an explicit arrival time (set to 15 minutes before the scheduled appointment) affects when patients arrive for their appointments, compared to a control condition where only the appointment time is displayed and patients are encouraged to arrive 15 min before the appointment (without an explicit arrival time).
Study Overview
Status
Conditions
Detailed Description
Timely patient arrival is essential for maintaining efficient clinic operations and ensuring patients receive the full duration of their scheduled care. Late arrivals disrupt clinic flow, reduce time with providers, and can delay subsequent appointments, creating a ripple effect across the day. This project aims to test a low-cost behavioral intervention that clarifies arrival expectations and promotes on-time arrival for scheduled appointments.
This study evaluates the effectiveness of an intervention designed to make the expected arrival time more salient to patients. The study will be implemented across outpatient departments that deliver primary care as part of UCLA Health's operational improvement initiative to improve clinic flow and patient experience.
Specifically, the intervention modifies how appointment information is presented to patients (or proxies in the case of patients < 18 years old) through two communication channels used by UCLA Health: (1) the patient portal (called MyChart at UCLA Health) and (2) the text messaging platform (called Hello World at UCLA Health), which sends patients automated text notifications prior to their appointment.
Control Condition On the MyChart home page, patients see only the scheduled appointment time (e.g., "Starts at 3:00 PM") for their upcoming appointments. Within the appointment details page, patients see their appointment time and an additional instruction to "Arrive 15 minutes before your appointment." Text notifications state the appointment time and include a prompt to arrive 15 minutes early (e.g., "[Patient name], you have an upcoming visit on 12 Jan 2026 at 3:00pm. Arrive 15 minutes before your appointment time").
Treatment Condition On the MyChart home page, patients see an explicit arrival time for their upcoming appointments, set to 15 minutes before the scheduled appointment time (e.g., "Arrive by 2:45 PM" for an appointment scheduled at 3PM), instead of the appointment time itself. Within the appointment details page, patients see their appointment time as well as the arrival time.
Text notifications explicitly tell patients their expected arrival time, instead of their appointment time (e.g., "[Patient name], you have an upcoming visit on 12 Jan 2026. Arrive by 2:45pm.")
The investigators will implement a cluster randomization, assigning all in-person physician or advanced practice provider (APP) appointments within the same clinic building to the same experimental condition. A total of 37 clinic buildings will be included. The investigators plan to run this clinical trial for 6 months. The arrival time functionality will be implemented 1 month before the start of the trial period to introduce a washout period.
Key Research Question:
The investigators ask the following research question: Does displaying an explicit arrival time change how early patients arrive for their appointments? The investigators hypothesize that the treatment will lead people to arrive earlier for their appointments, relative to the control condition.
In addition to examining the continuous measure of how far ahead a patient checks in for their appointments (the primary outcome measures), the investigators will also examine two binary metrics:
A. On-time arrival: Does the treatment lead patients to be more likely to arrive on time (i.e., check in before or at the scheduled appointment time)?.
B. Early arrival: Does the treatment condition increase patients' likelihood of arriving at least 15 minutes before their scheduled appointment time?
Analysis Plan:
The investigators will use ordinary least squares (OLS) regressions with robust standard errors to predict outcome variables. Statistical inferences will be based on model-robust standard errors clustered at the clinic building level, which is the unit of randomization. All analyses will be conducted at the appointment level. The primary predictor will be an indicator for whether the patient's clinic was assigned to the arrival time treatment condition (vs. standard appointment time control).
These regressions will be run with and without the following control variables:
- Patient age (If there will be missing values, the investigators will replace with the mean and add a dummy variable to indicate patients with missing age)
- Patient gender
- Patient race/ethnicity
- Patient punctuality: The proportion of the patient's in-person physician appointments at the same clinic in the past 36 months prior to the start of the trial for which they arrived on time (Patients with no completed appointments during this period will have missing data. For these cases, the investigators will impute the sample mean and add a dummy variable to indicate these patients). If we cannot have patient visit history for 36 months prior to the start of the trial, we will instead control for the proportion of the patient's in-person physician appointment at UCLA Health (across all clinics) for which they arrived on time (excluding walk-in appointment)
- Visit type (adult vs child; new vs. return)
- An indicator for whether the clinic operated using appointment schedules in 15/30 minute slots or 20/40 minute slots
- Insurance type (Traditional Medicare, Medicare Advantage, Medicaid, Commercial, other/unknown)
- Multimorbidity score (If there are missing values , the investigators will replace with the mean and add a dummy variable to indicate patients with a missing multimorbidity score)
The following mutually exclusive binary indicators to account for differences in (1) whether an appointment has been scheduled before the arrival-time functionality was implemented and (2) how far in advance an appointment was scheduled :
- Scheduled before functionality implementation: Indicator for appointments that were scheduled before the arrival-time functionality was implemented
- Scheduled >7 days in advance: Indicator for appointments scheduled on or after the implementation date with more than 7 days between scheduling and appointment date.
- Scheduled 1-7 days in advance: Indicator for appointments scheduled on or after the implementation date with 1 to 7 days between scheduling and appointment date.
- Scheduled <1 day in advance: Indicator for appointments scheduled on or after the implementation date with less than 1 day between scheduling and appointment date.
As an exploratory analysis, the investigators will examine treatment effects only among appointments scheduled on or after the functionality implementation date, since the appointment confirmation text notifications received by those patients will reflect the experimental design.
For robustness checks, the investigators will conduct logit models for binary outcomes and re-estimate models for the continuous arrival-time outcome at the 1st and 99th percentiles (which is a wider winsorization range than the range specified in the primary outcome section later).
Note: Some patients may have multiple eligible encounters during the study window. The main analyses will include only the first encounter per patient. Exploratory analyses will assess whether including subsequent encounters changes the results.
To test for heterogeneous treatment effects, the investigators will estimate interaction models in which the treatment indicator is interacted with patient, visit, or clinic characteristics. The investigators will analyze the following moderators:
- Patient-level punctuality as defined above (To account for missing values, the regression models will interact the treatment indicator with both the imputed punctuality rate and the missingness indicator)
- How many times patients have attended a physician appointment at that same clinic in the 36 months prior to the start of the trial
- Whether the clinic department schedules appointments in 15/30 minute slots or 20/40 minute slots
- Clinic's baseline punctuality rate: percentage of appointments that were on time (checked in ≤ 0 minutes late) in the six months prior to the trial
- Visit type (adult vs. child)
- Appointment scheduling time (four mutually exclusive subgroups): Whether the appointment was scheduled before the arrival-time functionality was implemented vs. it was scheduled after the functionality was implemented but more than 7 days before the scheduled visit date vs. 1-7 days, vs. <1 day before the scheduled visit date.
- Multimorbidity score (To account for missing values, the regression models will interact the treatment indicator with both the imputed multimorbidity score and the missingness indicator)
The investigators will conduct additional exploratory analyses to examine potential downstream consequences of the intervention:
- Appointment attendance The investigators will explore whether the treatment condition affects no-show rates relative to the control condition. Explicitly displaying an earlier requested arrival time could potentially increase no-shows if some patients believe they have already missed their appointment window or feel discouraged from coming when they realize they cannot arrive by the requested time.
Patient satisfaction:
The investigators will explore whether assignment to the treatment condition affects patient satisfaction ratings in post-visit surveys, by focusing on two binary outcomes that allow for an intent-to-treat analysis:
A. Whether the patient leaves a bad review (this variable equals 1 if the patient gives 1 or 2 stars out of 5 stars and 0 if the patient gives a higher star rating or does not provide a star rating) B. Whether the patient leaves a good review (this variable equals 1 if the patient gives 5 stars and 0 if the patient gives a lower rating or does not provide a star rating).
The investigators will conduct text analyses of patients' qualitative comments in the surveys to assess sentiment and sources of concerns or compliments.
- Appointment cancellations The investigators will test whether the treatment condition affects cancellation rates relative to the control condition. This analysis will help determine whether the "Arrive By" framing has any unintended effect on patients' likelihood of cancelling rather than attending their appointment.
- Clinic workflow metrics:
The investigators will examine whether the treatment influences the following two operational metrics within the clinic:
A. Patient room time: the number of minutes between the patient's check-in and the time they are placed in the exam room.
B. Time when physician enters the exam room: the number of minutes between the scheduled appointment time and when the provider enters the room.
C. Time between check-in and provider entry: Number of minutes between the patient's check-in and the time the provider enters the exam room.
The investigators will use quantile regressions for this set of analyses. These exploratory measures provide insight into whether improved punctuality translates into smoother clinic flow or changes in patient wait time. These measures are likely noisy as the time when patients are placed in the exam room or are seen by the provider are not always recorded in real time.
Study Type
Enrollment (Estimated)
Phase
- Not Applicable
Contacts and Locations
Study Locations
-
-
California
-
Los Angeles, California, United States, 90095
- Recruiting
- UCLA Health Department of Medicine, Quality Office
-
Contact:
- Richard Leuchter
- Phone Number: 3109488828
- Email: rleuchter@mednet.ucla.edu
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- In-person outpatient appointments with clinicians at UCLA Health that fall into the study period
- Appointments scheduled for the department specialties of Primary Care, Pediatrics, or Internal Medicine, Med Peds
- Has an active MyChart status
- Opted in to receive SMS communications from UCLA Health
Appointments classified as the following visit types:
- Return
- Well adult (physical)
- Well child return
- New
- Well adult new (physical)
- Well child (new)
Exclusion Criteria:
- Appointments at clinics that are not scheduled through the Patient Access Organization
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Health Services Research
- Allocation: Randomized
- Interventional Model: Parallel Assignment
- Masking: Double
Arms and Interventions
Participant Group / Arm |
Intervention / Treatment |
|---|---|
|
Active Comparator: Arm 1: Appointment time
Patients will receive appointment communications via the MyChart patient portal and Hello World text notifications that display their appointment time.
|
In the MyChart patient portal homepage, the appointment widget will show "Starts at [Appointment Time]." The appointment details page will display appointment time, along with the instructions to arrive 15 minutes before the appointment. The Hello World text notifications will tell patients : "Your visit is scheduled for [Date] at [Appointment Time]. Please arrive 15 minutes before your appointment time." |
|
Experimental: Arm 2: Arrival time
Patients will receive appointment communications via the MyChart patient portal and Hello World text notifications that display their expected arrival time, set to 15 minutes before their scheduled appointment time.
|
In the MyChart patient portal homepage, the appointment widget will show "Arrive by [Arrival Time]," replacing the standard "Starts at [Appointment Time]" display. The appointment details page will show appointment time, along with a reminder to "Arrive by [Arrival Time]." The Hello World text notifications will tell patients: "Your visit is scheduled for [Date]. Arrive by [Arrival Time]." |
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Difference between patient's arrival time and scheduled appointment time
Time Frame: 1 day, day of appointment
|
The number of minutes between the patient's check-in time and the scheduled appointment time.
A positive (negative) value indicates that the patient arrived before (after) the scheduled appointment time.Winsorization at the 0.5th and 99.5th percentiles will be applied.
|
1 day, day of appointment
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
On-time arrival
Time Frame: 1 day, day of appointment
|
Indicator for whether the patient checks in before/at the scheduled appointment time (as opposed to arriving later than the appointment time)
|
1 day, day of appointment
|
|
Early arrival
Time Frame: 1 day, day of appointment
|
Indicator for whether the patient checks in at least 15 minutes before the scheduled appointment time
|
1 day, day of appointment
|
Collaborators and Investigators
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Estimated)
Study Completion (Estimated)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Actual)
Study Record Updates
Last Update Posted (Actual)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Keywords
Other Study ID Numbers
- OTA_arrival_time
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Primary Care
-
University of EdinburghEnrolling by invitationPalliative Care | Primary Care | Primary Care PhysicianArgentina
-
McMaster UniversityUnknownPalliative Care | Satisfaction | Primary CareCanada
-
Duke UniversityCompleted
-
University of CoimbraCompletedPalliative Care | Primary Health CarePortugal
-
Bert LeysenIntermutualistic Agency; National Institute for Health and Disability Insurance...CompletedPalliative Care | Primary Health CareBelgium
-
University of Beira InteriorWithdrawnPalliative Care | Primary Health Care | GeriatricsPortugal
-
Veteran Affairs Office of Patient Care ServicesVA Office of Research and Development; VA Palo Alto Health Care System; VHA Primary...CompletedPrimary Health Care | Health Care Costs
-
VA Office of Research and DevelopmentVA Palo Alto Health Care System; Veteran Affairs Office of Patient Care ServicesCompletedPrimary Health Care | Health Care Costs
-
University of Colorado, DenverCompletedPrimary Health Care | Advance Care PlanningUnited States
-
Veteran Affairs Office of Patient Care ServicesVA Office of Research and Development; VA Palo Alto Health Care System; VHA Primary...CompletedPrimary Health Care | Health Care CostsUnited States
Clinical Trials on Control appointment communications
-
University of PennsylvaniaYale University; Stanford University; Harvard UniversityCompleted
-
Johns Hopkins Bloomberg School of Public HealthCompletedObesityUnited States
-
Abramson Cancer Center at Penn MedicineCompletedOvarian Cancer | Genetic Predisposition to Disease | Breast Cancer Female | Hereditary Diseases | Gene Mutation-Related Cancer | Hereditary Breast and Ovarian Cancer | Hereditary Cancer SyndromeUnited States
-
University of South WalesBritish Red CrossWithdrawnMental Health Wellness 1United Kingdom
-
University of South WalesMIND CymruTerminated
-
University of AberdeenNHS Highland; Scottish Ambulance ServiceCompletedEmergency Medical Services | Emergency Service, HospitalUnited Kingdom
-
Talita ColomboHospital de Clinicas de Porto Alegre; McMaster University; VU University of Amsterdam and other collaboratorsNot yet recruitingCOVID-19 Pandemic | Prenatal Stress | Pregnancy; Mental DisordersBrazil
-
University of ChileActive, not recruiting
-
Connolly Hospital BlanchardstownCompletedOutpatients General Surgery Virtual ClinicIreland
-
Ohio State University Comprehensive Cancer CenterNational Cancer Institute (NCI)CompletedTobacco-Related CarcinomaUnited States