Machine-based Algorithm for Increased Physical Activity and Sustained User Engagement
Machine-based Algorithm for Adjusting Activity Targets to Increase Physical Activity and Sustain User Engagement Among Telus Wellbeing Users
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Detailed Description
We partnered with Telus Health Inc. to begin to examine the effectiveness of a supervised ML algorithm integrated into their Telus Wellbeing corporate wellness app (iOS and Android versions), formerly known as "Sprout-At-Work". As of April 29, 2025, Telus Wellbeing was the employee wellness solution for more than 50 companies across 70 countries (i.e., approximately 90% of users registered within USA). At the time they reported over 400,000 registered users and about 100,000 monthly active users (MAUs; i.e., users who engage with the platform at least once a month). Download and use of the app is voluntary and of no financial cost to employees. The multi-component app is rooted in the core components of the three-layer Behaviour Change Wheel (BCW), a comprehensive framework for designing and evaluating behaviour change interventions.
Telus Wellbeing operationalizes the COM-B model, for example, by providing educational content and PA self-monitoring opportunities to build knowledge and skills (i.e., capability), offering features like peer-to-peer sharing and team challenges to foster social support (i.e., opportunity), and using FI (i.e., motivation) to drive goal achievement (see Supplementary File A for more details). Telus Wellbeing also addresses structural barriers (e.g., built environment), systemic challenges (e.g., socioeconomic disparities), and contextual factors (e.g., social norms) through the integration of promising BCTs. For example, by offering offline functionality (i.e., environment restructuring [12.1]), subsidies for wellness programs (i.e., material incentive [6.1]), and connecting users to local health services (i.e., social support [3.1]), Telus Wellbeing supports diverse user needs (Supplementary File A).
After downloading Telus Wellbeing, users can open the app and navigate through the landing and home page. On the home page, the number of steps completed that day and the users daily step goal are shown. Participants can click on two icons at the top of the home page. If the users click on the left icon, the history page is displayed. The history page allows participants to track their performance over the past week by showing their daily steps and daily goals on a color-coded bar graph. The green bar indicates the accomplishment of achieving the step goal on the corresponding day, and the red bar indicates failure to achieve the step goal on the corresponding day. The built-in health chip in the iPhone and Android devices collects the step data, and the accuracy of step counts collected by the iPhone and Android health chip has been validated in a number of studies to have comparable accuracy to an ActiGraph. The push notification for the app is also activated (if activated by the user), and the standard iOS and Android push notification is used. The push notification is visible in the landing page and in the recent notifications tab on the phone.
Eligible participants will start a five-week run-in period after downloading the app. The purpose of the run-in period is to collect baseline daily steps, and assess if the participant is able to comply with the requirements needed to regularly use the Telus Wellbeing app. During the run-in period, all participants in the control and the intervention groups will receive a traditional personalized daily step goal based on their historical step data. The machine learning algorithm will not be used to compute step goals for participants in the intervention group during the run-in period. Dynamically increasing step goals will be used in the run-in period to engage participants in using the app regularly. In addition, all participants will receive a push notification at 8:00 AM that provides the day's step goal, and if the participant accomplishes the goal before 8:00 PM, then another push notification will be sent to congratulate that participant on reaching their step goal for the day. The identical goals between the 2 groups during the run-in period is used to establish a reference level of initial physical activity, which will be used in the statistical analyses to compare the difference in daily steps between run-in and 12 weeks for the 2 groups. Data collected during the run-in period will be used by the machine learning algorithm to compute step goals for the intervention period. This is a valid approach because run-in data will be indicative of the preference of different participants. All participants will have been placed into one of two groups. The allocation of app users to groups will be implemented by Telus Health after the run-in period. After the five-week run-in period, participants in the control group will be provided with a personalized static daily step goal hrough the Telus Wellbeing app. Participants will receive a push notification at 8:00 AM every day that provides that day's step goal (10,000 steps), and if the participant achieves the goal before 8:00 PM, then another push notification will be sent to congratulate the participant on reaching their step goal (of 10,000 steps) for the day.
After the five-week run-in period, participants in the intervention group will receive adaptively personalized step goals through the Telus Wellbeing app. The daily step goals will be computed using machine learning on the complete history (past steps and goals) of the user. Machine learning will be applied every day to reduce variance in future steps and goals. Participants will receive a push notification at 8:00 AM every day that provides today's step goal, and if the participant accomplishes the goal before 8:00 PM, then another push notification will be sent to congratulate the participant on reaching their step goal for that day. Machine learning will adaptively compute personalized step goals that are predicted to maximize future physical activity for each participant based on all their past steps' data and goals of each participant. Machine learning is applied to each participant individually, and it consists of two main steps. The first step is to use all of the participant's data to construct a quantitative model that predicts how many steps the participant will take in the future, given a prescribed set of step goals, and an important aspect of the model is a component that describes how achieving goals in the present can increase the likelihood of achieving goals in the future. The second step is to use this quantitative model to select a sequence of step goals that maximizes the predicted future number of steps. To make the process of updating step goals adaptive, machine learning is applied each day (using all the users' past data) to generate step goals for the coming day. Moreover, the step goals computed by machine learning for the coming day are not constant but increase or decrease based on the model prediction. The Telus Wellbeing app will automatically track the participants' step counts each day and will provide goals regardless of their level of engagement within the app over the 12-week study period. As the data is being analyzed retrospectively, no "end of study" letter will be provided to participants. However, upon registering for the studies procedures, all users provided written informed consent for their data to be collected and analyzed.
Study Type
Study Type
Enrollment (Actual)
Enrollment
Phase
Phase
- Not Applicable
Contacts and Locations
Study Locations
-
-
Ontario
-
London, Ontario, Canada
- Western University
-
-
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- Adults aged 18 years or older
- User intent to become physically active in the next 12 weeks
- Own a smartphone device
- Willing to install and use the Telus Wellbeing app (which requires Internet connection) every day for 12 weeks
- Ability to speak and read English
Exclusion Criteria:
- Known medical conditions or physical problems that require special attention in a physical activity program
- Planning an international trip during the next 3 months, which could interfere with daily server uploads of mobile phone data
- Pregnant or gave birth during the past 6 months
- Current participation in lifestyle modification programs or research studies that may confound study results
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Treatment
- Allocation: Randomized
- Interventional Model: Parallel Assignment
- Masking: Single
Number of Arms
Arms and Interventions
Participant Group / ArmParticipant Group / Arm |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Experimental: Adaptive Step Goal (Intervention)
The 'Smart Mode' feature used a propriety ML algorithm to generate 16 user clusters based on daily step count patterns from approximately 100,000 global Telus Wellbeing users over the previous two years (March 1, 2020 to March 1, 2022; characteristics of these users unknown).
The algorithm then compared time series data from participants' five-week baseline against the repository of 16 user cluster patterns to determine to which cluster they would be assigned.
Once assigned, a difference in proportions was calculated (ratio of previous week's average daily step count over the step count goal for that week vs. ratio of average daily step count from two weeks prior over step count goal for that week [e.g., 8000 steps/7500 steps=1.067 vs. 8000 steps/9500 steps=0.8421]).
Chi-square testing was used to assess statistical significance of the difference (p<0.05).
This was done to determine whether the next calculated goal would go up, down, or stay the same.
|
Receiving automated personalized daily step goals,
|
|
Active Comparator: Static Step Goal (Control)
Over the course of the 12-week intervention period controls continued with their static daily step goal, equivalent to their baseline period weekly average daily step count.
Control participants received an out-of-app push notification at 8:00 a.m. each Monday during the intervention period reminding them of their static daily step goal.
If the participant achieved their daily step goal before 8:00 p.m. on any day a push notification was sent to congratulate them on reaching their goal for the day.
No notifications were sent past 8:00 p.m. Participants achieving daily step goals were rewarded with FI in the form of points (i.e., "SproutBucks").
They could redeem "SproutBucks" either "on-platform" (e.g., gift cards to StarbucksTM, BestBuyTM, iTunesTM, VisaTM) or "off-platform" (e.g., employer specific rewards like vouchers for fitness membership discounts).
The value of "SproutBucks" was unique to companies, ranging from $0.00 to $1.00 USD per daily goal achieved.
|
Receiving personalized static daily step goals.
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Step count
Time Frame: 17 weeks
|
Relative change in daily steps from the 5 week run-in period to the 12-week follow-up, in groups receiving adaptive daily step goals versus those receiving non-adaptive goals.
|
17 weeks
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Number of app opens, total time spent on app, number of pages opened
Time Frame: 12 weeks
|
Difference in level of engagement (described in title) within the adaptive goals group compared to non-adaptive goals throughout the 12-week follow-up period.
|
12 weeks
|
Collaborators and Investigators
Sponsor
Sponsor
Publications and helpful links
General Publications
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011 Apr 23;6:42. doi: 10.1186/1748-5908-6-42.
- Mitchell MS, Orstad SL, Biswas A, Oh PI, Jay M, Pakosh MT, Faulkner G. Financial incentives for physical activity in adults: systematic review and meta-analysis. Br J Sports Med. 2020 Nov;54(21):1259-1268. doi: 10.1136/bjsports-2019-100633. Epub 2019 May 15.
- Armijo-Olivo S, Stiles CR, Hagen NA, Biondo PD, Cummings GG. Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research. J Eval Clin Pract. 2012 Feb;18(1):12-8. doi: 10.1111/j.1365-2753.2010.01516.x. Epub 2010 Aug 4.
Study record dates
Study Major Dates
Study Start (Actual)
Study Start
Primary Completion (Actual)
Primary Completion
Study Completion (Actual)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Other Study ID Numbers
Other Study ID Numbers
- 123632
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
IPD Plan Description
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
product manufactured in and exported from the U.S.
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Health Behavior
-
NCT06022120CompletedHealth Behavior | Health Knowledge, Attitudes, Practice | Health-Related Behavior | Health Literacy
-
NCT07156162Completed
-
NCT05963633Active, not recruitingBehavior, Health
-
NCT07310017RecruitingHealth-Related Behavior
-
NCT05851144CompletedHealth-Related Behavior
-
NCT07176195Active, not recruitingHealth-Related Behavior
-
NCT06455579CompletedSleep | Health-Related Behavior
-
NCT07276191RecruitingOral Health Behavior Change | Oral Health Care | Oral Health Self-efficacy
-
NCT06618040RecruitingSleep | Health-Related Behavior
-
NCT06539845RecruitingHealth Attitude | Health Behavior | Knowledge, Attitudes, Practice | Health Knowledge, Attitudes, Practice | Health-Related Behavior | Behavior, Health | Attitude to Health | Preparedness | Outbreaks
Clinical Trials on Adaptive Step Goal (Intervention)
-
NCT05715242CompletedObesity | Overweight | Weight Loss | Health Behavior
-
NCT05826379Enrolling by invitationOverweight and Obesity | Walking | Physical Inactivity | Self-regulation | Cognitive Health
-
NCT06193343RecruitingAnterior Cruciate Ligament Injuries
-
NCT02886871CompletedPhysical Activity | Sedentary Lifestyle
-
NCT03272438Completed
-
NCT02008071Completed
-
NCT03148145CompletedPhysical Activity | Sedentary Lifestyle
-
NCT04791722CompletedSmoking Cessation | Smoking, Tobacco | Second Hand Tobacco Smoke
-
NCT07092345RecruitingSuicidal and Self-injurious Behavior | Linkage to Care