Individualized Prediction of Migraine Attacks Using a Mobile Phone App and Fitbit (Migraine Alert)

Individualized Prediction of Migraine Attacks Using a Mobile Phone App

This trial is collaboration between Mayo Clinic, Second Opinion Health (Simon Bloch, simon@somobilehealth.com 408-981-3814) and Allergan. Mayo Clinic investigators are conducting the clinical trial, Second Opinion Health is providing the software for use in the trial (Migraine Alert app for data collection, analysis and machine learning algorithms), and Allergan is providing funding.

The investigators hypothesize that the use of a mobile phone app and Fitbit wearable to collect daily headache diary data, exposure/trigger data and physiologic data will predict the occurrence of migraine attacks with high accuracy. The objective of the trial is to assess the ability to use daily exposure/trigger and symptom data, as well as physiologic data (collected by Fitbit) to create individual predictive migraine models to accurately predict migraine attacks in individual patients via a mobile phone app.

Study Overview

• Status: Completed
• Conditions: Brain Diseases; Central Nervous System Diseases; Nervous System Diseases; Migraine Disorders; Headache Disorders, Primary; Headache Disorders

Detailed Description

Eliminating migraine attacks before they start is of an enormous importance to migraine sufferers. But figuring out the onset of an attack before it actually starts remains a major challenge for the medical community.

The widespread use of mobile smartphones, the availability of wearable devices that measure health information, and advances in multivariate pattern analysis via machine learning algorithms allow for development of individual predictive models that can determine the likelihood of an individual patient developing a migraine on a given day. Such models are based upon objectively measured biometric parameters (e.g. activity, sleep), objectively measured environmental conditions (e.g. weather parameters), exposures to possible migraine triggers, and patient reported symptoms. Using machine-learning algorithms to explore this large dataset that is collected for each patient, the optimal combination of factors that most accurately predict the likelihood of a migraine attack is determined.

Prediction of individual migraine attacks would have substantial positive impacts for patients with migraine. Accurate prediction of a migraine attack would give the migraineur a greater sense of control over their condition, a sense of control that is often lacking in patients with migraine. Most importantly, if individual migraine attacks could be predicted with high accuracy, treatment of that inevitable migraine attack before development of symptoms could prevent the attack altogether.

Eligible subjects will enter a baseline phase during which subjects will wear a Fitbit device and record data into the daily headache diary using the mobile phone app. This phase will be of variable duration for each subject to a maximum of 75 days. It is during the baseline phase that the individualized predictive model for a migraine attack is developed and optimized.

During the second phase (75 days), the accuracy of the predictive model will be tested. The probability of developing a migraine will be calculated and the accuracy of the prediction will be tested against the patient reported incidence of migraine attacks within the mobile phone app. Subjects will be blinded to the app's migraine attack predictions to avoid expectancy bias.

Migraine prediction suffers from 'the curse of dimensionality' (machine learning parlance). Too many factors affect outcomes, but the outcomes (positive migraine attacks) are few and far in between. To develop an accurate machine learning model using traditional approaches requires a long and impractical time duration. Migraine Alert has effectively addressed these using proprietary algorithms and techniques that generate individual models using fewer migraines. Covariate analysis is performed for each individual using features derived from the raw data. Individual models may differ from one other in the specific feature they use and/or the importance attached to them in the model. Proprietary techniques are used to create these individual models and to monitor their pre-validation and post-validation accuracy and recall. Concept drift as evidenced by any degradation in accuracy or recall is monitored in the prediction phase and model is retrained as necessary.

• Study Type: Observational
• Enrollment (Actual): 19

Contacts and Locations

Study Locations

• United States
  • Arizona
    • Scottsdale, Arizona, United States, 852589
      • Mayo Clinic Arizona
  • California
    • Los Angeles, California, United States, 90033
      • University of Southern California

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

• Sampling Method: Non-Probability Sample

Study Population

People with episodic migraines

Description

Inclusion Criteria:

• Subjects fulfilling ICHD-3beta criteria for migraine with average of 5 - 10 migraine attacks per month and up to 12 headache days per month
• Males of females 18 years of age or older
• Subject report of weather being one of the triggers
• Subject has an iPhone
• Subject is willing to wear a Fitbit device for the duration of the study
• Subject has an active Facebook account or is willing to create one

Exclusion Criteria:

• Children younger than 18 years of age
• Subjects with headaches other than migraine or probable migraine
• Inability to provide informed consent
• Not willing to maintain a daily diary
• Current participation in another clinical trial

Study Plan

How is the study designed?

Design Details

• Observational Models: Cohort
• Time Perspectives: Prospective

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
AUC of individual prediction models using cross validation data on environmental and physiological variables.	The study will develop a separate predictive model for each participant that will forecast probability of experiencing a migraine attack during a particular interval. The outcome measures performance of this model using the Area Under the Curve (AUC) metric. AUC measures how often the algorithm predicts a higher probability for a migraine over non-migraine. This measure is attractive because it is independent of the quantization threshold, which is required for other metrices such as precision/recall. In the baseline phase, 30% of the data will be randomly selected for cross validation and will not used for training the model. Once the model is trained, the AUC of the model is measured on the cross validation data as the outcome of this phase. The data will include various measurements of weather such as temperature, pressure, humidity, wind and physiological measurements such as sleep duration and quality and activity level measured through a wearable Fitbit device.	10 weeks
AUC of individual prediction models using post prediction data on environmental and physiological variables.	The metric and the type of the data is the same as in Outcome 1. The only difference is that the data is obtained from the user after the model is trained. The user is not shown the prediction to avoid expectancy bias.	10 weeks

Collaborators and Investigators

• Sponsor: Second Opinion Health
• Collaborators: Mayo Clinic; University of Southern California; Allergan
• Investigators: Principal Investigator: Rashmi Halker Singh, MD, Mayo Clinic; Principal Investigator: Soma Sahai-Srivastava, MD, University of Southern California

Publications and helpful links

Helpful Links

• Migraine
• Migraine Headaches

Study record dates

Study Major Dates

• Study Start (Actual): November 1, 2016
• Primary Completion (Actual): July 1, 2018
• Study Completion (Actual): July 31, 2018

Study Registration Dates

• First Submitted: September 13, 2016
• First Submitted That Met QC Criteria: September 20, 2016
• First Posted (Estimate): September 22, 2016

Study Record Updates

• Last Update Posted (Actual): August 6, 2018
• Last Update Submitted That Met QC Criteria: August 2, 2018
• Last Verified: August 1, 2018

More Information

Terms related to this study

• Keywords: Migraine; App; Prediction; Fitbit; Machine Learning; Algorithm; Mayo Clinic; Allergan; Forecast; Individual; Second Opinion
• Additional Relevant MeSH Terms: Pathologic Processes; Pain; Neurologic Manifestations; Disease; Nervous System Diseases; Brain Diseases; Migraine Disorders; Headache; Headache Disorders; Central Nervous System Diseases; Headache Disorders, Primary
• Other Study ID Numbers: 16-005803

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: No