Validation of the Diabetes Deep Neural Network Score for Diabetes Mellitus Screening
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Study Type
Study Type
Phase
Phase
- Not Applicable
Contacts and Locations
Study Contact
Study Contact
- Name: Geoff Tison, MD, MPH
- Phone Number: (415) 353-2873
- Email: geoff.tison@ucsf.edu
Study Contact Backup
- Name: Mattheus Ramsis, MD
- Email: mattheus.ramsis@ucsf.edu
Study Locations
-
-
California
-
San Francisco, California, United States, 94143
- University of California, San Francisco
-
-
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- Age > 18 years old
- Participants without a prior diagnosis of DM
- Participants with a recently measured HBA1c one month before enrollment or scheduled to undergo a HBA1c measurement within one month after enrollment
- Participants not scheduled for HBA1c and are willing to undergo a lab measured HBA1c
- Participants without risk factors for DM
- Participants with > 1 of the following risk factors for DM:
- Age > 40 years old
- Obesity (BMI > 30)
- Family history: Any first degree relative with a hx of DM
- Lifestyle risk factors (exercise, smoking, and sleep duration)
- Ownership of a smart phone
- Able to provide informed consent
- Willingness to provide PPG waveforms
Exclusion Criteria:
- Participants with a history of DM
- Participants with a prior HBA1c > 6.5%
- Inability to collect PPG signals (digit amputation, excessive tremors, etc)
- Lack of ownership of a smartphone
- Inability or unwillingness to consent and/or follow requirements of the study
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Diagnostic
- Allocation: Non-Randomized
- Interventional Model: Parallel Assignment
- Masking: None (Open Label)
Number of Arms
Arms and Interventions
Participant Group / ArmParticipant Group / Arm |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Experimental: Study Population
The investigators will conduct an electronic medical record (EMR) query of individuals in the University of California, San Francisco (UCSF) primary care clinics without a prior diagnosis of DM and who are undergoing, or who have recently undergone, a lab measured HBA1c before or after 1 month of enrollment.
sample size estimation for testing the estimated AUROC in the validation sample vs. the null value of AUC 0.7.
The investigators will target an enrollment of 5006 subjects in order to obtain a pre-specified AUROC 95% confidence interval width of 0.07 (i.e.
AUROC = 0.76 [95%CI 0.725, 0.795]).
The investigators assume that ~4% of the cohort will have undiagnosed diabetes based on national prevalence estimates.
|
After creating accounts, participants in both groups will download the Azumio Instant Diabetes Test and provide a Photoplethysmography (PPG) waveforms by placing their index finger over their smartphone camera for 20 seconds to provide PPG waveform data for the study .
|
|
Experimental: Alternative Sample Group
The investigators also aim to perform a sensitivity analysis to estimate the DNN performance in a target general population without a diabetes diagnosis.
The investigators will recruit patients from the UCSF EHR system without a history of diabetes, no prior HBA1c measured, and no history of known diabetic risk factors.
The investigators will target an enrollment of 1000 subjects in order to obtain a pre-specified AUROC 95% confidence interval width of 0.18 (i.e.
AUROC = 0.76 [95%CI 0.67, 0.85]).
The investigators assume that ~3% of the cohort will have undiagnosed diabetes based on national prevalence estimates.
|
After creating accounts, participants in both groups will download the Azumio Instant Diabetes Test and provide a Photoplethysmography (PPG) waveforms by placing their index finger over their smartphone camera for 20 seconds to provide PPG waveform data for the study .
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
The area under the receiver operating characteristic (AUROC) of the DNN Score as compared with one HBA1c measurement, based an average of two PPG measurements.
Time Frame: PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
Participants will provide seven total PPG measurements by their own smartphone camera.
After PPG measurements are obtained, the DNN algorithm will be deployed and be reported a as a DNN score.
The investigators will assess the DNN performance by the the area under the receiver operating characteristic (AUROC) of the DNN Score as compared with the HBA1c based on the DNN score from an average of 2 PPG measurements.
|
PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
|
The Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value of the DNN Score as compared with one HBA1c measurement based an average of two PPG measurements.
Time Frame: PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
Participants will provide seven total PPG measurements by their own smartphone camera.
After PPG measurements are obtained, the DNN algorithm will be deployed and be reported as a DNN score.
The investigators will assess the DNN performance by the Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value of the DNN Score as compared with the HBA1c based on the DNN score from an average of 2 PPG measurements.
|
PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
|
Assess the performance of the DNN score in different ethnicity and skin tones
Time Frame: PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
The investigators will aim to recruit individuals of different races/ethnicities and skin tones to assess the performance of the DNN score in different races/ethnicities.
|
PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
The area under the receiver operating characteristic (AUROC) of the DNN Score as compared with one HBA1c measurement based on > 2 PPG measurements.
Time Frame: PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
Participants will provide seven total PPG measurements by their own smartphone camera.
After PPG measurements are obtained, the DNN algorithm will be deployed and be reported a as a DNN score.
The investigators will assess the DNN performance the area under the receiver operating characteristic (AUROC) of the DNN Score of > 2 PPG measurements as compared with the HBA1c.
|
PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
|
The Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value of the DNN Score as compared with one HBA1c measurement based on >2 PPG measurements.
Time Frame: PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
Participants will provide seven total PPG measurements by their own smartphone camera.
After PPG measurements are obtained, the DNN algorithm will be deployed and be reported a as a DNN score.
The investigators will assess the DNN performance by the Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value of the DNN Score of > 2 PPG measurements as compared with the HBA1c.
|
PPG measurements and DNN score to be obtained within one month oh HBA1c measurement
|
|
Retrain the DNN algorithm
Time Frame: Retraining to occur after complete collection of PPG measurements and HBA1c data. The investigators estimate this will occur one year after enrollment.
|
By collecting PPG waveform data in patients with laboratory-confirmed diabetes, the investigators will be able to train the algorithm using the more specific diagnosis of laboratory-confirmed diabetes.
The investigators will assess the performance of the DNN Score once retrained using HbA1c.
The DNN will be trained using similar approaches as the investigators have previously published
|
Retraining to occur after complete collection of PPG measurements and HBA1c data. The investigators estimate this will occur one year after enrollment.
|
Collaborators and Investigators
Sponsor
Sponsor
Collaborators
Collaborators
Investigators
Investigators
- Principal Investigator: Geoff Tison, MD, MPH, University of California, San Franscisco
Publications and helpful links
Study record dates
Study Major Dates
Study Start (Estimated)
Study Start
Primary Completion (Actual)
Primary Completion
Study Completion (Actual)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Additional Relevant MeSH Terms
Other Study ID Numbers
Other Study ID Numbers
- 21-35207
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
product manufactured in and exported from the U.S.
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.