Clinical Validation of the Hyfe Cough Monitoring System

September 27, 2023 updated by: Hyfe Inc

This is a multicenter observational study and will include individuals with a variety of cough related conditions including but not limited to refractory chronic cough, Chronic Obstructive Pulmonary Disease (COPD) and non-tuberculous mycobacteria.

The primary objective of this study is to assess the overall performance of the Hyfe Cough Monitoring System (HCMS, Hyfe Inc., 2022) when used by individuals with problematic cough, under common living conditions.The monitoring period for outpatients will be 24 hours.

Study Overview

Status

Active, not recruiting

Conditions

Intervention / Treatment

Detailed Description

Researcher will evaluate the accuracy of the mobile HCMS as a tool to monitor cough. HCMS is a dedicated Android smart watch running specialized software that runs continuously and calculates a patient's cough rate on an hourly basis. After providing informed consent, research subjects will be instructed to wear the HCMS and a second watch serving as an audio recorder. These devices will be kept on the wrist or within 3 feet (~91 cm) of the mouth, a behavior abetted by keeping the charging station for both watches on the bedside table. Participants will be asked to go about their day as usual while wearing these devices.

The subjects will be instructed to not turn off either watch for the duration of the 24 hours. In addition, participants will be instructed to avoid environments with active coughers and to inform others in their environment that sound is being recorded. Additionally, they will be told to avoid getting the watches wet. Participants will be instructed to charge the watches on a nightstand next to the bed while they sleep using the provided watch chargers. At the end of the 24-hour period, participants will be instructed to turn off and remove the watches. Additionally, participants will be given a printed Hyfe diary to write down the exact time when the device was turned on/off and any times the watch was not being worn. The devices will be returned to the researchers once the recording period is complete.The 24 hours of continuous ambient sounds collected by the audio recording watch and will be listened to by Hyfe technicians trained in cough annotation and data security, and each coughwill be annotated on the audio file using audio-analysis software, according to standard operating procedures developed by Hyfe. These results will be compared on an hourly basis with the coughs detected by HCMS and the performance of the HCMS for identifying cough in home settings calculated in comparison to the human annotated continuous recording reported.

Study Type

Observational

Enrollment (Estimated)

21

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

      • Navarro, Spain
        • Clinica Universidad de Navarra
    • Oregon
      • Oregon City, Oregon, United States, 97239
        • Oregon Health Science University
    • Washington
      • Seattle, Washington, United States, 98105
        • Hyfe North American Clinical Office

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

21 years and older (Adult, Older Adult)

Accepts Healthy Volunteers

No

Sampling Method

Non-Probability Sample

Study Population

The study population are adults (21 years old or above) seeking health care and who express concern about their cough.

Description

Inclusion Criteria:

  1. Age 21 years old or above
  2. Individuals seeking health care, who express concern about their active cough (problematic cough)
  3. Anticipate that they can collect auditory recording and keep the devices with them continuously for 24 hours.
  4. Residing in a domestic environment without unusually high and / or persistent background sound levels .
  5. Willing to wear a watch an audio recorder and keep them at bedside (within 3 ft) from the mouth during the night.

Exclusion Criteria:

  1. Inability to accept the privacy policy and terms of use of HCMS due to confidentiality or other concerns.
  2. Inability to avoid unusually prolonged loud environments for the duration of the 24-hour study period.
  3. Need to conduct confidential conversations during the 24-hour monitoring period
  4. Individuals who have had significant change in antitussive therapy in the week preceding study.

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

Cohorts and Interventions

Group / Cohort
Intervention / Treatment
Clínica Universidad Navarra site
Research subjects will be enrolled at Clínica Universidad Navarra. Research subjects will be instructed to wear the HCMS and a second watch serving as an audio recorder. These devices will be kept on the wrist or within 3 feet (~91 cm) of the mouth, a behavior abetted by keeping the charging station for both watches on the bedside table. Participants will be asked to go about their day as usual while wearing these devices.
The subjects will be instructed to not turn off either watch for the duration of the 24 hours. In addition, participants will be instructed to avoid environments with active coughers and to inform others in their environment that sound is being recorded. Additionally, participants will be told to avoid getting the watches wet. Participants will be instructed to charge the watches on a nightstand next to the bed while they sleep using the provided watch chargers. At the end of the 24-hour period, participants will be instructed to turn off and remove the watches. Additionally, participants will be given a printed Hyfe diary to write down the exact time when the device was turned on/off and any times the watch was not being worn. The devices will be returned to the researchers once the recording period is complete.
OHSU site
Research subjects will be enrolled at OHSU. Research subjects will be instructed to wear the HCMS and a second watch serving as an audio recorder. These devices will be kept on the wrist or within 3 feet (~91 cm) of the mouth, a behavior abetted by keeping the charging station for both watches on the bedside table. Participants will be asked to go about their day as usual while wearing these devices.
The subjects will be instructed to not turn off either watch for the duration of the 24 hours. In addition, participants will be instructed to avoid environments with active coughers and to inform others in their environment that sound is being recorded. Additionally, participants will be told to avoid getting the watches wet. Participants will be instructed to charge the watches on a nightstand next to the bed while they sleep using the provided watch chargers. At the end of the 24-hour period, participants will be instructed to turn off and remove the watches. Additionally, participants will be given a printed Hyfe diary to write down the exact time when the device was turned on/off and any times the watch was not being worn. The devices will be returned to the researchers once the recording period is complete.
Decentralized - US-based

Research subjects will be enrolled in a decentralized manner ou of the Hyfe North American Clinical Office.

Research subjects will be instructed to wear the HCMS and a second watch serving as an audio recorder. These devices will be kept on the wrist or within 3 feet (~91 cm) of the mouth, a behavior abetted by keeping the charging station for both watches on the bedside table. Participants will be asked to go about their day as usual while wearing these devices.

The subjects will be instructed to not turn off either watch for the duration of the 24 hours. In addition, participants will be instructed to avoid environments with active coughers and to inform others in their environment that sound is being recorded. Additionally, participants will be told to avoid getting the watches wet. Participants will be instructed to charge the watches on a nightstand next to the bed while they sleep using the provided watch chargers. At the end of the 24-hour period, participants will be instructed to turn off and remove the watches. Additionally, participants will be given a printed Hyfe diary to write down the exact time when the device was turned on/off and any times the watch was not being worn. The devices will be returned to the researchers once the recording period is complete.

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Hyfe Cough Monitoring System (HCMS) accuracy using Pearson correlation coefficient
Time Frame: Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the primary outcome measures.

The HCMS timestamps coughs as they occur. Hourly counts of cough events will be compared with ground truth hourly counts determined by trained human annotators, who will listen to audio recordings and timestamp each cough using proprietary labeling software.

If human annotators and the HCMS agreed perfectly, their paired hourly counts would lie on the line y=x (ground truth on the x-axis, HCMS on the y-axis). Agreement with this ideal line quantifies HCMS performance: the Pearson correlation coefficient must be close to 1

By comparison with ground truth annotations, each HCMS timestamp is either a true positive or a false positive; by the usual formula, HCMS Sensitivity = Number of true positives Total number of coughs where the denominator is determined by ground truth.

Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the primary outcome measures.
Hyfe Cough Monitoring System (HCMS) accuracy using OLS slope/intercept
Time Frame: Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the co-primary outcome measures

The HCMS timestamps coughs as they occur. Hourly counts of cough events will be compared with ground truth hourly counts determined by trained human annotators, who will listen to audio recordings and timestamp each cough using proprietary labeling software.

If human annotators and the HCMS agreed perfectly, their paired hourly counts would lie on the line y=x (ground truth on the x-axis, HCMS on the y-axis). Agreement with this ideal line quantifies HCMS performance: the slope and intercept of the OLS line of best fit must be close to 1 and 0, respectively.

By comparison with ground truth annotations, each HCMS timestamp is either a true positive or a false positive; by the usual formula

HCMS Sensitivity = Number of true positives Total number of coughs

where the denominator is determined by ground truth.

Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the co-primary outcome measures
Hyfe Cough Monitoring System (HCMS) sensitivity of cough detection
Time Frame: Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the co-primary outcome measures.

The HCMS timestamps coughs as they occur. Hourly counts of cough events will be compared with ground truth hourly counts determined by trained human annotators, who will listen to audio recordings and timestamp each cough using proprietary labeling software.

By comparison with ground truth annotations, each HCMS timestamp is either a true positive or a false positive; by the usual formula

HCMS Sensitivity = Number of true positives Total number of coughs

where the denominator is determined by ground truth.

Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the co-primary outcome measures.
Hyfe Cough Monitoring System (HCMS) false positivity rate
Time Frame: Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the co-primary outcome measures.

The HCMS timestamps coughs as they occur. Hourly counts of cough events will be compared with ground truth hourly counts determined by trained human annotators, who will listen to audio recordings and timestamp each cough using proprietary labeling software.

The false positive rate is the total number of false positives divided by the total number of monitoring hours.

Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours, and cough events will be tabulated hourly. Each participant will thus contribute 24 data points to the calculation of the co-primary outcome measures.

Secondary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Differential analysis of nighttime versus daytime HCMS performance
Time Frame: Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours. All of the coughs timestamped by trained human annotators and by the Hyfe Cough Monitoring System will be used to calculate the second
Given the value of monitoring cough only during the day or only at night, a secondary analysis will compare HCMS performance during these periods; "nighttime" is defined as time spent in bed and "daytime" is defined as time not spent in bed. When going to bed, subjects will note their bedtimes carefully and will place the HCMS and monitor in chargers by the bed; reported bedtimes will be validated against the charging times recorded by the watches. The accuracy metrics defined above will then be calculated separately for subjects' daytime and nighttime monitoring periods.
Each participant will be monitored continuously with the audio recorder and the HCMS for 24 hours. All of the coughs timestamped by trained human annotators and by the Hyfe Cough Monitoring System will be used to calculate the second
Differential analysis of HCMS performance for individual subjects
Time Frame: Each participant will be monitored continuously with the audio recorder and the Hyfe Cough Monitoring System for 24 hours. All of the coughs timestamped by trained human annotators and by the HCMS will be used to calculate the seco

HCMS performance will vary from subject to subject; in particular, the HCMS may fail to recognize extremely unusual coughs or may perform differently with challenging acoustic backgrounds. Trained human annotators face similar issues, leading to disputed annotations that will be resolved by a third expert annotator.

To understand the impact of atypical coughers on HCMS performance, the accuracy metrics defined earlier will be calculated separately for each individual participant. The distributions of these accuracy metrics will be investigated and summarized, and a post hoc analysis of audio from those subjects with exceptionally poor performance will be done to determine the causes of degraded performance.

Each participant will be monitored continuously with the audio recorder and the Hyfe Cough Monitoring System for 24 hours. All of the coughs timestamped by trained human annotators and by the HCMS will be used to calculate the seco
Dependence of HCMS performance on individual cough rates
Time Frame: Each participant will be monitored continuously with the audio recorder and the Hyfe Cough Monitoring System for 24 hours. All of the coughs timestamped by trained human annotators and by the HCMS will be used to calculate the seco
It is possible that HCMS performance could depend on the frequency with which different subjects cough. To assess the impact of this variable, subjects will be stratified into tertiles according to their average cough rates; a subject's average cough rate is that individual's total number of coughs divided by the number of hours of monitoring. The performance metrics defined above will be calculated separately for these tertiles and compared.
Each participant will be monitored continuously with the audio recorder and the Hyfe Cough Monitoring System for 24 hours. All of the coughs timestamped by trained human annotators and by the HCMS will be used to calculate the seco

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Investigators

  • Principal Investigator: Carlos Chaccour, Clinica Universidad de Navarra

Publications and helpful links

The person responsible for entering information about the study voluntarily provides these publications. These may be about anything related to the study.

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

March 10, 2023

Primary Completion (Estimated)

November 15, 2023

Study Completion (Estimated)

December 15, 2023

Study Registration Dates

First Submitted

February 3, 2023

First Submitted That Met QC Criteria

February 3, 2023

First Posted (Actual)

February 10, 2023

Study Record Updates

Last Update Posted (Actual)

September 28, 2023

Last Update Submitted That Met QC Criteria

September 27, 2023

Last Verified

September 1, 2023

More Information

Terms related to this study

Other Study ID Numbers

  • Clinical Validation of the CM

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

YES

IPD Plan Description

All anonymized IPD that support each resulting publication.

IPD Sharing Time Frame

IPD will be made available upon publication

IPD Sharing Access Criteria

IPD will be available via an open repository

IPD Sharing Supporting Information Type

  • STUDY_PROTOCOL
  • SAP
  • ICF
  • ANALYTIC_CODE
  • CSR

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

Yes

product manufactured in and exported from the U.S.

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Cough

Clinical Trials on Clinical Validation of the Hyfe Cough Monitoring System

Search Similar Trials