Clinical Validation of SMD-AFECG for Predicting New-Onset Atrial Fibrillation Within 2 Hours Using Single-Lead ECG Data
A Retrospective, Single-Center, Single-Arm, Superiority Confirmatory Study to Evaluate the Clinical Validity of SMD-AFECG, Artificial Intelligence Software to Predict the Risk of Atrial Fibrillation, Including First Episode Within 2 Hours, Using Single-Lead-Based Electrocardiogram Analysis
研究概览
详细说明
This clinical study is designed as a retrospective, single-center, single-arm, superiority confirmatory clinical performance study.
Pre-screening Electronic medical records and the VitalDB database at Seoul National University Hospital will be reviewed to identify potentially eligible data. The study will use continuous single-lead electrocardiogram data collected through VitalDB between September 1, 2022, and before September 30, 2025, from patients who were 19 years of age or older at the time of data collection.
Screening and Data Collection A screening number will be assigned sequentially to each potentially eligible case. Eligibility will be determined by reviewing the predefined inclusion and exclusion criteria. For eligible cases, continuous single-lead electrocardiogram data, signal loss, heart rate, the occurrence and timing of atrial fibrillation episodes, the electrocardiogram collection period, demographic information, previous history of atrial fibrillation, and pregnancy status will be collected. Directly identifying personal information will not be collected.
Test Dataset Creation Eligible data will be classified according to the presence or absence of a previous history of atrial fibrillation and the occurrence of an atrial fibrillation episode. The datasets will be categorized as new-onset atrial fibrillation positive or negative and repeated atrial fibrillation positive or negative. A subject number will then be assigned to each eligible dataset.
The planned sample size is 797 cases, including 462 cases for the evaluation of new-onset atrial fibrillation and 335 cases for the evaluation of repeated atrial fibrillation.
Reference Standard Establishment Two physicians with at least 5 years of relevant clinical experience will independently review the electrocardiogram data and relevant medical records. They will assess the suitability of the electrocardiogram data, confirm the presence or absence and timing of atrial fibrillation episodes, and verify the previous history of atrial fibrillation. Any disagreement between the physicians will be resolved according to the procedures specified in the study protocol. The final agreed classification will be used as the reference standard.
Application of the Investigational Device The medical device operator will receive the test electrocardiogram datasets labeled only with screening numbers and will not be provided with the reference-standard results or positive or negative group classifications. The blinded datasets will be analyzed using SMD-AFECG to generate the predicted risk of atrial fibrillation occurring within 2 hours. The software-generated results will be recorded in the electronic data capture system.
Statistical Analysis The software-generated predictions will be compared with the reference-standard classifications. The primary performance measures are the areas under the receiver operating characteristic curves for the prediction of new-onset atrial fibrillation and repeated atrial fibrillation. Two-sided 95% confidence intervals will be calculated using DeLong's method with a Wald-type confidence interval.
The performance criterion for new-onset atrial fibrillation will be met if the lower bound of the 95% confidence interval for the area under the curve is greater than 0.7753. The performance criterion for repeated atrial fibrillation will be met if the corresponding lower bound is greater than 0.8299. The study will be considered successful only if both primary performance criteria are met.
Secondary performance measures include the area under the precision-recall curve, precision, recall, F1 score, sensitivity, specificity, positive predictive value, negative predictive value, confusion-matrix results at different thresholds, and prediction time horizon.
Because this is a retrospective study using previously collected data, there will be no direct participant contact, additional examination, treatment, or change in clinical care.
研究类型
注册 (估计的)
联系人和位置
学习联系方式
- 姓名:JooYeon Yoo
- 电话号码:+82-2-2051-3161
- 邮箱:clinical_trial@huinno.com
参与标准
资格标准
适合学习的年龄
- 成人
- 年长者
接受健康志愿者
取样方法
研究人群
描述
Inclusion Criteria:
- Existing continuous single-lead electrocardiogram data collected through VitalDB at Seoul National University Hospital from September 1, 2022, to before September 30, 2025
- Participant aged 19 years or older at the time of electrocardiogram data collection
Availability of an electrocardiogram dataset meeting one of the following criteria:
- No previous history of atrial fibrillation and a first atrial fibrillation episode, with continuous atrial fibrillation-free electrocardiogram data for the 2 hours before onset and electrocardiogram data for 1 hour after onset (NOAF-positive group)
- No previous history of atrial fibrillation and no atrial fibrillation episode, with continuous atrial fibrillation-free electrocardiogram data for the 2 hours before a selected index time and electrocardiogram data for 1 hour after the index time (NOAF-negative group)
- Previous history of atrial fibrillation and an atrial fibrillation episode, with continuous atrial fibrillation-free electrocardiogram data for the 2 hours before onset and electrocardiogram data for 1 hour after onset (RAF-positive group)
- Previous history of atrial fibrillation and no atrial fibrillation episode, with continuous atrial fibrillation-free electrocardiogram data for the 2 hours before a selected index time and electrocardiogram data for 1 hour after the index time (RAF-negative group)
- If atrial fibrillation occurred within 2 hours after the start of electrocardiogram recording, availability of electrocardiogram data from the start of recording through up to 1 hour after atrial fibrillation onset, with a minimum recorded electrocardiogram duration of 10 minutes
Exclusion Criteria:
- Electrocardiogram data considered to be of inadequate quality because of noise, poor equipment handling, unclear signals, artifacts, or similar problems
- Electrocardiogram data with signal loss of 5 percent or greater
- Electrocardiogram data with a heart rate below 30 beats per minute or above 300 beats per minute
- Data collected from a participant who was pregnant or breastfeeding at the time of data collection
- Data previously used for training or validation of the artificial intelligence model
- Data considered unsuitable for this clinical study by the principal investigator
学习计划
研究是如何设计的?
设计细节
队列和干预
团体/队列 |
|---|
|
NOAF Positive Group
Single-lead electrocardiogram datasets from patients without a previous history of atrial fibrillation that include the first atrial fibrillation episode.
The datasets include an atrial fibrillation-free electrocardiogram period before the onset of atrial fibrillation and electrocardiogram data following its onset.
SMD-AFECG will be retrospectively applied to estimate the risk of atrial fibrillation occurring within 2 hours.
|
|
NOAF Negative Group
Single-lead electrocardiogram datasets from patients without a previous history of atrial fibrillation and without an atrial fibrillation episode during the predefined assessment period.
The datasets include a continuous atrial fibrillation-free electrocardiogram period before a selected index time and electrocardiogram data following the index time.
SMD-AFECG will be retrospectively applied to estimate the risk of atrial fibrillation occurring within 2 hours.
|
|
RAF Positive Group
Single-lead electrocardiogram datasets from patients with a previous history of atrial fibrillation that include an atrial fibrillation episode.
The datasets include an atrial fibrillation-free electrocardiogram period before the onset of atrial fibrillation and electrocardiogram data following its onset.
SMD-AFECG will be retrospectively applied to estimate the risk of atrial fibrillation occurring within 2 hours.
|
|
RAF Negative Group
Single-lead electrocardiogram datasets from patients with a previous history of atrial fibrillation and without an atrial fibrillation episode during the predefined assessment period.
The datasets include a continuous atrial fibrillation-free electrocardiogram period before a selected index time and electrocardiogram data following the index time.
SMD-AFECG will be retrospectively applied to estimate the risk of atrial fibrillation occurring within 2 hours.
|
研究衡量的是什么?
主要结果指标
结果测量 |
措施说明 |
大体时间 |
|---|---|---|
|
AUROC of SMD-AFECG for Predicting New-Onset Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases (up to 2 hours)
|
The area under the receiver operating characteristic curve (AUROC) will be calculated by comparing the maximum risk score generated by SMD-AFECG with the reference-standard classification of the NOAF-positive and NOAF-negative ECG datasets.
A two-sided 95% confidence interval will be estimated using DeLong's method with a Wald-type confidence interval.
The performance criterion will be met if the lower bound of the 95% confidence interval is greater than 0.7753.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases (up to 2 hours)
|
|
AUROC of SMD-AFECG for Predicting Repeated Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases (up to 2 hours)
|
The area under the receiver operating characteristic curve (AUROC) will be calculated by comparing the maximum risk score generated by SMD-AFECG with the reference-standard classification of the RAF-positive and RAF-negative ECG datasets.
A two-sided 95% confidence interval will be estimated using DeLong's method with a Wald-type confidence interval.
The performance criterion will be met if the lower bound of the 95% confidence interval is greater than 0.8299.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases (up to 2 hours)
|
次要结果测量
结果测量 |
措施说明 |
大体时间 |
|---|---|---|
|
AUPRC of SMD-AFECG for Predicting New-Onset Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
The area under the precision-recall curve (AUPRC) will be calculated from the relationship between precision and recall using the reference-standard NOAF-positive and NOAF-negative ECG datasets.
AUPRC ranges from 0 to 1, with higher values indicating better identification of positive cases.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
AUPRC of SMD-AFECG for Predicting Repeated Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
The area under the precision-recall curve (AUPRC) will be calculated from the relationship between precision and recall using the reference-standard RAF-positive and RAF-negative ECG datasets.
AUPRC ranges from 0 to 1, with higher values indicating better identification of positive cases.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Sensitivity of SMD-AFECG for Predicting New-Onset Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, sensitivity, also referred to as recall, will be calculated as the proportion of reference-standard NOAF-positive ECG datasets classified as positive by SMD-AFECG.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Sensitivity of SMD-AFECG for Predicting Repeated Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, sensitivity, also referred to as recall, will be calculated as the proportion of reference-standard RAF-positive ECG datasets classified as positive by SMD-AFECG.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Specificity of SMD-AFECG for Predicting New-Onset Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, specificity will be calculated as the proportion of reference-standard NOAF-negative ECG datasets classified as negative by SMD-AFECG.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Specificity of SMD-AFECG for Predicting Repeated Atrial Fibrillation Within 2 Hours
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, specificity will be calculated as the proportion of reference-standard RAF-negative ECG datasets classified as negative by SMD-AFECG.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Positive Predictive Value of SMD-AFECG for New-Onset Atrial Fibrillation
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, positive predictive value, also referred to as precision, will be calculated as the proportion of ECG datasets classified as positive by SMD-AFECG that are NOAF-positive according to the reference standard.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Positive Predictive Value of SMD-AFECG for Repeated Atrial Fibrillation
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, positive predictive value, also referred to as precision, will be calculated as the proportion of ECG datasets classified as positive by SMD-AFECG that are RAF-positive according to the reference standard.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Negative Predictive Value of SMD-AFECG for New-Onset Atrial Fibrillation
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, negative predictive value will be calculated as the proportion of ECG datasets classified as negative by SMD-AFECG that are NOAF-negative according to the reference standard.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific Negative Predictive Value of SMD-AFECG for Repeated Atrial Fibrillation
大体时间:At each evaluated threshold, negative predictive value will be calculated as the proportion of ECG datasets classified as negative by SMD-AFECG that are RAF-negative according to the reference standard.
|
At each evaluated threshold, negative predictive value will be calculated as the proportion of ECG datasets classified as negative by SMD-AFECG that are RAF-negative according to the reference standard.
|
At each evaluated threshold, negative predictive value will be calculated as the proportion of ECG datasets classified as negative by SMD-AFECG that are RAF-negative according to the reference standard.
|
|
Threshold-Specific F1 Score of SMD-AFECG for Predicting New-Onset Atrial Fibrillation
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, the F1 score will be calculated as the harmonic mean of precision and recall for the classification of NOAF-positive and NOAF-negative ECG datasets.
Values range from 0 to 1, with higher values indicating better performance.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Threshold-Specific F1 Score of SMD-AFECG for Predicting Repeated Atrial Fibrillation
大体时间:During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
At each evaluated threshold, the F1 score will be calculated as the harmonic mean of precision and recall for the classification of RAF-positive and RAF-negative ECG datasets.
Values range from 0 to 1, with higher values indicating better performance.
|
During the AF-free ECG window immediately preceding AF onset for positive cases or the selected index time for negative cases, up to 2 hours
|
|
Prediction Time Horizon of SMD-AFECG for New-Onset Atrial Fibrillation
大体时间:Within the 2-hour period before the onset of the first atrial fibrillation episode
|
The prediction time horizon will be calculated as the time interval, in minutes, between the SMD-AFECG prediction or alarm and the onset of the reference-standard first atrial fibrillation episode among NOAF-positive ECG datasets.
|
Within the 2-hour period before the onset of the first atrial fibrillation episode
|
|
Prediction Time Horizon of SMD-AFECG for Repeated Atrial Fibrillation
大体时间:Within the 2-hour period before the onset of the atrial fibrillation episode
|
The prediction time horizon will be calculated as the time interval, in minutes, between the SMD-AFECG prediction or alarm and the onset of the reference-standard atrial fibrillation episode among RAF-positive ECG datasets.
|
Within the 2-hour period before the onset of the atrial fibrillation episode
|
合作者和调查者
研究记录日期
研究主要日期
学习开始 (估计的)
初级完成 (估计的)
研究完成 (估计的)
研究注册日期
首次提交
首先提交符合 QC 标准的
首次发布 (实际的)
研究记录更新
最后更新发布 (实际的)
上次提交的符合 QC 标准的更新
最后验证
更多信息
与本研究相关的术语
关键字
其他研究编号
- HU-NOAF-01
- RS-2026-25543193 (其他赠款/资助编号:Korea Medical Device Development Foundation)
计划个人参与者数据 (IPD)
计划共享个人参与者数据 (IPD)?
IPD 计划说明
药物和器械信息、研究文件
研究美国 FDA 监管的药品
此信息直接从 clinicaltrials.gov 网站检索,没有任何更改。如果您有任何更改、删除或更新研究详细信息的请求,请联系 register@clinicaltrials.gov. clinicaltrials.gov 上实施更改,我们的网站上也会自动更新.