- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT07229300
AI ECHO INSIGHT RCT for Automated Echo Reporting (AI INSIGHT)
Artificial Intelligence Echocardiogram Interpretation for Systematic Integration and Guided Healthcare Transformation (The AI ECHO INSIGHT Study)
The goal of this blinded randomized controlled trial is to assess whether AI-assisted TTE interpretation can improve cardiologist efficiency and reduce interpretation variability while preserving accuracy compared to current methods in adult patients whose historical echocardiogram images were performed.
The main questions it aims to answer is to:
- Assess overall transthoracic echocardiogram (TTE) interpretation accuracy of an AI-assisted workflow compared to standard cardiologist-only and sonographer-assisted workflows to hypothesize if AI-assisted workflow for echocardiography interpretation is non-inferior in accuracy compared to standard workflows.
- Evaluate cardiologist interpretation time using an AI-assisted workflow compared to standard cardiologist-only and sonographer-assisted workflows to determine if an AI-assisted workflow will result in a decrease in interpretation time compared to the cardiologist-only workflow.
- To compare interpretation consistency and reliability compared to historical reports as well as consensus reports of all finalized cardiologist reports.
Study Overview
Status
Study Type
Enrollment (Estimated)
Phase
- Not Applicable
Contacts and Locations
Study Locations
-
-
California
-
Pleasanton, California, United States, 94588
- Kaiser Permanente Northern California Division of Research
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- ≥ 18 years of age
- Comprehensive transthoracic echocardiogram study performed a KPNC Medical Center.
Exclusion Criteria:
- Known Congenital heart disease study
- Known Ventricular assist device
- Limited transthoracic echocardiogram study
- Transesophageal echocardiogram study
- Stress echocardiogram study
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Diagnostic
- Allocation: Randomized
- Interventional Model: Parallel Assignment
- Masking: Single
Arms and Interventions
Participant Group / Arm |
Intervention / Treatment |
|---|---|
|
Active Comparator: AI-Assisted Interpretation
In AI-prelim arm, AI provides the preliminary interpretation which is finalized by a blinded cardiologist.
|
Echocardiogram studies are pre-interpreted by the AI software and finalized by a blinded cardiologist.
|
|
Active Comparator: Sonographer-Assisted Interpretation
In Sonographer-prelim arm, sonographer provides the preliminary interpretation which is finalized by a blinded cardiologist.
|
(Standard of Care 1): Echocardiogram studies are pre-interpreted by a sonographer and finalized by a blinded cardiologist.
|
|
Active Comparator: Cardiologist-Only Interpretation
In cardiologist-prelim arm, cardiology provides the preliminary interpretation which is finalized by a blinded separate cardiologist.
|
(Standard of Care 2): Echocardiogram studies are interpreted solely by two cardiologists (one provides a preliminary interpretation another provides a blinded final interpretation).
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Accuracy of AI-Assisted Echocardiogram Interpretation Compared to Standard Workflows.
Time Frame: 6 months
|
The accuracy rate is defined as the proportion of transthoracic echocardiogram (TTE) studies for which the final cardiologist interpretation is not significantly different from the preliminary interpretation. We will assess the accuracy rate in the AI-assisted arm for non-inferiority versus the pooled accuracy rate across both the sonographer-assisted and cardiologist-only arms. The investigators will measure the proportion of TTE studies for which the final cardiologist report is substantially different from the preliminary report (e.g., the rate of substantial change). We define a TTE report to be substantially different from another TTE interpretation if any of its key elements are substantially different (LVEF, right ventriuclar function, chamber size, valvular regurgitation severity, valvular stenosis severity, and right ventricular systolic pressure). |
6 months
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Secondary Measures of Accuracy (Superiority Analyses)
Time Frame: 6 months
|
Accuracy rates will also be analyzed for superiority rather than non-inferiority. The proportion of TTE studies for which the final cardiologist interpretation is not significantly different from the preliminary interpretation will be compared individually between the AI-assisted arm and each comparator arm (sonographer-assisted and cardiologist-only).
|
6 months
|
|
Accuracy Compared with Historical Cardiologist Interpretations
Time Frame: 6 months
|
Accuracy is defined as the proportion of TTE studies for which the final cardiologist report is substantially different from the historical report (e.g., the rate of substantial change).
We define a TTE report to be substantially different from another TTE interpretation if any of its key elements are substantially different (LVEF, right ventriuclar function, chamber size, valvular regurgitation severity, valvular stenosis severity, and right ventricular systolic pressure).
|
6 months
|
|
Accuracy Compared with Consensus Cardiologist Interpretations
Time Frame: 6 months
|
Accuracy is defined as the proportion of TTE studies for which the consensus cardiologist report is substantially different from the preliminary report (e.g., the rate of substantial change).
We define a TTE report to be substantially different from another TTE interpretation if any of its key elements are substantially different (LVEF, right ventriuclar function, chamber size, valvular regurgitation severity, valvular stenosis severity, and right ventricular systolic pressure).
|
6 months
|
|
Evaluation requiring two-grade change in valve disease severity as substantial change
Time Frame: 6 months
|
Accuracy is defined asthe proportion of TTE studies for which the final cardiologist report is substantially different from the preliminary report (e.g., the rate of substantial change). We define a TTE report to be substantially different from another TTE interpretation if any of its key elements are substantially different (LVEF, right ventricular function, chamber size, valvular regurgitation severity, valvular stenosis severity, and right ventricular systolic pressure).
|
6 months
|
|
Cardiologist Overread Time (Efficiency)
Time Frame: 6 months
|
To assess whether AI-assisted interpretation saves time, the investigators will compare the mean time in seconds required for the cardiologist to complete the overreading process across the three arms (i.e., TTE interpretation workflows) in our trial. Specifically, we will perform the following comparisons:
|
6 months
|
|
Comparison of Existing Standards of Care (Sonographer-Assisted vs Cardiologist-Only)
Time Frame: 6 months
|
The investigators will measure the proportion of TTE studies for which the final cardiologist report is substantially different from the preliminary report (e.g., the rate of substantial change) in sonographer-prelim and cardiologist-prelim arms.
We define a TTE report to be substantially different from another TTE interpretation if any of its key elements are substantially different (LVEF, right ventricular function, chamber size, valvular regurgitation severity, valvular stenosis severity, and right ventricular systolic pressure).
|
6 months
|
|
Blinding
Time Frame: 6 months
|
In each of the arms, at the completion of each study for the final cardiologist assessment, the cardiologist will be asked to guess whether the preliminary assessment was AI or human.
This will be used to calculate a blinding index comparing the AI-prelim arm vs. a composite of the two standard of care arms, as well as comparing the AI-prelim arm with the sonographer-prelim arm individually and comparing the AI-prelim arm with the cardiologist-prelim arm individually.
|
6 months
|
Collaborators and Investigators
Sponsor
Investigators
- Principal Investigator: David Ouyang, Kaiser Permanente
- Principal Investigator: Keane K Lee, Kaiser Permanente
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Estimated)
Study Completion (Estimated)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Estimated)
Study Record Updates
Last Update Posted (Estimated)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Keywords
Other Study ID Numbers
- 2302504
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
IPD Sharing Supporting Information Type
- STUDY_PROTOCOL
- SAP
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Echocardiography, Transthoracic
-
Emergency Medical Service of the Central Bohemian...Masaryk Hospital Usti nad LabemCompletedTransthoracic EchocardiographyCzechia
-
University of HawaiiCompletedEducation | Echocardiography | Transthoracic Echocardiography | Medical StudentUnited States
-
Emergency Medical Service of the Central Bohemian...Masaryk Hospital Usti nad LabemUnknown
-
Patrick F Wouters, MD PhDCompletedEchocardiography, Doppler | Echocardiography, Three-Dimensional | Echocardiography, Transesophageal | Echocardiography, TransthoracicBelgium
-
IRCCS Ospedale San RaffaeleRecruiting
-
Emergency Medical Service of the Central Bohemian...Masaryk Hospital Usti nad LabemUnknownTransthoracic EchocardiographyCzechia
-
Guangzhou Women and Children's Medical CenterCompletedPatients for Transthoracic Echocardiography | Unknown DiagnosisChina
-
Wuhan Union Hospital, ChinaRecruitingARDS | Ventilation Therapy; Complications | Transthoracic Echocardiography | Right Ventricular FunctionChina
-
Emergency Medical Service of the Central Bohemian...Masaryk Hospital Usti nad LabemUnknownTransthoracic EchocardiographyCzechia
-
Al-Azhar UniversityCompletedShock | Transthoracic Echocardiography | Electrical Cardiometry | Fluid ResuscitationEgypt
Clinical Trials on AI-Assisted Echocardiogram Interpretation
-
Federal University of Minas GeraisUppsala UniversityNot yet recruitingCardiovascular Abnormalities | Electrocardiogram
-
The Third Affiliated Hospital of Southern Medical...RecruitingDiagnostic Imaging | Artificial Intelligence (AI) | Common Systemic DiseasesChina
-
Jinling Hospital, ChinaNot yet recruitingIntracranial Aneurysm | CT Angiography | Cluster Randomized Trial | AI (Artificial Intelligence)
-
Cardiocentro TicinoRecruitingAcute Coronary Syndrome (ACS) | Myocardial Infarction (MI)Switzerland
-
Norwegian Institute of Public HealthHelse Vest; Norwegian Cancer Society; Helse Midt-Norge; Helse NordRecruiting
-
Taipei Veterans General Hospital, TaiwanFar Eastern Memorial Hospital; Ministry of Health and Welfare, Taiwan; Taipei... and other collaboratorsNot yet recruiting
-
Germans Trias i Pujol HospitalAstraZenecaNot yet recruitingLeft Ventricular Hypertrophy | Cardiac Amyloidosis | Heart Failure With Preserved Ejection Fraction (HFPEF)
-
Yonsei UniversityNot yet recruitingCoronary Artery Disease | Chest Pain | Acute Coronary SyndromeSouth Korea
-
Montreal Heart InstituteWithdrawn
-
Shanghai East HospitalNot yet recruiting