Kosmos Guidance Performance Evaluation Data Annotation

August 13, 2026 updated by: EchoNous Inc.
The purpose of this study is to supplement prior Kosmos Trio Guidance performance testing conducted under ECHO-020 Kosmos Guidance, Grading, and Capture Performance Evaluation Protocol. The Kosmos Trio Guidance algorithm is designed to provide guidance to help novice scanners acquire images and videos during ultrasound scanning of three cardiac views (Parastenal Long Axis, Apical 4 Chamber, and Apical 2 Chamber) with Kosmos Trio. The study will divide the guidance cues not evaluated sufficiently in the ECHO-020 study into four categories: 1) corrective guidance, 2) incorrect scanning window, 3) incorrect probe orientation, and 4) low confidence prediction. For each guidance cue evaluated in this study, expert annotators will review two clips: one suboptimal view, collected when the probe is positioned at an incorrect location; and one guided view, captured after the sonographer followed the probe motion cue displayed by the system. Annotators will review each pair of clips and respond indicating either i) Yes, the guided clip demonstrates the appropriate correction from the suboptimal view; ii) No, the guided clip does not demonstrate the appropriate correction from the suboptimal view; or iii) Unevaluable, the guided clip is technically inadequate for assessment. For each category of guidance cues, the outcome measure will be the rate at which annotators respond "Yes." Finally, this study will also evaluate the Kosmos Trio Auto-Capture algorithm's ability to detect and capture a diagnostic-quality image. Annotators will rate clips captured by Kosmos Trio Auto-Capture on an ACEP-based image quality scale. The outcome measure will be the image quality score. The study design involves the compilation of de-identified retrospective cardiac clips acquired using the Kosmos diagnostic ultrasound system. This data was collected for two previous studies; no additional data will be collected from previous study participants for the purposes of this study.

Study Overview

Study Type

Observational

Enrollment (Estimated)

81

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

    • Washington
      • Redmond, Washington, United States, 98052
        • EchoNous, Inc.

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

Yes

Sampling Method

Non-Probability Sample

Study Population

The study used retrospective datasets from 2 sources: ECHO-020 Kosmos Guidance, Grading, and Capture Performance Evaluation study, and ECHO-025 Kosmos Guidance Performance Evaluation study. Both datasets comprise fully de-identified, retrospective, echocardiographic clips acquired using the Kosmos diagnostic ultrasound system.

Data collection for both studies was performed at EchoNous headquarters in Redmond, Washington. Source data was collected targeting a balanced representation of demographics and clinical characteristics (including gender and BMI) to ensure the generalizability of study findings.

Description

Inclusion Criteria:

  • All data used in this study must have been collected per 45 CFR § 26,
  • Data must have been collected per source protocol requirements with no deviation for that data set,
  • Adequate demographic information available from original study participation (sex, BMI, ethnicity, and race)
  • Exam acquisition performed by a qualified echocardiographer using the Kosmos system

Exclusion Criteria:

  • Inadequate demographic information corresponding to the available data, and
  • Non-echocardiographer acquired images.

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

Cohorts and Interventions

Group / Cohort
Intervention / Treatment
Project 1
Participants included in Project 1, Category 1: Corrective Guidance
When the system detects that the probe is near the correct cardiac window but requires a specific directional adjustment, it displays a Category 1 - Corrective Guidance message. Each case in this project consists of two clips: Clip A - Suboptimal View: captured after the sonographer has intentionally moved the probe to a prescribed off-target position; and Clip B - Guided View: captured after the sonographer followed the Category 1 probe motion cue displayed by the system. For each pair of clips, annotators will be asked when Comparing Clip A and Clip B whether following the Category 1 corrective guidance instruction produces a discernible improvement in overall image quality. They will provide an answer of Yes, No, or Unevaluable.
Project 2
Participants included in Project 2, Category 2: Incorrect Scanning Window
When the system detects that the probe is positioned at a fundamentally incorrect anatomical location relative to the target cardiac view, it displays a Category 2 - Incorrect Scanning Window message. Each case in this project consists of two clips: Clip A - Suboptimal View: captured after the sonographer has intentionally a clearly incorrect anatomical location; and Clip B - Guided View: captured after the sonographer followed the Category 2 window-navigation cue and moved to the correct scanning window displayed by the system. For each pair of clips, annotators will be asked when Comparing Clip A and Clip B whether following the Category 2 guidance instruction produces a clip in the correct scanning window. They will provide an answer of Yes, No, or Unevaluable.
Project 3
Participants included in Project 3, Category 3: Incorrect Probe Orientation
When the system detects that the probe has been rotated 180° around its longitudinal axis, producing a laterally mirrored image, it displays a Category 3 - Incorrect Probe Orientation message. Each case in this project consists of two clips: Clip A - Suboptimal View: with the probe rotated 180° at the correct cardiac window, producing a mirrored image; and Clip B - Guided View: sonographer corrected the probe orientation in response to the Category 3 message displayed by the system. For each pair of clips, annotators will be asked when Comparing Clip A and Clip B whether following the Category 3 guidance instruction produced a clip that is oriented correctly. They will provide an answer of Yes, No, or Unevaluable.
Project 4
Participants included in Project 4, Category 4: Low Confidence Prediction
When the system's confidence in the current image is insufficient to issue a specific directional correction, it displays a Category 4 - Low Confidence Prediction message. Each case in this project consists of two clips: Clip A - Suboptimal View: with the probe rotated 180° at the correct cardiac window, producing a mirrored image; and Clip B - Guided View: sonographer corrected the probe orientation in response to the Category 3 message displayed by the system. For each pair of clips, annotators will be asked when Comparing Clip A and Clip B whether following the Category 3 guidance instruction produced a clip that is oriented correctly. They will provide an answer of Yes, No, or Unevaluable.
Project 5
Participants included in Project 5, Auto-Capture Frame-Level Re-annotation
The Kosmos Trio Auto-Capture feature automatically triggers clip recording when it detects that a diagnostic quality image has been achieved. Each case in this project is a single captured clip. No comparison clip is provided. The view (PLAX, A4C, or A2C) is indicated for each case. For each frame in this clip, annotators will be asked to assign a quality grade using the ACEP 1-5 image quality scale (where 1 represents a frame in which the relevant anatomy is not visualized or identifiable, and 5 represents a frame in which the image is sharp and the relevant anatomy is well visualized and present in the frame) to each frame.

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Guidance Algorithm Accuracy
Time Frame: Post data acquisition (2 months)
Guidance algorithm accuracy will be evaluated using Positive Predictive Value (PPV), a calculation that compares the diagnostic quality between the suboptimal view following an indicated probe movement and the guided view following the Guidance correction of the probe location. PPV will be calculated for each cardiac view included in this study (PLAX, A4C, and A2C), across all four Guidance categories. PPV is calculated by dividing the number of True Positives (the number of trial pairs in which the post-action clip demonstrates that following the guidance instruction produced the intended improvement for the applicable guidance category) by the number of True Positives plus the number of False Positives (the number of trial pairs in which the post-action clip does not demonstrate the expected improvement for the applicable category). Success is defined as a PPV > 0.80 and 95% CI lower bound > 0.80 for each view. All three views must independently satisfy this criteria.
Post data acquisition (2 months)
Performance of Auto-Capture
Time Frame: Post data acquisition (2 months)
The accuracy of Auto-Capture will be evaluated using Positive Predictive Value (PPV), a calculation that provides the proportion of clips captured using Auto-Capture that contain a sufficient proportion of diagnostic-quality frames to be considered clinically acceptable. PPV is calculated by dividing the number of True Positives (the number of clips with at least one full cardiac cycle of frames is determined to be diagnostic by expert reviewers, in accordance with the ACEP-based grading scale) by the number of True Positives plus the number of False Positives (the number of clips that do not have at least one full cardiac cycle of frames is determined to be diagnostic by expert reviewers, in accordance with the ACEP-based grading scale). Success is defined as a PPV > 0.80 and 95% CI lower bound > 0.80.
Post data acquisition (2 months)

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

June 5, 2026

Primary Completion (Estimated)

August 30, 2026

Study Completion (Estimated)

September 30, 2026

Study Registration Dates

First Submitted

August 13, 2026

First Submitted That Met QC Criteria

August 13, 2026

First Posted (Actual)

August 18, 2026

Study Record Updates

Last Update Posted (Actual)

August 18, 2026

Last Update Submitted That Met QC Criteria

August 13, 2026

Last Verified

August 1, 2026

More Information

Terms related to this study

Additional Relevant MeSH Terms

Other Study ID Numbers

  • ECHO-302

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

UNDECIDED

IPD Plan Description

Publication decisions will be made at a later date.

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

Yes

product manufactured in and exported from the U.S.

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Subscribe