- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT06306599
Ultrasound Operator Influence on Diagnostics With AI for Thyroid Nodules - Clinial Trial
The Ultrasound Operator's Influence on the Diagnostic Accuracy of Artificial Intelligence for Thyroid Nodules Assessment - a Clinical Trial
This is a prospective clinical study aiming to test how the experience of the ultrasound operator influences the performance of AI-based (artificial intelligence-based) diagnostics when analysing thyroid nodules on ultrasound scans. The investigators set up an experiment with five stations, each with a patient with a thyroid nodule and an ultrasound machine with the deep learning based system S-Detect for Thyroid installed. 20 study participants where recruited: 8 medical students of novice ultrasound skill, 3 junior ENT (ear-nose-throat) registrars of intermediate ultrasound skill, and 9 senior ENT registrars experienced in ultrasound. The participants scanned all the patients and recorded their analyses of the nodules using the EUTIRADS (European thyroid imagining reporting and data system) system in three different ways: a analysis of their own, S-Detect's analysis, and an analysis combining the two previous.
The hypothesis was that the AI system would perform equally well when between the participant groups. In addition, it was expected that the experienced participants would perform better than the students without AI help, and that the doctors would gain little from AI input, but that the students would have their performance improved by AI input.
Study Overview
Status
Conditions
Intervention / Treatment
Study Type
Enrollment (Actual)
Phase
- Not Applicable
Contacts and Locations
Study Locations
-
-
-
Copenhagen, Denmark, 2100
- Rigshospitalet
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
- Child
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Medical students
Inclusion Criteria:
- Last year student
Exclusion Criteria:
- Experience with ultrasound beyond that which is taught at the University of Copenhagen
Junior ENT registrar doctors
Inclusion Criteria:
- Doctor enrolled in introductory training as ENT physician.
Senior ENT registrar doctors
Inclusion Criteria:
- Doctor enrolled in ENT training.
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Diagnostic
- Allocation: N/A
- Interventional Model: Single Group Assignment
- Masking: None (Open Label)
Arms and Interventions
Participant Group / Arm |
Intervention / Treatment |
---|---|
Experimental: Experiment
20 participants ultrasound scan five patients with thyroid nodules, and assess these nodules themselves, then with the AI-program, and at last they give a combined assessment.
|
Deep learning based program on Samsung ultrasound machines designed to do real-time semi-automated analysis of thyroid nodules.
The ultrasound operator freezes a transverse image of the patient's thyroid nodule and activates S-Detect.
The operator selects the nodule on the screen, and the program automatically draws a region of interest.
Then S-Detect gives a dichotomous diagnosis of either "Possibly benign" and "Possibly malignant".
In addition, it measures the nodule and characterises it with a lexicon based on EUTIRADS.
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
---|---|---|
Accuracy of S-Detect diagnosis
Time Frame: 1 day (day of experiment)
|
Number of correct thyroid nodule malignancy diagnoses out of total malignancy diagnoses by the AI-based ultrasound diagnostic system "S-Detect" on the five patients' thyroid nodules.
Gold standard is cytology and histology of the nodules.
|
1 day (day of experiment)
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
---|---|---|
Accuracy of biopsy recommendation
Time Frame: 1 day (day of experiment)
|
Number of correct biopsy recommendations on the five patients' thyroid nodules.
Recommendation is derived from EUTIRADS analyses done by participants with and without AI assistance.
Gold standard is biopsy recommendation derived from expert consensus EUTIRADS assessment of the nodules.
|
1 day (day of experiment)
|
Nodule classification agreement
Time Frame: 1 day (day of experiment)
|
Agreement of nodule classification with gold standard.
Nodule classifications are derived from EUTIRADS done by participants, S-Detect, and participant with S-Detect input on the five patients' thyroid nodules.
Gold standard is expert consensus EUTIRADS assessment of the nodules.
|
1 day (day of experiment)
|
Accuracy of EUTIRADS scores
Time Frame: 1 day (day of experiment)
|
Number of correct EUTIRADS scores given by analyses from participants, S-Detect, and participants with S-Detect input on the five patients' thyroid nodules.
Gold standard is EUTIRADS score from expert consensus EUTIRADS assessment of the nodules.
|
1 day (day of experiment)
|
Nodule measurement
Time Frame: 1 day (day of experiment)
|
Measurement of the five patients' thyroid nodules done by participants and S-Detect.
Gold standard are measurements from expert consensus assessment analysis of the nodules.
|
1 day (day of experiment)
|
OSAUS score
Time Frame: 1 day (day of experiment)
|
Mean OSAUS (objective structured assessment of ultrasound skills) scores of participants as assessed from their ultrasound scans of the five patients.
Assessment are independently by two head-and-neck ultrasound experts.
|
1 day (day of experiment)
|
Collaborators and Investigators
Sponsor
Investigators
- Study Director: Tobias Todsen, Ph.d, Rigshospitalet, Denmark
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Actual)
Study Completion (Actual)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Actual)
Study Record Updates
Last Update Posted (Actual)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Keywords
Additional Relevant MeSH Terms
Other Study ID Numbers
- Thyroid AI US operator exp
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Thyroid Nodule
-
Tseung Kwan O Hospital, Hong KongNot yet recruitingBenign Thyroid Nodule | Suspicious Malignant Thyroid Nodule
-
Aarhus University HospitalOdense University Hospital; University of AarhusEnrolling by invitationThyroid Cancer | Thyroid Nodule (Diagnosis)Denmark
-
Pulse Biosciences, Inc.RecruitingThyroid Nodule (Benign)Italy
-
Rijnstate HospitalZonMw: The Netherlands Organisation for Health Research and Development; University... and other collaboratorsRecruitingRadiofrequency Ablation | Thyroid Nodule, Toxic or With Hyperthyroidism | Autonomous Thyroid Function | Thyroid Nodule; Hyperthyroidism | Iodine Hyperthyroidism | Iodine Adverse ReactionNetherlands
-
University of Wisconsin, MadisonNational Cancer Institute (NCI); University of MichiganCompletedThyroid Cancer | Thyroid Nodule | Benign Thyroid NoduleUnited States
-
University of Sao Paulo General HospitalRecruiting
-
Assiut UniversityNot yet recruitingThyroid Nodule (Benign)
-
Fundatia Bio-ForumCompletedBenign Thyroid NoduleRomania
-
Wuhan UniversityRecruitingThyroid Carcinoma | Thyroid Nodule (Benign) | Ablation; RetinaChina
Clinical Trials on S-Detect for Thyroid
-
DiaxonhitUnknownThyroid Cancer | Thyroid NoduleFrance
-
Samsung MedisonUniversity of RochesterUnknownBreast Cancer | Breast Lesions | Breast MassUnited States
-
The University of Texas Health Science Center,...National Institute on Aging (NIA)Not yet recruiting
-
Fudan UniversityThe First Affiliated Hospital of Anhui Medical University; Guangdong Provincial... and other collaboratorsWithdrawn
-
Sohag UniversityNot yet recruitingDuchenne Muscular DystrophyEgypt
-
Ain Shams UniversityUnknownICU Acquired Weakness | Thyroid AbnormalitiesEgypt
-
University of California, Los AngelesRecruitingPapillary Thyroid CancerUnited States
-
Leiden University Medical CenterZonMw: The Netherlands Organisation for Health Research and DevelopmentEnrolling by invitationCeliac Disease in ChildrenNetherlands
-
Million Marker Wellness, Inc.CompletedEnvironmental Exposure | Survey | Health Literacy | Endocrine Disrupting Chemicals | Phthalate Exposure | Bisphenol AUnited States
-
National Health Research Institutes, TaiwanRecruiting