Prospective User Study and Multicenter Validation of Multimodal Medical Imaging Large Models
Prospective User Study and Multicenter Validation of Multimodal Medical Imaging Large Models in the Diagnosis of Common Systemic Diseases
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Detailed Description
Study Type
Study Type
Enrollment (Actual)
Enrollment
Contacts and Locations
Study Contact
Study Contact
- Name: Tao Li, MD
- Phone Number: +86-15527360835
- Email: lt12420131@163.com
Study Locations
-
-
Guangdong
-
Guangzhou, Guangdong, China, 510630
- The Third Affiliated Hospital of Southern Medical University
-
-
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Sampling Method
Study Population
Description
Inclusion Criteria:
- Patients who underwent CT examinations for common systemic diseases.
- Imaging data must have confirmed clinical reference standards, expert consensus, or pathological diagnosis.
- Availability of complete DICOM format images with standard acquisition protocols.
Exclusion Criteria:
- Poor image quality (e.g., severe motion or metal artifacts) that precludes definitive diagnosis.
- Cases with incomplete clinical or pathological reference standards.
- Corrupted image files or duplicate cases.
Study Plan
How is the study designed?
Design Details
Number of groups / cohorts
Cohorts and Interventions
Group / CohortGroup / Cohort |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Validation Cohort
Prospective Observational Validation Cohorts CT data are prospectively collected at two centers after model locking and used for observational model validation.
A subset is included in the randomized crossover reader study.
|
Radiologists interpret the medical images independently without any assistance from the AI model to establish a baseline performance.
Radiologists interpret the same set of medical images with the assistance of the multimodal medical imaging large model to evaluate the improvement in diagnostic performance.
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Case-level Diagnostic Accuracy and Area Under the ROC Curve (AUC)
Time Frame: Up to 1 week per evaluation period
|
Evaluation of case-level diagnostic accuracy (defined as the proportion of diagnostic decisions matching the clinical ground-truth label) and discrimination performance (measured by AUC) to compare unaided radiologist performance versus AI-assisted performance.
|
Up to 1 week per evaluation period
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Diagnostic Efficiency (Reading and Reporting Time)
Time Frame: Up to 1 week per evaluation period
|
Measurement of diagnostic efficiency recorded as the time (in seconds) taken by radiologists to complete the case review and generate findings, with and without AI assistance.
|
Up to 1 week per evaluation period
|
|
Inter-rater Agreement (Fleiss' Kappa)
Time Frame: Up to 1 week per evaluation period
|
Assessment of diagnostic consensus and inter-rater consistency among participating radiologists measured using Fleiss' kappa (κ).
|
Up to 1 week per evaluation period
|
|
Clinical Report Quality and Semantic Accuracy Score
Time Frame: Up to 1 week per evaluation period
|
Assessment of AI-generated draft report quality evaluated by senior experts on a 5-point Likert scale (focusing on semantic accuracy and clinical relevance) and automated metrics (GREEN and ROUGE-L).
|
Up to 1 week per evaluation period
|
Collaborators and Investigators
Sponsor
Sponsor
Investigators
Investigators
- Principal Investigator: Yinghua Zhao, PhD, The Third Affiliated Hospital of Southern Medical University
Study record dates
Study Major Dates
Study Start (Actual)
Study Start
Primary Completion (Actual)
Primary Completion
Study Completion (Actual)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Other Study ID Numbers
Other Study ID Numbers
- 2025-ER-141
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
IPD Plan Description
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.