A Multimodal AI Agent for Ophthalmic Clinical Decision Support
Multicenter Randomized Controlled Trial of a Multimodal AI Agent for Ophthalmology Clinical Decision Support
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Detailed Description
This multicenter, randomized controlled trial aims to evaluate the integration of EyeAgent, a multimodal artificial intelligence (AI) agent, in real-world clinical settings. The AI system is designed to support clinicians by analyzing patient data, including ocular images and electronic health records, to aid in image interpretation, diagnosis, and treatment planning.
A total of 300 participants will be randomly assigned to either an AI-assisted care arm or a standard care arm. In the AI-assisted arm, clinicians review the comprehensive report generated by AI agent as a supportive tool before finalizing their independent decisions. The study comprehensively measures diagnostic accuracy, the rate of inappropriate treatment decisions, report generation, workflow efficiency, and user questionnaire.
By comparing these two groups, the trial aims to provide robust evidence on the effectiveness and practical utility of AI-driven clinical decision support in ophthalmology, with the goal of enhancing both the quality and efficiency of patient care.
Study Type
Study Type
Enrollment (Estimated)
Enrollment
Phase
Phase
- Not Applicable
Contacts and Locations
Study Contact
Study Contact
- Name: Xiaolan Chen
- Phone Number: +85295822773
- Email: yuewy.wu@connect.polyu.hk
Study Contact Backup
- Name: Danli Shi, Dr
- Email: danli.shi@polyu.edu.hk
Study Locations
-
-
-
Hong Kong, China
- The Hong Kong Polytechnic University
-
Contact:
- Xiaolan Chen
- Phone Number: 085295822773
- Email: xiaolan-xl.chen@connect.polyu.hk
-
-
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
- Child
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- Outpatient participants aged 6 to 75 years.
- Participants who undergo ophthalmic examinations for medical purposes during the study period.
- Participants who can produce clear ophthalmic images in both eyes.
Agree to participate in this study with written informed consent:
- Participants aged 18 years or older provide their own consent.
- Participants aged 6-17 years require consent from a parent or legal guardian.
Exclusion Criteria:
- Participants who are reluctant to participate in this study.
- Participants presenting with acute or emergency ocular conditions requiring immediate intervention.
- Participants with poor quality of ophthalmic images, including blurriness, artifacts, underexposure, or overexposure.
- Other unsuitable reasons determined by the evaluators.
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Other
- Allocation: Randomized
- Interventional Model: Parallel Assignment
- Masking: Double
Number of Arms
Arms and Interventions
Participant Group / ArmParticipant Group / Arm |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Experimental: AI-assisted care arm
Clinicians perform report generation, diagnosis, and treatment planning with support from the EyeAgent system.
|
EyeAgent is a multimodal AI agent assistant for ophthalmology that integrates imaging, electronic health records, and curated clinical knowledge.
In this arm, EyeAgent supports clinicians in clinical consultation, including report generation, diagnostic interpretation, and treatment planning.
|
|
No Intervention: Standard care arm
Clinicians provide routine ophthalmic care without support from the EyeAgent system.
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Diagnostic accuracy rate
Time Frame: Immediately after the intervention.
|
Proportion of diagnoses consistent with a reference expert panel.
|
Immediately after the intervention.
|
|
Rate of inappropriate treatment decisions
Time Frame: Immediately after the intervention.
|
The frequency of treatment recommendations (e.g., injection, laser therapy, or observation) that deviate from clinical guidelines as determined by the senior expert panel gold standard.
Expert adjudication is conducted post-hoc after the enrollment phase concludes.
|
Immediately after the intervention.
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Workflow efficiency
Time Frame: During the index diagnostic session.
|
Time elapsed from image acquisition to final diagnosis and report completion.
|
During the index diagnostic session.
|
|
Report quality
Time Frame: Within 1 month after enrollment.
|
Quality of clinical reports assessed using a structured Expert Report Quality Rubric evaluating five domains: accuracy, completeness, safety, reasoning, and interpretability.
Each domain is scored on a 3-point scale (1 = poor, 2 = acceptable, 3 = good).
Total scores range from 5 to 15.
Higher scores indicate better report quality.
|
Within 1 month after enrollment.
|
|
Clinician confidence
Time Frame: Immediately after the intervention.
|
Self-rated confidence in diagnosis and treatment planning measured using a single-item 5-point Likert scale (1 = not confident at all; 5 = extremely confident).
|
Immediately after the intervention.
|
|
Satisfaction and usability
Time Frame: At the end of each clinician's participation period, approximately 2 months.
|
Usability of the AI agent assessed using the System Usability Scale (SUS), a validated 10-item questionnaire scored on a 5-point Likert scale.
Each item is scored from 1 (Strongly disagree) to 5 (Strongly agree).
Total SUS scores are calculated according to standard scoring procedures and range from 0 to 100, with higher scores indicating better perceived usability.
|
At the end of each clinician's participation period, approximately 2 months.
|
Collaborators and Investigators
Sponsor
Sponsor
Investigators
Investigators
- Principal Investigator: Mingguang He, The Hong Kong Polytechnic University
Study record dates
Study Major Dates
Study Start (Estimated)
Study Start
Primary Completion (Estimated)
Primary Completion
Study Completion (Estimated)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Keywords
Additional Relevant MeSH Terms
Other Study ID Numbers
Other Study ID Numbers
- PolyU-IRB-2025-001
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Retinal Disease
-
NCT05122442Completed
-
NCT07641738Not yet recruiting
-
NCT04311112Withdrawn
-
NCT05957276Active, not recruitingInherited Retinal Diseases
-
NCT07530783Terminated
-
NCT02811536Completed
-
NCT06749639RecruitingInherited Retinal Diseases
-
NCT06839170CompletedInherited Retinal Diseases
Clinical Trials on EyeAgent AI system
-
NCT07470463RecruitingDifferential Diagnosis | Diagnostic Accuracy
-
NCT06962423Not yet recruitingBiomedical Research | Artificial Intelligence (AI)
-
NCT05792280Recruiting
-
NCT07454967CompletedGastrointestinal Stromal Tumors | Gastric Subepithelial Tumors | Artificial Intelligence (AI) | Gastric Leiomyoma | Multimodal Imaging
-
NCT06718725RecruitingThe Malignant Lesions and Non-malignant Lesions of Pancreas, Bile Duct, Liver and Lymph Node
-
NCT06543862Not yet recruitingColonic Polyp | Artificial Intelligence
-
NCT07505251Not yet recruitingPeriodontitis Stage II | Periodontitis Stage III | Periodontitis Stage IV
-
NCT05851885Not yet recruitingArtificial Intelligence | Endoscopy, Gastrointestinal
-
NCT03738930UnknownBleeding | Acute Coronary Syndrome | Percutaneous Coronary Intervention