AI-Assisted Interpretation of Ultra-Widefield Retinal Images
Prospective Multi-Center Evaluation of AI-Assisted Interpretation of Ultra-Widefield Retinal Images in a Multi-Reader Crossover Study
The goal of this prospective observational study is to evaluate the impact of artificial intelligence (AI) assistance on clinician interpretation of ultra-widefield (UWF) retinal images.
The main questions it aims to answer are:
whether AI assistance improves the diagnostic performance of ophthalmologists in detecting retinal findings on UWF retinal images; whether AI assistance improves sensitivity, specificity, and inter-reader agreement across clinicians with different levels of experience.
Approximately 600 UWF retinal images prospectively collected from multiple ophthalmic centers in China will be included. Images will be independently annotated by expert retinal specialists to establish reference labels for retinal finding categories.
Four ophthalmologists with different levels of clinical experience, including one senior retinal specialist and three junior ophthalmologists, will participate in a crossover multi-reader study.
For each clinician, the dataset will be randomly divided into two equal subsets. During the first reading session, clinicians will evaluate one subset without AI assistance and the other subset with AI assistance. After a washout interval of at least two weeks, the reading conditions will be reversed in a second reading session with independently randomized image order.
Under the AI-assisted condition, clinicians will be provided with category-level AI prediction probabilities for retinal findings. No localization maps, heatmaps, segmentation overlays, or automated diagnostic recommendations will be displayed. Clinicians will retain full autonomy over final decisions.
Reader performance under AI-assisted and unaided conditions will be compared using expert reference annotations as the ground truth.
Tutkimuksen yleiskatsaus
Tila
Ehdot
Interventio / Hoito
Yksityiskohtainen kuvaus
This study is a prospective multi-center observational reader study designed to evaluate the impact of artificial intelligence (AI) assistance on clinician interpretation of ultra-widefield (UWF) retinal images.
Approximately 600 UWF retinal images will be prospectively collected from multiple ophthalmic centers in China. Images will be acquired using clinically routine UWF retinal imaging systems and will include a broad spectrum of retinal diseases and retinal findings encountered in real-world clinical practice.
All images will undergo independent expert annotation by retinal specialists to establish reference labels for retinal finding categories. These expert annotations will serve as the reference standard for subsequent performance evaluation.
Four ophthalmologists with different levels of clinical experience will participate in the reader study, including:
one senior retinal specialist with approximately five years of retinal clinical experience; three junior ophthalmologists with approximately two years of ophthalmology residency training.
A randomized crossover multi-reader design will be implemented to minimize recall bias and balance reading conditions.
For each clinician, the image dataset will be randomly divided into two equal subsets (subset A and subset B; approximately 300 images each).
During Round 1:
subset A will be interpreted without AI assistance; subset B will be interpreted with AI assistance.
After a washout interval of at least two weeks, the reading conditions will be reversed during Round 2:
subset A will be interpreted with AI assistance; subset B will be interpreted without AI assistance.
Image order will be independently randomized for each session and each clinician.
Under the unaided condition, clinicians will evaluate retinal images using standard clinical interpretation without AI output.
Under the AI-assisted condition, clinicians will receive category-level AI prediction probabilities for retinal finding categories. The AI output will provide probabilistic confidence scores only and will not include lesion localization maps, heatmaps, segmentation overlays, or automated binary recommendations.
Clinicians will remain blinded to the expert reference labels and to the interpretations of other readers. Final diagnostic decisions will be independently determined by each clinician.
The primary analysis will compare diagnostic performance between unaided and AI-assisted conditions, including sensitivity, specificity, area under the receiver operating characteristic curve (AUC), and inter-reader agreement.
Opintotyyppi
Ilmoittautuminen (Todellinen)
Yhteystiedot ja paikat
Opiskelupaikat
-
-
Chongqing Municipality
-
Chongqing, Chongqing Municipality, Kiina
- Chongqing Huaxia Eye Hospital
-
-
Fujian
-
Fuzhou, Fujian, Kiina, 361000
- Fuzhou Eye Hospital
-
Xiamen, Fujian, Kiina, 361000
- Xiamen Eye Center of Xiamen University
-
-
Hebei
-
Hengshui, Hebei, Kiina
- Hengshui Tongrui Eye Hospital
-
-
Shandong
-
Heze, Shandong, Kiina
- Heze Huaxia Eye Hospital
-
-
Osallistumiskriteerit
Kelpoisuusvaatimukset
Opintokelpoiset iät
- Aikuinen
- Vanhempi Aikuinen
Hyväksyy terveitä vapaaehtoisia
Näytteenottomenetelmä
Tutkimusväestö
Kuvaus
Inclusion Criteria:
- Participants undergoing ultra-widefield retinal imaging at participating ophthalmic centers;
Exclusion Criteria:
- Poor-quality or ungradable retinal images;
Opintosuunnitelma
Miten tutkimus on suunniteltu?
Suunnittelun yksityiskohdat
Kohortit ja interventiot
Ryhmä/Kohortti |
Interventio / Hoito |
|---|---|
|
AI-Assisted Interpretation
Clinicians interpret ultra-widefield retinal images with access to AI-generated category-level prediction probabilities for retinal findings.
|
Clinicians interpret ultra-widefield retinal images with access to AI-generated category-level prediction probabilities for retinal findings.
|
|
Unaided Interpretation
Clinicians interpret ultra-widefield retinal images without AI assistance using routine retinal image interpretation alone.
|
Clinicians interpret ultra-widefield retinal images without AI assistance using routine retinal image interpretation alone.
|
Mitä tutkimuksessa mitataan?
Ensisijaiset tulostoimenpiteet
Tulosmittaus |
Toimenpiteen kuvaus |
Aikaikkuna |
|---|---|---|
|
Sensitivity for retinal finding detection
Aikaikkuna: through study completion, an average of 2 months
|
Sensitivity of clinicians in detecting retinal finding categories under AI-assisted and unaided conditions using expert annotations as the reference standard.
|
through study completion, an average of 2 months
|
|
Specificity for retinal finding detection
Aikaikkuna: through study completion, an average of 2 months
|
Specificity of clinicians in detecting retinal finding categories under AI-assisted and unaided conditions.
|
through study completion, an average of 2 months
|
Toissijaiset tulostoimenpiteet
Tulosmittaus |
Toimenpiteen kuvaus |
Aikaikkuna |
|---|---|---|
|
Area under the receiver operating characteristic curve (AUC)
Aikaikkuna: through study completion, an average of 2 months
|
The AUC quantifies the overall ability to correctly distinguish the presence versus absence of predefined retinal findings on ultra-widefield retinal images.
AUC values range from 0.5 (no discriminative ability) to 1.0 (perfect discrimination).
Clinician interpretations will be compared with an expert-adjudicated reference standard under AI-assisted and unaided conditions.
|
through study completion, an average of 2 months
|
|
Inter-reader agreement
Aikaikkuna: At study completion (up to 3 months)
|
Agreement among participating clinicians in classifying predefined retinal findings on ultra-widefield retinal images.
Agreement will be quantified using Cohen's kappa coefficient (for pairwise comparisons) or Fleiss' kappa coefficient (for multiple readers).
Kappa values range from 0 (no agreement beyond chance) to 1 (perfect agreement).
|
At study completion (up to 3 months)
|
|
Diagnostic performance improvement among junior ophthalmologists
Aikaikkuna: At study completion (up to 3 months)
|
Improvement in diagnostic performance of junior ophthalmologists when interpreting ultra-widefield retinal images with AI assistance compared with unaided interpretation, measured by changes in sensitivity, specificity, accuracy, and AUC using the expert-adjudicated reference standard.
|
At study completion (up to 3 months)
|
Yhteistyökumppanit ja tutkijat
Tutkijat
- Päätutkija: Xiuju Chen, Xiamen Eye Center of Xiamen University
Opintojen ennätyspäivät
Opi tärkeimmät päivämäärät
Opiskelun aloitus (Todellinen)
Ensisijainen valmistuminen (Todellinen)
Opintojen valmistuminen (Todellinen)
Opintoihin ilmoittautumispäivät
Ensimmäinen lähetetty
Ensimmäinen toimitettu, joka täytti QC-kriteerit
Ensimmäinen Lähetetty (Todellinen)
Tutkimustietojen päivitykset
Viimeisin päivitys julkaistu (Todellinen)
Viimeisin lähetetty päivitys, joka täytti QC-kriteerit
Viimeksi vahvistettu
Lisää tietoa
Tähän tutkimukseen liittyvät termit
Avainsanat
Muita asiaankuuluvia MeSH-ehtoja
Muut tutkimustunnusnumerot
- XMYKZX-KY-2026-008
Yksittäisten osallistujien tietojen suunnitelma (IPD)
Aiotko jakaa yksittäisten osallistujien tietoja (IPD)?
IPD-suunnitelman kuvaus
Lääke- ja laitetiedot, tutkimusasiakirjat
Tutkii yhdysvaltalaista FDA sääntelemää lääkevalmistetta
Tutkii yhdysvaltalaista FDA sääntelemää laitetuotetta
Nämä tiedot haettiin suoraan verkkosivustolta clinicaltrials.gov ilman muutoksia. Jos sinulla on pyyntöjä muuttaa, poistaa tai päivittää tutkimustietojasi, ota yhteyttä register@clinicaltrials.gov. Heti kun muutos on otettu käyttöön osoitteessa clinicaltrials.gov, se päivitetään automaattisesti myös verkkosivustollemme .