- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT04132401
AI for the Detection of Retinal Disease and Glaucoma in Patients With Diabetes Mellitus in Primary Care
Artificial Intelligence for the Detection of Central Retinal Disease and Non-mydriatic Glaucoma in the Context of Patients With Diabetes Mellitus in Primary Care: A Prospective Study Comparing the Diagnostic Capacity of an AI Algorithm
Background: Diabetic retinopathy (DR) is one of the most important causes of blindness worldwide, especially in developed countries. In diabetic patients, periodic examination of the back of the eye using a nonmydriatic camera has been widely demonstrated to be an effective system to control and prevent the onset of DR. Convolutional neural networks have been used to detect DR, achieving very high sensitivities and specificities.
Hypothesis: It is possible to develop algorithms based on artificial intelligence that can demonstrate equal or superior performance and that constitute an alternative to the current screening of DR and other ophthalmic pathologies in diabetic patients.
Objectives:
- Development of an artificial intelligence system for the detection of signs of retinal pathology and other ophthalmic pathologies in diabetic patients.
- Scientific validation of the system to be used as a screening system in primary care.
Methods: This project consisted of carrying out two studies simultaneously:
- Development of an algorithm with artificial intelligence to detect signs of DR and other pathologies of the central retina in patients with diabetes.
- An observational, cross-sectional study comparing the diagnostic capacity of the algorithms with that of the family medicine specialists who read the fundus images. The reference was double-blind reading by ophthalmologists who specialize in retina.
The cession of the images began at the end of 2018. The images used for the validation were obtained during routine diabetic retinopathy screening between May and August 2021. The results have since been published.
The study allowed the development of an algorithm based on AI able to demonstrate an equal or superior performance, and to constitute a complement or an alternative to the current screening of DR in diabetic patients.
Study Overview
Status
Conditions
Intervention / Treatment
Detailed Description
Study Design This project followed a methodology consisting of 2 concomitant studies: In the first study, an AI algorithm was developed to detect the signs of DR in patients with diabetes. The second part of the project consisted of an observational, cross-sectional study comparing the diagnostic capacity of the algorithm with that of the family medicine physicians and with retina specialists. The reference was a blinded double reading conducted by the retina specialists (with a blinded third reading in case of disagreement in the previous 2 readings). In this way, the results obtained, both by the AI algorithm and by family medicine specialists, were compared using the gold standard (accuracy, sensitivity, specificity, area under the curve, retina specialists (with a blinded third reading in case of disagreement in the previous 2 readings). In this way, the results obtained, both by the AI algorithm and by family medicine specialists, were compared using the gold standard (accuracy, sensitivity, specificity, area under the curve, etc). The inclusion of nurses who received training in fundus readings was considered to compare their diagnostic capacity.
Study Population, Site Participation, and Recruitment. Images for the development of the algorithm were ceded by the CHS and included images from the whole Catalan population. The study took place in the primary care centers managed by the Catalan Health Institute in Central Catalonia, which includes the counties of Bages, Osona, Berguedà, and Anoia. The reference population was the population assigned to these primary care centers. This population included about 512,000 people in 2017, with an estimated prevalence of diabetes of 7.1%. The study period included 2010-2017 for the development of the algorithm with AI. Once the algorithm had been developed, the study was conducted on fundus images obtained during routine diabetic retinopathy screening over a period of about 3-4 months, between May and August 2021.
Conduct of the Study. For the development of the AI algorithm, all fundus images labeled as DR of patients from primary care centers in Catalonia between 2010 and 2017 were included. For the study, all the images of patients who underwent an eye fundus examination were included until the adequate number of patients was reached. A high percentage of the fundus images had sufficient quality; that is, a 40-degree vision of the central retina where at least a three-fourth part of the optic nerve, a well-focused macula, and well-defined veins and arteries of the upper and lower arcs can be seen. Eye fundus images that did not have adequate technical quality (dark) or that could not be evaluated due to the opacity of the media (eg, for cataracts) were excluded.
Data Collection. For the development of the AI algorithm, anonymized images with the corresponding label that classifies each image (in one of the classes with which the algorithm was trained) were required. The personnel responsible for information technology (IT) of the CHS evaluated the best strategy for the anonymization and extraction of the images from the computer systems of the CHS, as well as the identification of each image with a unique identifier. A tabulated file type CSV or TXT was used to relate each image identifier with the corresponding classification. The person responsible for IT of the CHS, together with the technical manager of OPTretina, agreed on the best way to transfer these 2 sources of information, in a secure way, from the CHS servers to the OPTretina servers (SSH File Transfer Protocol, external hard disk), depending on the volume of data to be transferred and the internal policy of the CHS. OPTretina is experienced in developing AI models for automatic fundus image classification and is a Spanish Agency of Medicines and Health Products-certified medical device manufacturer. For the study, anonymized weekly fundus readings collected by family medicine physician readers of fundus images in Central Catalonia were collected. The images were transferred to the OPTretina servers to be first analyzed by the diagnostic algorithm and then by the retina specialists who made the definitive diagnosis. The person responsible for IT of the CHS, together with the technical manager of OPTretina, agreed on the best way to transfer these data in a secure manner.
Study Type
Enrollment (Actual)
Phase
- Not Applicable
Contacts and Locations
Study Locations
-
-
Barcelona
-
Manresa, Barcelona, Spain, 08242
- CAP Bages
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
- Child
- Adult
- Older Adult
Accepts Healthy Volunteers
Sampling Method
Study Population
Description
Inclusion Criteria:
- Clinical diagnosis of type II diabetes mellitus
- Fundus photograph taken as part of the screening for diabetic retinopathy
Exclusion Criteria:
- patients with glaucoma under treatment
- patients with advanced dementia who do not collaborate in taking photographs
- patients with significant deafness who cannot follow the instructions for taking photographs
- patients with mobility problems (wheelchairs, important kyphosis) or tremor who cannot take photographs
- patients with pathologies that interfere with the quality of images such as cataracts, nystagmus, corneal leucoma or corneal transplants.
Study Plan
How is the study designed?
Design Details
Cohorts and Interventions
Group / Cohort |
Intervention / Treatment |
|---|---|
|
family medicine physicians
Retina reading
|
The diagnostic capacity of the algorithm will be compared with that of the family medicine physicians and with retina specialists.
The reference will be a blinded double reading conducted by the retina specialists
|
|
retina specialists
Retina reading (gold standard)
|
The diagnostic capacity of the algorithm will be compared with that of the family medicine physicians and with retina specialists.
The reference will be a blinded double reading conducted by the retina specialists
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Sensitivity of the algorithm
Time Frame: 1 year
|
True positive rate of the algorithm
|
1 year
|
|
Specificity of the algorithm
Time Frame: 1 year
|
True negative rate of the algorithm
|
1 year
|
|
Accuracy of the algorithm
Time Frame: 1 year
|
Ratio of number of correct predictions to the total number of input samples
|
1 year
|
|
Area under the receiver operating characteristic curve of the algorithm
Time Frame: 1 year
|
Diagnostic ability of the algorithm
|
1 year
|
Collaborators and Investigators
Investigators
- Study Chair: Josep Vidal-Alaball, MD, PhD, MPH, Institut Català de la Salut / IDIAP Jordi Gol
- Principal Investigator: Alba Arocas Bonache, RN, Institut Català de la Salut
Publications and helpful links
General Publications
- Bourne RR, Stevens GA, White RA, Smith JL, Flaxman SR, Price H, Jonas JB, Keeffe J, Leasher J, Naidoo K, Pesudovs K, Resnikoff S, Taylor HR; Vision Loss Expert Group. Causes of vision loss worldwide, 1990-2010: a systematic analysis. Lancet Glob Health. 2013 Dec;1(6):e339-49. doi: 10.1016/S2214-109X(13)70113-X. Epub 2013 Nov 11.
- Sanchez Gonzalez S, Calvo Lozano J, Sanchez Gonzalez J, Pedregal Gonzalez M, Cornejo Castillo M, Molina Fernandez E, Barral FJ, Perez Espinosa JR. [Assessment of the use of retinography as a screening method for the early diagnosis of chronic glaucoma in Primary Care: Validation for screening in populations with open-angle glaucoma risk factors]. Aten Primaria. 2017 Aug-Sep;49(7):399-406. doi: 10.1016/j.aprim.2016.10.008. Epub 2017 Jan 23. Spanish.
- Gomez-Ulla F, Fernandez MI, Gonzalez F, Rey P, Rodriguez M, Rodriguez-Cid MJ, Casanueva FF, Tome MA, Garcia-Tobio J, Gude F. Digital retinal images and teleophthalmology for detecting and grading diabetic retinopathy. Diabetes Care. 2002 Aug;25(8):1384-9. doi: 10.2337/diacare.25.8.1384.
- Dankwa-Mullan I, Rivo M, Sepulveda M, Park Y, Snowdon J, Rhee K. Transforming Diabetes Care Through Artificial Intelligence: The Future Is Here. Popul Health Manag. 2019 Jun;22(3):229-242. doi: 10.1089/pop.2018.0129. Epub 2018 Oct 2.
- Quellec G, Charriere K, Boudi Y, Cochener B, Lamard M. Deep image mining for diabetic retinopathy screening. Med Image Anal. 2017 Jul;39:178-193. doi: 10.1016/j.media.2017.04.012. Epub 2017 Apr 28.
- Usher D, Dumskyj M, Himaga M, Williamson TH, Nussey S, Boyce J. Automated detection of diabetic retinopathy in digital retinal images: a tool for diabetic retinopathy screening. Diabet Med. 2004 Jan;21(1):84-90. doi: 10.1046/j.1464-5491.2003.01085.x.
- Somfai GM, Tatrai E, Laurik L, Varga B, Olvedy V, Jiang H, Wang J, Smiddy WE, Somogyi A, DeBuc DC. Automated classifiers for early detection and diagnosis of retinopathy in diabetic eyes. BMC Bioinformatics. 2014 Apr 12;15:106. doi: 10.1186/1471-2105-15-106.
- Abramoff MD, Lou Y, Erginay A, Clarida W, Amelon R, Folk JC, Niemeijer M. Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. Invest Ophthalmol Vis Sci. 2016 Oct 1;57(13):5200-5206. doi: 10.1167/iovs.16-19964.
- Abramoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med. 2018 Aug 28;1:39. doi: 10.1038/s41746-018-0040-6. eCollection 2018.
- Li Z, Keel S, Liu C, He Y, Meng W, Scheetz J, Lee PY, Shaw J, Ting D, Wong TY, Taylor H, Chang R, He M. An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs. Diabetes Care. 2018 Dec;41(12):2509-2516. doi: 10.2337/dc18-0147. Epub 2018 Oct 1.
- Vidal-Alaball J, Arocas Bonache A, Sole-Casals J, Royo Fibla D, Marin-Gomez FX, Distefano LN, Boixadera A, Casado-Garcia A, Garcia-Dominguez M, Ines A, Heras J, Zapata MA. Clinical validation of artificial intelligence algorithms for the detection of different central-involved retinal pathologies and glaucoma from non-mydriatic images. Front Artif Intell. 2026 Mar 10;9:1754682. doi: 10.3389/frai.2026.1754682. eCollection 2026.
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Actual)
Study Completion (Actual)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Actual)
Study Record Updates
Last Update Posted (Actual)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Keywords
Additional Relevant MeSH Terms
- Endocrine System Diseases
- Vascular Diseases
- Cardiovascular Diseases
- Diabetes Mellitus
- Eye Diseases
- Diabetic Angiopathies
- Diabetes Complications
- Retinal Diseases
- Retinal Degeneration
- Ocular Hypertension
- Diabetic Retinopathy
- Macular Degeneration
- Glaucoma
- Epiretinal Membrane
- Mathematical Concepts
- Algorithms
Other Study ID Numbers
- P18/109
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
IPD Plan Description
IPD Sharing Time Frame
IPD Sharing Access Criteria
IPD Sharing Supporting Information Type
- STUDY_PROTOCOL
- CSR
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Glaucoma
-
Hospices Civils de LyonRecruitingOpen-angle Glaucoma | Glaucoma Eye | Pigmentary Glaucoma | Closed-Angle Glaucoma | Pseudo Exfoliative SyndromeFrance
-
Imperial College Healthcare NHS TrustIRIDEX CorporationNot yet recruitingGlaucoma | Glaucoma, Open-Angle | Glaucoma, Angle-Closure | Glaucoma, Neovascular | Glaucoma Eye | Glaucoma Secondary | Glaucoma Traumatic | Glaucoma Uveitic
-
Wills EyeIOP OphthalmicsTerminatedPrimary Open Angle Glaucoma | Neovascular Glaucoma | Uveitic Glaucoma | Pseudoexfoliation Glaucoma | Primary Angle Closure Glaucoma | Pigmentary Glaucoma | Traumatic GlaucomaUnited States
-
University of MiamiAbbVieRecruitingOcular Hypertension | Glaucoma | Open-Angle Glaucoma | Glaucoma SuspectUnited States
-
Isfahan University of Medical SciencesActive, not recruitingAngle Closure Glaucoma | Glaucoma EyeIran
-
Centre hospitalier de l'Université de Montréal...CompletedGlaucoma | Glaucoma, Open-Angle | Glaucoma, Neovascular | Glaucoma Eye | Glaucoma and Ocular Hypertension | Glaucoma, Uncompensated | Glaucoma SecondaryCanada
-
Ngoc Nguyen Inc.Alcon ResearchNot yet recruitingGlaucoma | Glaucoma, Open Angle | Open Angle Glaucoma (OAG) | Normal Tension Glaucoma (NTG)United States
-
Pro Top & Mediking Company LimitedCompletedOpen Angle Glaucoma | Neovascular Glaucoma | Angle Closure Glaucoma | Uveitis Glaucoma | Young Age Glaucoma | High Risk PatientEstonia
-
Stanford UniversityNot yet recruitingPrimary Open Angle Glaucoma | Open Angle Glaucoma | Low Tension Glaucoma | Pseudoexfoliation Glaucoma | Pigmentary GlaucomaUnited States
-
Henry Ford Health SystemNot yet recruitingPrimary Open Angle Glaucoma (POAG) | Secondary Open Angle Glaucoma | Open Angle Glaucoma (OAG)United States
Clinical Trials on algorithm
-
University of ArizonaWithdrawn
-
Samuel Lunenfeld Research Institute, Mount Sinai...Completed
-
University of California, San FranciscoEko Devices, Inc.CompletedAortic Valve Stenosis | Mitral Regurgitation | Heart Murmurs | Valvular Heart DiseaseUnited States
-
ResMedCompletedObstructive Sleep Apnea (OSA)Australia
-
ResMedRecruitingObstructive Sleep ApneaAustralia
-
Ottawa Heart Institute Research CorporationActive, not recruitingMitral RegurgitationCanada
-
Johann Wolfgang Goethe University HospitalHemoSonics LLCTerminatedHemorrhage | BleedingGermany
-
University of OxfordUnknownHeart Failure, SystolicUnited Kingdom
-
Columbia UniversityNational Institute of Neurological Disorders and Stroke (NINDS)Not yet recruitingModeling of Recruitment CurvesUnited States
-
ITALO EUGENIO SOUZA GADELHA DE ABREUCompletedDeep Vein Thrombosis | Artificial Intelligence | Clinical Decision Support Systems | Pulmonary Thromboembolisms | Superficial ThrombophlebitisBrazil