A Blinded, Self-control Trial to Evaluate an Artificial Intelligence Based CAD System for Diabetic Retinography

November 2, 2020 updated by: Youxin Chen, Peking Union Medical College Hospital
To evaluate the safety and performance of an innovative artificial intelligence based Computer-Aided Diagnosis(CAD) system for diabetic retinography, Retinal images of patients with diabetes mellitus or diabetic retinopathy(DR) were collected retrospectively. All images were graded by a retinal specialists expert panel and the CAD device using the International Clinical Diabetic Retinopathy severity scale criteria. Investigator responsible for DR grading by CAD system is blinded to the DR grading results from the expert panel. Finally, DR grading results of the CAD system and experts were compared using sensitivity and specificity.

Study Overview

Detailed Description

  1. Retinal images were collected retrospectively according to the following inclusion/exclusion criterion:

    Inclusion Criterion:

    Clinical history of diabetes mellitus or diabetic retinopathy; Fully Gradable Images; around 45° field which covers optic disc and macula; complete patient identification information;

    Exclusion Criterion:

    incomplete patient identification information;

  2. DR grading by expert panel At first, retinal images are graded by three experts independently, then they met for a consensus meeting to discuss cases without initial agreement. If they can't achieve consensus, a final decision is made by the principal investigator. Experts give a grading of both DR and Diabetic Macular Edema (DME) for each image according to the International Clinical Diabetic Retinopathy severity scale criteria and hard exudates around optic disc.
  3. Blinding and DR grading by CAD system Before DR grading by CAD system, a randomized identification(ID) is assigned to each retinal image, which ensures that investigator responsible for CAD system operation is masked to the expert panel grading result. Both DR and DME grading is generated by the CAD system and the results are exported.
  4. Unblinding Finally, all data are unblinded and results of the CAD system are compared to the results of human grading, which is considered the gold standard, using measures as sensitivity and specificity;

Study Type

Interventional

Enrollment (Actual)

1081

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

    • Beijing
      • Peking, Beijing, China, 100005
        • Peking Union Medical College Hospital

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • ADULT
  • OLDER_ADULT
  • CHILD

Accepts Healthy Volunteers

No

Genders Eligible for Study

All

Description

Inclusion Criteria:

  • Clinical history of diabetes mellitus or diabetic retinopathy;
  • Fully Gradable Images;
  • around 45° field which covers optic disc and macula;
  • complete patient identification information;

Exclusion Criteria:

  • incomplete patient identification information

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: DIAGNOSTIC
  • Allocation: NON_RANDOMIZED
  • Interventional Model: PARALLEL
  • Masking: SINGLE

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
EXPERIMENTAL: DR Grading with CAD
A CAD system is used to make DR grading.
OTHER: DR Grading by expert panel
DR Grading by expert panel

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Se and Sp under investigation target 3
Time Frame: through study completion,an average of four months
1.investigation target 3: Negative: DR grading of 0 or 1; Positive: DR grading of 2 or higher; After completion of DR grading by expert panel and CAD system, results of the CAD system were compared to the results of human grading, which is considered the gold standard, using measures as sensitivity(Se) and specificity(Sp).
through study completion,an average of four months

Secondary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Se and Sp under investigation target 1/2/4/5
Time Frame: through study completion,an average of four months
investigation target 1: Negative : DR grading of 0 ; Positive : DR grading of 1 or higher; investigation target 2: Negative : DR grading of 0,1 or 2 ; Positive : DR grading of 3 or higher; investigation target 4: Negative : no clinically significant DME; Positive : clinically significant DME; investigation target 5: Negative : no clinically significant DME and DR grading of 0, 1 or 2 ; Positive : clinically significant DME or DR grading of 3 or higher; After completion of DR grading by expert panel and CAD system, results of the CAD system were compared to the results of human grading, which is considered the gold standard, using measures as sensitivity(Se) and specificity(Sp).
through study completion,an average of four months

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Investigators

  • Principal Investigator: Chen Youxin, Professor, Peking Union Medical College Hospital

Publications and helpful links

The person responsible for entering information about the study voluntarily provides these publications. These may be about anything related to the study.

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (ACTUAL)

May 31, 2019

Primary Completion (ACTUAL)

July 15, 2020

Study Completion (ACTUAL)

August 15, 2020

Study Registration Dates

First Submitted

May 27, 2019

First Submitted That Met QC Criteria

May 31, 2019

First Posted (ACTUAL)

June 4, 2019

Study Record Updates

Last Update Posted (ACTUAL)

November 3, 2020

Last Update Submitted That Met QC Criteria

November 2, 2020

Last Verified

November 1, 2020

More Information

Terms related to this study

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Diabetic Retinopathy

Clinical Trials on DR Grading with CAD

3
Subscribe