A convolutional neural network for the screening and staging of diabetic retinopathy

Mohamed Shaban, Zeliha Ogur, Ali Mahmoud, Andrew Switala, Ahmed Shalaby, Hadil Abu Khalifeh, Mohammed Ghazal, Luay Fraiwan, Guruprasad Giridharan, Harpal Sandhu, Ayman S El-Baz, Mohamed Shaban, Zeliha Ogur, Ali Mahmoud, Andrew Switala, Ahmed Shalaby, Hadil Abu Khalifeh, Mohammed Ghazal, Luay Fraiwan, Guruprasad Giridharan, Harpal Sandhu, Ayman S El-Baz

Abstract

Diabetic retinopathy (DR) is a serious retinal disease and is considered as a leading cause of blindness in the world. Ophthalmologists use optical coherence tomography (OCT) and fundus photography for the purpose of assessing the retinal thickness, and structure, in addition to detecting edema, hemorrhage, and scars. Deep learning models are mainly used to analyze OCT or fundus images, extract unique features for each stage of DR and therefore classify images and stage the disease. Throughout this paper, a deep Convolutional Neural Network (CNN) with 18 convolutional layers and 3 fully connected layers is proposed to analyze fundus images and automatically distinguish between controls (i.e. no DR), moderate DR (i.e. a combination of mild and moderate Non Proliferative DR (NPDR)) and severe DR (i.e. a group of severe NPDR, and Proliferative DR (PDR)) with a validation accuracy of 88%-89%, a sensitivity of 87%-89%, a specificity of 94%-95%, and a Quadratic Weighted Kappa Score of 0.91-0.92 when both 5-fold, and 10-fold cross validation methods were used respectively. A prior pre-processing stage was deployed where image resizing and a class-specific data augmentation were used. The proposed approach is considerably accurate in objectively diagnosing and grading diabetic retinopathy, which obviates the need for a retina specialist and expands access to retinal care. This technology enables both early diagnosis and objective tracking of disease progression which may help optimize medical therapy to minimize vision loss.

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1. Fundus images for the five…
Fig 1. Fundus images for the five stages of DR.
Fig 2. Proposed CNN architecture.
Fig 2. Proposed CNN architecture.
Fig 3. ROC curve for the proposed…
Fig 3. ROC curve for the proposed model in case of (a) 5-fold cross validation (b) 10-fold cross validation.
Fig 4. Examples of misclassified fundus images…
Fig 4. Examples of misclassified fundus images by the proposed architecture.
(a) Ground Truth “0” Predicted “1”. (b) Ground Truth “1” Predicted “2” (c) Ground Truth “1” Predicted “0” (d) Ground Truth “2” Predicted “1”.

References

    1. Litjens G., Kooi T., Benjnordi B., Setio A., Ciompi F., Ghafoorian M., et al., A Survey on Deep Learning on Medical Image Analysis, Medical Image Analysis, vol. 42, pp. 60–88, 2017. 10.1016/j.media.2017.07.005
    1. O’Shea K. and Nash R., An Introduction to Convolutional Neural Networks, Neural and Evolutionary Computing, Cornell University Library, 2016.
    1. Mookiah M., Acharya U., Chua C., Lim C., Ng E. and Laude A., Computer-Aided Diagnosis of Diabetic Retinopathy: A Review, Computers in Biology and Medicine, vol. 43, no. 12, pp. 2136–2155, 2013. 10.1016/j.compbiomed.2013.10.007
    1. Acharya U., Chua C., Ng E., Yu W., Chee C., Application of Higher Order Spectra for the Identification of Diabetes Retinopathy Stages, Journal of Medical Systems, vol. 32, no. 6, pp. 481–488, 2008. 10.1007/s10916-008-9154-8
    1. Acharya U., Lim C., Ng E., Chee C. and Tamura T., Computer-Based Detection of Diabetes Retinopathy Stages using Digital Fundus Images, Proceedings of the Institution of Mechanical Engineers, vol. 223, no. 5, pp. 545–553, 2009. 10.1243/09544119JEIM486
    1. Nayak J., Bhat P., Acharya R., Lim C. and Kagathi M., Automated Identification of Diabetic Retinopathy Stages using Digital Fundus Images, Journal of Medical Systems, vol. 32, no. 2, pp. 107–115, 2008. 10.1007/s10916-007-9113-9
    1. H. Pratt, F. Coenen, D. Broadbent, S. Harding, Y. Zheng, “Convolutional Neural Networks for Diabetic Retinopathy”, International Conference on Medical Imaging Understanding and Analysis, Loughborough, UK, July 2016.
    1. M. Shaban, Z. Ogur, A. Shalaby, A. Mahmoud, M. Ghazal, H. Sandhu, et al., “Automated Staging of Diabetic Retinopathy Using a 2D Convolutional Neural Network”, IEEE International Symposium on Signal Processing and Information Technology, Louisville, Kentucky, USA, December 2018.
    1. Omar Dekhil, Ahmed Naglah, Mohamed Shaban, Ahmed Shalaby, Ayman El-Baz, “Deep-Learning Based Method for Computer Aided Diagnosis of Diabetic Retinopathy”, IEEE International Conference on Imaging Systems & Techniques, Abu Dhabi, United Arab Emirates, December 2019.
    1. Gao Z., Li J., Guo J., Chen Y., Yi Z., and Zhong J., Diagnosis of Diabetic Retinopathy using Deep Neural Networks, IEEE Access Journal, vol. 7, pp. 3360–3370, 2018.
    1. Hu J., Chen Y., Zhong J., Ju R., and Yi Z., Automated Analysis for Retinopathy of Prematurity by Deep Neural Networks, IEEE Transactions on Medical Imaging, vol. 38, no. 1, pp. 269–279, 2019. 10.1109/TMI.2018.2863562
    1. A. Mizutani, C. Muramatsu, Y. Hatanaka, S. Suemori, T. Hara and H. Fujita, “Automated Microaneurysm Detection Method Based on Double Ring Filter in Retinal Fundus Images”, Proceedings of SPIE, 2009.
    1. H. Jaafar, A. Nandi and W. Al-Nuaimy, “Automated Detection of Exudates in Retinal Images using a Split-and-Merge Algorithm”, 18th European Signal Processing Conference. Aalborg, Denmark, 2010.
    1. Pachiyappan A., Das U., Murthy T. and Tatavarti R., Automated Diagnosis of Diabetic Retinopathy and Glaucoma using Fundus and OCT Images, Lipids in Health and Disease, vol. 11, no. 73, 2012.
    1. Tan J., Acharya U., Chua K., Cheng C C. and Laude A., Automated Extraction of Retinal Vasculature, Medical Physics. Vol. 43, no. 5, pp. 2311–2322, 2016.
    1. Sara Sabour, Nicholas Frosst, and Geoffrey E. Hinton, Dynamic routing between capsules, NIPS Proceedings, 2017.
    1. Asia Pacific Tele-Ophthalmology Society, “APTOS 2019 blindness detection,” Kaggle, , 2019, [Dataset].
    1. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “ImageNet: A large-Scale Hierarchical Image Database”, IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, June 2009.
    1. Ben-David A., “Comparison of classification accuracy using cohens weighted kappa,” Expert Systems with Applications, vol. 34, no. 2, pp. 825–832, 2008.
    1. Molina-Fernández E, Valero-Moll MS, Pedregal-González M, Díaz-Rodríguez E, Sánchez-Ramos JL, and Soriano-Villegas JM, Inter-observer variability in the diagnosis and classification of diabetic retinopathy through biomicroscopy, Arch Soc Esp Oftalmol., vol. 83, no. 1, pp. 23–8, 2008. 10.4321/s0365-66912008000100006
    1. Boucher MC, Gresset JA, Angioi K, and Olivier S, Effectiveness and safety of screening for diabetic retinopathy with two nonmydriatic digital images compared with the seven standard stereoscopic photographic fields, Can J Ophthalmol., vol. 38, no. 7, pp. 557–68, 2003. 10.1016/s0008-4182(03)80109-6

Source: PubMed

3
Abonner