Feasibility and patient acceptability of a novel artificial intelligence-based screening model for diabetic retinopathy at endocrinology outpatient services: a pilot study

Stuart Keel, Pei Ying Lee, Jane Scheetz, Zhixi Li, Mark A Kotowicz, Richard J MacIsaac, Mingguang He, Stuart Keel, Pei Ying Lee, Jane Scheetz, Zhixi Li, Mark A Kotowicz, Richard J MacIsaac, Mingguang He

Abstract

The purpose of this study is to evaluate the feasibility and patient acceptability of a novel artificial intelligence (AI)-based diabetic retinopathy (DR) screening model within endocrinology outpatient settings. Adults with diabetes were recruited from two urban endocrinology outpatient clinics and single-field, non-mydriatic fundus photographs were taken and graded for referable DR ( ≥ pre-proliferative DR). Each participant underwent; (1) automated screening model; where a deep learning algorithm (DLA) provided real-time reporting of results; and (2) manual model where retinal images were transferred to a retinal grading centre and manual grading outcomes were distributed to the patient within 2 weeks of assessment. Participants completed a questionnaire on the day of examination and 1-month following assessment to determine overall satisfaction and the preferred model of care. In total, 96 participants were screened for DR and the mean assessment time for automated screening was 6.9 minutes. Ninety-six percent of participants reported that they were either satisfied or very satisfied with the automated screening model and 78% reported that they preferred the automated model over manual. The sensitivity and specificity of the DLA for correct referral was 92.3% and 93.7%, respectively. AI-based DR screening in endocrinology outpatient settings appears to be feasible and well accepted by patients.

Conflict of interest statement

Yes there is potential competing interest. Mingguang He reports a patent on managing color fundus images using deep learning models. The patent application number was ZL201510758675.5 and patent filing date was May 31, 2017.

Figures

Figure 1
Figure 1
Flowchart of testing protocol.

References

    1. Foreman, J. et al. The Prevalence and Causes of Vision Loss in Indigenous and Non-Indigenous Australians: The National Eye Health Survey. Ophthalmology, 10.1016/j.ophtha.2017.06.001 (2017).
    1. Magliano DJ, et al. Projecting the burden of diabetes in Australia–what is the size of the matter? Australian and New Zealand journal of public health. 2009;33:540–543. doi: 10.1111/j.1753-6405.2009.00450.x.
    1. Diabetes: The Silent Pandemic and its Impact on Australia. (Baker IDI Heart & Diabetes Institute, 2012).
    1. Tapp RJ, et al. The prevalence of and factors associated with diabetic retinopathy in the Australian population. Diabetes Care. 2003;26:1731–1737. doi: 10.2337/diacare.26.6.1731.
    1. Cheung N, Mitchell P, Wong TY. Diabetic retinopathy. Lancet. 2010;376:124–136. doi: 10.1016/S0140-6736(09)62124-3.
    1. Wong TY, Cheung CM, Larsen M, Sharma S, Simo R. Diabetic retinopathy. Nature reviews. Disease primers. 2016;2:16012. doi: 10.1038/nrdp.2016.12.
    1. NHMRC. (Available from: , 2008).
    1. Nguyen HV, et al. Cost-effectiveness of a National Telemedicine Diabetic Retinopathy Screening Program in Singapore. Ophthalmology. 2016;123:2571–2580. doi: 10.1016/j.ophtha.2016.08.021.
    1. Scanlon PH. The English National Screening Programme for diabetic retinopathy 2003-2016. Acta diabetologica. 2017;54:515–525. doi: 10.1007/s00592-017-0974-1.
    1. Foreman, J. et al. The National Eye Health Survey 2016, Vision 2020 Australia, Centre for Eye Research Australia.
    1. Australian Government. Budget 2016-2017: Portfolio Budget Statements 2016–2017 Budget Related Paper No1.10 Health Portfolio. (Canberra, 2016).
    1. Statham MO, Sharma A, Pane AR. Misdiagnosis of acute eye diseases by primary health care providers: incidence and implications. Med J Aust. 2008;189:402–404.
    1. Oh E, Yoo TK, Park EC. Diabetic retinopathy risk prediction for fundus examination using sparse learning: a cross-sectional study. BMC medical informatics and decision making. 2013;13:106. doi: 10.1186/1472-6947-13-106.
    1. Saleh, E. et al. Diabetic retinopathy risk estimation using fuzzy rules on electronic health record data. Modeling Decisions for Artificial Intelligence, 263–274 (2016).
    1. Roychowdhury S, Koozekanani DD, Parhi KK. DREAM: diabetic retinopathy analysis using machine learning. IEEE journal of biomedical and health informatics. 2014;18:1717–1728. doi: 10.1109/JBHI.2013.2294635.
    1. Usher D, et al. Automated detection of diabetic retinopathy in digital retinal images: a tool for diabetic retinopathy screening. Diabet Med. 2004;21:84–90. doi: 10.1046/j.1464-5491.2003.01085.x.
    1. Gulshan, V. et al. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA, 10.1001/jama.2016.17216 (2016).
    1. Wong TY, Bressler NM. Artificial Intelligence With Deep Learning Technology Looks Into Diabetic Retinopathy Screening. Jama. 2016;316:2366–2367. doi: 10.1001/jama.2016.17563.
    1. Peto T, Tadros C. Screening for diabetic retinopathy and diabetic macular edema in the United Kingdom. Curr Diab Rep. 2012;12:338–345. doi: 10.1007/s11892-012-0285-4.
    1. Szeged, C., Vanhouck, V., loffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. CVPR (2016).
    1. Crossland L, et al. Diabetic Retinopathy Screening and Monitoring of Early Stage Disease in Australian General Practice: Tackling Preventable Blindness within a Chronic Care Model. Journal of diabetes research. 2016;2016:8405395. doi: 10.1155/2016/8405395.
    1. Larizza MF, et al. Feasibility of screening for diabetic retinopathy at an Australian pathology collection service: a pilot study. Med J Aust. 2013;198:97–99. doi: 10.5694/mja12.11121.
    1. Litchfield I, et al. Routine failures in the process for blood testing and the communication of results to patients in primary care in the UK: a qualitative exploration of patient and provider perspectives. BMJ quality & safety. 2015;24:681–690. doi: 10.1136/bmjqs-2014-003690.
    1. Keel S, et al. The Prevalence of Diabetic Retinopathy in Australian Adults with Self-Reported Diabetes: The National Eye Health Survey. Ophthalmology. 2017;124:977–984. doi: 10.1016/j.ophtha.2017.02.004.
    1. Britt H, et al. A decade of general practice activity. Sydney University Press. 2015;39:1–159.

Source: PubMed

3
구독하다