A machine learning approach for retinal images analysis as an objective screening method for children with autism spectrum disorder

Maria Lai, Jack Lee, Sally Chiu, Jessie Charm, Wing Yee So, Fung Ping Yuen, Chloe Kwok, Jasmine Tsoi, Yuqi Lin, Benny Zee, Maria Lai, Jack Lee, Sally Chiu, Jessie Charm, Wing Yee So, Fung Ping Yuen, Chloe Kwok, Jasmine Tsoi, Yuqi Lin, Benny Zee

Abstract

Background: Autism spectrum disorder (ASD) is characterised by many of features including problem in social interactions, different ways of learning, some children showing a keen interest in specific subjects, inclination to routines, challenges in typical communication, and particular ways of processing sensory information. Early intervention and suitable supports for these children may make a significant contribution to their development. However, considerable difficulties have been encountered in the screening and diagnosis of ASD. The literature has indicated that certain retinal features are significantly associated with ASD. In this study, we investigated the use of machine learning approaches on retinal images to further enhance the classification accuracy.

Methods: Forty-six ASD participants were recruited from three special needs schools and 24 normal control were recruited from the community. Among them, 23 age-gender matched ASD and normal control participant-pairs were constructed for the primary analysis. All retinal images were captured using a nonmydriatic fundus camera. Automatic retinal image analysis (ARIA) methodology applying machine-learning technology was used to optimise the information of the retina to develop a classification model for ASD. The model's validity was then assessed using a 10-fold cross-validation approach to assess its validity.

Findings: The sensitivity and specificity were 95.7% (95% CI 76.0%, 99.8%) and 91.3% (95% CI 70.5%, 98.5%) respectively. The area under the ROC curve was 0.974 (95% CI 0.934, 1.000); however, it was noted that the specificity for female participants might not be as high as that for male participants.

Interpretation: Because ARIA is a fully automatic cloud-based algorithm and relies only on retinal images, it can be used as a risk assessment tool for ASD screening. Further diagnosis and confirmation can then be made by professionals, and potential treatment may be provided at a relatively early stage.

Keywords: Autism spectrum disorder; Automatic retinal image analysis; Machine learning; Risk assessment; screening tool.

Conflict of interest statement

BZ and JL have a patent “Method and device for retinal image analysis” licensed to Health View Bioanalytic Limited, received royalties through the Chinese University of Hong Kong. BZ and JL are founders and shareholders of Health View Bioanalytic Limited, Bioanalytic Holdings Limited, and Bioanalytic International Holdings Limited. ML is director of Bioanalytic Holdings Limited, and Bioanalytic International Holdings Limited. BZ is co-founder and shareholder of Beth Bioinformatics Company Limited. ML reports Spouse of Founder and Shareholder of Health View Bioanlaytic Limited; Honorary Consultant of Health View Bioanalytic Limited. The remaining authors have no conflict of interest to declare.

© 2020 The Author(s).

Figures

Fig. 1
Fig. 1
Flowchart of the method presented in our ASD study Note: RGB – Red, Green and Blue ResNet50 – residual network that is 50 layers deep Glmnet – Generalized linear model via penalized maximum likelihood SVM – Support vector machine.(For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article.)
Fig. 2
Fig. 2
Box plot for the probability of ASD based on the matched case–control data.

References

    1. Muhle R., Trentacoste S.V., Rapin I. The genetics of autism. Pediatrics. 2004 May;113(5):e472–e486. doi: 10.1542/peds.113.5.e472.
    1. Dover C.J., Le Couteur A. How to diagnose autism. Arch Dis Child. 2007;92:540–545. doi: 10.1136/adc.2005.086280.
    1. Filipek P.A., Accardo P.J., Ashwal S., Baranek G.T., Jr Cook EH, Dawson G., Gordon B., Gravel J.S., Johnson C.P., Kallen R.J., Levy S.E., Minshew N.J., Ozonoff S., Prizant B.M., Rapin I., Rogers S.J., Stone W.L., Teplin S.W., Tuchman R.F., Volkmar F.R. Practice parameter: screening and diagnosis of autism: report of the quality standards subcommittee of the American academy of neurology and the child neurology society. Neurology. 2000 Aug 22;55(4):468–479. doi: 10.1212/wnl.55.4.468.
    1. Risi S., Lord C., Gotham K., Corsello C., Chrysler C., Szatmari P., Jr Cook EH, Leventhal B.L., Pickles A. Combining information from multiple sources in the diagnosis of autism spectrum disorders. J Am Acad Child Adolesc Psychiatry. 2006;45(9):1094–1103. doi: 10.1097/01.chi.0000227880.42780.0e.
    1. Bryson S.E., Zwaigenbaum L., Roberts W. The early detection of autism in clinical practice. Paediatr Child Health. 2004 April;9(4):219–221.
    1. Martinez-Pedraza F.L., Carter A.S. Autism Spectrum disorders in young children. Child Adolesc Psychiatr Clin N Am. 2009 July;18(3):645–663.
    1. Baio J., Wiggins L., Christensen D.L., Maenner M.J., Daniels J., Warren Z., Kurzius-Spencer M., Zahorodny W., Robinson Rosenberg C., White T., Durkin M.S., Imm P., Nikolaou L., Yeargin-Allsopp M., Lee L.C., Harrington R., Lopez M., Fitzgerald R.T., Hewitt A., Pettygrove S., Constantino J.N., Vehorn A., Shenouda J., Hall-Lande J., Van Naarden Braun K., Dowling N.F. Prevalence of autism spectrum disorder among children aged 8 years – autism and developmental disabilities monitoring network, 11 Sites, United States, 2014. Morb Mort Week Rep – Surveill Summ. 2018 Apr 27;67(6):1–23. doi: 10.15585/mmwr.ss6706a1.
    1. Charron R. “Autism rates across the developed world. Focus for Health. 2017 August 28, 2017. Date of access: 6 Sep 2020.
    1. Child Assessment Service, Department of health, Hong Kong Special Administrative Region Government, June 2017. Date of access: 6 Sep 2020.
    1. American Psychiatric Association . American Psychiatric Publishing; Washington, DC, USA: 2000. Diagnostic and statistical manual of mental disorders.
    1. Sutera S., Pandey J., Esser E.L. Predictors of optimal outcome in toddlers diagnosed with autism spectrum disorders. J Autism Dev Disord. 2007 Jan;37(1):98–107. doi: 10.1007/s10803-006-0340-6.
    1. Werner E., Dawson G., Osterling J., Dinno N. Recognition of autism spectrum disorder before one year of age: a retrospective study based on home videotapes. J Autism Dev Disord. 2000;30(2):157–162. doi: 10.1023/a:1005463707029.
    1. Wiggins L.D., Bakeman R., Adamson L.B., Robins D. The utility of the social communication questionnaire in screening for autism in children referred for early intervention. Focus Autism Other Dev Disab. 2007;22 doi: 10.1177/10883576070220010401. Page 33-38 January 1.
    1. Baird G., Charman T., Baron-Cohen S. A screening instrument for autism at 18 months of age: a 6 year follow-up study. J Am Acad Child Adolesc Psychiatry. 2000;39:694–702. doi: 10.1097/00004583-200006000-00007.
    1. Dietz C., Swinkels S., van Daalen E. Screening for autistic spectrum disorder in children aged 14-15 months. II: population screening with the early screening of autistic traits questionnaire (ESAT). Design and general findings. J Autism Dev Disord. 2006;36:13–22. doi: 10.1007/s10803-006-0114-1.
    1. Kleinman J.M., Robins D.L., Ventola P.E., Pandey J., Boorstein H.C., Esser E.L., Wilson L.B., Rosenthal M.A., Sutera S., Verbalis A.D., Barton M., Hodgson S., Green J., Dumont-Mathieu T., Volkmar F., Chawarska K., Klin A., Fein D. The modified checklist for autism in toddlers: a follow-up study investigating the early detection of autism spectrum disorders. J Autism Dev Disord. 2008 May;38(5):827–839.
    1. Stone W.L., Coonrod E.E., Turner L.M., Pozdol S.L. Psychometric properties of the STAT for early autism screening. J Autism Dev Disord. 2004;34(6):691–701.
    1. Stone W.L., McMahon C.R., Henderson L.M. Use of the Screening Tool for Autism in Two-year-olds (STAT) for children under 24 months: an exploratory study. Autism. 2008;12(5):557–573.
    1. Landa R.J., Gross A.L., Stuart E.A., Faherty A. Developmental trajectories in children with and without autism spectrum disorders: the first 3 years. Child Dev. 2013 Mar-Apr;84(2):429–442.
    1. Landa R.J., Holman K.C., Garrett-Mayer E. Social and communication development in toddlers with early and later diagnosis of autism spectrum disorders. Arch Gen Psychiatry. 2007 Jul;64(7):853–864. doi: 10.1001/archpsyc.64.7.853.
    1. Ozonoff S., Young G.S., Landa R.J., Brian J., Bryson S., Charman T., Chawarska K., Macari S.L., Messinger D., Stone W.L., Zwaigenbaum L., Iosif A.M. Diagnostic stability in young children at risk for autism spectrum disorder: a baby siblings research consortium study. J Child Psychol Psychiatry. 2015 Sep;56(9):988–998. doi: 10.1111/jcpp.12421.
    1. Christensen D.L., Baio J., Van Naarden Braun K., Bilder D., Charles J., Constantino J.N., Daniels J., Durkin M.S., Fitzgerald R.T., Kurzius-Spencer M., Lee L.C., Pettygrove S., Robinson C., Schulz E., Wells C., Wingate M.S., Zahorodny W., Yeargin-Allsopp M. Centers for disease control and prevention (CDC). “Prevalence and characteristics of autism spectrum disorder among children aged 8 years–autism and developmental disabilities monitoring network, 11 sites, United States, 2012. MMWR Surveill Summ. 2016 Apr 1;65(3):1–23. doi: 10.15585/mmwr.ss6513a1.
    1. Epidemiology and Research Committee Child assessment service, department of health. Child Assessm Serv Epidemiol Res Bull. 2007;(2)
    1. Tait K., Fung F., Hu A., Sweller N., Wang W. Understanding Hong Kong Chinese families’ experiences of an autism/ASD diagnosis. J Dev Disord. 2016;46:1164–1183. doi: 10.1007/s10803-015-2650-z.
    1. Kerrison J.B., FlynnT Green WR. Retinal pathologic changes in multiple sclerosis. Retina. 1994;14(5):445–451. doi: 10.1097/00006982-199414050-00010.
    1. Baker M.L., Hand P.J., Wang J.J., Wong T.Y. Retinal signs and stroke. Stroke. 2008;39:1371–1379. doi: 10.1161/STROKEAHA.107.496091.
    1. Satue M., Seral M., Otin S. Retinal thinning and correlation with functional disability inpatients with Parkinson's disease. Br J Ophthalmol. 2014;98:350–355. doi: 10.1136/bjophthalmol-2013-304152.
    1. DeBuc D.C., Gaca-Wysocka M., Grzybowski A., Kanclerz P. Identification of retinal biomarkers in alzheimer's disease using optical coherence tomography: recent insights, challenges, and opportunities. J Clin Med. 2019 Jul 9;8(7) doi: 10.3390/jcm8070996. pii: E996.
    1. Zee B., Lee J., Li Q., Mok V., Kong A., Chiang L.K., Ng L., Zhuo Y., Yu H., Yang Z. “Stroke risk assessment for the community by automatic retinal image analysis using fundus photograph. Qual Prim Care. 2016;24(3):114–124.
    1. Lau A., Mok V., Lee J., Fan Y., Zeng J., b Lam, Wong A., Kwok C., Lai M., Zee B. Retinal image analytics detects white matter hyperintensities in healthy adults. Ann Clin Transl Neurol. 2018 Nov 15;6(1):98–105. doi: 10.1002/acn3.688. COI.
    1. Emberti Gialloreti L., Pardini M., Benassi F., Marciano S., Amore M., Mutolo M.G., Porfirio M.C., Curatolo P. Reduction in retinal nerve fiber layer thickness in young adults with autism spectrum disorders. J Autism Dev Disord. 2014 Apr;44(4):873–882. doi: 10.1007/s10803-013-1939-z.
    1. He Kaiming, Zhang Xiangyu, Ren Shaoqing, Sun Jian. Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. "Deep residual learning for image recognition; pp. 770–778.
    1. Zee B., Lee J., Li Q., “Method and device for retinal image analysis”, Patent No. US8787638 B2, granted on 22 July 2014.
    1. Fan R.-.E., Chen P.-.H., Lin C.-.J. “Working set selection using second order information for training support vector machines. J Mach Learn Res. 2005;6:1889–1918.
    1. Hastie T., Tibshirani R., Friedman J. 2nd Edition. Springer; NY: 2008. The elements of statistical learning.
    1. Guo V.Y., Chan J.C.N., Chung H., Ozaki R., So W., Luk A., Lam A., Lee J., Zee B.C. Retinal information is independently associated with cardiovascular disease in patients with type 2 diabetes. Sci Rep. 2016;6
    1. Guo V., Cao B., Wu X., Lee J., Zee B.C. Prospective association between diabetic retinopathy and cardiovascular disease – a systematic review and meta-analysis of cohort studies. J Stroke Cerebrovasc Dis. July 2016;25(7):1688–1695. doi: 10.1016/j.jstrokecerebrovasdis.2016.03.009.
    1. Lee J., Zee B., Li Q. Detection of neovascularization based on fractal and texture analysis with interaction effects in diabetic retinopathy. PLoS One. 2013 Dec 16;8(12):e75699. doi: 10.1371/journal.pone.0075699.
    1. Lee J., Zee B., Li Q. Segmentation and texture analysis with multimodel inference for the automatic detection of exudates in early diabetic retinopathy. J. Biomed Sci Eng. 2013;6:298–307. doi: 10.4236/jbise.2013.63038.
    1. Scholkopf B., Smola A. Adaptive computation and machine learning. The MIT Press; Cambridge, MA: 2002. Learning with kernels: support vector machines, regularization, optimization and beyond.
    1. Chow Shao, Wang . Clinical research. Taylor& Francis,; NY: 2003. Sample size calculations. Pages 48-50.
    1. Peters B., Forlin C. Chinese children with ASD in Hong Kong (SAR): development of inclusive practice. J Res Special Educ Needs. 2011;11(2):87–98.
    1. Rice C. Prevalence of autism spectrum disorders – autism and developmental disabilities monitoring network, 14 sites, United States, 2002. MMWR Surveill Summ. 2007;56(SS01):12–28. 2007 Feb. 9, 2007.
    1. MacDonald R., Parry-Cruwys D., Dupere, Ahearn W. “Assessing progress and outcome of early intensive behavioral intervention for toddlers with autism. Res Dev Disabil. December 2014;35(12):3632–3644. Pages.
    1. Dudley C. and Emery J.C.H., “The value of caregiver time: costs of support and care for individuals living with autism spectrum disorder”, University of Calgary School of Public Policy Research Papers, Volume 7, Issue 1, January 2014.
    1. Courchesne E. Abnormal early brain development in autism. Mol Psychiatry. 2002;7(2):S21–S23. doi: 10.1038/sj.mp.4001169. Suppl.
    1. Xiao Z., Qiu T., Ke X., Xiao X., Xiao T., Liang F., Zou B., Huang H., Fang H., Chu K., Zhang J., Liu Y. Autism spectrum disorder as early neurodevelopmental disorder: evidence from the brain imaging abnormalities in 2-3 years old toddlers. J Autism Dev Disord. July 2014;44(7):1633–1640.
    1. Lange N., Travers B.G., Bigler E.D., Prigge M.B., Froehlich A.L., Nielsen J.A., Cariello A.N., Zielinski B.A., Anderson J.S., Fletcher P.T., Alexander A.A., Lainhart J.E. Longitudinal volumetric brain changes in autism spectrum disorder ages 6-35 years. Autism Res. 2015 Feb;8(1):82–93.
    1. Carper R.A., Moses P., Tigue Z.D., Courchesne E. Cerebral lobes in autism: early hyperplasia and abnormal age effects. Neuroimage. 2002 Aug;16(4):1038–1051. doi: 10.1006/nimg.2002.1099.
    1. Hazlett H.C., Poe M.D., Gerig G., Styner M., Chappell C., Smith R.G., Vachet C., Piven J. Early brain overgrowth in autism associated with an increase in cortical surface area before age 2 years. Arch Gen Psychiatry. 2011 May;68(5):467–476.
    1. Casanova M.F. White matter volume increase and minicolumns in autism. Ann Neurol. 2004 Sep;56(3):453. doi: 10.1002/ana.20196.
    1. Lange N., Dubray M.B., Lee J.E., Froimowitz M.P., Froehlich A., Adluru N., Wright B., Ravichandran C., Fletcher P.T., Bigler E.D., Alexander A.L., Lainhart J.E. Atypical diffusion tensor hemispheric asymmetry in autism. Autism Res. 2010 Dec;3(6):350–358. doi: 10.1002/aur.162.
    1. Just M.A., Cherkassky V.L., Keller T.A., Minshew N.J. Cortical activation and synchronization during sentence comprehension in high-functioning autism: evidence of underconnectivity. Brain A J Neurol. 2004;127(Pt 8):1811–1821. doi: 10.1093/brain/awh199.
    1. Pardini M., Garaci F.G., Bonzano L., Roccatagliata L., Palmieri M.G., Pompili E. White matter reduced streamline coherence in young men with autism and mental retardation. Eur J Neurol Off J Eur Federat Neurol Societ. 2009;16(11):1185–1190. doi: 10.1111/j.1468-1331.2009.02699.x.

Source: PubMed

3
Suscribir