Basics of Deep Learning: A Radiologist's Guide to Understanding Published Radiology Articles on Deep Learning
Synho Do, Kyoung Doo Song, Joo Won Chung, Synho Do, Kyoung Doo Song, Joo Won Chung
Abstract
Artificial intelligence has been applied to many industries, including medicine. Among the various techniques in artificial intelligence, deep learning has attained the highest popularity in medical imaging in recent years. Many articles on deep learning have been published in radiologic journals. However, radiologists may have difficulty in understanding and interpreting these studies because the study methods of deep learning differ from those of traditional radiology. This review article aims to explain the concepts and terms that are frequently used in deep learning radiology articles, facilitating general radiologists' understanding.
Keywords: Artificial intelligence; Convolutional neural network; Deep learning; Radiology.
Conflict of interest statement
The authors have no potential conflicts of interest to disclose.
Copyright © 2020 The Korean Society of Radiology.
Figures
References
- Chartrand G, Cheng PM, Vorontsov E, Drozdzal M, Turcotte S, Pal CJ, et al. Deep learning: a primer for radiologists. Radiographics. 2017;37:2113–2131.
- Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, et al. A survey on deep learning in medical image analysis. Med Image Anal. 2017;42:60–88.
- Dreyer KJ, Geis JR. When machines think: radiology’s next frontier. Radiology. 2017;285:713–718.
- Soffer S, Ben-Cohen A, Shimon O, Amitai MM, Greenspan H, Klang E. Convolutional neural networks for radiologic images: a radiologist's guide. Radiology. 2019;290:590–606.
- Cardoso JR, Pereira LM, Iversen MD, Ramos AL. What is gold standard and what is ground truth? Dental Press J Orthod. 2014;19:27–30.
- Zhong Z, Zheng L, Kang G, Li S, Yang Y. Random erasing data augmentation. eprint arXiv; 2017. [Accessed April 1, 2019]. Available at: .
- TIOBE index for April 2019. TIOBE Web site; [Accessed April 30, 2019].
- Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, et al. Caffe: convolutional architecture for fast feature embedding. eprint arXiv; 2014. [Accessed April 1, 2019]. Available at: .
- Bastien F, Lamblin P, Pascanu R, Bergstra J, Goodfellow I, Bergeron A, et al. Theano: new features and speed improvements. eprint arXiv; 2012. [Accessed April 1, 2019]. Available at: .
- Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, et al. TensorFlow: a system for large-scale machine learning. eprint arXiv; 2016. [Accessed April 1, 2019]. Available at: .
- Lee JG, Jun S, Cho YW, Lee H, Kim GB, Seo JB, et al. Deep learning in medical imaging: general overview. Korean J Radiol. 2017;18:570–584.
- Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. 2012;25:1090–1098.
- Lee C, Kim Y, Kim YS, Jang J. Automatic disease annotation from radiology reports using artificial intelligence implemented by a recurrent neural network. AJR Am J Roentgenol. 2019;212:734–740.
- Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. eprint arXiv; 2013. [Accessed April 1, 2019]. Available at: .
- Kazuhiro K, Werner RA, Toriumi F, Javadi MS, Pomper MG, Solnes LB, et al. Generative adversarial networks for the creation of realistic artificial brain magnetic resonance images. Tomography. 2018;4:159–163.
- Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. Generative adversarial networks. eprint arXiv; 2014. [Accessed April 1, 2019]. Available at: .
- Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation. eprint arXiv; 2015. [Accessed April 1, 2019]. Available at: .
- Huang G, Liu Z, van der Maaten L, Weinberger KQ. Densely connected convolutional networks. eprint arXiv; 2016. [Accessed April 1, 2019]. Available at: .
- Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. eprint arXiv; 2014. [Accessed April 1, 2019]. Available at: .
- He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. eprint arXiv; 2015. [Accessed April 1, 2019]. Available at: .
- Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. eprint arXiv; 2014. [Accessed April 1, 2019]. Available at: .
- He K, Gkioxari G, Dollár P, Girshick R. Mask R-CNN. eprint arXiv; 2017. [Accessed April 1, 2019]. Available at: .
- Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE. 1998;86:2278–2324.
- Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. eprint arXiv; 2013. [Accessed April 1, 2019]. Available at: .
- Qian N. On the momentum term in gradient descent learning algorithms. Neural Netw. 1999;12:145–151.
- Nesterov YE. A method for solving the convex programming problem with convergence rate O(1/k2) Dokl Akad Nauk SSSR. 1983;269:543–547.
- Duchi J, Hazan E, Singer Y. Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res. 2011;12:2121–2159.
- Zeiler MD. ADADELTA: an adaptive learning rate method. eprint arXiv; 2012. [Accessed April 1, 2019]. Available at: .
- Kingma DP, Ba J. Adam: a method for stochastic optimization. eprint arXiv; 2014. [Accessed April 1, 2019]. Available at: .
Source: PubMed