An artificial intelligence deep learning model for identification of small bowel obstruction on plain abdominal radiographs

D H Kim, H Wit, M Thurston, M Long, G F Maskell, M J Strugnell, D Shetty, I M Smith, N P Hollings, D H Kim, H Wit, M Thurston, M Long, G F Maskell, M J Strugnell, D Shetty, I M Smith, N P Hollings

Abstract

Objectives: Small bowel obstruction is a common surgical emergency which can lead to bowel necrosis, perforation and death. Plain abdominal X-rays are frequently used as a first-line test but the availability of immediate expert radiological review is variable. The aim was to investigate the feasibility of using a deep learning model for automated identification of small bowel obstruction.

Methods: A total of 990 plain abdominal radiographs were collected, 445 with normal findings and 445 demonstrating small bowel obstruction. The images were labelled using the radiology reports, subsequent CT scans, surgical operation notes and enhanced radiological review. The data were used to develop a predictive model comprising an ensemble of five convolutional neural networks trained using transfer learning.

Results: The performance of the model was excellent with an area under the receiver operator curve (AUC) of 0.961, corresponding to sensitivity and specificity of 91 and 93% respectively.

Conclusion: Deep learning can be used to identify small bowel obstruction on plain radiographs with a high degree of accuracy. A system such as this could be used to alert clinicians to the presence of urgent findings with the potential for expedited clinical review and improved patient outcomes.

Advances in knowledge: This paper describes a novel labelling method using composite clinical follow-up and demonstrates that ensemble models can be used effectively in medical imaging tasks. It also provides evidence that deep learning methods can be used to identify small bowel obstruction with high accuracy.

Conflict of interest statement

Competing interests: Dr Daniel H Kim and Dr G Maskell are providing support to core research projects for the National Consortium of Intelligent Medical Imaging (NCIMI) which currently involves collaboration with the University of Oxford, General Electric and Alliance Medical. Dr G Maskell is currently on the board for NCIMI. Dr Daniel H Kim is on the Data Access Committee for NCIMI. The submitted study received no funding or support from NCIMI or any of its partners; or any other external institution. The remaining authors declare that they have no competing financial interests or personal relationships that could have appeared to influence the work reported in this.

Figures

Figure 1.
Figure 1.
Flow diagram illustrating image labelling and network training methods. CNN, convolution neural network; PACS, picture archiving and communication system
Figure 2.
Figure 2.
ROC curve for the ensemble model. ROC, receiver operator characteristic.
Figure 3.
Figure 3.
Examples of correctly categorised images demonstrating normal appearances (a) and obstruction (b). The ensemble model scores and category predictions are shown in boxes at the base of each image.
Figure 4.
Figure 4.
Examples of incorrectly diagnosed images showing false negatives (a) and false positives (b). Ensemble model output scores and class predictions are shown in boxes at the base of each image.

References

    1. Leem M, Sayers A, Wilson T, et al. . Current management of small bowel obstruction in the UK: results from the National audit of small bowel obstruction clinical practice survey. Colorectal dis 2018; 7: 623–30.
    1. Gore RM, Silvers RI, Thakrar KH, Wenzke DR, Mehta UK, Newmark GM, et al. . Bowel obstruction. Radiol Clin North Am 2015; 53: 1225–40. doi: 10.1016/j.rcl.2015.06.008
    1. Ozturk E, van Iersel M, Stommel MM, Schoon Y, Ten Broek RR, van Goor H. Small bowel obstruction in the elderly: a plea for comprehensive acute geriatric care. World J Emerg Surg 2018; 13: 48. doi: 10.1186/s13017-018-0208-z
    1. Paulson EK, Thompson WM. Review of small-bowel obstruction: the diagnosis and when to worry. Radiology 2015; 275: 332–42. doi: 10.1148/radiol.15131519
    1. Fevang BT, Fevang J, Stangeland L, Soreide O, Svanes K, Viste A. Complications and death after surgical treatment of small bowel obstruction: a 35-year institutional experience. Ann Surg 2000; 231: 529–37. doi: 10.1097/00000658-200004000-00012
    1. Cheadle WG, Garr EE, Richardson JD. The importance of early diagnosis of small bowel obstruction. Am Surg 1988; 54: 565–9.
    1. Springer JE, Bailey JG, Davis PJB, Johnson PM. Management and outcomes of small bowel obstruction in older adult patients: a prospective cohort study. Can J Surg 2014; 57: 379–84. doi: 10.1503/cjs.029513
    1. American College of Radiology. ACR appropriateness criteria. Suspected small-bowel obstruction. American College of Radiology. 1996. Available from: .
    1. Royal College of Radiologists. iRefer: Making the best use of clinical radiology, 8th edition. Guideline G11 Acute small bowel obstruction: confirmation and assessment of level. 2019. Available from: .
    1. Silva AC, Pimenta M, Guimarães LS. Small bowel obstruction: what to look for. Radiographics 2009; 29: 423–39. doi: 10.1148/rg.292085514
    1. The Royal College of Radiologist. Clinical radiology UK workforce census. 2020. Available from: .
    1. Thompson WM, Kilani RK, Smith BB, Thomas J, Jaffe TA, Delong DM, et al. . Accuracy of abdominal radiography in acute small-bowel obstruction: does reviewer experience matter? AJR Am J Roentgenol 2007; 188: W233–8. doi: 10.2214/AJR.06.0817
    1. Suzuki K. Overview of deep learning in medical imaging. Radiol Phys Technol 2017; 10: 257–73. doi: 10.1007/s12194-017-0406-5
    1. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. . Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017; 542: 115–8. doi: 10.1038/nature21056
    1. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature 2015; 521: 436–44. doi: 10.1038/nature14539
    1. Yosinski J, Clune J, Bengio Y. How transferable are features in deep neural networks? Advances in Neural Information Processing Systems 2014; 27: 3320–8.
    1. Goksuluk D, Korkmaz S, Zararsiz G, Karaagaoglu A.,Ergun. easyROC: an interactive web-tool for ROC curve analysis using R language environment. R J 2016; 8: 213–30. Accessed 28 Oct 2019. doi: 10.32614/RJ-2016-042
    1. Chollet F. Keras: the Python deep learning library. 2015. Available from: .
    1. Abadi M, Agarwal A, Brevdo P. Tensorflow: large-scale machine learning on heterogenous systems. 2015. Available from: .
    1. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from Overfitting. Journal of Machine Learning Research 2014; 15: 1929–58.
    1. Simonyan K, Zisserman A. Very deep Convolutional networks for large-scale image recognition. 2014;: arXiv:1409.1556. doi:
    1. Huang G, Liu Z, Maaten LVD, Weinberger KQ. Densely connected Convolutional networks. 2016;: arXiv:1608.06993.
    1. Zoph B, Vasudevan V, Shlens J LQV. Learning transferable architectures for scalable image recognition. 2017;: arXiv:1707.07012.
    1. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojnaa Z. Rethinking the inception architecture for computer vision. 2015;: arXiv:1512.00567.
    1. Chollet F. Xception: deep learning with depthwise separable convolutions. 2016;: arXiv:1610.02357.
    1. Dong W, Socher R, Li LJ, Li K, Fei-Fei L. ImageNet: a large-scale hierarchical image database. CVPR09. 2009. Available from: .
    1. Pedregosa F, Varoquaux G, Gramfort A, et al. . Scikit-learn: machine learning in python. Journal of Machine Learning Research 2011; 12: 2825–30.
    1. Rajpurkar P, Irvin J, Zhu K, et al. . CheXNet: Radiologist-Level pneumonia detection on chest x-rays with deep learning. 2017;: arXiv:1711.05225. doi:
    1. Cheng PM, Tran KN, Whang G, Tejura TK. Refining Convolutional neural network detection of small-bowel obstruction in conventional radiography. AJR Am J Roentgenol 2019; 212: 342–50. doi: 10.2214/AJR.18.20362
    1. Cheng PM, Tejura TK, Tran KN, Whang G. Detection of high-grade small bowel obstruction on conventional radiography with convolutional neural networks. Abdom Radiol 2018; 43: 1120–7. doi: 10.1007/s00261-017-1294-1
    1. Shen Y, Li X, Liu Z, Shang J, et al. . Application of deep residual neural network in detecting small bowel obstruction by abdominal plain film. Xi'an jiao tong dA xue xue bao. Yi xue ban 2020; 1: 102–7.
    1. Ogawa R, Kido T, Kido T, Mochizuki T. Effect of augmented datasets on deep convolutional neural networks applied to chest radiographs. Clin Radiol 2019; 74: 697–701. doi: 10.1016/j.crad.2019.04.025
    1. Gans SL, Stoker J, Boermeester MA. Plain abdominal radiography in acute abdominal pain; past, present, and future. Int J Gen Med 2012; 5: 525–33. doi: 10.2147/IJGM.S17410

Source: PubMed

3
구독하다