Anatomically informed deep learning on contrast-enhanced cardiac magnetic resonance imaging for scar segmentation and clinical feature extraction
Dan M Popescu, Haley G Abramson, Rebecca Yu, Changxin Lai, Julie K Shade, Katherine C Wu, Mauro Maggioni, Natalia A Trayanova, Dan M Popescu, Haley G Abramson, Rebecca Yu, Changxin Lai, Julie K Shade, Katherine C Wu, Mauro Maggioni, Natalia A Trayanova
Abstract
Background: Visualizing fibrosis on cardiac magnetic resonance (CMR) imaging with contrast enhancement (late gadolinium enhancement; LGE) is paramount in characterizing disease progression and identifying arrhythmia substrates. Segmentation and fibrosis quantification from LGE-CMR is intensive, manual, and prone to interobserver variability. There is an unmet need for automated LGE-CMR image segmentation that ensures anatomical accuracy and seamless extraction of clinical features.
Objective: This study aimed to develop a novel deep learning solution for analysis of contrast-enhanced CMR images that produces anatomically accurate myocardium and scar/fibrosis segmentations and uses these to calculate features of clinical interest.
Methods: Data sources were 155 2-dimensional LGE-CMR patient scans (1124 slices) and 246 synthetic "LGE-like" scans (1360 slices) obtained from cine CMR using a novel style-transfer algorithm. We trained and tested a 3-stage neural network that identified the left ventricle (LV) region of interest (ROI), segmented ROI into viable myocardium and regions of enhancement, and postprocessed the segmentation results to enforce conforming to anatomical constraints. The segmentations were used to directly compute clinical features, such as LV volume and scar burden.
Results: Predicted LV and scar segmentations achieved 96% and 75% balanced accuracy, respectively, and 0.93 and 0.57 Dice coefficient when compared to trained expert segmentations. The mean scar burden difference between manual and predicted segmentations was 2%.
Conclusion: We developed and validated a deep neural network for automatic, anatomically accurate expert-level LGE- CMR myocardium and scar/fibrosis segmentation, allowing direct calculation of clinical measures. Given the training set heterogeneity, our approach could be extended to multiple imaging modalities and patient pathologies.
Keywords: CMR; Contrast-enhanced; Deep learning; Machine learning; Segmentation.
© 2021 Heart Rhythm Society.
Figures
References
- Zipes D.P., Wellens H.J.J. Sudden cardiac death. Circulation. 1998;98:2334–2351.
- Kuruvilla S., Adenaw N., Katwal A.B., Lipinski M.J., Kramer C.M., Salerno M. Late gadolinium enhancement on cardiac magnetic resonance predicts adverse cardiovascular outcomes in nonischemic cardiomyopathy: a systematic review and meta-analysis. Circ Cardiovasc Imaging. 2014;7:250–258.
- Marco A.D., Anguera I., Schmitt M., et al. Late gadolinium enhancement and the risk for ventricular arrhythmias or sudden death in dilated cardiomyopathy: systematic review and meta-analysis. JACC Heart Fail. 2017;5:28–38.
- van der Burg A.E.B., Bax J.J., Boersma E., Pauwels E.K.J., Wall E.E., Schalij M.J. Impact of viability, ischemia, scar tissue, and revascularization on outcome after aborted sudden death. Circulation. 2003;108:1954–1959.
- Wu K.C. Sudden cardiac death substrate imaged by MRI: from investigational tool to clinical applications. Circ Cardiovasc Imaging. 2017;10:7.
- Roes S.D., Borleffs C.J.W., Geest R.J., et al. Infarct tissue heterogeneity assessed with contrast-enhanced MRI predicts spontaneous ventricular arrhythmia in patients with ischemic cardiomyopathy and implantable cardioverter-defibrillator. Circ Cardiovasc Imaging. 2009;2:183–190.
- Scott P.A., Morgan J.M., Carroll N., et al. The extent of left ventricular scar quantified by late gadolinium enhancement MRI is associated with spontaneous ventricular arrhythmias in patients with coronary artery disease and implantable cardioverter-defibrillators. Circ Arrhythm Electrophysiol. 2011;4:324–330.
- AlJaroudi W.A., Flamm S.D., Saliba W., Wilkoff B.L., Kwon D. Role of CMR imaging in risk stratification for sudden cardiac death. JACC Cardiovasc Imaging. 2013;6:392–406.
- Kim R.J., Fieno D.S., Parrish T.B., et al. Relationship of MRI delayed contrast enhancement to irreversible injury, infarct age, and contractile function. Circulation. 1999;100:1992–2002.
- Disertori M., Rigoni M., Pace N., et al. Myocardial fibrosis assessment by LGE is a powerful predictor of ventricular tachyarrhythmias in ischemic and nonischemic LV dysfunction: a meta-analysis. JACC Cardiovasc Imaging. 2016;9:1046–1055.
- Mordi I., Jhund P.S., Gardner R.S., et al. LGE and NT-ProBNP identify low risk of death or arrhythmic events in patients with primary prevention ICDs. JACC Cardiovasc Imaging. 2014;7:561–569.
- Cain M.A., Metzl M.D., Patel A.R., et al. Cardiac sarcoidosis detected by late gadolinium enhancement and prevalence of atrial arrhythmias. Am J Cardiol. 2014;113:1556–1560.
- Marra M.P., De Lazzari M., Zorzi A., et al. Impact of the presence and amount of myocardial fibrosis by cardiac magnetic resonance on arrhythmic outcome and sudden cardiac death in nonischemic dilated cardiomyopathy. Heart Rhythm. 2014;11:856–863.
- Balaban G., Halliday B.P., Porter B., et al. Late-gadolinium enhancement interface area and electrophysiological simulations predict arrhythmic events in patients with nonischemic dilated cardiomyopathy. JACC Clin Electrophysiol. 2021;7:238–249.
- Kucukseymen S., Yavin H., Barkagan M., et al. Discordance in scar detection between electroanatomical mapping and cardiac MRI in an infarct swine model. JACC Clin Electrophysiol. 2020;6:1452–1464.
- Arevalo H.J., Vadakkumpadan F., Guallar E., et al. Arrhythmia risk stratification of patients after myocardial infarction using personalized heart models. Nat Commun. 2016;7:11437.
- Ashikaga H., Arevalo H., Vadakkumpadan F., et al. Feasibility of image-based simulation to estimate ablation target in human ventricular arrhythmia. Heart Rhythm. 2013;8:1109–1116.
- Bello G.A., Dawes T.J.W., Duan J., et al. Deep-learning cardiac motion analysis for human survival prediction. Nat Mach Intell. 2019;1:95–104.
- Zheng Q., Delingette H., Duchateau N., Ayache N. 3D consistent and robust segmentation of cardiac images by deep learning with spatial propagation. IEEE Trans Med Imaging. 2018:1.
- Yue Q., Luo X., Ye Q., Xu L., Zhuang X. Cardiac segmentation from LGE MRI using deep neural network incorporating shape and spatial priors. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. 2019;11765 LNCS:559–567.
- Roth H., Zhu W., Yang D., Xu Z., Xu D. In: Statistical Atlases and Computational Models of the Heart. Multi-Sequence CMR Segmentation, CRT-EPiggy and LV Full Quantification Challenges. Pop M., Sermesant M., Camara O., et al., editors. Springer International Publishing; 2020. Cardiac segmentation of LGE MRI with noisy labels; pp. 228–236.
- Chen C., Ouyang C., Tarroni G., et al. International Workshop on Statistical Atlases and Computational Models of the Heart. Springer; 2019. Unsupervised multi-modal style transfer for cardiac MR segmentation; pp. 209–219.
- Campello V., Martín-Isla C., Izquierdo C., Petersen S.E., Ballester M.A.G., Lekadir K. International Workshop on Statistical Atlases and Computational Models of the Heart. Springer; 2019. Combining multi-sequence and synthetic images for improved segmentation of late gadolinium enhancement cardiac MRI; pp. 290–299.
- Zabihollahy F., Rajchl M., White J.A., Ukwatta E. Fully automated segmentation of left ventricular scar from 3D late gadolinium enhancement magnetic resonance imaging using a cascaded multi-planar U-net (CMPU-net) Med Phys. 2020;47:1645–1655.
- Moccia S., Banali R., Martini C., et al. Development and testing of a deep learning-based strategy for scar segmentation on CMR-LGE images. MAGMA. 2019;32:187–195.
- Fahmy A.S., Neisius U., Chan R.H., et al. Three-dimensional deep convolutional neural networks for automated myocardial scar quantification in hypertrophic cardiomyopathy: a multicenter multivendor study. Radiology. 2019;294:190737.
- Fahmy A.S., Rowin E., Chan R.H., Manning W.J., Maron M.S., Nezafat R. Improved quantification of myocardium scar in late gadolinium enhancement images: deep learning based image fusion approach. J Magn Reson Imaging. 2021;54:303–312.
- Wu K.C., Gerstenblith G., Guallar E., et al. Combined cardiac magnetic resonance imaging and C-reactive protein levels identify a cohort at low risk for defibrillator firings and death. Circ Cardiovasc Imaging. 2012;5:178–186.
- Bernard O., Lalande A., Zotti C., et al. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans Med Imaging. 2018;37:2514–2525.
- Radau P., Lu Y., Connelly K., Paul G., Dick A., Wright G. Evaluation framework for algorithms segmenting short axis cardiac MRI. The MIDAS Journal. 2009
- Pizer S.M., Amburn E.P., Austin J.D., et al. Adaptive histogram equalization and its variations. Computer Vision, Graphics, and Image Processing. 1987;39:355–368.
- Ronneberger O., Fischer P., Brox T. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Navab N., Hornegger J., Wells W., Frangi A., editors. Springer; 2015. U-net: convolutional networks for biomedical image segmentation; pp. 234–241.
- Salehi S.S.M., Erdogmus D., Gholipour A. International Workshop on Machine Learning in Medical Imaging. Springer; 2017. Tversky loss function for image segmentation using 3D fully convolutional deep networks; pp. 379–387.
- Kingma D., Ba J. Adam: a method for stochastic optimization. Int. Conf. on Learn. Represent. 2014
- Chollet François, others. Keras 2015. Retrieved from.
- Abadi M., Agarwal A., Barham P., et al. TensorFlow: large-scale machine learning on heterogeneous systems. 2015. Software available from.
- Birsan T., Tiba D. IFIP Conference on System Modeling and Optimization. Springer; 2005. One hundred years since the introduction of the set distance by Dimitrie Pompeiu; pp. 35–39.
- Schmidt A., Azevedo C.F., Cheng A., et al. Infarct tissue heterogeneity by magnetic resonance imaging identifies enhanced cardiac arrhythmia susceptibility in patients with left ventricular dysfunction. Circulation. 2007;115:2006–2014.
- Jablonowski R., Chaudhry U., Pals J., et al. Cardiovascular magnetic resonance to predict appropriate implantable cardioverter defibrillator therapy in ischemic and nonischemic cardiomyopathy patients using late gadolinium enhancement border zone: comparison of four analysis methods. Circ Cardiovasc Imaging. 2017;10
- Zhuang X. International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer; 2016. Multivariate mixture model for cardiac segmentation from multi-sequence MRI; pp. 581–588.
- Zhuang X. Multivariate mixture model for myocardial segmentation combining multi-source images. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2019;41:2933–2946.
- Klem I., Weinsaft J.W., Bahnson T.D., et al. Assessment of myocardial scarring improves risk stratification in patients evaluated for cardiac defibrillator implantation. J Am Coll Cardiol. 2012;60:408–420.
- Prakosa A., Arevalo H.J., Deng D., et al. Personalized virtual-heart technology for guiding the ablation of infarct-related ventricular tachycardia. Nat Biomed Eng. 2018;2:732–740.
- Ballistipedia Bivariate. 2020. Retrieved from.
- Boyle P.M., Zghaib T., Zahid S., et al. Computationally guided personalized targeted ablation of persistent atrial fibrillation. Nat Biomed Eng. 2019;3:870–879.
- Zhuang X., Xu J., Luo X., et al. Cardiac segmentation on late gadolinium enhancement MRI: a benchmarkstudy from multi-sequence cardiac MR segmentation challenge. arXiv preprint arXiv. 2006
- Painchaud N., Skandarani Y., Judge T., Olivier B., Lalande A., Jodoin P.M. International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer; 2019. CardiacMRI segmentation with strong anatomical guarantees; pp. 632–640.
- Larrazabal A.J., Martínez C., Glocker B., Ferrante E. Post-DAE: Anatomically plausible segmentation viapost-processing with denoising autoencoders. IEEE Trans Med Imaging. 2020;39:3813–3820.
- Akaike H. A new look at the statistical model identification. IEEE Trans Autom Control. 1974;19:716–723.
Source: PubMed