Abstract
Purpose of Review
Myocardial fibrosis (MF) arises due to myocardial infarction and numerous cardiac diseases. MF may lead to several heart disorders, such as heart failure, arrhythmias, and ischemia. Cardiac magnetic resonance (CMR) imaging techniques, such as late gadolinium enhancement (LGE) CMR, enable non-invasive assessment of MF in the left ventricle (LV). Manual assessment of MF on CMR is a tedious and time-consuming task that is subject to high observer variability. Automated segmentation and quantification of MF is important for risk stratification and treatment planning in patients with heart disorders. This article aims to review the machine learning (ML)-based methodologies developed for MF quantification in the LV using CMR images.
Recent Findings
With the availability of relatively large labeled datasets supervised learning methods based on both conventional ML and state-of-the-art deep learning (DL) methods have been successfully applied for automated segmentation of MF. The incorporation of ML algorithms into imaging techniques such as 3D LGE CMR permits fast characterization of MF on CMR imaging and may enhance the diagnosis and prognosis of patients with heart disorders. Concurrently, the studies using cine CMR images have revealed that accurate segmentation of MF on non-contrast CMR imaging might be possible.
Summary
The application of ML/DL tools in CMR image interpretation is likely to result in accurate and efficient quantification of MF.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Cardiovascular disease (CVD) is the leading cause of death worldwide [1]. Myocardial fibrosis (MF) is one of the most common histologic features associated with injury to the myocardium [2]. Conditions such as myocardial infarction, coronary and hypertension heart disease, and aortic stenosis are the most frequent causes of MF [3,4,5]. The MF can be of two types: interstitial and replacement fibrosis [6]. Interstitial fibrosis, which is believed to be reversible through early diagnosis and treatment planning [7, 8], is characterized by the diffuse spread of extracellular collagen without cardiomyocyte necrosis [9]. Replacement fibrosis that occurs after myocardial infarction is considered irreversible [7, 10, 11]. The focus of this review is on replacement MF. The mass, surface area, and spatial distribution of the MF have shown to be predictors of patient prognosis and clinical outcomes [12•]. For instance, the MF mass was shown to be an independent predictor of severe diastolic dysfunction [13]. Diastolic dysfunction is correlated with larger MF mass and lower left ventricular ejection fraction [14]. Recently, computational modeling of the patient with ischemic cardiomyopathy has emerged as a promising non-invasive tool that allows clinicians to conduct a patient-specific diagnosis and treatment of associated rhythm disorders [15,16,17,18,19,20,21]. However, accurate remodeling of myocardial structural requires the incorporation of intact geometry of the MF region [15, 22, 23]. Therefore, identification and characterization of MF are of utmost importance. Characterizing MF may also help clinicians in determining the appropriateness and procedural approach to percutaneous ablation (aimed at eliminating electrical channels) and cardiac resynchronization therapy [24, 25].
Cardiovascular magnetic resonance (CMR) is a non-invasive imaging modality for patients with MF and it establishes a reference methodology for cardiac anatomy and function assessment [26, 27]. CMR is routinely performed during multiple breath-holds in predefined 2D image orientations, and it provides an accurate and reproducible estimate of cardiac structure including left ventricle (LV), right ventricle (RV), and myocardial viability [28, 29]. Routine CMR exams include late gadolinium enhancement (LGE) and cinematic CMR (cine CMR) images. Gadolinium, which is a contrast agent, is used in CMR scans to improve the clarity of the cardiac structure in the images. Cine images are required to acquire complete information of the heart function throughout the cardiac cycle [30]. Figure 1 shows an example of the LGE CMR. Two-dimensional (2D) LGE CMR has been recognized as the non-invasive reference standard for MF identification [31, 32]. LGE increases the volume of distribution for the contrast agent and prolongs washout related to the decreased capillary density within the myocardial fibrotic tissue, which in turn causes the MF to appear as the bright signal intensity in the CMR [26]. Spatial resolution at which the images are acquired may affect the predictive value of the quantified MF by the CMR techniques [33]. 3D CMR is relatively a new technique that allows more accurate spatial representation and quantification [34]. 3D LGE CMR images can now be acquired via cardiac gating during free breathing [35, 36]. Furthermore, it improves myocardial nulling, especially relevant at higher magnetic field strengths such as 3 T [37]. Although compared to the 2D technique, 3D LGE CMR images provide higher signal intensity and contrast for MF with reduced overall acquisition times [38,39,40], delineating MF from 3D LGE CMR images is more challenging due to their mere size [41]. The 3D LGE CMR images may consist of hundreds of slices, reformatted in multiple imaging planes with 3D reconstruction. It has been demonstrated that MF segmentation directly from cine CMR images without contrast agents is feasible [42, 43••] for patients with chronic kidney diseases who are not recommended to use gadolinium-based contrast agents [44].
Automated quantification of MF is important for clinicians for the efficient determination of the clinical diagnosis and prognosis of the patients. This is due to increases in both the size of cardiac images and the number of scans acquired annually due to the growth in the number of patients. Rosendahl et al. [45] showed that computer software for MF characterization decreased the required expert evaluation time by more than 50% while maintaining clinical accuracy to that of manual assessment. Moreover, fully automated methods are reproducible and not subject to operator variability.
Prior to the recent advancements in machine learning (ML)-based methods, the intensity-threshold-based methods and energy minimization-based methods were widely employed for MF segmentation from LGE CMR Images. Two widely used intensity threshold-based methods are the full width at half maximum (FWHM) and signal threshold to reference mean (STRM). In FWHM, the maximum intensity within the myocardial boundary is considered as the reference and all intensity values that are larger than half of the maximum intensity value, are defined as scar [46]. In STRM, the intensity of healthy tissue is considered as a reference, and MF is defined as its mean value plus two (STRM2), three (STRM3), four (STRM4), five (STRM5), or six (STRM6) standard deviation [47]. These two methods require myocardial segmentation and choosing seed points manually, which are subject to high inter- and intra-observer variability. Energy minimization-based methods define a mathematical criterion for the “goodness” of MF segmentation as an optimization problem with regularization constraint on the segmented boundary and a term based on image-based energies. These techniques require the users to define an initial contour in the vicinity of the MF region, which is then evolved by minimizing the optimization criteria. The energy minimization-based methods include graph cuts, level sets, and convex max flow-based methods [48,49,50,51]. Most of these methods were semi-automated and required manual segmentation of the myocardium to constrain the search space for segmenting the MF. However, since these methods use only simple straight forward features such as image intensity and spatial consistency and have only a few hyper-parameters, the performance of these methods plateaued even with the increasing number of larger annotated datasets [52].
Deep learning (DL), which is a branch of ML, has evolved over the last decade and has been providing exciting solutions for the interpretation of medical images. DL architectures such as deep neural networks, deep belief networks, recurrent neural networks (RNNs), and convolutional neural networks (CNNs) employ multiple layers of non-linear processing units to solve complex data with large feature sizes [53]. Recent advances in DL and the availability of large annotated datasets have aided in the identification, classification, and quantification of abnormalities in medical images. Automated characterization of MF using LGE CMR images is no exception. In this paper, we describe semi- and fully automated methods developed for LV MF segmentation from 2D/3D LGE CMR images with more emphasis on the ML and DL-based methods. Furthermore, ML-based methods developed for the delineation of MF from non-contrast CMR images will also be summarized.
ML-Based Methods for Identification of MF from 2D/3D LGE CMRI
A summary of previously published ML-based methods for MF quantification and segmentation from 2D/3D LGE CMR images are shown in Table 1. We first describe the conventional ML-based algorithms. The DL-based methodologies will then be presented and within each category semi- and fully automated techniques will be described.
Conventional ML-Based Methods
Karim et al. described an evaluation framework for algorithms that segment and quantify MF in LV from LGE CMR images [54]. They created two datasets with a total of 15 images of humans with a known history of ischemic cardiomyopathy and 15 porcine with chronic myocardial ischemia, of which five in each cohort were used as a training set for the algorithms. The datasets were used for an open challenge, put forth to the medical imaging community at the Medical Image Computing and Computer-Assisted Intervention (MICCAI) annual meeting’s workshop entitled as Delayed Enhancement MRI segmentation challenge. Few of those techniques were based on ML-based methods. Lara et al. suggested a method based on support vector machine and level sets to identify MF in LV. The FWHM method was first applied to get an approximate segmentation of MF. The connected-component analysis was employed to find the groups of connected pixels and some features including area, bounding box, major and minor axes, eccentricity, convex-hull area, and Euler number were extracted from those groups of connected pixels. Using these features, the support vector machine (SVM) was then applied to differentiate between healthy and MF tissues. A level set method was used to refine the segmentation. This method yielded the median Dice similarity coefficient (DSC) of 73% and 86% on the patient and porcine LGE CMR test scans, respectively.
Kurzendorfer et al. developed a four-step texture-based method to segment MF from 3D LGE CMR images [55]. They first decomposed the image into a set of binary images by applying a two-threshold binary decomposition. Next, a set of fractal dimension features were extracted from binary images. Global and local features were included in the feature vectors as well. Then, a random forest classifier was employed to classify extracted features. They used a dataset of clinical 3D LGE CMRI images of 30 patients and evaluated their algorithm using a 6-fold nested cross-validation technique. The suggested methodology achieved DSC of 66% ± 17% on the test samples. The authors compared their algorithm with STRM and FWHM, which required user input. The comparison of obtained results using different methods demonstrated that the random forest-based method outperforms STRM, but not the FWHM. According to the authors’ argument, the results likely biased toward the FWHM segmentation as FWHM was used to provide annotated ground truth images.
DL-Based Methods
Majority of the DL-based algorithms employed CNN-based networks to segment MF from LGE-CMR images [56,57,58,59,60, 61••]. In the following subsections, we first describe semi-automated methods, where manual segmentation of LV is required to segment MF boundary in LGE-CMR images. The fully automated techniques will then be summarized.
Semi-Automated Algorithms
Moccia et al. used a fully convolutional neural network (FCN) to delineate MF in the LV from 3D LGE CMR [56]. In FCN architecture, several convolutional layers are stacked in an encoder-decoder fashion. The encoder downsamples the image through convolutional and pooling layers, and the decoder upsamples the image using transpose convolution to generate the segmentation map. The feature maps from the downsampling and upsampling paths are summed up to combine context information with spatial information. The authors delineated MF from pre-segmented myocardium as a region of interest (ROI). A total of 250 slices were compiled from CMR images of 30 patients with ischemic heart disease. The proposed method was evaluated against expert manual segmentation using a one-patient-out cross-validation technique. The suggested technique yielded a median DSC of 71.25%.
Zabihollahy et al. proposed a 2D and 3D CNN-based algorithms to identify MF from pre-segmented LV using a dataset of 3D LGE CMR images of 34 patients with ischemic cardiomyopathy [57, 58]. Small 2D and 3D patches were extracted around each voxel in the LV myocardium and presented to the trained 2D and 3D CNNs to be classified as healthy or MF tissue. A segmentation map was then created using output labels and compared with ground truth images. 2D CNN-based method yielded DSC of 94.50% ± 3.62% on the test instances while DSC of 93.63% ± 2.6% was obtained using 3D CNN.
Fully Automated Algorithms
Moccia et al. segmented MF directly from CMR image using the same method and dataset employed for the semi-automated pipeline described in [56]. The fully automated protocol yielded a median DSC of 54% and 71.25%. The authors compared the results obtained from semi- and fully automated methods and demonstrated that identification of MF is significantly more accurate when the search area is limited to the myocardial region (p value < 0.05).
In another study, a deep convolutional neural network (DCNN) was used to quantify MF from LV on 2D LGE [59]. Since only some of the slices of the image will contain scar tissue, the authors suggested a generative adversarial network (GAN)-based technique to simulate scar tissue on healthy myocardium and artificially augment the training samples. Unlike other approaches that generate samples from scratch, the authors simulated scar tissue on normal scans to generate highly realistic samples for training. The proposed approach was evaluated using a dataset with 159 LGE CMR scans and reported a DSC of 80.5% for MF delineation on test images.
Fahmy et al. employed a U-Net architecture to quantify LV mass and MF volume on LGE. The U-Net architecture is built upon the FCN with the main difference that U-Net is symmetric. Furthermore, in U-Net, the skip connections between the downsampling path and the upsampling path apply a concatenation operator instead of summation. Images of 1041 patients with hypertrophic cardiomyopathy were used for this study (train/test = 80%/20%) [60]. Their method achieved DSCs of 82% ± 8% and 81% ± 11% for LV identification and DSCs of 57% ± 23% and 58% ± 28% for MF segmentation on LGE at the per-patient and slice levels. Using this algorithm, the DSC of LV segmentation was lower in the apical slices compared with other slice locations (70% ± 20% versus 83% ± 10%; p < 0.001).
Zabihollahy et al. introduced a novel DL-based method to discover the boundaries of MF from automatically segmented LV using 3D LGE CMR images of 34 patients with ischemic cardiomyopathy [61••]. Two cascaded modules were employed to segment LV myocardium and use it as an ROI to search for MF tissue. In each module, three different U-Nets were trained using slices extracted from transversal, coronal, and sagittal directions to benefit from the isotropic property of the voxel in the 3D images. The proposed methodology achieved DSC of 88.61% ± 2.54% for fully automated segmentation of MF on 3D LGE CMR test images.
DL-Based Methods for Identification of MF from Non-Contrast CMRI
Several studies have been reported on fully automated segmentation of MF from cine CMR images using DL-based methods. These algorithms are validated by comparing to the ground truths manually segmented from corresponding LGE CMR images. Chen et al. described an algorithm to segment the boundaries of MF in the LV and evaluated their method using a dataset comprised of cine CMR images of 73 subjects [62]. In their approach, the static image information and motion information described by the optical flow were fused and presented as inputs into the stack denoising autoencoder (SDAE), which is comprised of multiple layers of sparse autoencoders. An SVM classifier was then applied to the discriminative feature representation learned by the SDAE. This method yielded the accuracy and precision of 87.6% and 86.2% on 13 test cases.
Xu et al. developed an end-to-end deep-learning algorithm framework to detect MF using the short-axis cine CMR image of 114 patients [63]. The authors first used a fast region-based CNN (Fast R-CNN) algorithm to localize and crop the ROI including the left ventricle. Local and global motion features were then generated by long short-term memory recurrent neural network (LSTM-RNN) and deep optical flow, respectively. Particularly, two types of motion features namely local and global are learned together: patch-based motion features using the local intensity change between patches cropped from image sequences, and image-based motion features using the global intensity change along the whole image sequence. An autoencoder was included at the end to detect the MF region from the learned local and global motion features. The proposed framework yielded a classification accuracy of 94.35% at the pixel level. In another study, the authors used a deep learning framework, which is similar to the previous work [63], except that instead of Fast R-CNN, Faster R-CNN was used for LV localization in non-contract CMR images. Fast R-CNN uses the selective search for generating ROI, while Faster R-CNN uses region proposal network and generates a set of object proposals, each with a score. This algorithm evaluated using 165 cine CMR images and achieved 89.87% DSC using a 10-fold cross-validation technique [42]. Zhang et al. used the same method and evaluated the method with a dataset of 212 patients with chronic MF and 87 control patients from which approximately 20% was used for the test phase. The DSC was reported as 86.1% ± 5.7% for the delineating of MF on the short-axis cine CMR image [64].
Xu et al. proposed a deep spatiotemporal adversarial network to segment and quantify MF directly from the cine MR image [65]. Manual segmentation of MF on the corresponding LGE CMR images was considered as ground truth to evaluate the performance of the proposed methodology. In this algorithm, first a coarse to fine hierarchical features are learned using a multi-level and multi-scale spatiotemporal variation encoder. Then, a cross-task generator generates the segmentation and quantification tasks results and connects the beneficial interaction feature maps of these two related tasks. Then, three discriminators (including segmentation, quantification, and relationship) are iteratively imposed on the encoder and generator to detect and correct the inconsistencies in the label relatedness between and within tasks via adversarial learning. This method yielded an accuracy of 96.98% at the pixel level.
Discussion
Due to the availability of large annotated datasets, supervised learning approaches based on DL methods are ideally suited for the segmentation of ML in CMR images. In this paper, we described the ML-based methods developed for the quantification of MF. The proposed methods are evolved from semi- to fully automated, and the majority of them are CNN-based. We reviewed methods introduced for MF assessment using both types of CMR images including LGE and cine. The LGE CMR imaging has been known as a gold standard for MF assessment as it hyper enhances the intensity regions of MF compared to normal tissue. However, gadolinium-based contrast agents may not be recommended for patients with chronic kidney diseases [44]. Therefore, there is an increased interest in the automated characterization of MF using non-contrast CMR images.
The use of different datasets and metrics in the reported studies on MF segmentation hampers the direct comparison of the proposed algorithms. Furthermore, in some studies where segmentation was performed using cine MR images, pixel-wise accuracy was used as a sole metric to investigate the performance of the developed method for MF segmentation. This metric does not represent the segmentation method performance as MF has a relatively small size in CMR images compared to the background that leads to a substantial class imbalance between pixels labeled as MF or background. It has been shown that in the case of class imbalance, a proper metric other than accuracy (e.g., sensitivity, specificity, receiver operating characteristic curve, precision-recall curves, etc.) must be chosen to evaluate the model performance [66]. Selecting a metric is problem dependent. Another limitation concerning algorithm evaluation is the subjectivity of manual segmentations as the reference standard. In all aforementioned studies, expert manual segmentation was used as a surrogate to evaluate the performance of developed algorithms for MF segmentation performed typically by a single expert or few experts. However, there is observer variability in the manual delineation of the MF in the images, which often has not taken into account. Another limitation of the surveyed studies is that a limited number of images were used for the evaluation of the algorithms. This is a common issue in medical image processing problems as acquiring annotated images is quite expensive. Therefore, further studies are required to investigate the robustness of the presented automated techniques for various LGE CMR images. The future works include domain adaptation and transfer learning that might be beneficial to adapt the pre-trained deep learning models to data from new centers.
References
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
Murtha LA, Schuliga MJ, Mabotuwana NS, Hardy SA, Waters DW, Burgess JK, et al. The processes and mechanisms of cardiac and pulmonary fibrosis. Front Physiol. 2017;8:1664–042X. https://doi.org/10.3389/fphys.2017.00777.
Weber KT, Sun Y, Bhattacharya SK, Ahokas RA, Gerling IC. Myofibroblast-mediated mechanisms of pathological remodelling of the heart. Nat Rev Cardiol. 2013;10:15–26. https://doi.org/10.1038/nrcardio.2012.158.
Zeisberg M, Kalluri R. Cellular mechanisms of tissue fibrosis. Common and organ-specific mechanisms associated with tissue fibrosis. Am J Physiol Cell Physiol. 2013;304:C216–25. https://doi.org/10.1152/ajpcell.00328.2012.
Jellis C, Martin J, Narula J, Marwick TH. Assessment of nonischemic myocardial fibrosis. J Am Coll Cardiol. 2010;56:89–97. https://doi.org/10.1016/j.jacc.2010.02.047.
Disertori M, Masè M, Ravelli F. Myocardial fibrosis predicts ventricular tachyarrhythmias. Trends Cardiovasc Med. 2017;27:363–72.
Espeland T, Lunde IG, Amundsen BH, Gullestad L, Aakhus S. Myocardial fibrosis. Tidsskr Nor Laegeforen. 2018;138. https://doi.org/10.4045/tidsskr.17.1027.
Piek A, de Boer RA, Silljé HH. The fibrosis-cell death axis in heart failure. Heart Fail Rev. 2016;21:199–211. https://doi.org/10.1007/s10741-016-9536-9.
Barison A, Grigoratos C, Todiere G, Aquaro GD. Myocardial interstitial remodelling in non-ischaemic dilated cardiomyopathy: insights from cardiovascular magnetic resonance. Heart Fail Rev. 2015;20:731–49. https://doi.org/10.1007/s10741-015-9509-4.
Herum KM, Lunde IG, McCulloch AD, Christensen G. The soft- and hard-heartedness of cardiac fibroblasts: mechanotransduction signaling pathways in fibrosis of the heart. J Clin Med. 2017;6:E53. https://doi.org/10.3390/jcm6050053.
Travers JG, Kamal FA, Robbins J, Yutzey KE, Blaxall BC. Cardiac fibrosis: the fibroblast awakens. Circ Res. 2016;118:1021–40. https://doi.org/10.1161/CIRCRESAHA.115.306565.
Kong P, Christia P, Frangogiannis NG. The pathogenesis of cardiac fibrosis. Cell Mol Life Sci. 2014;71:549–74. https://doi.org/10.1007/s00018-013-1349-6.
Tao Q, Sebastiaan RP, Hildo JL, Katja Z, Rob JG. Myocardial scar surface area identified by LGE MRI is an independent predictor of mortality in post-infarction patients. J Cardiovasc Magn Reson. 2015;17(Suppl 1):P46. https://doi.org/10.1186/1532-429X-17-S1-P46The findings of this study demonstrate that MF surface area identified from LGE CMRI is a predictor of all-course mortality in post-infarction patients, independent of left ventricle ejection fraction.
Lin A, Kwan C, Guppy-Coles K, Sippel J, Atherton J, Prasad S. Impact of infarct size on left ventricular diastolic function following acute myocardial infarction. Heart Lung Circ. 2015;132:A18996. https://doi.org/10.1016/j.hlc.2015.06.089.
Nguyen T, Phan J, Richards D, Moses D, Serratore M, Hogan J, et al. The impact of myocardial scar size and systolic function on diastolic dysfunction following acute st elevated myocardial infarction (STEMI) revascularisation. Heart Lung Circ. 2013;22:S200. https://doi.org/10.1016/j.hlc.2013.05.476.
Trayanova NT. Computational cardiology: the heart of the matter. ISRN Cardiol. 2012;2012:269680–15. https://doi.org/10.5402/2012/269680.
Ashikaga H, Arevalo H, Vadakkumpadan F, Blake RC, Bayer JD, Nazarian S, et al. Feasibility of image-based simulation to estimate ablation target in human ventricular arrhythmia. Heart Rhythm. 2013;10:1109–16. https://doi.org/10.1016/j.hrthm.2013.04.015.
Winslow RL, Trayanova N, Geman D, Miller MI. Computational medicine: Translating models to clinical care. Sci Transl Med. 2012;4:158rv11. https://doi.org/10.1126/scitranslmed.3003528.
Vigmond E, Vadakkumpadan F, Gurev V, Arevalo H, Deo M, Plank G, et al. Towards predictive modelling of the electrophysiology of the heart. Exp Physiol. 2009;94:563–77. https://doi.org/10.1113/expphysiol.2008.044073.
Vadakkumpadan F, Gurev V, Constantino J, Arevalo H, Trayanova N. Modeling of whole-heart electrophysiology and mechanics: toward patient-specific simulations. Modeling of whole-heart electrophysiology and mechanics: toward patient-specific simulations. In: Kerckhoffs R, editor. Patient-specific modeling of the cardiovascular system. New York: Springer; 2010.
Vadakkumpadan F, Arevalo H, Jebb A, Wu KC, Trayanova N. Image-based patient-specific simulations of ventricular electrophysiology for sudden arrhythmic death risk stratification. Circulation. 2013;128:A18014. https://doi.org/10.1161/CIRCEP.117.004743.
Ukwatta E, Nikolov P, Zabihollahy F, Trayanova NA, Wright GA. Virtual electrophysiological study as a tool for evaluating efficacy of MRI techniques in predicting adverse arrhythmic events in ischemic patients. Phys Med Biol. 2018;63:225008. https://doi.org/10.1088/1361-6560/aae8b2.
Trayanova N, Boyle PM, Arevalo HJ, Zahid S. Exploring susceptibility to atrial and ventricular arrhythmias resulting from remodeling of the passive electrical properties in the heart: a simulation approach. Front Physiol. 2014;5:435. https://doi.org/10.3389/fphys.2014.00435.
Ukwatta E, Arevalo H, Rajchl M, White JA, Pashakhanloo F, Prakosa A, et al. Image-based reconstruction of three-dimensional myocardial infarct geometry for patient-specific modeling of cardiac electrophysiology. Med Phys. 2015;42:4579–90. https://doi.org/10.1118/1.4926428.
Schmidt A, Azevedo CF, Cheng A, Gupta SN, Bluemke DA, Foo TK, et al. Infarct tissue heterogeneity by magnetic resonance imaging identifies enhanced cardiac arrhythmia susceptibility in patients with left ventricular dysfunction. Circulation. 2007;115:2006–14. https://doi.org/10.1161/CIRCULATIONAHA.106.653568.
Bello D, Fieno DS, Kim RJ, Pereles FS, Passman R, Song G, et al. Infarct morphology identifies patients with substrate for sustained ventricular tachycardia. J Am Coll Cardiol. 2005;45:1104–8. https://doi.org/10.1016/j.jacc.2004.12.057.
Kubicek J, Bryjova I, Penhaker M, Augustynek M. Extraction of myocardial fibrosis from MR using fuzzy soft thresholding algorithm. In: Proceedings - 2016 5th IIAI International Congress on Advanced Applied Informatics, IIAI-AAI 2016. 2016. https://doi.org/10.1109/IIAI-AAI.2016.143.
Rajiah P, Desai MY, Kwon D, Flamm SD. MR imaging of myocardial infarction. Radiographics. 2013;33:1383–413. https://doi.org/10.1148/rg.335125722.
Mewton N, Chia Ying L, Croisille P, Bluemke D, João ACL. Assessment of myocardial fibrosis with cardiovascular magnetic resonance. J Am Coll Cardiol. 2011;57(8):891–903. https://doi.org/10.1016/j.jacc.2010.11.013.
Flett AS, Hayward MP, Ashworth MT, Hansen MS, Taylor AM, Elliott PM, et al. Equilibrium contrast cardiovascular magnetic resonance for the measurement of diffuse myocardial fibrosis: preliminary validation in humans. Circulation. 2010;122(2):138–44. https://doi.org/10.1161/CIRCULATIONAHA.109.930636 ISSN 0009-7322.
Pfeiffer MP, Biederman RW. Cardiac MRI: a general overview with emphasis on current use and indication. Med Clin North Am. 2015;99:849–61. https://doi.org/10.1016/j.mcna.2015.02.011.
Kim RJ, Fieno DS, Parrish TB, Harris K, Chen EL, Simonetti O, et al. Relationship of MRI delayed contrast enhancement to irreversible injury, infarct age, and contractile function. Circulation. 1999;100(19):1992–2002. https://doi.org/10.1161/01.CIR.100.19.1992Circulation.
Ibrahim T, Makowski MR, Jankauskas A, Maintz D, Karch M, Schachoff S, et al. Serial contrast-enhanced cardiac magnetic resonance imaging demonstrates regression of hyperenhancement within the coronary artery wall in patients after acute myocardial infarction. JACC Cardiovasc Imaging. 2009;2:580–8. https://doi.org/10.1016/j.jcmg.2008.12.029.
Farrag NA, Ramanan V, Wright GA, Ukwatta E. Effect of T1-mapping technique and diminished image resolution on quantification of infarct mass and its ability in predicting appropriate ICD therapy. Med Phys. 2018;45:1577–85. https://doi.org/10.1002/mp.12840.
Amano Y, Yanagisawa F, Tachi M, Asai K, Suzuki Y, Hashimoto H, et al. Three-dimensional cardiac MR imaging: related techniques and clinical applications. Magn Reson Med Sci. 2017;16:183–9. https://doi.org/10.2463/mrms.rev.2016-0116.
Davis CP, Hany TF, Wildermuth S, Schmidt M, Debatin JF. Postprocessing techniques for gadolinium-enhanced three-dimensional MR angiography. Radiographics. 1997;17:1061–77. https://doi.org/10.1148/radiographics.17.5.9308101.
Heiss SG, Shifrin RY, Sommer FG. Contras-enhanced three-dimensional fast spoiled gradient-echo renal MR imaging: evaluation of vascular and nonvascular disease. Radiographics. 2000;20:1341–52. https://doi.org/10.1148/radiographics.20.5.g00se251341.
Bizino M, Tao Q, Amersfoort J, Van Der Geest RJ, Lamb HJ. 3D free-breathing late gadolinium enhancement 3T MRI: comparison with standard 2D Imaging. J Cardiovasc Magn Reson. 2014;16(Suppl 1):P198. https://doi.org/10.1186/1532-429X-16-S1-P198.
Viallon M, Jacquier A, Rotaru C, Delattre BMA, Mewton N, Vincent F, et al. Head-to-head comparison of eight late gadolinium-enhanced cardiac MR (LGE CMR) sequences at 1.5 tesla: from bench to bedside. J Magn Reson Imaging. 2011;34(6):1374–87. https://doi.org/10.1002/jmri.22783.
Morita K, Utsunomiya D, Oda S, Komi M, Namimoto T, Hirai T, et al. Comparison of 3D phase-sensitive inversion-recovery and 2D inversion-recovery MRI at 3.0 T for the assessment of late gadolinium enhancement in patients with hypertrophic cardiomyopathy. Acad Radiol. 2013;20(6):752–7. https://doi.org/10.1016/j.acra.2013.01.014.
Goetti R, Kozerke S, Donati OF, Sürder D, Stolzmann P, Kaufmann PA, et al. Acute, subacute, and chronic myocardial infarction: quantitative comparison of 2D and 3D late gadolinium enhancement MR imaging. Radiology. 2011;259(3):704–11. https://doi.org/10.1148/radiol.11102216.
Rajchl M, Yuan J, White JA, Ukwatta E, Stirrat J, Nambakhsh CMS, et al. Interactive hierarchical-flow segmentation of scar tissue from late-enhancement cardiac MR images. IEEE Trans Med Imaging. 2014;33(1):159–72. https://doi.org/10.1109/TMI.2013.2282932.
Xu C, Xu L, Gao Z, Zhao S, Zhang H, Zhang Y, et al. Direct delineation of myocardial infarction without contrast agents using a joint motion feature learning architecture. Med Image Anal. 2018;50:82–94. https://doi.org/10.1016/j.media.2018.09.001.
•• Xu C, Howey J, Ohorodnyk P, Roth M, Zhang H, Li S. Segmentation and quantification of infarction without contrast agents via spatiotemporal generative adversarial learning. Med Image Anal. 2020;59:101568. https://doi.org/10.1016/j.media.2019.101568The findings of this research show that LV MF characterization from non-contrast CMRI with high accuracy is possible.
Fox CS, Muntner P, Chen AY, Alexander KP, Roe MT, Cannon CP, et al. Use of evidence-based therapies in short-term outcomes of ST-segment elevation myocardial infarction and non–ST-segment elevation myocardial infarction in patients with chronic kidney disease: a report from the National Cardiovascular Data Acute Coronary Treatment and Intervention Outcomes Network Registry. Circulation. 2010;121(3):357–65. https://doi.org/10.1161/CIRCULATIONAHA.109.865352.
Rosendahl L, Blomstrand P, Heiberg E, Ohlsson J, Björklund PG, Ahlander BM, et al. Computer-assisted calculation of myocardial infarct size shortens the evaluation time of contrast-enhanced cardiac MRI. Clin Physiol Funct Imaging. 2008;28(1):1–7. https://doi.org/10.1111/j.1475-097X.2007.00765.x.
Neizel M, Katoh M, Schade E, Rassaf T, Krombach GA, Kelm M, et al. Rapid and accurate determination of relative infarct size in humans using contrast-enhanced magnetic resonance imaging. Clin Res Cardiol. 2009;98:319–24. https://doi.org/10.1007/s00392-009-0007-3.
Kolipaka A, Chatzimavroudis GP, White RD, O’Donnell TP, Setser RM. Segmentation of non-viable myocardium in delayed enhancement magnetic resonance images. Int J Cardiovasc Imaging. 2005;21:303–11. https://doi.org/10.1007/s10554-004-5806-z.
Ukwatta E, Arevalo H, Li K, Yuan J, Qiu W, Malamas P, et al. Myocardial infarct segmentation from magnetic resonance images for personalized modeling of cardiac electrophysiology. IEEE Trans Med Imaging. 2016;35:1408–19. https://doi.org/10.1109/TMI.2015.2512711.
Ukwatta E, Yuan J, Qiu W, Wu KC, Trayanova N, Vadakkumpadan F. Myocardial infarct segmentation and reconstruction from 2D late-gadolinium enhanced magnetic resonance image. Med Image Comput Comput Assist Interv. 2014;35:1408–19. https://doi.org/10.1109/TMI.2015.2512711.
Usta F, Gueaieb W, White JA, Ukwatta E. 3D scar segmentation from LGE-MRI using a continuous max-flow method. Houston: SPIE Medical Imaging; 2018. https://doi.org/10.1117/12.2294406.
Lu Y, Connelly KA, Yang Y, Joshi SB, Wright G, Radau PE. Semi-automated analysis of infarct heterogeneity on DE-MRI using graph cuts. J Cardiovasc Magn Reson. 2012;14:T6. https://doi.org/10.1186/1532-429X-14-S1-T6.
Zhu X, Vondrick C, Fowlkes CC, Ramanan D. Do we need more training data? Int J Comput Vis. 2016;119(17):76–92. https://doi.org/10.1007/s11263-015-0812-2.
LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436–44.
Karim R, Bhagirath P, Claus P, James Housden R, Chen Z, Karimaghaloo Z, et al. Evaluation of state-of-the-art segmentation algorithms for left ventricle infarct from late Gadolinium enhancement MR images. Med Image Anal. 2016;30:95–107. https://doi.org/10.1016/j.media.2016.01.004.
Kurzendorfer T, Breininger K, Steidl S, Brost A, Forman C, Maier A. Myocardial scar segmentation in LGE-MRI using fractal analysis and random forest classification. 2018 24th International Conference on Pattern Recognition (ICPR), August 2018:3168–3173. https://doi.org/10.1109/ICPR.2018.8545636.
Moccia S, Banali R, Martini C, Muscogiuri G, Pontone G, Pepi M, et al. Development and testing of a deep learning-based strategy for scar segmentation on CMR-LGE images. Magn Reson Mater Physics, Biol Med. 2019;32(2):187(9). https://doi.org/10.1007/s10334-018-0718-4.
Zabihollahy F, White JA, Ukwatta E. Myocardial scar segmentation from magnetic resonance images using convolutional neural network. Proceedings Volume 10575, Medical Imaging 2018: Computer-aided diagnosis; 105752Z. https://doi.org/10.1117/12.2293518.
Zabihollahy F, White JA, Ukwatta E. Convolutional neural network-based approach for segmentation of left ventricle myocardial scar from 3D late gadolinium enhancement MR images. Med Phys. 2019;46(4):1740–51. https://doi.org/10.1002/mp.13436.
Lau F, Hendriks T, Lieman-Sifry J, Berk N, Sall S, Golden D, et al. ScarGAN: chained generative adversarial networks to simulate pathological tissue on cardiovascular MR scans. Deep Learn. Med. Image Anal. Multimodal Learn. Clin. Decis. Support, 2018:343–350. https://doi.org/10.1007/978-3-030-00889-5_39,.
Fahmy AS, Rausch J, Ulf N, Chan RH, Maron MS, Appelbaum E, et al. Automated cardiac MR scar quantification in hypertrophic cardiomyopathy using deep convolutional neural networks. JACC Cardiovasc Imaging. 2018;11(12):1917–8. https://doi.org/10.1016/j.jcmg.2018.04.030.
Zabihollahy F, Rajchl M, White JA, Ukwatta E. Fully automated segmentation of left ventricular scar from 3D late gadolinium enhancement magnetic resonance imaging using a cascaded multi-planar U-Net (CMPU-Net). Med Phys. 2020. https://doi.org/10.1002/mp.14022This document demonstrates the fully automated quantification of LV MF from 3D LGE CMRI with high accuracy is feasible.
Chen M, Fang L, Zhuang Q, Liu H. Deep learning assessment of myocardial infarction from MR image sequences. IEEE Access. 2019;7:5438–46. https://doi.org/10.1109/ACCESS.2018.2889744.
Xu C, Xu L, Gao Z, Zhao S, Zhang H, Zhang Y, et al. Direct detection of pixel-level myocardial infarction areas via a deep-learning algorithm. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2017. arXiv:1706.03182v1.
Zhang N, Yang G, Gao Z, Xu C, Zhang Y, Shi R, et al. Deep learning for diagnosis of chronic myocardial infarction on nonenhanced cardiac cine MRI. Radiology. 2019;291(3):606–17. https://doi.org/10.1148/radiol.2019182304.
Xu C, Howey J, Ohorodnyk P, Roth M, Zhang H, Li S. Segmentation and quantification of infarction without contrast agents via spatiotemporal generative adversarial learning. Med Image Anal. 2020;291(3):606–17. https://doi.org/10.1148/radiol.2019182304.
Sun, Wong AKC, Kamel MS. Classification of imbalanced data: a review. Int J Pattern Recognit Artif Intell. 2009;23(04):687–719. https://doi.org/10.1142/S0218001409007326.
Acknowledgments
F. Zabihollahy acknowledges the Ontario Graduate Scholarship (OGS).
Funding
This work was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery grant (E. Ukwatta).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
F. Zabihollahy, S. Rajan, and E. Ukwatta declare that they have no conflict of interest.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Cardiac PET, CT, and MRI
Rights and permissions
About this article
Cite this article
Zabihollahy, F., Rajan, S. & Ukwatta, E. Machine Learning-Based Segmentation of Left Ventricular Myocardial Fibrosis from Magnetic Resonance Imaging. Curr Cardiol Rep 22, 65 (2020). https://doi.org/10.1007/s11886-020-01321-1
Published:
DOI: https://doi.org/10.1007/s11886-020-01321-1