Introduction

Congenital heart disease (CHD) is the most common birth defect, with a prevalence of approximately 10 in every 1000 births [20]. Survival rates have been increasing, with 90% of infants born with CHD now surviving to adulthood due to improvements in surgical interventions. For the first time the population of adults with CHD is larger than the pediatric population [7]. However, heart failure is a significant problem for adults with CHD. As a result, CHD patients undergo regular monitoring in order to correctly time surgical interventions [20]. MRI is the preferred method of evaluation, due to the absence of ionizing radiation, coverage of the whole heart, and high spatial and temporal resolution [20]. However, analysis of the images requires segmentation of the chambers and muscle, which remains a significant bottleneck despite substantial work on improving analysis methods (see [16] for a review).

Although historically the left ventricle (LV) has been viewed as the most important chamber in maintaining cardiac health, later research has shown the importance of the right ventricle (RV) in maintaining overall cardiac function [1, 8, 18]. Interdependence between the ventricles is of particular importance in CHD [3, 8, 19]. Their closely linked anatomy, haemodynamics and shared muscle fibres make it necessary to assess the both ventricles in CHD. While evaluation of biventricular (left and right ventricular) function from cardiac MRI has been widely researched, few studies have considered the additional challenges associated with CHD [16, 17, 22]. Figure 1 shows a four chamber cine view of patients with three different types of CHD. The images are representative of the quality of images typically collected in cardiac MRI examinations in CHD patients. Additional artifacts are caused by septal wires and artificial valves (Fig. 1, left image). For clinical evaluation, the standard method is to manually contour the endocardial and epicardial boundaries of both ventricles on all short axis slices at both end-diastole (ED) and end-systole (ES), up to the inflow and outflow valves, and calculate volumes by slice summation. This method has been shown to be prone to inter-observer and intra-observer error as well as being very time-consuming [10]. Although rapid, reproducible analysis is critical for clinical throughput, fully automated methods are currently not robust enough for biventricular analysis in CHD. Semi-automated methods with minimal user interaction are therefore required with fast (real time) interaction.

Fig. 1
figure 1

Three ED frames of four-chamber slices in three different types of CHD. Left congenitally-corrected transposition of the great arteries, which connects the left atrium to the right ventricle and the right atrium to the left ventricle. Middle double outlet right ventricle after a Fontan surgery, showing single ventricle circulation. Right dextro-transposition of the great arteries, as well as a ventricular septal defect. The patient has under-gone a Senning procedure, with subsequent arterial switch and mitral regurgitation

Previous methods for segmenting biventricular geometry have included subdivision surfaces [21] and 4D spatio-temporal models [15], however neither are capable of real-time interaction. Lamata et al. [11] devised a customizable biventricular model, however this study did not model the full cardiac cycle and did not capture the full basal extent of the ventricles (up to the atrioventricular valves). Wang et al. [24] developed a segmentation-free method of assessing biventricular function from MR images, however they did not test the performance of their algorithm on CHD cases. Both [26] and [27] used 3D MRI datasets at the ED frame to create whole heart segmentations. Zhuang et al. [26] used spatially encoded mutual information and free form deformation and Zuluaga et al. [27] used a multi-atlas segmentation. While both methods reported good correlation with manual delineation, they did not report correlation with clinical measures of heart function, and did not show results in patients.

In this paper we extended and validated a biventricular modelling tool described in a technical conference report [5]. In particular we examined the performance of the method in simulated customizations, and compared results in 60 patients representing a variety of CHD types against manual contours for two independent observers.

Methods

Interactive biventricular modelling

Guide-point modelling [6, 25] was used to interactively customize a 3D time-varying finite element model to a patient’s cardiac MRI scan. The biventricular finite element model is shown in Fig. 2 and consisted of 82 3D elements with Bézier interpolation and \(C^1\) continuity, meaning surfaces were continuous in slope across the element boundaries.

Fig. 2
figure 2

Finite element model showing the four valves and element boundaries. Model coordinates (\(\xi _1,\xi _2,\xi _3\)) were defined as shown. MV mitral valve, AV aortic valve, PV pulmonary valve , TV tricuspid valve

The initial model template was scaled and registered to the patient’s images using landmarks defined on the valves (as shown in Fig. 3) as well as LV and RV centroids defined on the apical and basal slices, and the apical point of the heart defined on a long axis slice. The apex and valves were tracked throughout the cardiac cycle using image feature tracking by non-rigid registration [13].

Fig. 3
figure 3

Valve inserts on long axis images. The pink dots are the mitral valve, the dark blue the aortic valve, purple the tricuspid and cyan the pulmonary valve

In order to customise a model to a patient’s anatomy, three types of data points were used: (i) guide points, points placed by the user to guide the contour location; (ii) predicted points, points generated by the algorithm to predict the model deformation; and (iii) tracked contour points, generated from image feature tracking [13]. The model was customised by minimizing the following objective function:

$$\begin{aligned} E = S(\varvec{u}) +\sum _{d}{w_{d}\big \Vert \varvec{x}(\varvec{\xi }_{d}) -{\varvec{x}_{d}}\big \Vert ^2} \end{aligned}$$
(1)

which measures the distance between each user, predicted and tracked contour point, (d) and each corresponding point the model surface. The data points are represented by \(\varvec{x}_d\) and the corresponding model point is represented by \(\varvec{x}(\varvec{\xi }_d)\). The distance between these two points was weighted by \(w_d\) to allow for the differing importance of different point types to the model during fitting. For example, if there is a predicted point and a guide point close together, it is better for the model to fit the guide point more accurately as it is user generated thus the guide point would have a higher weighting than the predicted point. \(S(\varvec{u})\) is the smoothing term, which is described in “D-Affine smoothing” section. Equation 1 was minimized using a preconditioned conjugate gradient algorithm (see “Appendix” for details).

Calculating predicted points

Predicted points were calculated algorithmically to improve computational efficiency in the optimization process [6] by using a simple model defined in prolate spheroid coordinates to represent the LV endocardial surface and the biventricular epicardial surface [5]. Figure 4a shows the LV prolate model. Briefly, a 16 element model with Bézier interpolation was fitted to the data points and then sampled to provide a set of predicted points. The LV prolate model has been shown to produce efficient and accurate 4D models of the LV geometry [12, 25], but in this application the LV prolate model was used to provide cardiac motion for the LV endocardium and biventricular epicardium only. This was motivated by the observation that, even though the RV is typically non-convex, the biventricular epicardium is approximately convex, as is the LV endocardium. Note that this prediction does not force the final solution to be convex.

Fig. 4
figure 4

a The prolate spheroid coordinate system with the initial prolate model. The origin is one-third the distance from the base towards the LV apex. The coordinate system has four parameters, the radial coordinate (\(\lambda\)), the rotation coordinate (\(\theta\)), the azimuthal coordinate (\(\mu\)) and the focal length (f). b The customized prolate model

The prolate spheroid coordinate system was defined as:

$$\begin{aligned} \begin{aligned} x&= f \cosh (\lambda )\cos (\mu )\\ y&= f \sinh (\lambda )\sin (\mu )\cos (\theta )\\ z&=f \sinh (\lambda )\sin (\mu )\sin (\theta ) \end{aligned} \end{aligned}$$
(2)

where \(\lambda>0\) defines the transmural direction from the center of the LV, \(0\le \mu <\pi\) is the azimuthal direction from apex (\(\mu =0\)) to base, \(0\le \theta \le 2\pi\) is the circumferential direction, and \(f>0\) is the focal length. We fixed f in this application such that \(\lambda\) at apex is equal to 1.

The prolate model was initialized from the biventricular template, after customization to the anatomical landmarks on the MR images. The basal extent of the prolate model was defined from the mitral valve plane. The prolate coordinate system was permitted to translate and rotate so that the prolate central axis (x axis in Eq. 2) passed through the LV apex in all frames. The apex was marked by the user on the end-diastolic frame and was warped through the cardiac cycle using a non-rigid registration method [13]. The prolate surfaces were updated by a linear least squares optimization of the radial (\(\lambda\)) field, as a function of the angular coordinates. The resulting prolate prediction model is shown in Fig. 4b. The predicted points were defined at the locations of the nodes of the biventricular model and were mapped onto the modified prolate model epicardial and LV endocardial surfaces. This mapping was fixed so that after each prolate model update, the position of the predicted points could be found by simple matrix–vector multiplication.

D-Affine smoothing

The smoothing term in Eq. 1 is required to regularize the solution in the presence of sparse data. Previously, a Sobolev smoothing term [12, 23] has been used for this purpose [6]; however, this has the disadvantage of being sensitive to large rotations and motions, as are often seen around the RV, leaving artifacts in the model surfaces. In this work we used a D-Affine smoothing term [5], which penalized change in deformation across the model. The D-Affine smoothing term S(u) in Eq. 1 was defined to be

$$\begin{aligned} S(\mathbf u ) = \sum _{k \in \{x,y,z\}}\int _{\Omega }{\alpha _{k}\bigg \Vert \tfrac{\partial \mathbf J }{\partial \xi _{k}}\bigg \Vert _{F}^{2}d\Omega }, \end{aligned}$$
(3)

where k indicates the model directions in x, y and z, \(\bigl \Vert \cdot \bigr \Vert _{F}^{2}\) is the Frobenius norm and \(\Omega\) represents the model domain. J is the Jacobian of motion, which is the deformation gradient tensor and \(\alpha _k\) is the smoothing weight in the \(kth\) direction. The method for incorporating the smoothing term in the conjugate gradient optimization process can be found in the “Appendix”.

Unlike previous methods such as poly-affine models [14] and locally affine transformations [2], D-Affine smoothing does not require prior knowledge of the number and location of affine transformations. The main advantages of D-Affine smoothing are:

  • The method is invariant to affine transformations, including rotations.

  • D-Affine smoothing does not require prior knowledge of the displacement fields

  • D-Affine smoothing minimises strain across the model

  • The method results in a smoothly varying deformation field.

These advantages make D-Affine smoothing useful for modelling CHD, where large deformations, particularly in the RV, are typically observed.

Table 1 Congenital heart disease pathologies and surgeries represented in the dataset

The fitting process

The full customization process, each time a guidepoint is added, included the following steps:

  1. 1.

    Solve the prolate spheroidal model.

  2. 2.

    Create a set of predicted points from the polar model.

  3. 3.

    Solve the biventricular model for registration (high smoothing).

  4. 4.

    Solve the biventricular model with user data (low smoothing).

  5. 5.

    Solve the time varying model.

After each user edit to a landmark or guide-point, the modified prolate model was updated, which was very fast since it involved a low complexity model with a single coordinate field (\(\lambda\)). The predicted point locations at the nodes of the biventricular model were then updated and the biventricular model was then fitted to the predicted point locations with a high smoothing weighting (see “Appendix”). Then the biventricular model was optimized to the user-placed guide-points, as well as tracked contours from the non-rigid registration, using a normal smoothing weighting. This two step solution process was found to improve the resulting solution by improving the mapping between user defined points and their corresponding model positions. Finally, the time-varying model was updated by fitting all frames using a Fourier harmonic temporal basis function. This acted to provide additional temporal coherence to the final model motion.

Implementation

The method was implemented in C++ on a Dell OptiPlex 990 running Windows 7 using an Intel\(^{\circledR }\) Core i5 3.30GHz with 4GB of RAM, containing 4 cores. The preconditioned conjugate gradient solution was implemented using the Math Kernel Library (Version 10.1.3.028) utilizing the inbuilt routine with multithreading. A solution was possible in 0.15 s per frame (including x, y and z), enabling real time updates of the model while dragging a guide-point.

Experiments

Simulation experiments were performed to test the performance of the smoothing, and the method was validated in 60 patients with CHD.

Simulated customizations

In order to assess the performance of the D-Affine smoothing, test model behavior and find appropriate smoothing and data weights, a series of simulated customizations were performed. The simulations were designed to test the D-Affine smoothing behavior as well as the performance of the smoothing when combined with other factors, such as guide-points and predicted points. The simulations comprised:

  1. 1.

    A 10 mm displacement in the x direction using 8 guide-points.

  2. 2.

    A 45° rotation using eight guide-points.

  3. 3.

    A displacement of 10 mm in the x and z direction on the LV freewall, using 8 guide-points and a set of predicted points.

  4. 4.

    A deformation caused by a displacement of one guide-point 10 mm in the x direction, relative to 3 others kept stationary, and a set of predicted points.

  5. 5.

    A longitudinal scaling simulated by a displacement of 30\(\%\) towards the apex.

CHD patients

Ethical approval was obtained from the local ethics committee and 60 participants with CHD gave written informed consent for their images to be used. Table 1 shows the pathologies and surgical interventions represented in the group. There were 25 females and 35 males with an average age of \(23\pm 13\) (range 7–75) years. The images were acquired using a 1.5 T MRI scanner ( Siemens Avanto, Siemens Healthcare, Erlangen, Germany) and all cines were prospectively or retrospectively gated breath-hold steady-state free precession acquisitions. The short axis slices were acquired parallel to the tricuspid annulus plane and spanned both ventricles. Long axis slices were obtained through all valves and spanning both ventricles. Typical imaging parameters were as follows: slice thickness = 6 mm, flip angle = 60°, TE = 1.6 ms and TR = 30 ms, field of view = \(360\times 360\) mm and image matrix = \(256\times 208\). The images were acquired as part of routine clinical care and the study targeted patients who required assessment of RV function as well as LV function.

All short axis slices between the apex and the valves were manually contoured either using Argus (Syngo MR2004V, Siemens Healthcare, Erlangen, Germany) or Segment V1.9 (http://segment.heiberg.se) [9] by two independent expert analysts. Myocardial mass and ventricular volumes were calculated using Simpsons rule. Two analysts also assessed the same 60 cases using the biventricular modelling tool.

Fig. 5
figure 5

Initial (left) and fitted (right) models for each test. The LV endocardium has a green surface, the RV endocardium has a yellow surface and the epicardium is blue. Guide-points are purple stars and their corresponding model point is a purple circle

Results

Simulated customisations

The D-Affine smoothing was evaluated using the tests described in “Simulated customizations”. Tests 1, 2 and 5 did not include predicted points, while tests 3 and 4 did include predicted points. Figure 5 shows the original and fitted models for the five tests.

Table 2 Average values for each method as well as the difference and correlation between methods for the full dataset

The translation (test 1) and rotation (test 2) simulations showed exact solutions to these affine transformations. Tests 3 and 4 show typical customizations, shifting a subset of guide points while others remain constant, similar to what would occur in a typical customization. Test 5 shows the model shortening in the longitudinal direction, while maintaining its size in the y and z direction, similar to the descent of the basal valves towards the apex seen in typical cardiac motion. Similar results were obtained with a range of weights, with good results obtained in all tests with the smoothing matrix given a weight of 1, the predicted points given a weight of 0.01, and the guide-points a weight of 0.1. More detailed tests on the behaviour on the conditioning and numerical accuracy of the smoothing scheme can be found in the “Appendix”.

CHD patients

For the patient studies, the smoothing weights represented by \(\alpha _k\) in Eq. 3 were increased 100 times for the high smoothing step, where the biventricular model is registered to the predicted points. Analysis with the biventricular modelling tool took an average of \(21\pm 7\) min per case for all frames compared to over an hour with the manual contouring tools for only end-diastole and end-systole. Each case required approximately \(178\pm 36\) guide-points to customise the template to the patients images. The prediction of cardiac motion step provided good deformation of the model throughout the cardiac cycle for all hearts, including those with complex congenital defects that cause a large variation in geometry. The end-diastolic volume, the end-systolic volume, mass, stroke volume and ejection fraction were evaluated for the comparison between the manual contours and the biventricular modelling tool.

Table 2 shows the average values for each measure produced by both methods as well as the difference between the methods and the correlation as measured by Pearson product moment correlation coefficient (PPMCC). The PPMCC shows strong correlation in all measures between manual contours and the biventricular modelling tool. Figure 6a shows the regression plots of the two methods for all measures of function with \(R^2\) values used to measure correlation. Figure 6b shows the Bland–Altman plots for all measures. Both plots demonstrate good agreement between the biventricular modelling tool and manual contours. The largest CHD group in our dataset was Tetralogy of Fallot and the results from these 29 cases are shown in Table 3. Figure 7 shows the patient specific model created using the biventricular modelling tool for a 13 year old female with repaired coarctation of the aorta.

Fig. 6
figure 6

a Regression plots showing the correlation between the two measurement methods. b Bland–Altman plots comparing the correlation of the manual results and the biventricular modelling tool. The average difference is shown in red and 2 standard deviations are shown in green

Table 3 Average values for each method as well as the difference and correlation between methods for the tetralogy of Fallot patients

Table 4 shows the inter-observer error for both the manual contours and the biventricular modelling tool, on common measures of function. The PPMCC was calculated to assess correlation between the two observers for each method. The inter-observer correlation was high in all measures.

Table 4 Inter-observer error and correlation for manual analysis and the biventricular modelling tool

Discussion

This study validated an interactive tool for 4D (3D + time) biventricular mass and volume quantification for CHD patients using a rapid interactive method. A major advantage of the method is that the full basal extent of the biventricular geometry up to all four atrioventricular valves is included, avoiding a major source of error in identifying the basal extent of the ventricles. Long axis slices were used to provide anatomical information which is not well defined on short axis slices due to partial voluming [4]. The biventricular modelling tool showed good correlation with manual contours in 60 cases. The method used fast prediction of surface motion in prolate coordinates, and D-Affine smoothing to constrain motion between data points. The addition of the predicted points benefited the solution time, requiring fewer iterations in test 3 than test 1 (“Appendix”). A previous implementation using Sobolev smoothing and calculation of predicted points using a trilinear host mesh [6], required an average of \(19\pm 4\) min with \(318\pm 46\) guide-points per case. Although the analysis times were similar with the current method, the average number of guide-points used was almost halved. This suggests that less interaction is required to customize models with the incorporation of D-Affine smoothing and polar prediction. The error between manual analysis and the biventricular modelling tool decreased in the LV ESV (\(32\)\(7\%\)), LV EF (\(17\)\(8\%\)), LV Mass (\(27\)\(17\%\)), RV EDV (\(5\)\(2\%\)), RV ESV (\(19\)\(11\%\)) but increased in RV EF (\(16\)\(19\%\)) and RV mass (\(33\)\(37\%\)) with the inclusion of polar prediction and D-Affine smoothing. However, the cases used in [6] represent a subset of the cases analysed in this paper. The differences in the errors could also be due to a larger variety of CHD cases being analysed. Also, differences in basal extent may account for systematic differences in RV EF.

Compared to the other pathologies, the tetralogy of Fallot cases saw similar differences between the methods in most measures. Differences in RV EDV and ESV may be due to the difficulty defining the pulmonary valves in some ToF cases. Many of these patients have pulmonary homografts, making the valve hard to distinguish.

Our dataset also had five cases where the right ventricle was the systemic ventricle. In these cases, the average differences between the manual analysis and our biventricular modelling tool were as follows: LV EDV, \(8.1\%\); LV ESV, \(-11.7\%\); LV Mass, \(-27.0\%\); LV SV, \(19.5\%\); LV EF, \(10.0\%\); RV EDV, \(1.5\%\); RV ESV, \(-12.1\%\); RV Mass, \(-23.2\%\); RV SV, \(24.7\%\); RV EF, \(24.4\%\). While most of the systemic ventricle average differences were somewhat higher than the whole dataset, this would need to be confirmed with more patients. Our dataset did not contain any single ventricle cases and the model developed in this method is currently not flexible enough to fit a single ventricle case to our satisfaction. In these cases a single ventricle model may be appropriate.

While no information was provided on ECG wave forms as part of this study, the method should be applicable in cases of bundle branch blocks and asynchrony. The method described uses non-rigid registration to track features of each image from frame to frames and allows the user to add guidepoints to as many or as few frames as required. The analysts noted the time of minimum volume could be different for RV and LV in some patients, however the causes of this require further study.

The correlation of results from the biventricular modelling tool to the manual analysis results was strong but there was lower inter-observer correlation than in the manual analysis. This was due to the fact that the manual analysis used a consensus approach to determine the the valve locations, where both analysts agreed on basal extent. The basal extent is often very difficult to determine from the short axis images alone, leading to large inter-observer errors in mass and volume if this approach is not taken [10]. In contrast the biventricular analysis was performed completely separately, with analysts with less experience. This difference in protocol was the most likely cause of the lower inter-observer correlation in the biventricular analysis, and improvements are expected with increased training. The long axis slices are particularly useful in defining the valve locations accurately, and use of the long axis slices enables better estimation of the mass and volume of each ventricle when compared to using only the short axis slices [6].

Figure 7 shows the initial (a) and customised (b) contours on the same example frame as well as the 3D model after customisation of all slices. The case fitted in this figure has a relatively good fit; however, there are some CHD lesions which the model does not account for. In the future, the tool should be extended to model ventricular septal defects and valvular regurgitation.

Fig. 7
figure 7

A model fitted to a 13 year old female with coarctation of the aorta, who has undergone an aortic arch repair. The LV endocardium is contoured in green, the RV endocardium in yellow/gold, the biventricular epicardium in dark blue, the mitral valve in pink and the triscupid valve in purple. a Shows the initial contours presented to the user after fitting to anatomical markers. b Shows the customised contours for the same four chamber ED frame as (a). c Shows the resulting ED frame of the model after full customisation to all slices

Conclusion

In conclusion, we have presented a biventricular modelling tool which can rapidly and accurately create 3D time-varying patient specific models for CHD. A major advantage of our model is that it includes all 4 atrioventricular valves, and includes long axis information to reduce the errors in locating the correct valve position. The model showed good results in comparison with the current clinical standard and can be applied in patients to follow the progression of biventricular remodelling due to disease.