Introduction

Diagnosis of coronary artery disease (CAD) requires not only anatomical but also functional evaluation in order to optimize the treatment strategy [1]. Coronary CT angiography (CCTA) has been validated as one non-invasive imaging modality that can accurately rule out obstructive CAD [2, 3]. However, this approach is unable to assess the hemodynamic significance of coronary stenosis, which is also essential for guiding treatment [4].

CT myocardial perfusion imaging (CT-MPI) combined with CCTA is an emerging technique that allows “one-stop shop” imaging of coronary vasculature as well as myocardial blood perfusion [5]. Static protocol is one CT-MPI acquisition method that provides only visual analysis of perfusion defect at lower radiation dose [6]. In contrast, dynamic CT-MPI enables absolute quantification and semi-quantification of various perfusion parameters at the cost of longer acquisition period and higher radiation exposure [7]. However, the diagnostic performance of these two approaches significantly varied between different studies with different methodologies [6,7,8,9,10,11] and no previous study has made head-to-head comparison of diagnostic accuracy between quantitative, semi-quantitative, and visual analysis. At present, there is no consensus regarding the standardized approach for CT-MPI interpretation and it is of clinical importance to determine the optimal way for ischemia evaluation by intra-individual comparison of the aforementioned methods. Therefore, we aimed to investigate the diagnostic accuracy of quantitative, semi-quantitative, and visual analysis of dynamic CT-MPI with reference to invasive fractional flow reserve (FFR).

Materials and methods

Patient population

Between January 1, 2018, and December 31, 2019, we prospectively enrolled symptomatic patients with intermediate to high pre-test probability of obstructive CAD for dynamic CT-MPI + CCTA followed by invasive coronary angiography (ICA) + FFR measurement. The inclusion criteria were (1) patients with stable angina or angina-equivalent symptoms; and (2) the pre-test probability of obstructive CAD was intermediate to high according to updated Diamond-Forrester score (pre-test probability ≧ 15%). Exclusion criteria were (1) patients with previous history of coronary revascularization; (2) patients with previous history of myocardial infarction; (3) patients with suspected cardiomyopathy or microvascular dysfunction; (4) invasive FFR was not performed due to the absence of 40 to 90% stenosis on ICA; (5) image quality of dynamic CT-MPI was significantly impaired (Fig. 1).

Fig. 1
figure 1

Flow chart of inclusion and exclusion. Abbreviations: CAD, coronary artery disease; CCTA, coronary computed tomography angiography; CT, computed tomography; FFR, fractional flow reserve; HCM, hypertrophic cardiomyopathy; ICA, invasive coronary angiography; MPI, myocardial perfusion imaging

All recruited patients were referred for dynamic CT-MPI + CCTA followed by ICA + FFR measurement within 4-week interval regardless of the dynamic CT-MPI results. The hospital ethics committee approved this prospective study and the written informed consents were acquired from all participants.

Imaging protocol of dynamic CT-MPI

All patients were scanned with third-generation dual-source CT (SOMATOM Force, Siemens Healthineers), and an integrated protocol, which incorporated calcium score, dynamic CT-MPI, and CCTA, was employed. In brief, calcium score was firstly performed to calculate the calcification burden of each pericardial vessel. Intravenous infusion of adenosine triphosphate (ATP) at 160 μg/kg/min was then administrated for 3 min before the triggering of dynamic CT-MPI acquisition [12]. Dynamic CT-MPI was acquired using a shuttle mode technique and started 4 s after the beginning of contrast injection. Dynamic acquisition was set at the end-systolic phase (triggered at 250 ms after the R wave in all patients) and scans were launched every second or third heart cycle according to patients’ heart rate. CARE kV and CARE dose 4D was used to reduce radiation dose. The reference tube voltage and effective current was 80 kVp and 300 mAs, respectively. Nitroglycerin was given sublingually in all subjects 5 min after dynamic CT-MPI. Prospective ECG-triggered sequential acquisition was performed in all participants for CCTA. The detailed parameters of contrast medium injection, dynamic CT-MPI, and CCTA acquisition were given in online appendix.

Image analysis of dynamic CT-MPI

Dataset of dynamic CT-MPI was reconstructed with a dedicated kernel (Qr36) for the reduction of iodine beam-hardening artifacts and analyzed using a commercially available CT-MPI software package (Myocardial perfusion analysis, VPCT body, Siemens Healthineers). Motion correction was manually applied if breathing-related misregistration of the left ventricle was present. The quantification of myocardial blood flow (MBF) was performed using a hybrid deconvolution model, as previously reported [13]. Image interpretation of CT-MPI was performed using different approaches as described below.

Visual analysis was made on three multiplanar-reformatted short-axis views (apical, mid, and basal) with 10-mm slice thickness. A narrow window width (200 HU) and window level (100 HU) was used for image interpretation [14]. Dynamic video data of the above short-axis views was visually evaluated frame by frame for detection of ischemic perfusion defect, which was defined as the hypo-density area that persisted throughout the cardiac cycle [14]. Any presence of ischemic perfusion defect was recorded according to 17-segment model [15] with the exclusion of the apical segment.

For absolute quantitative analysis, the region of interest (ROI) was manually placed on short-axis view to sample the MBF on a segment base according to the aforementioned 17-segment model with the exclusion of the apical segment. The ROI was drawn to cover the whole area of suspected perfusion defects within the segment or cover the whole segment when perfusion defect was absent. The stenosis-subtended territories and reference territories were each determined according to the fusion images of coronary vasculature and perfusion map. The mean value of stress MBF was measured for each segment of both stenosis-subtended territories and reference territories.

For semi-quantitative analysis, the stress MBF ratio (MBFratio) was adopted in the current study. This parameter was defined as the mean MBF of stenosis-subtended territories versus that of reference territories. In order to avoid underestimating the reference MBF, the reference territories were defined as all the myocardial segments supplied by epicardial vessels without the presence of ≥ 30% stenosis, of which the hemodynamic status was considered insignificant [16].

Two cardiovascular radiologists (with 10 years and 6 years of experience in cardiovascular imaging), who were blinded to clinical histories, independently analyzed all CT-MPI data. Any disagreement regarding qualitative analysis was resolved by consensus. The mean values of quantitative parameters measured by two observers were used for analysis.

Image analysis of CCTA

Axial images were reconstructed with smooth kernel (Bv 40) and third-generation iterative reconstruction (IR) technique (strength 3, ADMIRE, Siemens). Data were transferred to an offline workstation (SyngoVia VB10, Siemens Healthineers) and the dataset with the best image quality throughout available cardiac phases was used for further evaluation.

Diameter stenosis (DS) was semi-automatically quantified as (reference diameter – minimal lumen diameter) / reference diameter. Two cardiovascular radiologists (with 10 years and 6 years of experience in cardiovascular imaging), who were blinded to clinical histories and CT-MPI results, independently analyzed the lesions and the mean values of DS measured by two observers were used for further analysis.

ICA and FFR measurement

ICA was performed by two interventional cardiologists (with 26 years and 20 years’ experience of coronary intervention) with standard method and at least two views were obtained for each major vessel. The stenotic extent of each lesion was visually assessed without the knowledge of dynamic CT-MPI and CCTA results. Invasive FFR was measured by using a 0.014-in. pressure guidewire (Abbott) as previously described [4]. Hyperemia was induced by intravenous infusion of ATP at 160 μg/kg/min. FFR measurement was performed in all lesions on major coronary arteries (caliber ≧ 2.5 mm) with stenosis severity between 40 and 90% [17]. An FFR value of ≤ 0.8 was considered physiologically significant stenosis.

Comparison of CT-MPI and invasive FFR

For the prespecified reference standard, all vessels interrogated with invasive FFR were classified into ischemic and non-ischemic according to FFR results. Vessels having any lesion with FFR ≤ 0.8 were defined as ischemic whereas vessels not having any lesion with FFR ≤ 0.8 were defined as non-ischemic.

Comparison of multiple qualitative, quantitative, and semi-quantitative CT-derived parameters with the reference standard was made on a vessel-based analysis and patient-based analysis. For CT-quantified DS, the lesions with the most severe stenosis extent on one specific vessel were selected for comparison with invasive FFR (in case of the presence of tandem lesions). For visual analysis of CT-MPI, vessels with the presence of any visible perfusion defect within the territories were considered ischemic and further compared with FFR results. For quantitative and semi-quantitative analysis, the best cutoff values derived from receiver operating characteristic (ROC) analyses were used to distinguish ischemic and non-ischemic vessels.

Statistical analysis

Statistical analysis was performed by using commercial statistical software (MedCalc Statistical Software version 15.2.2, MedCalc Software bvba). One-sample Kolmogorov-Smirnov test was used to check the assumption of normal distribution. Normally distributed continuous quantitative variables were expressed as means ± standard deviations, or median with first to third quartile otherwise. Student’s t test was used for normally distributed data, and the Mann-Whitney U test was used for data that were not normally distributed. The average measures for intra-observer and inter-observer agreements were expressed in intra-class correlation coefficient (ICC) and Cohen’s kappa coefficient when data were continuous variables and categorical variables respectively. The relationship between invasive FFR, MBF, and MBFratio was assessed by the Pearson correlation analysis. ROC curve analyses were performed to calculate the area under the receiver operating characteristic curve (AUC). The optimal cutoff values for various parameters were determined by the Youden index, the maximum sum of sensitivity and specificity. Diagnostic performance was compared using ROC analysis with DeLong’s method. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were recorded. The sensitivity, specificity, and diagnostic accuracy between visual analysis, MBF, and MBFratio were compared using the McNemar test. A two-tailed p < 0.05 was considered statistically significant.

Results

Clinical demographics of study participants

Between January 1, 2018, and December 31, 2019, consecutive 180 patients with angina or angina-equivalent symptoms were clinically evaluated in cardiology service and those with intermediate-to-high pre-test probability of obstructive CAD were screened for recruitment. Seventy-two patients were initially excluded because of low pre-test probability of obstructive CAD whereas 25 patients were excluded due to the clinical history of myocardial infarction or revascularization. Eight patients who refused to provide informed consent were also excluded. After the enrollment, fifteen patients were further excluded due to various reasons as shown in Fig. 1.

Sixty-two patients (mean age, 65 ± 10 [range, 46–83] years; 54 men (mean age, 65 ± 10 [range, 46–82] years) and 8 women (mean age, 67 ± 9 [range 51–83] years; p = 0.339) with 95 vessels interrogated by FFR were finally included in the present study. The dose length product of dynamic CT-MPI and the whole integrated CT protocol (scout view, calcium score, dynamic CT-MPI, and CCTA) were 211.7 (160.2–284.8) mGy*cm and 385.5 (336.5–543.0) mGy*cm respectively. The mean effective doses of radiation for dynamic CT-MPI and the whole integrated CT protocol were 3.0 (2.2–4.0) mSv and 5.4 (4.7–7.6) mSv respectively when using 0.014 as the conversion factor. The mean interval between CT examinations and invasive tests was 13.9 ± 9.8 days (range 1 to 30 days). The mean time for dynamic CT-MPI post-processing and image analysis was 25.8 ± 4.2 min (19–37 min). Other clinical details were given in Table 1.

Table 1 Demographic data

Characteristics of CT-derived imaging parameters between ischemic and non-ischemic lesions

The intra-observer and inter-observer agreement for the measurement of CT-derived parameters were good (online supplement Table E1 and E2). The mean lesion-based absolute MBF value was significantly lower in ischemic segments than that in non-ischemic segments (78.0 (65.0–86.0) mL/min/100 mL vs. 133.0 (117.5–163.8) mL/min/100 mL, p < 0.001). Similarly, the lesion-based MBFratio was also markedly lower in territories with positive FFR results (0.52 (0.44–0.64) vs. 0.93 (0.91–0.97), p < 0.001). In addition, for ischemic vessel territories, the visible perfusion defect was more frequently presented whereas CT-quantified DS was significantly higher (Table 2). Representative cases showing ischemic and non-ischemic lesions were given in Figs. 2 and 3. According to correlation analysis, both lesion-based MBF and MBFratio correlated well with FFR results (Fig. 4).

Table 2 Characteristics of CT-derived imaging parameters between ischemic and non-ischemic lesions
Fig. 2
figure 2

Representative case of a 51-year-old female presenting with atypical chest pain. Dynamic CT-MPI provided functional information to accurately exclude myocardial ischemia of severe stenosis. a CPR images showed non-calcified plaque at LAD ostium with severe stenosis (white arrow) whereas the other two major coronary arteries were free of stenosis. b Short-axis views (from apical to basal) of visual analysis did not reveal perfusion defect in any segment. c Short-axis views (from apical to basal) of MBF color-coded map demonstrated the absence of decreased perfusion. The mean MBF of LAD territory (white area) was 223 mL/min/100 mL and mean MBF of reference segments (gray area) was 218 mL/min/100 mL. The MBFratio was 1.02 accordingly. d ICA confirmed the severe stenosis at LAD ostium (white arrow). FFR was measured as 0.85 for this lesion (white arrowhead). Abbreviations: CPR, curved planar reformation; CT, computed tomography; FFR, fractional flow reserve; ICA, invasive coronary angiography; LAD, left anterior descending; MBF, myocardial blood flow; MPI, myocardial perfusion imaging

Fig. 3
figure 3

Representative case of a 69-year-old male presenting with exertional chest pain. Dynamic CT-MPI provided functional information to accurately diagnose myocardial ischemia of moderate stenosis. a CPR images showed calcified and mixed plaques at proximal to middle LAD with multiple moderate stenosis (white arrow) whereas other two major coronary arteries were with lumen irregularity and minimal stenosis. b Short-axis views (from apical to basal) of visual analysis revealed diffuse perfusion defect in anterior and septal wall. c Short-axis views (from apical to basal) of MBF color-coded map demonstrated the extensive reduced myocardial perfusion in anterior, septal wall as well as part of lateral wall. The mean MBF of LAD territory (white area) was 62 mL/min/100 mL and mean MBF of reference segments (gray area) was 138 mL/min/100 mL. The MBFratio was 0.45 accordingly. Please note that the area with decreased MBF was slightly larger than that with perfusion defect by visual analysis. d ICA confirmed the diffuse moderate stenosis at proximal to middle LAD (white arrow). FFR was measured as 0.67 for this lesion (white arrowhead). Abbreviations: CPR, curved planar reformation; CT, computed tomography; FFR, fractional flow reserve; ICA, invasive coronary angiography; LAD, left anterior descending; MBF, myocardial blood flow; MPI, myocardial perfusion imaging

Fig. 4
figure 4

Pearson correlation analysis of MFB and MBFratio versus invasive FFR measurement. MBF (a) and MBFratio (b) correlated well with invasive FFR measurement. Abbreviations: FFR, fractional flow reserve; MBF, myocardial blood flow

Diagnostic performance of visual analysis, absolute quantification, and semi-quantification of dynamic CT-MPI for predicting hemodynamically significant stenosis

As for lesion-based evaluation, 51 vessels were diagnosed by FFR as functionally significant lesions. According to ROC analysis, absolute MBF and MBFratio had similarly large AUC on per-vessel level (AUC = 0.942 vs. AUC = 0.956, p = 0.413). In contrast, the visual analysis resulted in smaller AUC compared with quantitative and semi-quantitative assessment (Fig. 5). When using 89.5 mL/min/100 mL and 0.81 as the best cutoffs, the overall diagnostic accuracies of MBF and MBFratio were 90.5% (86/95) and 94.7% (90/95) respectively on a per-vessel level. Visual analysis (78.9%, compared with MBF and MBF ratio, p = 0.007 and p < 0.001 respectively) and CT-quantified DS (72.6%, compared with MBF and MBF ratio, p = 0.005 and p = 0.001 respectively) were shown to have inferior diagnostic accuracy compared with the two aforementioned parameters (Table 3).

Fig. 5
figure 5

ROC curve analysis of dynamic CT-MPI for identifying functionally significant coronary stenosis. Vessel-based (a) and patient-based (b) analysis showing that MBF and MBFratio had significantly larger AUC compared with visual analysis and DS. Abbreviations: AUC, area under the curve; CT, computed tomography; DS, diameter stenosis; FFR, fractional flow reserve; MBF, myocardial blood flow; MPI, myocardial perfusion imaging

Table 3 Diagnostic performance of CT-derived imaging parameters for predicting hemodynamically significant stenosis

As for patient-based analysis, similar results were also observed as absolute MBF and MBFratio had the highest diagnostic accuracy, sensitivity, specificity, PPV, and NPV compared to visual interpretation and CT-quantified DS. The AUCs of MBF and absolute MBF and MBFratio on a per-patient level were 0.977 and 0.972 respectively. Details were given in Table 3. In addition, for male patients, the AUCs of MBF visual, absolute MBF, and MBFratio were 0.833, 0.991, and 0.995 respectively (all p < 0.001), which were similar to those for total population. According to MBFratio analysis, 21 patients in the current cohort had negative perfusion result and would have been deferred from further invasive tests.

Discussion

The major finding of the current study was that the absolute MBF and MBFratio had similarly excellent diagnostic performance with reference to invasive FFR. In addition, quantitative and semi-quantitative evaluation outperformed visual analysis for the detection of myocardial ischemia.

The integrated CT-MPI and CCTA scan allow one-stop-shop imaging for functional and anatomical evaluation of obstructive CAD. In contrast to static perfusion imaging protocol, dynamic CT-MPI enables absolute calculation of MBF for ischemia assessment, which can theoretically enhance the detection of myocardial ischemia. According to the present finding, absolute MBF was able to discriminate flow-limiting from non-flow-limiting coronary stenosis at high sensitivity (84.3%, 43/51) and specificity (97.7%, 43/44). The diagnostic accuracy of MBF in the current study was better than those reported in previous studies [18,19,20], which can be mainly explained by the technical development of CT scanners. The present study employed third-generation dual-source CT, which allowed dynamic CT-MPI acquisition at higher temporal resolution (66 ms) and with less motion artifact compared with other CT scanners. In addition, the use of a dedicated reconstruction kernel (Qr36) could further reduce beam hardening artifact and led to better quantification accuracy. However, it is also notable that the best cutoff of MBF for discriminating ischemic and non-ischemic varied from 75 mL/min/100 mL to 113 mL/min/100 mL according to different previous studies [9, 18,19,20,21]. Various factors may affect the individual stress hyperemic extent and different calculation algorithms also lead to discrepant MBF results [22]. Therefore, it is conceivable that using one single absolute MBF value to diagnose myocardial ischemia in different cohorts is challenging.

In addition to absolute quantification, the current study also found that MBFratio had similarly high diagnostic accuracy compared with MBF. When using 0.81 as the best cutoff value, MBFratio was able to accurately differentiate functionally significant and insignificant stenosis in 94.7% (90/95) of total lesions. According to the definition of MBFratio, 0.81 corresponds to a roughly 20% decrease of myocardial perfusion compared with the reference segments. It is interesting to note that this value is very close to the percentage of pressure drop used by invasive FFR to diagnose hemodynamically significant lesions. In cases without microvascular dysfunction, the extent of reduced myocardial perfusion is theoretically similar to the percentage of pressure drop across coronary stenosis. Moreover, unlike absolute MBF value which can be affected by various factors, MBFratio represents the relative MBF reduction of stenosis-subtended territory with comparison to reference territory. We consequently hypothesized that this ratio will be highly reproducible even in a more generalized population regardless of the MBF calculation algorithm. Thus, MBFratio might be a more robust parameter than absolute MBF for dynamic CT-MPI interpretation in real-world clinical practice.

Moreover, the current study also investigated the diagnostic performance of visual analysis of dynamic CT-MPI. According to the present findings, perfusion defect by visual analysis had high specificity (97.7%, 43/44) but low sensitivity (62.7%, 32/51) and the overall diagnostic accuracy was lower than those of MBF and MBF ratio. The underlying reason for this inferiority can be explained by the insufficient attenuation difference to be detected by visual analysis between ischemic and non-ischemic segments, especially for lesions with mild ischemia and small area of involvement. This finding suggests that visual analysis should not be adopted as the main evaluation approach when quantitative analysis is available. Also, static CT-MPI, which only allows visual analysis for assessment, should be replaced by dynamic CT-MPI if the latter one is technically feasible on the in-use CT scanners.

As for other non-invasive imaging modalities for ischemia evaluation, CT fractional flow reserve (CT-FFR) and magnetic resonance myocardial perfusion imaging (MR-MPI) are two alternatives to dynamic CT-MPI. CT-FFR has the advantage of having no additional radiation exposure and less contrast medium consumption compared with CT-MPI [23]. However, impaired image quality of CCTA and heavy calcification may negatively affect the diagnostic performance of CT-FFR [24, 25]. According to one head-to-head comparison study, the diagnostic accuracy dynamic CT-MPI outperforms machine learning–based CT-FFR technique with reference to invasive FFR [9]. Other than CT-based approaches, MR-MPI is one more widely applied method in terms of ischemia assessment. With the latest technical development of cardiac magnetic resonance imaging, MR-MPI also enables absolute quantification of MBF without radiation burden and can accurately differentiate ischemic from non-ischemic lesions with reference to invasive FFR [26]. However, a direct comparison between CT-MPI and MR-MPI on the latest hardware platform is still absent and future studies are warranted to determine which modality is superior with regard to ischemia imaging.

Despite of the above promising findings, the present study has several limitations. First, the overall pre-test probability of obstructive CAD was high in the current cohort. The best cutoff values of MBF and MBFratio were generated from relatively high-risk patients. Therefore, these criteria still need to be validated in future studies with more low-to-intermediate risk patients. Second, all patients were scanned with third-generation dual-source CT in the current study. Although MBFratio might not be affected, the results of absolute MBF and visual analysis could be altered if different hardware and calculation algorithm are employed. Thus, future investigation is also warranted to confirm those results on different CT scanners. Third, the majority of included patients (87.1%) were males and therefore gender-based sub-analysis was not feasible. Symptomatic female patients are more likely to suffer from microvascular dysfunction, which could be a diagnostic challenge for CT-MPI [27]. So the present results may not be applied to the symptomatic patients with microvascular dysfunction. Finally, the measurement of MBF was performed manually with non-fixed ROIs according to the actual area with decreased MBF. This method is semi-automated rather than fully automated and requires long postprocessing/image analysis time (mean time, 25.8 ± 4.2 min). Future automated methods are needed to be developed to reduce the analyzing time.

In conclusion, the absolute MBF and MBFratio had similarly excellent diagnostic performance with reference to invasive FFR. In addition, quantitative and semi-quantitative evaluation outperformed visual analysis for the detection of myocardial ischemia.