Abstract
Objective
To assess the effect of reader experience on variability, evaluation time and accuracy in the detection of coronary artery plaques with computed tomography coronary angiography (CTCA).
Methods
Three independent, blinded readers with three different experience levels twice labelled 50 retrospectively electrocardiography (ECG)-gated contrast-enhanced dual-source CTCA data sets (15 female, age 67.3 ± 10.4 years, range 46–86 years) indicating the presence or absence of coronary plaques. The evaluation times for the readings were recorded. Intra- and interobserver variability expressed as κ statistics and sensitivity, specificity, and negative and positive predictive values were calculated for plaque detection, with a consensus reading of the three readers taken as the standard of reference. A bootstrap method was applied in the statistical analysis to account for clustering.
Results
Significant correlations were found between reader experience and, respectively, evaluation times (r = −0.59, p < 0.05) and intraobserver variability (r = 0.73, p < 0.05). The evaluation time significantly differed among the readers (p < 0.05). The observer variability for plaque detection, compared with the consensus, varied between κ = 0.582 and κ = 0.802. Variability of plaque detection was significantly smaller (p < 0.05) and more accurate (p < 0.05) for the most experienced reader.
Conclusion
Reader experience significantly correlated with observer variability, evaluation time and accuracy of coronary plaque detection at CTCA.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
In developed countries, atherosclerotic cardiovascular disease represents one of the leading causes of morbidity and mortality. Coronary artery disease (CAD) is characterised by the development of plaques through the accumulation of calcified or lipid deposits in the coronary vessel walls [1, 2]. Several studies have shown a correlation between the risk of developing the various symptoms associated with CAD and plaque characteristics such as obstruction [3, 4], composition [5–7] and localisation [8–11].
Computed tomography coronary angiography (CTCA) is a robust and accurate imaging technique for the non-invasive assessment of coronary arteries with respect to the diagnosis or exclusion of significant coronary stenoses [12] as well as for the detection and semi-qualitative characterisation of coronary artery plaques [13–16]. A recent study demonstrated the composition of coronary artery plaques, as determined by CTCA, to be an independent risk factor for developing cardiac events, beyond the degree of luminal narrowing alone [17]. In addition, plaque identification with CTCA has been shown to be important for stratifying the risk of patients with CAD [18].
Until now, no objective criteria based on Hounsfield units (HU) at CTCA for plaque detection and differentiation could be defined [19–23]. Hence, a considerable intra- and interobserver variability has been reported both for the detection [24, 25] and for the volumetric assessment [26, 27] of coronary plaques. Another factor potentially affecting the reliability and accuracy of coronary artery plaque detection with CTCA might be the impact of reader experience, as recently demonstrated for the analysis of CTCA in regard to the diagnosis of coronary artery stenoses [28]. The influence of reader experience on intra- and interobserver variability as well as on evaluation time for plaque detection has not been reported so far.
The purpose of our study was to assess the effect of reader experience on variability, evaluation time and accuracy for the detection of coronary artery plaques with CTCA.
Materials and methods
Patients
Between August 2007 and September 2007, 50 consecutive patients (35 male, 15 female, aged 67.3 ± 10.4 years, range 46–86 years) undergoing CTCA for clinical reasons were enrolled in this study. The indications for CTCA were in accordance with current guidelines and recommendations [12] and ruled out significant coronary stenoses in all 50 patients. All patients suffered from atypical chest pain and had a low to intermediate risk of having CAD, as determined by Diamond and Forrester [29]. Patients with nephropathy, known hypersensitivity to iodine-containing contrast media, previous myocardial infarction (clinical and ECG), known CAD, or with aorto-coronary bypass grafts or previous coronary interventions were excluded from study enrolment. Eight per cent of the patients were in chronic beta-blocker therapy. Clinical characteristics and demographic data of the patients are summarised in Table 1.
This retrospective study was approved by the local ethics committee who waived the written informed consent requirement.
CTCA protocol
All patients underwent dual-source computed tomography (CT) (Somatom Definition, Siemens Healthcare, Forchheim, Germany) following a standard retrospectively electrocardiography (ECG)-gated CTCA protocol. All patients received a single dose of 2.5 mg isosorbide dinitrate s. l. (Isoket, Schwarz Pharma, Monheim, Germany) before CT. No beta-receptor antagonists were given. Eighty millilitres of a non-ionic, iodinated contrast agent (iopromide, Ultravist 370, 370 mg/ml, Bayer Schering Pharma, Berlin, Germany) was injected at a flow rate of 5 ml/s followed by 30 ml saline solution through an antecubital vein. Contrast agent application was controlled by bolus tracking in the ascending aorta (signal attenuation threshold 140 HU). CT parameters were: detector collimation 2 × 32 × 0.6 mm, slice acquisition 2 × 64 × 0.6 mm by means of a z-flying focal spot, gantry rotation time 330 ms, tube potential 120 kV, tube current time product 330 mAs per rotation, and pitch of 0.2–0.5 depending on the heart rate. ECG-gated tube current modulation for radiation dose reduction was used in all patients as previously recommended [30]. CT images were acquired in a cranio-caudal direction from the level of the tracheal bifurcation to the diaphragm. CTCA data were reconstructed using a mono-segment algorithm with a slice thickness of 0.75 mm, a reconstruction increment of 0.4 mm and using a soft-tissue convolution kernel (B26f) during mid-diastole at 70% of the R–R interval. When motion artefacts were present in the data set, additional reconstructions were performed in 5% steps within the window of full tube current. The reconstruction phase with least motion artefacts as determined by the attending radiologist during acquisition was used for further analysis.
Data analysis
Three observers with different levels of experience in cardiac CT imaging according to the statement of the Society of Cardiovascular Computed Tomography, the Society of Atherosclerosis Imaging and Prevention, the Society for Cardiovascular Angiography and Interventions, and the American Society of Nuclear Cardiology [31] were involved.
Reader 1 (R1) was a first-year resident of our radiology department with less than 1 year of experience in cardiac CT (level 1 experience, i.e. 0 or more mentored examinations while being present during the performance and more than 50 interpreted mentored examinations).
Reader 2 (R2) was a third-year resident of our radiology department with 3 years of experience in cardiac CT (level 2 experience, i.e. more than 35 mentored examinations while being present during the performance and more than 150 interpreted mentored examinations).
Reader 3 (R3) was a sixth-year resident of our radiology department with 5 years of experience in cardiac CT (level 3 experience, i.e. more than 100 mentored examinations while being present during the performance and more than 300 interpreted mentored examinations).
All three readers, blinded to the clinical presentation and history of the patient, independently evaluated the 50 CTCA data sets for the presence or absence of coronary artery plaques. All data sets were anonymised and were presented to the readers in random order. The randomization was performed with a random generator having equal weights. For each individual reading, the random generator created for each of the 50 data sets a number between 1 and 50 representing the order number the data set should be displayed during the reading. In case the order number was already assigned to another data set, a new order number was created. The reading of the 50 data sets was repeated 4 weeks after the first reading.
Interface
A graphical user interface offering the standard functionality of a commercial workstation was developed with the MeVisLab software (Version 1.5 for Windows, MeVis Medical Solutions AG, Bremen, Germany). The user interface allowed automated measurement of the evaluation time in seconds per patient. The reader was instructed to start, pause/resume and finish the reading of each patient by using the corresponding buttons. The evaluation time was defined as the elapsed time between pressing the start and end buttons, which included the manual reporting of the findings on prepared sheets. When the reading was paused, the data set was hidden and the time measurement was held. The readers were aware of the time recording but the evaluation time was not displayed to the reader during reading. Evaluation and reporting included the following:
Segments
Coronary segments were defined and numbered according to the 16-segment scheme proposed by the American Heart Association (AHA) [32]. First, in each reading, the segments were classified by the readers as being of diagnostic image quality, non-diagnostic image quality because of major artefacts, or as anatomically not present. Only segments with diagnostic image quality were evaluated for the presence or absence of plaques.
Plaques
Three different types of plaque were visually differentiated: purely calcified plaques, purely non-calcified plaques and mixed plaques, the last of these indicating a mixture of calcified and non-calcified components. Plaques extending over more than one segment were labelled according to their most proximal segment.
Consensus
A consensus reading was performed 4 weeks after the last individual reading in which all three readers jointly determined the classification of the segments as well as the presence and type of plaques within the segments. The readers were unaware of their individual performance for the consensus reading which was then defined as the reference standard of the study. Biases such as differing segment numbering among the readers or assignment of plaques extending over more than one segment were resolved during consensus reading.
Statistical analysis
All statistical analyses were performed by using the statistical software package R (release 2.8.1 for Windows, www.r-project.org). Categorical variables were expressed as frequencies or percentages. Quantitative variables were expressed as means ± standard deviations as well as medians. The non-Gaussian distributed evaluation times were compared with a Wilcoxon signed rank test. The relationship between evaluation time and experience level was analysed with Spearman’s rank-order correlation coefficient.
To account for a potential correlation between the 16 segments analysed for plaque detection per patient, the data were clustered [28]. Therefore, the bootstrap method [33] was applied with 1,000 resamples created by randomly sampling the 50 patients with replacement. If a given patient was included in the resample, all associated observations from the 16 segments of this patient were included. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and κ values were estimated for each bootstrap resample. Intraobserver variability and interobserver variability between two readings for plaque detection on a segment level was assessed using Cohen’s κ, whereas observer variability among multiple readings was assessed by Fleiss’ κ. Bias corrected 95% confidence intervals (CI) were calculated by using the 1,000 estimates of each quantity. One thousand estimates of two quantity measures were compared using Friedman’s rank sum test [34, 35]. The relationship between intraobserver variability and experience level was assessed using Spearman’s rank-order correlation coefficient.
Results
Consensus reading
The consensus reading revealed 663 (82.9%) segments with diagnostic image quality, 31 (3.9%) segments with non-diagnostic image quality and 106 (13.2%) anatomically non-present segments. A total of 377 (47.1%) segments were identified to be harbouring plaques. The consensus reading resulted in 125 (27.9%) calcified, 217 (48.4%) mixed and 106 (23.7%) non-calcified plaques.
Evaluation time
The average (median) evaluation time per patient in seconds for the first and second readings, respectively, was 328.3 s (307.5 s) and 321.8 s (326.7 s) for R1, 266.2 s (247.0 s) and 242.9 s (234.0 s) for R2, and 172.9 s (163.6 s) and 177.8 s (151.3 s) for R3. No significant differences (R1: p = 0.79, R2: p = 0.07, R3: p = 0.95) were found between the evaluation times of the first and second readings for all readers (Fig. 1). Significant differences were present when the R1 and R2 (p < 0.05), R1 and R3 (p < 0.05), and R2 and R3 (p < 0.05) evaluation times were compared. The evaluation time per patient showed a significant negative correlation with the experience level (r = −0.59, p < 0.05).
Observer variability
Reader R1 labelled 233/234 segments, reader R2 marked 253/269 segments and reader R3 indicated 321/327 segments as having plaques in the first/second reading, respectively (Table 2). Compared with the consensus, R1 missed 151/153, R2 missed 141/132 and R3 missed 71/64 segments with plaques in the first/second reading, respectively (Fig. 2). The sensitivity, specificity, negative predictive value (NPV) and positive predictive value (PPV) for all readers and readings are listed in Table 3.
Variability as compared with consensus
The observer variability for plaque detection, compared with the consensus, varied between κ = 0.582 and κ = 0.802 (Table 3). For both readings, R3 was significantly better than R1 (first p < 0.05/second p < 0.05) and R2 (p < 0.05/p < 0.05) (Fig. 3). There was no significant difference when comparing the first reading of R1 with the first reading of R2 (p = 0.31). A significant difference existed between the first reading of R1 and the second reading of R2 (p < 0.05) as well as between the second reading of R1 and the two readings of R2 (p < 0.05/p < 0.05).
Intraobserver variability
The κ values for the intraobserver variability were R1: κ = 0.761 (95% CI [0.693, 0.830]), R2: κ = 0.779 (95% CI [0.715, 0.835]) and R3: κ = 0.847 (95% CI 0.787, 0.902]) with significant differences between R1 and R2 (p < 0.05), R1 and R3 (p < 0.05), and between R2 and R3 (p < 0.05). A significant correlation between the experience level and the κ values for the intraobserver variability has been revealed (r = 0.73, p < 0.05), i.e. a reader with a higher experience level performed more consistent labelling (Fig. 4).
Interobserver variability
The interobserver variability among all readings was κ = 0.662 (CI [0.622, 0.704]). The κ value for the interobserver variability between two readers varied between 0.582 and 0.715.
Discussion
This study is one of the first to demonstrate the effect of reader experience on the variability, time effectiveness and accuracy of coronary artery plaque detection with CTCA. With an increasing level of experience, intraobserver variability and evaluation time for coronary plaque detection decreased, while the accuracy improved.
Pugliese et al. [28] recently reported on the effect of reader experience on the time effectiveness for reading CTCA data sets with regard to the presence or absence of coronary stenoses. Although the evaluation time is not of primary interest for making the diagnosis, the parameter is of clinical importance in terms of economic factors like reimbursement. Therefore, there is a demand for keeping the evaluation time for reading radiological studies as low as possible while maintaining the accuracy of the method. Our study demonstrates a significantly decreased evaluation time for plaque detection with increasing reader experience, comparable to the previous study on reading coronary stenoses with CTCA [28].
The interobserver agreement for the detection of coronary plaques in our study (κ = 0.66) was lower than that reported by Hoffmann et al. [25] (κ = 0.89) and Ferencik et al. [24] (κ = 0.85). This may be explained by the selection of participating readers in our study, covering three different experience levels [31]. The intraobserver variability and accuracy of the reader with most experience in our study was similar to those reported in the literature [24, 25]. Our study shows that differences in variability are correlated with the experience level. As the experience level increases, the detection of coronary plaques with CTCA becomes more consistent and more accurate with lower intraobserver variability and lower variability as compared with the consensus.
Specificity and positive predictive values were not different between the three readers, but sensitivity and negative predictive values were lower for the less experienced ones. This result could reflect the tendency of less trained readers to attribute a pathological result in case of doubt and thus to increase the number of false positives. However, it is more likely that an inexperienced reader more often misses a plaque and thus increase the number of false positive ratings. Certainly, further targeted studies are needed to investigate this issue in more detail.
During education, a reader is normally mentored by an experienced senior reader who provides her own experience as feedback and thus helps to constantly improve the reader’s performance in plaque detection. In addition to this, it might be conceivable to incorporate software-based tools to further support this decision-making and learning process [40]. Although automatic algorithms for plaque detection have already been proposed [36, 37], their performance is still beyond the needs of clinical application as they all focus on specific plaque types. None of them covered all visible plaque types in CTCA as described by Becker et al. [38].
Limitations
First, our consensus was based on CTCA images, not on intravascular ultrasound (IVUS) which is the current reference imaging technique for detecting and characterising coronary plaques. However, we only evaluated observer variability for the detection of visible plaques in CTCA and not the diagnostic accuracy of CTCA itself. Moreover, our study aimed to analyse plaques in the entire coronary artery tree, which prevents the use of IVUS as reference standard considering its applicability only in larger, proximal coronary segments. Second, the consensus was performed with the participating readers and not with an outside panel of experienced observers which might induce a bias towards the opinion of the most experienced reader. To limit this, the readers were blinded to their individual performance during consensus reading. Third, the plaques were classified according to their CTCA attenuation behaviour into calcified, non-calcified and mixed, but no sub-analyses for the different plaque types were performed. This was due to the limited number of plaques in our study population preventing a meaningful statistical analysis. Fourth, we did not use the most recent CT scanner technology for cardiac imaging [39]. Finally, each experience level was represented by one single reader; thus, no intra-experience level statistics could be performed.
Conclusions
Our study demonstrates that with increasing experience, the intraobserver variability and evaluation time of coronary artery plaque detection with CTCA decreases, while the accuracy increases.
References
Olgac U, Poulikakos D, Saur SC et al (2009) Patient-specific three-dimensional simulation of LDL accumulation in a human left coronary artery in its healthy and atherosclerotic states. Am J Physiol Heart Circ Physiol 296:H1969–H1982
Enrico B, Suranyi P, Thilo C et al (2009) Coronary artery plaque formation at coronary CT angiography: morphological analysis and relationship to hemodynamics. Eur Radiol 19:837–844
Leber AW, Knez A, von Ziegler F et al (2005) Quantification of obstructive and nonobstructive coronary lesions by 64-slice computed tomography: a comparative study with quantitative coronary angiography and intravascular ultrasound. J Am Coll Cardiol 46:147–154
Otsuka M, Bruining N, Van Pelt NC et al (2008) Quantification of coronary plaque by 64-slice computed tomography: a comparison with quantitative intracoronary ultrasound. Invest Radiol 43:314–321
Beckman JA, Ganz J, Creager MA et al (2001) Relationship of clinical presentation and calcification of culprit coronary artery stenoses. Arterioscler Thromb Vasc Biol 21:1618–1622
Ehara S, Kobayashi Y, Yoshiyama M et al (2004) Spotty calcification typifies the culprit plaque in patients with acute myocardial infarction: an intravascular ultrasound study. Circulation 110:3424–3429
Fujii K, Carlier SG, Mintz GS et al (2005) Intravascular ultrasound study of patterns of calcium in ruptured coronary plaques. Am J Cardiol 96:352–357
Hong M-K, Mintz GS, Lee CW et al (2007) Plaque ruptures in stable angina pectoris compared with acute coronary syndrome. Int J Cardiol 114:78–82
Pregowski J, Tyczynski P, Mintz GS et al (2006) Intravascular ultrasound assessment of the spatial distribution of ruptured coronary plaques in the left anterior descending coronary artery. Am Heart J 151:898–901
Shimada Y, Courtney BK, Nakamura M et al (2006) Intravascular ultrasonic analysis of atherosclerotic vessel remodeling and plaque distribution of stenotic left anterior descending coronary arterial bifurcation lesions upstream and downstream of the side branch. Am J Cardiol 98:193–196
Wang JC, Normand S-LT, Mauri L et al (2004) Coronary artery spatial distribution of acute myocardial infarction occlusions. Circulation 110:278–284
Hendel RC, Patel MR, Kramer CM et al (2006) ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 appropriateness criteria for cardiac computed tomography and cardiac magnetic resonance imaging: a report of the American College of Cardiology Foundation Quality Strategic Directions Committee Appropriateness Criteria Working Group, American College of Radiology, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance, American Society of Nuclear Cardiology, North American Society for Cardiac Imaging, Society for Cardiovascular Angiography and Interventions, and Society of Interventional Radiology. J Am Coll Cardiol 48:1475–1497
Hoffmann U, Moselewski F, Nieman K et al (2006) Noninvasive assessment of plaque morphology and composition in culprit and stable lesions in acute coronary syndrome and stable lesions in stable angina by multidetector computed tomography. J Am Coll Cardiol 47:1655–1662
Achenbach S, Moselewski F, Ropers D et al (2004) Detection of calcified and noncalcified coronary atherosclerotic plaque by contrast-enhanced, submillimeter multidetector spiral computed tomography: a segment-based comparison with intravascular ultrasound. Circulation 109:14–17
Hausleiter J, Meyer T, Hadamitzky M et al (2006) Prevalence of noncalcified coronary plaques by 64-slice computed tomography in patients with an intermediate risk for significant coronary artery disease. J Am Coll Cardiol 48:312–318
Iriart X, Brunot S, Coste P et al (2007) Early characterization of atherosclerotic coronary plaques with multidetector computed tomography in patients with acute coronary syndrome. Eur Radiol 17:2581–2588
van Werkhoven JM, Schuijf JD, Gaemperli O et al (2009) Prognostic value of multislice computed tomography and gated single-photon emission computed tomography in patients with suspected coronary artery disease. J Am Coll Cardiol 53:623–632
Leber AW, Becker A, Knez A et al (2006) Accuracy of 64-Slice computed tomography to classify and quantify plaque volumes in the proximal coronary system: a comparative study using intravascular ultrasound. J Am Coll Cardiol 47:672–677
Motoyama S, Kondo T, Sarai M et al (2007) Multislice computed tomographic characteristics of coronary lesions in acute coronary syndromes. J Am Coll Cardiol 50:319–326
Brodoefel H, Reimann A, Heuschmid M et al (2008) Characterization of coronary atherosclerosis by dual-source computed tomography and HU-based color mapping: a pilot study. Eur Radiol 18:2466–2474
Pohle K, Achenbach S, MacNeill B et al (2007) Characterization of non-calcified coronary atherosclerotic plaque by multi-detector row CT: comparison to IVUS. Atherosclerosis 190:174–180
Schroeder S, Kopp AF, Baumbach A et al (2001) Noninvasive detection and evaluation of atherosclerotic coronary plaques with multislice computed tomography. J Am Coll Cardiol 37:1430–1435
Leber AW, Knez A, Becker A et al (2004) Accuracy of multidetector spiral computed tomography in identifying and differentiating the composition of coronary atherosclerotic plaques: a comparative study with intracoronary ultrasound. J Am Coll Cardiol 43:1241–1247
Ferencik M, Nieman K, Achenbach S (2006) Noncalcified and calcified coronary plaque detection by contrast-enhanced multi-detector computed tomography: a study of interobserver agreement. J Am Coll Cardiol 47:207
Hoffmann H, Frieler K, Hamm B et al (2008) Intra- and interobserver variability in detection and assessment of calcified and noncalcified coronary artery plaques using 64-slice computed tomography. Int J Card Imaging 24:735
Pflederer T, Schmid M, Ropers D et al (2007) Interobserver variability of 64-slice computed tomography for the quantification of non-calcified coronary atherosclerotic plaque. Rofo 179:953–957
Bruining N, Roelandt JRTC, Palumbo A et al (2007) Reproducible coronary plaque quantification by multislice computed tomography. Catheter Cardiovasc Interv 69:857–865
Pugliese F, Hunink MGM, Gruszczynska K et al (2009) Learning curve for coronary CT angiography: what constitutes sufficient training? Radiology 251:359–368
Diamond G, Forrester J (1979) Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med 300:1350–1358
Leschka S, Scheffel H, Desbiolles L et al (2007) Image quality and reconstruction intervals of dual-source CT coronary angiography: recommendations for ECG-pulsing windowing. Invest Radiol 42:543–549
Budoff MJ, Achenbach S, Berman DS et al (2008) Task force 13: training in advanced cardiovascular imaging (computed tomography): endorsed by the American Society of Nuclear Cardiology, Society of Atherosclerosis Imaging and Prevention, Society for Cardiovascular Angiography and Interventions, and Society of Cardiovascular Computed Tomography. J Am Coll Cardiol 51:409
Austen WG, Edwards JE, Frye RL (1975) A reporting system on patients evaluated for coronary artery disease. Report of the Ad Hoc Committee for Grading of Coronary Artery Disease, Council on Cardiovascular Surgery, American Heart Association. Circulation 5–40
Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman & Hall, New York
Hothorn T, Buhlmann P, Dudoit S et al (2006) Survival ensembles. Biostat 7:355–373
Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701
Tessmann M, Vega-Higuera F, Fritz D et al (2009) Multi-scale feature extraction for learning-based classification of coronary artery stenosis. In: Nico K, Maryellen LG (eds) SPIE 726002
Renard F, Yongyi Y (2008) Image analysis for detection of coronary artery soft plaques in MDCT images. In: Proceedings of the 5th IEEE international symposium on biomedical imaging: from nano to macro, ISBI, Paris, France, 14–17 May 2008, pp 25–28
Becker C, Nikolaou K, Muders M et al (2003) Ex vivo coronary atherosclerotic plaque characterization with multi-detector-row CT. Eur Radiol 13:2094–2098
Leschka S, Stolzmann P, Desbiolles L et al (2009) Diagnostic accuracy of high-pitch dual-source CT for the assessment of coronary stenoses: first experience. Eur Radiol 19:2896–2903. doi:10.1007/s00330–009–1618–9
Saur S, Cattin P, Desbiolles L et al (2009) Prediction rules for the detection of coronary artery plaques: evidence from cardiac CT. Invest Radiol 44:483–490
Acknowledgement
This research has been supported by the National Center of Competence in Research, Computer Aided and Image Guided Medical Interventions of the Swiss National Science Foundation (http://co-me.ch).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Saur, S.C., Alkadhi, H., Stolzmann, P. et al. Effect of reader experience on variability, evaluation time and accuracy of coronary plaque detection with computed tomography coronary angiography. Eur Radiol 20, 1599–1606 (2010). https://doi.org/10.1007/s00330-009-1709-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00330-009-1709-7