Introduction

Multislice CT (MSCT) is superior to conventional radiography in sensitivity for fractures [1, 2], assessment of intraarticular fractures [3, 4], and in the accuracy of fracture measurements [5, 6]. Zbijewski et al. [7] identified three factors that limit a broader application of MSCT as an alternative to conventional x-ray imaging in musculoskeletal (MSK) imaging: MSCT imaging does not allow for weight-bearing examinations, applies more radiation dose, is more costly, and has larger spatial demands [7]. Recently cone beam computed tomography (CBCT) has been suggested as an alternative to MSCT for orthopaedic imaging of the extremities. Dedicated CBCT scanners have the possibility to (at least partially) address these limitations of MSCT scanners.

CBCT, like MSCT, works with a rotating x-ray source and an opposing detector. The main difference between the two modalities lies in the detector. While an MSCT detector consists of many detector rows, CBCT uses a two-dimensional, flat-panel detector usually of amorphous silicon thin-film transistors. The opposing x-ray source emits a pulsating conical x-ray beam, which allows the scanner to take a series of two-dimensional projections from which software reconstructs images. Due to the differences in image acquisition, CBCT scanners have lesser demand for computational power. This, as well as the smaller set-up of CBCT scanners, makes them more mobile and less costly than full-body MSCT scanners [810].

While the application of dedicated CBCT scanners for MSK diagnostics is fairly new, CBCT imaging has long been used in other fields. Since the late 1990s, compact CBCT scanners have found use in almost every dental field [11, 12]. CBCT has also long been used in C-arm flat-panel computed tomography (FPCT) for intraoperative imaging and in image-guided radiotherapy (IGRT) [1315]. In more recent times, CBCT scanners have found application in ear, nose, and throat (ENT) imaging, especially in the imaging of small, high-contrast structures such as facial bones and the middle ear [16, 17]. Currently C-arm FPCT arthrography is under investigation for detection of cartilage pathologies and has shown, in part, superiority to standard CT arthrography [18, 19]. The 2011 study of the prototype of an MSK-dedicated CBCT scanner showed promising results in terms of resolution and practicability [7]. A phantom study of an MSK-dedicated CBCT scanner showed higher spatial resolution for the CBCT scanner compared to an MSCT scanner [20]. The first clinical case studies of CBCT images of wrist fractures showed similar results for CBCT and MSCT in terms of spatial resolution, allowing for easy fracture detection [21]. CBCT scanners are especially promising for weight-bearing tomography. A comparison of weight-bearing CBCT scans with non-weight-bearing MSCT scans showed significant differences in measurements of the hind foot [22]. Unfortunately, exact dosage comparisons are not very straightforward as the CT dose index (CTDI) used to approximate the effective radiation dose of MSCT scans cannot directly be applied to CBCT scanners due to different beam geometry. To date, there is no widely accepted CTDI-like dose estimation for CBCT scanners [9, 13, 23, 24]. While the radiation doses reported vary, the consensus is that the radiation dose of CBCT scans is lower than that of standard MSCT protocols yet significantly higher than that of plain radiography [2529].

In this study, we investigate the clinical use of an MSK-dedicated extremity CBCT scanner by comparing the depiction of several anatomical structures, the presence of artefacts, and the diagnostic validity of routine CBCT and MSCT scans of distal radius fractures.

Materials and methods

Patient selection

The study was approved by the local ethics committee. Informed consent was waived since the study was performed retrospectively with images from routine diagnostics. All scans were performed at the University Medical Center Freiburg and were independently analyzed by three radiologists of the department (residents with 2, 3, and 3 years of experience).

Eligible for inclusion were scans of acute radius fractures within 7 days of fracture. The CBCT scans included were performed between March and July 2012. The MSCT scans chosen had been acquired between March and July 2011. Scans from the same months of two consecutive years were chosen to obtain more homogenous patient populations since fracture populations vary depending on the season. In the respective time periods, 72 CBCT and 74 MSCT scans of distal radius fractures had been performed with the selected scanners. Excluded were any scans of patients that did not have a post-treatment x-ray exam or patients under the age of 18, and any MSCT scan not performed according to the standard protocol (see “Image Acquisition”). Also excluded were scans of patients that had suffered poly-trauma or that had external fixation at the time of tomographic imaging, as they would have undergone imaging in an MSCT scanner regardless of the availability of a CBCT scanner. This reduced the two groups to 35 CBCT and 33 MSCT scans. The patients of the groups were compared with respect to age, gender, and treatment.

Image acquisition

CBCT images were acquired with the orthopaedic extremity scanner Planmed Verity® (Planmed Oy, Helsinki, Finland). All scans were performed with the standard settings of 90 kV, 6.0 mA, and a slice thickness of 0.4 mm, with the exception of one scan, which was performed at 88 kV. This scan was included, nonetheless, due to the minimal deviation from standard settings. MSCT scans were performed with a Toshiba Aquilion One® scanner (Toshiba Medical Systems Corp., Otawara, Tochigi, Japan). The scans included had been performed with the standard protocol for wrist imaging at 120 kV, 40 mAs, and a slice thickness of 1.0 mm in volume acquisition mode with a 16-cm-wide detector. For image reconstruction, the standard of each scanner was used (iterative reconstruction for the MSCT and 3D-filtered back projection for the CBCT scanner). The mean radiation dose was calculated using the CTDIvol reported by each scanner.

Image processing

For better comparability, the 0.4-mm-thick CBCT scans were interpolated using Aquarius iNtuition® (TeraRecon Inc., Foster City, CA, USA) to obtain slices of the same thickness (1.0 mm) as the MSCT scans. The method was validated using 0.4-mm- and 1.0-mm-thick MSCT images of a hand phantom (Erler-Zimmer GmbH, Germany) acquired with different scanner settings. Image pairs of reconstructed and original 1.0-mm-thick MSCT scans were formed and two observers were asked to decide if 24 image pairs were of the same image quality (i.e. same scanner settings). With a sensitivity of 95.7 % and a specificity of 92.0 %, we assumed that this method of reconstruction did not significantly influence image quality.

Axial MSCT and reconstructed 1.0-mm-thick CBCT scans were anonymized and saved in randomized order as DICOM images with their corresponding post-treatment x-ray exams. Figure 1 shows images of CBCT and MSCT scans as presented to observers.

Fig. 1
figure 1

Images of CBCT (left) and MSCT (right) scans as presented to the observers (L/W 500/2000)

Image evaluation

The image analysis took place under standardized conditions with dimmed lighting on RadiForce GS320® (EIZO NANAO Corp., Hakusan, Ishikawa, Japan) clinical review monitors. Images showed no evidence of the date of examination or device settings. The initial contrast was set to 500/2000 for all scans; however, observers could adjust the contrast to their liking.

Prior to evaluation, observers were presented with sample images of the grading scale. The 3 observers were then asked to rate the 68 scans regarding the assessment of cortical bone, trabecular bone, articular surfaces, and soft tissue using a 5-category visual grading scale (see Table 1a). They also rated the extent and main type of artefact (see Table 1b). The extent of artefacts was determined by their influence on image assessment (i.e. if observers found the diagnosis of the fracture more difficult due to the artefacts). The types of artefacts were categorized by origin as by Barrett and Keat [30]. The observers also determined the American Orthopaedic (AO) classification (see Table 1c) and measured the cortical disruption and the length of the fracture gap. References for the AO classification and the types of artefacts were available. Post-treatment x-ray exams were used to evaluate the fracture reduction as a measure for treatment outcome (see Table 1d). Lastly, the AO classification was determined by an expert (board-certified radiologist with 20 years of experience) in consensus with a radiology resident (3 years of experience, not one of the observers) to be used as a reference standard.

Table 1 a-d: Grading scales for a) cortical bone, trabecular bone, articular surface, and soft tissue; b) extent and cause of artefacts; c) AO classification; and d) integrity of fracture reduction

Statistical analysis

While semi-quantitative, subjective image analysis is well-established as a clinically relevant method, there exists no single, indisputable method for the statistical analysis [3133]. Often, statistical tests that require nominal data are applied, although data is ordinal and grading cannot simply be transformed into numerical values [31, 34, 35]. For the statistical analysis of the five-category visual grading characteristics (VGC) analysis, as previously described by Båth and Månsson [31], was used. As a non-parametric, rank-invariant method, VGC analysis respects these limitations. The method produces a VGC curve, which describes the relationship between two modalities and is quantified by the area under the curve (AUCVGC). A 45° diagonal VGC curve shows equality between two modalities with an AUCVGC of 0.5 [31, 32]. For graphing and curve fitting, we used OriginPro® (OriginLab Corp., Northampton, MA, USA). All other statistics were performed with R [36].

Results

The patients in the two groups were comparable with respect to age, gender, and treatment (see Table 2). The mean radiation dose was 3.81 mGy (σ = 0.19) for CBCT and 5.49 mGy (σ = 1.18) for MSCT scans. A subsequent analysis of the reference standard showed slightly more type C fractures in the CBCT group (74 % of total fractures in the CBCT group vs. 67 % in the MSCT group, see supplementary table).

Table 2 Comparison of patient factors for CBCT and MSCT scans

Table 3 and Fig. 2a–d show the AUCVGC of the anatomical structures investigated. A 95 % confidence interval excluding 0.5 shows a statistically significant difference in performance. Thus, the CBCT performed significantly worse in the assessment of cortical bone, articular surface, and, most notably, soft tissue. Figure 3 shows representative CBCT and MSCT images of scans with the best overall ratings. Figure 4 shows a CBCT scan with particularly poor soft tissue discrimination. There was no significant difference for trabecular bone (see Table 3 and Fig. 2a–d). The inter-rater agreement was substantial (Kendall's coefficient of concordance w = 0.605–0.676) [37].

Table 3 Results of VGC analysis: AUC < 0.5 shows superiority of the MSCT for cortical bone, articular surface, and soft tissue; no significant difference for trabecular bone was found (confidence interval crossing 0.5 threshold). (1area under the curve; 2standard deviation)
Fig. 2
figure 2

a-d Visual grading characteristics (VGC) curve for a) cortical bone, b) trabecular bone, c) articular surface, and d) soft tissue with calculation of the area under the curve (AUC): An AUC less than 0.5 shows superiority of the MSCT for cortical bone, articular surface, and soft tissue

Fig. 3
figure 3

Images of CBCT (top) and MSCT (bottom) scans with the best cumulative ratings (L/W 500/2000)

Fig. 4
figure 4

Images of the CBCT scan with the worst ratings for soft tissue discrimination (ratings 4, 5, and 5; L/W 500/2000)

Table 4 shows, quite apparently, that more CBCT scans were rated as having artefacts, as confirmed by Pearson's chi square test. Figure 5 shows the types of artefacts contributing to the ratings in Table 4 (percent of total ratings for each modality). The vast majority of CBCT scans were rated as having artefacts. Some of these artefacts influenced the image assessment of the CBCT scans, though diagnosis of the fracture was possible in all scans. Beam-hardening artefacts, followed by motion artefacts, were the most common in CBCT scans (see Figs. 6 and 7).

Table 4 Ratings of extent of artefacts: the CBCT images showed significantly more artefacts
Fig. 5
figure 5

Extent and cause of artefacts: More CBCT scans showed artefacts than MSCT scans and artefacts were most often physics-based artefacts in both modalities with motion artefacts also being very common in CBCT scans. (Non-relevant artefacts = artefacts without influence on image assessment; Relevant artefacts = artefacts with influence on image assessment)

Fig. 6
figure 6

Beam-hardening artefacts in a CBCT scan (L/W 500/2000)

Fig. 7
figure 7

Severe motion artefacts in a CBCT scan (L/W 500/2000). These artefacts were rated as influencing image assessment by all three observers. Diagnosis of the fracture was, however, possible (as in all cases).

There was no significant difference in the agreement on AO classification for the two modalities (see Table 5a–b). The chi square test of inter-rater agreement for the measurements of fractures was substantial [37] for both scanners with Kendall’s coefficient of concordance w being 0.767 and 0.653 for the measurements of cortical disruption, and 0.722 and 0.758 for the measurements of the length of the fracture gap for CBCT and MSCT scans, respectively.

Table 5 a–b: Agreement on AO classification a) between observers and b) with reference standard: there was no significant difference in the agreement on AO classification between CBCT and MSCT images (4reference standard = classification of fractures by an expert in consensus with another observer)

There was a statistically significant difference between the CBCT and MSCT groups regarding the treatment outcome. More fractures that had undergone MSCT imaging showed adequate reduction (see Table 6).

Table 6 Ratings of fracture reduction: slightly, yet significantly, more fractures that had undergone MSCT imaging rather than CBCT imaging showed adequate reduction in post-treatment x-rays. (3Adequate reduction defined as < 1-mm articular gap, < 2-mm extra-articular cortical gap, < 10° angulation ad axim)

Discussion

In this clinical study, MSCT was superior to orthopaedic CBCT in the depiction of cortical bone, articular surfaces, and soft tissue. Artefacts were much more frequent among CBCT scans than MSCT scans with beam-hardening and motion artefacts being the most common types of artefacts. There was no significant difference between CBCT and MSCT regarding the agreement on AO classification and the agreement on fracture measurements was similar for both scanners.

In general, our study showed differences in the image quality in favour of the MSCT, most notably regarding the depiction of soft tissue. Due to the lesser importance of soft tissue depiction for fracture diagnosis, we do not see this as problematic for select orthopaedic applications for CBCT such as fracture detection. The difference between the two modalities for the depiction of cortical bone and articular surfaces was not as great as for soft tissue, but the CBCT scanner still performed significantly worse than the MSCT scanner. However, the equivalent agreement of raters on the AO classification and fracture measurements led us to the conclusion that both scanners are of similar diagnostic value for assessment of distal radius fractures. The depiction of trabecular bone showed no significant difference. Physics-based artefacts were much more common among CBCT scans. To minimize these artefacts, better correction algorithms or iterative methods for CBCT scanners would be helpful. As for the motion artefacts in the CBCT scans, we feel that adequate patient selection and an additional stabilization can sufficiently reduce motion artefacts. The evaluation of the post-treatment x-rays showed that more fractures that had undergone MSCT imaging had adequate reduction. The purpose of this evaluation was to uncover grave differences in treatment outcome, which could point to inadequate treatment planning on the basis of CBCT. Although there was a slight difference between the two groups, we do not see this as evidence for subpar treatment planning with CBCT scans. The subsequent analysis of the CBCT and MSCT groups using the reference standard showed slightly more type C fractures in the CBCT group. Due to the complexity and instability of type C fractures, we see this as a more probable explanation for the slight difference in treatment outcome.

As mentioned in the introduction, the use of MSK-dedicated CBCT scanners is fairly new and most experience comes from dedicated CBCT scanners in dental and ENT imaging. Poor depiction of soft tissue has been shown for many different CBCT scanners [8, 12, 38, 39] and is attributed to the lesser contrast resolution of CBCT scanners compared to MSCT scanners [9]. For ENT scanners, the poor soft tissue resolution is not seen as problematic for diagnosis of high-contrast pathologies in the temporal bone [40] and for image-guided surgery of the frontal recess [41]. In a recent study, the diagnostic quality of an MSK-dedicated CBCT scanner for soft tissue was rated as adequate although, as in our study, the CBCT performed significantly worse than the MSCT for soft tissue tasks [42]. The direct depiction of trabecular structure due to the high spatial resolution has been praised for ENT CBCT scanners [40]. Due to the detailed depiction of trabecular bone, CBCT scanners have been used in a method for bone density measurements in studies on anorexia nervosa [43, 44]. The study verifying this method found both the C-arm FPCT and the CBCT scanners investigated to be superior to the MSCT in the qualitative assessment of trabecular bone [45]. However, other results are more divergent: The comparison of five dental CBCT scanners with an MSCT scanner found only one CBCT scanner to be superior and the other four CBCT scanners inferior in the depiction of trabecular bone in the imaging of a dry mandible [45, 46]. As in our study, previous investigations of dental CBCT scanners and FPCT scanners found MSCT superior in depicting cortical bone [47, 48]. The aforementioned study of an MSK-dedicated CBCT scanner showed no significant difference in observer ratings between CBCT and MSCT for bone tasks in the hand, though the CBCT scanner performed significantly better than the MSCT for bone tasks in the knee [42]. As for articular surfaces, CBCT scanners have been found superior for the small articulations of the middle ear [49] and comparable to MSCT scanners in the diagnosis of temporomandibular joint pathologies [50].

The fact that the CBCT scans showed more artefacts was not surprising. The difference in occurrence and magnitude of physics-based artefacts between MSCT and CBCT scanners is attributed to better scatter and beam-hardening corrections of MSCT scanners as well as the iterative reconstruction in MSCT scanners [23, 30, 51]. A study of an MSK-dedicated CBCT prototype in 2011 described such cupping artefacts due to beam-hardening artefacts as possibly problematic [7], while the first clinical case studies of a CBCT scanner for wrist imaging reported only few beam-hardening artefacts [21]. An in-vitro phantom study of the same CBCT scanner as used in our study found cupping artefacts to contribute to the significantly lower homogeneity compared to an MSCT scanner [20]. Previous studies of dental CBCT scanners also found more beam-hardening artefacts in CBCT images than in MSCT images [23, 38]. Better correction algorithms and iterative methods for CBCT are currently being investigated to reduce such beam-hardening artefacts [5254]. In our study, the CBCT scans also showed more motion artefacts. CBCT imaging is vulnerable to motion artefacts due to long scanning times [7, 21, 25] (here, the CBCT took 18 seconds, while the comparative MSCT took less than 1 second). Additionally, CBCT scanners have been reported to be particularly susceptible to motion artefacts due to their high spatial resolution [55, 56]. The differences in scanning times are due to the relatively slow cesium iodide scintillators in flat-panel detectors compared to the faster ceramic detectors in MSCT detectors [9, 40]. However, we do not see motion artefacts as being problematic if patients are carefully selected. For small children and stressed or non-compliant patients, MSCT imaging might be preferable. This was discussed in the aforementioned case studies of CBCT for wrist imaging, where fixation of the wrist was used to reduce motion artefacts [21]. In our study no fixation was used, though the scanner would likely profit from an incorporated fixation belt.

The agreement on AO classification and fracture measurements speak to a similarly reliable diagnosis and pre-operative planning with the CBCT scanner. The impact of the imaging modality on patient management could not be investigated due to differing patient populations in the two groups. In a previous comparison of CBCT and MSCT imaging for interphalangeal fractures, the CBCT scanner was found to have 100 % sensitivity and specificity for the detection of articular involvement and there was no significant difference between modalities in the number of bone fragments detected [57]. Technical studies from various applications have shown CBCT scanners to be comparable to MSCT in geometric accuracy, making them well-suited for pre-operative planning [20, 5860].

Despite the superiority of the MSCT scanner for some anatomical structures and the fewer artefacts, we find CBCT well-suited to orthopaedic imaging when the limitations of soft tissue resolution and the susceptibility to motion artefacts are respected. We feel that MSK-dedicated scanners are a feasible alternative to MSCT imaging for fractures of the extremities in terms of fracture detection and treatment planning.

Limitations

In this study, we compared standard protocols of an orthopaedic CBCT extremity scanner and an MSCT scanner. The results are limited to this specific comparison of scanners and protocols. The influence of different scanner settings was not investigated. According to the CTDIvol calculated by the scanners, the mean radiation dose of the MSCT scans was greater than that of the CBCT scans. This is meant as an approximation of the radiation doses applied. The difficulty of reliable dose measurements for CBCT scans using the CTDIvol was discussed in the introduction. As there is no well-established alternative to the CTDI, more precise comparisons of the radiation dose of CBCT and MSCT protocols would entail dose measurements in phantoms or Monte Carlo simulations, which were not part of our study. Also the influence of the different reconstruction processes (3D filtered back projection in the CBCT and iterative reconstruction in the MSCT) was not investigated. 3D reconstructions are possible with CBCT scans as they are with MSCT scans. The quality of such reconstructions was not investigated in this study. This study was performed retrospectively with different patient populations in the CBCT and MSCT groups. It was not justifiable to examine patients with both scanners for this initial study due to the additional radiation exposure. The purpose of the inclusion and exclusion criteria was to create homogenous patient populations. The two groups proved comparable for several patient factors, so that we assume that any measurable difference in image quality is the result of the imaging modality and not due to confounding factors.

Conclusion

This initial study of an MSK-dedicated CBCT scanner showed that the image quality of an MSCT scanner remains superior for most anatomical structures when using standard protocols. CBCT scans have significantly more artefacts. However, the diagnostic validity of this CBCT scanner seems similar to that of the MSCT scanner for distal radius fractures. CBCT is a viable alternative to MSCT imaging for select orthopaedic imaging. Further studies of other orthopaedic applications and radiation dose comparisons are needed.