Abstract
Purpose
Ischemic lesion volume (ILV) is an important radiological predictor of functional outcome in patients with anterior circulation stroke. Our aim was to assess the agreement between automated ILV measurements on NCCT using the Brainomix software and manual ILV measurements on diffusion-weighted imaging (DWI).
Methods
This was a prospective single-center observational study of patients with CT angiography (CTA) proven anterior circulation occlusion treated with endovascular thrombectomy (May 2018 to May 2019). NCCT ILV was measured automatically by the Brainomix software. DWI ILV was measured manually. The McNemar’s test was used to test sensitivity and specificity. The Somer’s delta was used to test the differences between concordant and discordant ASPECTS regions. The Bland-Altman plot was calculated to compare the differences between Brainomix and DWI ILVs.
Results
Forty-five patients were included. Median Brainomix ILV was 23 ml (interquartile range [IQR], 15–39 ml), and median DWI ILV was 11.5 ml (IQR, 7–32 ml) in the TICI 2b-3 group. In the TICI 0-2a, the NCCT ILV was 39 ml (IQR, 18–62 ml) and DWI ILV was 30 (IQR, 11–105 ml). The DWI ILVs in patients with good clinical outcome (mRS 0–2) was significantly lower compared with patients with mRS ≥ 3 (10 mL vs 59 mL, p = 0.002). Similar trend was observed for Brainomix ILV measurements (21 mL vs 39 mL, p = 0.012). There was a high correlation and accuracy in the detection of follow-up ischemic changes in particular ASPECTS regions.
Conclusion
NCCT ILV measured automatically by the Brainomix software might be considered a valuable radiological outcome measure.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Baseline and follow-up diagnostic neuroimaging represent an inevitable part of stroke diagnosis, management, and outcome prediction. Follow-up non-contrast-computed tomography (NCCT) or magnetic resonance imaging (MRI) > 24 h post-recanalization treatment is clinically used for exclusion of hemorrhagic complications and visual estimation of the extent and location of acute ischemia [1,2,3,4,5].
Both the hypodensity (hypoattenuation) on follow NCCT and hyperintensity on diffusion-weighted imaging (DWI) MRI depict the same pathology, i.e., cellular swelling and increased water content. The DWI per se represents highly sensitive diagnostic modality in detecting acute ischemic lesions in stroke patients [6].
Previous studies showed that the ischemic lesion volume (ILV, i.e., volume of brain infarction/acute ischemia) measured on follow-up scans (> 24 h post-treatment) correlated with the 3-month functional outcome defined as modified Rankin scale (mRS) [1, 3, 5]. Even though the early prediction of short-term or long-term clinical outcome based on ILV is considered valuable, the ILV is not measured routinely in the everyday clinical practice due to time demands of manual volumetric measurements and limited personnel resources. These limitations might be overcome by a reliable automatic software.
Our primary goal was to evaluate the level of agreement between the ILVs measured by an available automatic software (for NCCT) and manual outlining (for DWI-MRI) on follow-up stroke neuroimaging in patients who underwent mechanical thrombectomy for a large vessel occlusion (LVO) in the anterior cerebral circulation.
Methods
This was a prospective single-center observational study of patients with CT angiography (CTA) proven proximal occlusion in the anterior cerebral circulation (terminal internal carotid artery [ICA] and/or M1 segment of middle cerebral artery [MCA]) and premorbid modified Rankin stroke scale < 2, who were treated with endovascular thrombectomy (EVT) between May 2018 and May 2019 in the Comprehensive Stroke Center of Faculty Hospital Ostrava (Czech Republic). Ethical approval was obtained from the local Institutional Review Boards.
All patients with symptoms of acute ischemic stroke and no history of contrast allergy routinely undergo baseline NCCT and single-phase CTA from the aortic arch to the vertex at our center (CT perfusion was not performed during the study period). Follow-up neuroimaging included NCCT (a standard of care at our institution), and MRI performed 24 to 48 h after the EVT procedure (not a standard of care at our institution). Both follow-up neuroimaging methods were performed 30 min apart. This time period was selected in order to compare the reliability of ILV measurement on NCCT (automated analysis by the Brainomix software) and DWI-MRI manual outlining. The timing of follow-up imaging > 24 h was chosen since it represents the earliest time point for accurate delineation of acute ischemia volume [7].
Imaging protocol
NCCT was performed on a multi-detector spiral 64 series CT machine (Siemens Medical Systems, Erlangen, Germany). The NCCT examination was followed by CTA using 50–100 ml of iodine conjugate (Visipaque, GE Healthcare, Piscataway, NJ, USA), which was applied at a rate of 4 ml/s. The range of CTA was from the aortic arch to the distal intracranial artery. The width of the basic CT sections for further reconstruction was 0.75 mm.
MRI was performed on the 1.5 T Siemens Avanto (Siemens, Erlangen, Germany). Imaging protocol included the following: localizer; diffusion-weighted imaging (DWI) in 3 planes with b-factor values of 0 and 1000 s/mm2; reconstructed maps of the apparent diffusion coefficient (ADC) maps (ST 5 mm, gap 0.5 mm, duration: 20 s each + SHIM time); and fluid attenuated inverse recovery (FLAIR) sequences in axial and sagittal plane (ST 3 mm, gap 0 mm, TR 8000 ms, TE 105 ms, TI 2371 ms).
Imaging analysis
ILVs on follow-up DWI-MRI were manually outlined by consensus of 2 experienced neuroradiologists (> 10 years of experience) who were blinded to all clinical information apart from the affected hemisphere (2 volumetric measurements were done 2 weeks apart). The DWI scans with the b factor of 1000 s/mm2 were used for the volumetric measurements of the cytotoxic ILV. The DWI hyperintense area was manually contoured in each slice. The total ILV was calculated as a sum of DWI areas in each slice multiplied by the effective slice thickness. The median of all four measurements was used for the statistical analyses.
ILVs on follow-up NCCT were measured automatically by the Brainomix software (Oxford, UK version 7.1; Fig. 1), a tool based on a combination of advanced image-processing and machine-learning algorithms. The image processing algorithm follows an AI approach, with a combination of traditional 3D graphics and statistical methods, and machine learning classification techniques. The input DICOM data is first resampled to correct any gantry tilt and to standardize the input resolution. Then, a fast proprietary registration approach is applied to re-align the data, removing any tilt and rotation. This ensures that the image is presented in a standard reference frame, which simplifies human interpretation of the scan. A scoring module uses a machine learning classifier to identify both early and non-acute signs of ischemia in order to derive a voxel-wise probability map. This classifier has been trained on a large dataset (> 10,000 images) containing a wide range of real-world CT scans from stroke patients and negative controls, with ground-truth data from additional imaging data such as MRI acquired within 1–2 h of the CT scan. This dataset contains examples of CT scans captured with scanners from all major manufacturers and from a wide range of countries worldwide. A patient-specific segmentation of the ASPECTS regions and ILV is computed, and finally, the output score or ILV is generated.
Statistical analysis
Standard descriptive statistics were used to measure the central tendency and variability of baseline characteristics. Ordinal/continuous variables were compared by the Mann-Whitney U test or the t test based on their distribution. All tests were two-sided and the significance level was considered as 0.05. Categorical variables were compared using the Fisher exact test. The Somer delta was used to test the differences between concordant and discordant ASPECTS regions, and McNemar’s test was used to test the sensitivity and specificity. The Bland-Altman plot was calculated to compare the differences between Brainomix and DWI ILVs. Statistical analyses were performed using STATA version 14.2 (College Station, TX).
Results
Fifty patients were treated with EVT during the 12-month study period; five patients were excluded due to hemorrhagic transformation (HT) or parenchymal hematoma (PH) on follow-up imaging. Table 1 demonstrates the clinical, radiological, and outcome (short-term and long-term) characteristics based on the recanalization status. Table 2 demonstrates selected characteristics of patients with independent outcome versus dependent outcome. Baseline CT “early ischemic changes” volumes were similar between the groups with and without successful reperfusion, 18 mL (interquartile range [IQR], 12–23) and 15 mL (IQR, 10–21), respectively. Successful recanalization (TICI2b-3) was achieved in 32 (71%) patients. Median follow-up NCCT ILV was 23 ml (IQR, 15–39 ml), and median follow-up DWI ILV was 11.5 ml (IQR, 7–32 ml) in the TICI2b-3 group. In the TICI 0-2a, the median NCCT ILV was 39 ml (IQR, 18–62 mL) and the median DWI ILV was 30 (IQR, 11–105 mL). The DWI ILVs in patients with good clinical outcome (mRS 0–2) were significantly lower compared with the patients with mRS ≥ 3 (10 mL vs 59 mL, p = 0.002). The similar trend was observed for the Brainomix ILV measurements (21 mL vs 39 mL, p = 0.012). There was a high correlation and accuracy in detection of follow-up ischemic changes in particular ASPECTS regions and cortical versus subcortical ASPECTS regions (Table 3). Bland-Altman plot comparing the differences between the Brainomix software and DWI ILV measurements is demonstrated in Fig. 2. Dot plot for particular Brainomix and DWI ILV measurements is presented in Fig. 3.
Discussion
Our single-center observational study demonstrated a good correlation between the expert manual DWI ILV outlining and fully automated NCCT ILV (Brainomix) measurement in patients who underwent the EVT for anterior circulation stroke.
ILV on follow-up neuroimaging represents a biomarker of stroke treatment efficacy, and follow-up NCCT still represents the imaging modality of choice in most of the countries worldwide. Automated (software-based) measurement of ILV by a reliable software has a potential to overcome the shortcomings and time demands associated with manual infarct delineation. It was demonstrated previously that the Brainomix software was non-inferior compared with expert radiologists for baseline ASPECTS reading [7,8,9]. Its newer versions enable to measure the volume (extent) of early ischemic changes on baseline NCCT (in addition to the ASPECT score) and ILVs on follow NCCT in short processing time, which might be considered helpful and beneficial in everyday practice. We demonstrated that the Brainomix software and radiology experts detected the concurrent ischemic changes in particular ASPECTS regions on follow-up neuroimaging (NCCT vs DWI-MRI) with similar accuracy.
The relationship between ILV outlined manually on NCCT, DWI, or FLAIR at the median time of 42 h and favorable clinical outcome in patients receiving EVT was studied before and found no differences in outcome prediction regardless the used imaging modality—implying that providing a follow-up NCCT might be sufficient for ILV measurements [10]. Manual ILV delineation on 27-h NCCT or FLAIR was used in a study by Albers et al. [3]. Software-assisted manual outlining of 24 h-NCCT ILV by using the ITK-Snap software was used in a study by Bucker et al. [1]. In comparison to the studies mentioned above, our study was one of the first testing the clinical utility of fully-automated software in ILV measurement in a prospective EVT cohort. Since our study was limited by the number of enrolled patients, we did not test the association between ILVs and 3-month clinical outcome.
Our study has several limitations including small sample size and single-center experience. The ILVs were measured by using two different imaging techniques (NCCT vs DWI-MRI) and expert reading versus automated software, which have different infarct conspicuity. Additionally, the Brainomix software is not able to measure ILV in the presence of hemorrhagic transformation or parenchymal hemorrhage, which limits its generalizability and should be overcome in future versions of the Brainomix software.
In conclusion, NCCT ILV measured automatically by the Brainomix software might be considered an additional early radiological outcome measure in everyday clinical practice.
References
Bucker A, Boers AM, Bot JCJ, Berkhemer OA, Lingsma HF, Yoo AJ, van Zwam W, van Oostenbrugge R, van der Lugt A, Dippel DWJ, Roos YBWEM, Majoie CBLM, Marquering HA, MR CLEAN Trial Investigators (Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands) (2017) Associations of ischemic lesion volume with functional outcome in patients with acute ischemic stroke: 24-hour versus 1-week imaging. Stroke 48:1233–1240. https://doi.org/10.1161/STROKEAHA.116.015156
Manning NW, Warne CD, Meyers PM (2018) Reperfusion and clinical outcomes in acute ischemic stroke: systematic review and meta-analysis of the stent-retriever-based, early window endovascular stroke trials. Front Neurol 9:301. https://doi.org/10.3389/fneur.2018.00301
Albers GW, Goyal M, Jahan R, Bonafe A, Diener HC, Levy EI, Pereira VM, Cognard C, Yavagal DR, Saver JL (2015) Relationships between imaging assessments and outcomes in solitaire with the intention for thrombectomy as primary endovascular treatment for acute ischemic stroke. Stroke 46:2786–2794. https://doi.org/10.1161/STROKEAHA.115.010710
Rangaraju S, Liggins JTP, Aghaebrahim A et al (2014) Pittsburgh outcomes after stroke thrombectomy score predicts outcomes after endovascular therapy for anterior circulation large vessel occlusions. Stroke 45:2298–2304. https://doi.org/10.1161/STROKEAHA.114.005595
Zaidi SF, Aghaebrahim A, Urra X, Jumaa MA, Jankowitz B, Hammer M, Nogueira R, Horowitz M, Reddy V, Jovin TG (2012) Final infarct volume is a stronger predictor of outcome than recanalization in patients with proximal middle cerebral artery occlusion treated with endovascular therapy. Stroke 43:3238–3244. https://doi.org/10.1161/STROKEAHA.112.671594
Van Everdingen KJ, Van Der Grond J, Kappelle LJ et al (1998) Diffusion-weighted magnetic resonance imaging in acute stroke. Stroke 29:1783–1790. https://doi.org/10.1161/01.STR.29.9.1783
Nagel S, Sinha D, Day D, Reith W, Chapot R, Papanagiotou P, Warburton EA, Guyler P, Tysoe S, Fassbender K, Walter S, Essig M, Heidenrich J, Konstas AA, Harrison M, Papadakis M, Greveson E, Joly O, Gerry S, Maguire H, Roffe C, Hampton-Till J, Buchan AM, Grunwald IQ (2017) E-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12(6):615–622. https://doi.org/10.1177/1747493016681020
Herweh C, Ringleb PA, Rauch G, Gerry S, Behrens L, Möhlenbruch M, Gottorf R, Richter D, Schieber S, Nagel S (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11:438–445. https://doi.org/10.1177/1747493016632244
Pfaff J, Herweh C, Schieber S, Schönenberger S, Bösel J, Ringleb PA, Möhlenbruch M, Bendszus M, Nagel S (2017) E-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. Am J Neuroradiol 38:1594–1599. https://doi.org/10.3174/ajnr.A5236
Yoo AJ, Chaudhry ZA, Nogueira RG, Lev MH, Schaefer PW, Schwamm LH, Hirsch JA, González RG (2012) Infarct volume is a pivotal biomarker after intra-arterial stroke therapy. Stroke 43:1323–1330. https://doi.org/10.1161/STROKEAHA.111.639401
Acknowledgments
The authors acknowledge Dr. Silvie Belaskova, Ph.D. (International Clinical Research Centre, St. Anne’s University Hospital, Brno, Czech Republic) for the statistical consultations.
Funding
This study is supported by the Ministry of Health, Czech Republic – conceptual development of research organization (FNOs/2018).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Ethical approval
All procedures were in accordance with the ethical standards of the institutional and national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all participants included in the study.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kral, J., Cabal, M., Kasickova, L. et al. Machine learning volumetry of ischemic brain lesions on CT after thrombectomy—prospective diagnostic accuracy study in ischemic stroke patients. Neuroradiology 62, 1239–1245 (2020). https://doi.org/10.1007/s00234-020-02419-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00234-020-02419-7