Abstract
Convolutional neural networks are the most commonly used models for multi-organ segmentation in CT volumes. Most approaches are based on supervised learning, which means that the data used for training requires expert annotations, which is time-consuming and tedious. Errors introduced during that process will inherently influence all downstream tasks and are difficult to counteract. To showthe impact of such annotation errors when training deep segmentation models, we evaluate simple U-Net architectures trained on multi-organ datasets including artificially generated annotation errors. Specifically, three types of common masks are simulated, i.e. constant over- or under-segmentation error at the organ’s boundary and the mixed-segmentation error. Our results show that using the ground truth data leads to mean dice score of 0.780, compared to mean dice scores of 0.761 and 0.663 for the constant over- and under-segmentation errors respectively. In contrast the mixed segmentation introduces a rather small performance decrease with a mean dice score of 0.771.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Gonzalez-Jimenez A, Lionetti S, Gottfrois P, Gröger F, Pouly M,Navarini AA. Robust T-Loss for Medical Image Segmentation. MICCAI 2023. Springer. 2023.
Vorontsov E, Kadoury S. Label Noise in Segmentation Networks: Mitigation Must Deal with Bias. DGM4MICCAI 2021. Springer International Publishing, 2021:251–8.
Heller N, Dean J, Papanikolopoulos N. Imperfect Segmentation Labels: How Much Do They Matter? LABELS Workshop MICCAI 2017. Springer International Publishing, 2018:112– 20.
Vădineanu Ş, Pelt D, Dzyubachyk O, Batenburg J. An Analysis of the Impact of Annotation Errors on the Accuracy of Deep Learning for Cell Segmentation. Medical Imaging with Deep Learning. 2022.
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. MICCAI 2015. Springer. 2015:234–41.
Bilic P, Christ PF, Vorontsov E, Chlebus G, Chen H, Dou Q et al. The Liver Tumor Segmentation Benchmark (LiTS). CoRR. 2019.
Kaur H, Kaur N, Neeru N. Evolution of multiorgan segmentation techniques from traditional to deep learning in abdominal CT images – A systematic review. Displays. 2022.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this paper
Cite this paper
Brückner, C., Liu, C., Rist, L., Maier, A. (2024). Influence of imperfect annotations on deep learning segmentation models. In: Maier, A., Deserno, T.M., Handels, H., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2024. BVM 2024. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-44037-4_65
Download citation
DOI: https://doi.org/10.1007/978-3-658-44037-4_65
Published:
Publisher Name: Springer Vieweg, Wiesbaden
Print ISBN: 978-3-658-44036-7
Online ISBN: 978-3-658-44037-4
eBook Packages: Computer Science and Engineering (German Language)