Abstract
Video capsule endoscope (VCE) is an emerging technology that allows examination of the entire gastrointestinal (GI) tract with minimal invasion. While traditional endoscopywith biopsy procedures are the gold standard for diagnosis of most GI diseases, they are limited by how far the scope can be advanced in the tract and are also invasive. VCE allows gastroenterologists to investigate GI tract abnormalities in detail with visualization of all parts of the GI tract. It captures continuous real time images as it is propelled in the GI tract by gut motility. Even though VCE allows for thorough examination, reviewing and analyzing up to eight hours of images (compiled as videos) is tedious and not cost effective. In order to pave way for automation of VCE-based GI disease diagnosis, detecting the location of the capsule would allow for a more focused analysis as well as abnormality detection in each region of the GI tract. In this paper, we compared four deep Convolutional Neural Network models for feature extraction and detection of the anatomical part within the GI tract captured by VCE images. Our results showed that VGG-Net has superior performance with the highest average accuracy, precision, recall and, F1-score compared to other state of the art architectures: GoogLeNet, AlexNet and, ResNet.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Anwar, S.M., Majid, M., Qayyum, A., Awais, M., Alnowami, M., Khan, M.K.: Medical image analysis using convolutional neural networks: a review. J. Med. Syst. 42(11), 226 (2018)
Azzopardi, C., Hicks, Y.A., Camilleri, K.P.: Exploiting gastrointestinal anatomy for organ classification in capsule endoscopy using locality preserving projections. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3654–3657. IEEE (2013)
Berens, J., Mackiewicz, M., Bell, D.: Stomach, intestine, and colon tissue discriminators for wireless capsule endoscopy images. In: Medical Imaging 2005: Image Processing, vol. 5747, pp. 283–290. International Society for Optics and Photonics (2005)
Ding, Z., Shi, H., Zhang, H., Meng, L., Fan, M., Han, C., Zhang, K., Ming, F., Xie, X., Liu, H., et al.: Gastroenterologist-level identification of small-bowel diseases and normal variants by capsule endoscopy using a deep-learning model. Gastroenterology 157(4), 1044–1054 (2019)
Eliakim, R., Fireman, Z., Gralnek, I.M., Yassin, K., Waterman, M., Kopelman, Y., Lachter, J., Koslowsky, B., Adler, S.N.: Evaluation of the pillcam colon capsule in the detection of colonic pathology: results of the first multicenter, prospective, comparative study. Endoscopy 38(10), 963–970 (2006)
Eliakim, R.: The pillcam colon capsule–a promising new tool for the detection of colonic pathologies. Curr. Colorectal Cancer Rep. 4(1), 5–9 (2008)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Iddan, G., Meron, G., Glukhovsky, A., Swain, P.: Wireless capsule endoscopy. Nature 405(6785), 417–417 (2000)
Klang, E., Barash, Y., Margalit, R.Y., Soffer, S., Shimon, O., Albshesh, A., Ben-Horin, S., Amitai, M.M., Eliakim, R., Kopylov, U.: Deep learning algorithms for automated detection of crohn’s disease ulcers by video capsule endoscopy. Gastrointest. Endosc. 91(3), 606–613 (2020)
Koh, J.E.W., Hagiwara, Y., Oh, S.L., Tan, J.H., Ciaccio, E.J., Green, P.H., Lewis, S.K., Acharya, U.R.: Automated diagnosis of celiac disease using DWT and nonlinear features with video capsule endoscopy images. Future Gener. Comput. Syst. 90, 86–93 (2019)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Lee, J., Oh, J., Shah, S.K., Yuan, X., Tang, S.J.: Automatic classification of digestive organs in wireless capsule endoscopy videos. In: Proceedings of the 2007 ACM Symposium on Applied Computing, pp. 1041–1045 (2007)
Li, H., Hou, X., Lin, R., Fan, M., Pang, S., Jiang, L., Liu, Q., Ling, F.: Advanced endoscopic methods in gastrointestinal diseases: a systematic review. Quantitative Imaging Med. Surg. 9(5), 905 (2019)
Paul, B.D., Babu, C.: Robust image compression algorithm for video capsule endoscopy: a review. In: 2019 International Conference on Intelligent Sustainable Systems (ICISS), pp. 372–377. IEEE (2019)
Razzak, M.I., Naz, S., Zaib, A.: Deep learning for medical image processing: overview, challenges and the future. In: Classification in BioApps, pp. 323–350. Springer (2018)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2921–2929 (2016)
Zou, Y., Li, L., Wang, Y., Yu, J., Li, Y., Deng, W.J.: Classifying digestive organs in wireless capsule endoscopy images based on deep convolutional neural network. In: 2015 IEEE International Conference on Digital Signal Processing (DSP), pp. 1274–1278. IEEE (2015)
Acknowledgment
This work was supported by Engineering in Medicine seed grant by the University of Virginia (Porter, Syed).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Adewole, S. et al. (2021). Deep Learning Methods for Anatomical Landmark Detection in Video Capsule Endoscopy Images. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Proceedings of the Future Technologies Conference (FTC) 2020, Volume 1. FTC 2020. Advances in Intelligent Systems and Computing, vol 1288. Springer, Cham. https://doi.org/10.1007/978-3-030-63128-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-63128-4_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63127-7
Online ISBN: 978-3-030-63128-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)