Abstract
In laparoscopic surgery, to identify the location of lesions and blood vessels inside organs, an ultrasound probe which can be inserted through small incision is used. However, since surgeons must observe the laparoscopic and ultrasound images both at the same time, it is difficult to understand the correspondence between the ultrasound image and real space. Therefore, to recognize the correspondence between these two images intuitively, we developed a system for overlaying ultrasound image on the laparoscopic image. Since the tip of the probe is flexed freely, we acquired the probe tip position and orientation using a method for detecting the probe angle from laparoscopic image and information obtained from optical tracking sensor. As a result of an experiment using a wire phantom, overlaying error of ultrasound images was found to be 0.97 mm. Furthermore, the rate of probe angle detection was evaluated through an animal experiment to be 83.1%.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Peterhans, M., vom Berg, A., Dagon, B., et al.: A navigation system for open liver surgery: design, workflow and first clinical applications. The International Journal of Medical Robotics and Computer Assisted Surgery 7, 7–16 (2011)
Sindram, D., McKillop, I.H., Martinie, J.B., et al.: Novel 3-D laparoscopic magnetic ultrasound image guidance for lesion targeting. International Hepato-Pancreato-Biliary Association 12, 709–716 (2010)
Langø, T., Vijayan, S., Rethy, A., et al.: Navigated laparoscopic ultrasound in abdominal soft tissue surgery. technological overview and perspectives. International Journal of Computer Assisted Radiology and Surgery 7, 585–599 (2012)
Harms, J., Feussner, H., Baumgartner, M., et al.: Three-dimensional navigated laparoscopic ultrasonography. Surgical Endoscopy 15, 1459–1462 (2001)
Nakamoto, M., Nakada, K., Sato, Y., et al.: Intraoperative Magnetic Tracker Calibration Using a Magneto-Optic Hybrid Tracker for 3-D Ultrasound-Based Navigation in Laparoscopic Surgery. IEEE Trans. Medical Imaging 27, 255–270 (2008)
Edgcumbe, P., Nguan, C., Rohling, R.: Calibration and Stereo Tracking of a Laparoscopic Ultrasound Transducer for Augmented Reality in Surgery. In: Liao, H., Linte, C.A., Masamune, K., Peters, T.M., Zheng, G. (eds.) MIAR 2013 and AE-CAI 2013. LNCS, vol. 8090, pp. 258–267. Springer, Heidelberg (2013)
Jayarathne, U.L., McLeod, A.J., Peters, T.M., Chen, E.C.S.: Robust Intraoperative US Probe Tracking Using a Monocular Endoscopic Camera. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part III. LNCS, vol. 8151, pp. 363–370. Springer, Heidelberg (2013)
Bouarfa, L., Akman, O., Schneider, A., et al.: In-vivo real-time tracking of surgical instruments in endoscopic video. Minimally Invasive Therapy 21, 129–134 (2012)
Liao, H., Tsuzuki, M., Mochizuki, T., et al.: Fast image mapping of endoscopic image mosaics with three-dimensional ultrasound image for intrauterine fetal surgery. Minimally Invasive Therapy 18, 332–340 (2009)
Gavaghan, K.A., Peterhans, M., Oliveira-Santos, T., et al.: A Portable Image Overlay Projection Device for Computer-Aided Open Liver Surgery. IEEE Trans on Biomedical Engineering 58, 1855–1864 (2011)
Hansen, C., Wieferich, J., Riffer, F., et al.: Illustrative visualization of 3D planning models for augmented reality in liver surgery. International Journal of Computer Assisted Radiology and Surgery 5, 133–141 (2010)
Yamaguchi, T., Nakamoto, M., Sato, Y., et al.: Development of a camera model and calibration procedure for oblique-viewing endoscopes. Computer Aided Surgery 9(5), 203–214 (2004)
Chen, T.K., Thurston, A.D., Ellis, R.E., et al.: A Real-Time Freehand Ultrasound Calibration System with Automatic Accuracy Feedback and Control. Ultrasound in Medical & Biology 35, 79–93 (2009)
Claron Technology Inc.: MicronTracker 3, Specifications (2013), http://www.clarontech.com/microntracker-specifications.php
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Oguma, R., Nakaguchi, T., Nakamura, R., Yamaguchi, T., Kawahira, H., Haneishi, H. (2014). Ultrasound Image Overlay onto Endoscopic Image by Fusing 2D-3D Tracking of Laparoscopic Ultrasound Probe. In: Linte, C.A., Yaniv, Z., Fallavollita, P., Abolmaesumi, P., Holmes, D.R. (eds) Augmented Environments for Computer-Assisted Interventions. AE-CAI 2014. Lecture Notes in Computer Science, vol 8678. Springer, Cham. https://doi.org/10.1007/978-3-319-10437-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-10437-9_2
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10436-2
Online ISBN: 978-3-319-10437-9
eBook Packages: Computer ScienceComputer Science (R0)