Abstract
The tissue surface shape provides important information for both tissue pathology detection and augmented reality. Previously a miniaturised structured light (SL) illumination probe (1.9 mm diameter) has been developed to generate sparsely reconstructed tissue surfaces in minimally invasive surgery (MIS). The probe is inserted through the biopsy channel of a standard endoscope and projects a pattern of spots with unique spectra onto the target tissue. The tissue surface can be recovered by light pattern decoding and using parallax. This paper introduces further algorithmic developments and analytical work to allow free-hand manipulation of the SL probe, to improve the light pattern decoding result and to increase the reconstruction accuracy. Firstly the “normalized cut” algorithm was applied to segment the light pattern. Then an iterative procedure was investigated to update both the pattern decoding and the relative position between the camera and the probe simultaneously. Based on planar homography computation, the orientations of local areas where the spots are located in 3D space were estimated. The acquired surface normal information was incorporated with the sparse spot correspondences to constrain the fitting of a thin-plate spline during surface reconstruction. This SL system was tested in phantom, ex vivo, and in vivo experiments, and the potential of applying this system in surgical environments was demonstrated.
Chapter PDF
Similar content being viewed by others
References
Schwartz, J.J., Lichtenstein, G.R.: Magnification endoscopy, chromoendoscopy and other novel techniques in evaluation of patients with IBD. Techniques in Gastrointestinal Endoscopy 6, 182–188 (2004)
King, A.P., Edwards, P.J., Maurer, C.R., Cunha, D.A.D., Gaston, R.P., Clarkson, M., Hill, D.L.G., Hawkes, D.J., Fenlon, M.R., Strong, A.J., Cox, T.C.S., Gleeson, M.J.: Stereo Augmented Reality in the Surgical Microscope. Presence: Teleoper. Virtual Environ. 9, 360–368 (2000)
Maier-Hein, L., Mountney, P., Bartoli, A., Elhawary, H., Elson, D., Groch, A., Kolb, A., Rodrigues, M., Sorger, J., Speidel, S., Stoyanov, D.: Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Medical Image Analysis 17, 974–996 (2013)
Maier-Hein, L., Groch, A., Bartoli, A., Bodenstedt, S., Boissonnat, G., Chang, P.L., Clancy, N.T., Elson, D.S., Haase, S., Heim, E., Hornegger, J., Jannin, P., Kenngott, H., Kilgus, T., Muller-Stich, B., Oladokun, D., Rohl, S., dos Santos, T.R., Schlemmer, H.P., Seitel, A., Speidel, S., Wagner, M., Stoyanov, D.: Comparative Validation of Single-Shot Optical Techniques for Laparoscopic 3-D Surface Reconstruction. IEEE Transactions on Medical Imaging 33, 1913–1930 (2014)
Schmalz, C., Forster, F., Schick, A., Angelopoulou, E.: An endoscopic 3D scanner based on structured light. Medical Image Analysis 16, 1063–1072 (2012)
Clancy, N.T., Stoyanov, D., Maier-Hein, L., Groch, A., Yang, G.-Z., Elson, D.S.: Spectrally encoded fiber-based structured lighting probe for intraoperative 3D imaging. Biomedical Optics Express 2, 3119–3128 (2011)
Lin, J., Clancy, N.T., Elson, D.S.: An endoscopic structured light system using multispectral detection. In: International Journal of Computer Assisted Radiology and Surgery (2015) ISSN:1861-6410
Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 888–905 (2000)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press (2004). ISBN: 0521540518
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)
Fitzgibbon, A., Pilu, M., Fisher, R.B.: Direct least square fitting of ellipses. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 476–480 (1999)
Franke, R.: Smooth interpolation of scattered data by local thin plate splines. Computers & Mathematics with Applications 8, 273–281 (1982)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Lin, J., Clancy, N.T., Stoyanov, D., Elson, D.S. (2015). Tissue Surface Reconstruction Aided by Local Normal Information Using a Self-calibrated Endoscopic Structured Light System. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds) Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science(), vol 9349. Springer, Cham. https://doi.org/10.1007/978-3-319-24553-9_50
Download citation
DOI: https://doi.org/10.1007/978-3-319-24553-9_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24552-2
Online ISBN: 978-3-319-24553-9
eBook Packages: Computer ScienceComputer Science (R0)