Abstract
This paper presents a novel method for photorealistic rendering of the bronchial lumen by directly deriving matched shading and texture parameters from video bronchoscope images. 2D/3D registration is used to match video bronchoscope images with 3D CT scan of the same patient, such that patient specific modelling and simulation with improved visual realism can be achieved. With the proposed method, shading parameters are recovered by modelling the bidirectional reflectance distribution function (BRDF) of the visible surfaces by exploiting the restricted lighting configurations imposed by the bronchoscope. The derived BRDF is then used to predict the expected shading intensity such that a texture map independent of lighting conditions can be extracted. This allows the generation of new views not captured in the original bronchoscopy video, thus allowing free navigation of the acquired 3D model with enhanced photo-realism.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Mori, K., Deguchi, D., Sugiyama, J., Suenaga, Y., Maurer Jr., C.R., Takabatake, J.T., Natori, H.: Tracking of a bronchoscope using epipolar geometry analysis and intensity -based image registration of real and virtual endoscopic images. Medical Image Analysis 6, 321–336 (2002)
Deligianni, F., Chung, A., Yang, G.Z.: pq-space 2d/3d registration for endoscope tracking. In: Conference on Medical Image Computing & Computer Assisted Intervention (MICCAI 2003), vol. 1, pp. 311–318 (2003)
McMillan, L.: An image-based approach to three-dimensional computer graphics. Technical Report TR97-013 (1997)
Chen, S.E., Williams, L.: View interpolation for image synthesis. In: SIGGraph 1993, pp. 279–288 (1993)
Debevec, P.E.: Pursuing reality with image-based modeling, rendering, and lighting. In: Pollefeys, M., et al. (eds.) SMILE 2000. LNCS, vol. 2018, p. 1. Springer, Heidelberg (2001)
Kajiya, J.T.: The rendering equation. In: Evans, D.C., Athay, R.J. (eds.) Computer Graphics SIGGRAPH 1986 Proceedings, vol. 20, pp. 143–150 (1986)
He, X.D., Torrance, K.E., Sillion, F.X., Greenberg, D.P.: A comprehensive physical model for light reflection. Computer Graphics 25, 175–186 (1991)
Lafortune, E.P., Willems, Y.D.: Using the Modified Phong BRDF for Physically Based Rendering. Technical Report CW197, Department of Computer Science, Katholieke Universiteit Leuven, Leuven, Belgium (1994)
Ward, G.J.: Measuring and modeling anisotropic reflection. In: Catmull, E.E. (ed.) Computer Graphics SIGGRAPH 1992 Proceedings, vol. 26, pp. 265–272 (1992)
Dana, K.J., van Ginneken, B., Nayar, S.K., Koenderink, J.J.: Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18(1), 1–34 (1999)
Lensch, H.P.A., Kautz, J., Goesele, M., Heidrich, W., Seidel, H.P.: Image-based reconstruction of spatial appearance and geometric detail. ACM Transactions on Graphics 22, 234–257 (2003)
Yu, Y., Debevec, P., Malik, J., Hawkins, T.: Inverse global illumination: Recovering reflectance models of real scenes from photographs. In: Rockwood, A. (ed.) Proceedings of the Conference on Computer Graphics Siggraph 1999, N.Y, pp. 215–224. ACM Press, New York (1999)
Loscos, C., et al.: Interactive virtual relighting and remodeling of real scenes. RT-0230, Institut National de Recherche en Informatique en Automatique (INRIA), Grenoble, France (1999), Available from http://www.imagis.imag.fr/Publications
Boivin, S., Gagalowicz, A.: Image-based rendering of diffuse, specular and glossy surfaces from a single image. In: Fiume, E. (ed.) SIGGRAPH 2001, Computer Graphics Proceedings. Annual Conference Series, pp. 107–116. ACM Press / ACM SIGGRAPH, New York (2001)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 1330–1334 (2000)
Schlathölter, T., et al.: Simultaneous segmentation and tree reconstruction of the airways for virtual bronchoscopy. In: Proceedings of SPIE, Medical Imaging 2002: Image Processing, vol. 4684, pp. 103–113 (2002)
Lévy, B., et al.: Least squares conformal maps for automatic texture atlas generation. In: Spencer, S. (ed.) Proceedings of the 29th Conference on Computer Graphics and Interactive Techniques (SIGGRAPH-02, vol. 21,3 of ACM Transactions on Graphics, pp. 362–371. ACM Press, New York (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chung, A.J., Deligianni, F., Shah, P., Wells, A., Yang, GZ. (2004). Enhancement of Visual Realism with BRDF for Patient Specific Bronchoscopy Simulation. In: Barillot, C., Haynor, D.R., Hellier, P. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2004. MICCAI 2004. Lecture Notes in Computer Science, vol 3217. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30136-3_60
Download citation
DOI: https://doi.org/10.1007/978-3-540-30136-3_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22977-3
Online ISBN: 978-3-540-30136-3
eBook Packages: Springer Book Archive