Abstract
We address a photometric stereo problem that has unknown lighting conditions. To estimate the shape, reflection properties, and lighting conditions, we employ a nonlinear minimization that searches for parameters that can synthesize images that best fit the input images. A similar approach has been reported previously, but it suffers from slow convergence due to specular reflection parameters. In this paper, we introduce specular-free residual minimization that avoids the negative effects of specular reflection components by projecting the residual onto the complementary space of the light color. The minimization process simultaneously searches for the optimal light color and other parameters. We demonstrate the effectiveness of the proposed method using several real and synthetic image sets.
Chapter PDF
Similar content being viewed by others
Keywords
- Input Image
- Photometric Stereo
- Point Light Source
- Preconditioned Conjugate Gradient Method
- Specular Component
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Belhumeur, P.N., Kriegman, D.J., Yuille, A.L.: The bas-relief ambiguity. Intl. J. of Computer Vision 35(1), 33–44 (1999)
Chandraker, M., Kahl, F., Kriegman, D.: Reflections on the generalized bas-relief ambiguity. In: Proc. CVPR 2005, vol. I, pp. 788–795 (2005)
Georghiades, A.S.: Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. In: Proc. ICCV 2003, vol. 2, pp. 816–823 (2003)
Ikeuchi, K.: Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-3(6), 661–669 (1981)
Klinker, G., Shafer, S., Kanade, T.: The measurement of high-lights in color images. Intl. J. Computer Vision 2(1), 7–32 (1988)
Migita, T., Ogino, S., Shakunaga, T.: Direct Bundle Estimation for Recovery of Shape, Reflectance Property and Light Position. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 412–425. Springer, Heidelberg (2008)
Okabe, T., Sato, Y.: Does a nearby point light source resolve the ambiguity of shape recovery in uncalibrated photometric stereo? In: Proc. MIRU 2007. pp. 881–886 (2007) (in Japanese)
Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes, 3rd edn. Cambridge University Press (2007)
Shafer, S.A.: Using color to separate reflection components. COLOR Research and Application 10(4), 210–218 (1985)
Tan, P., Mallick, S.P., Quan, L., Kriegman, D., Zickler, T.: Isotropy, reciprocity and the generalized bas-relief ambiguity. In: Proc. CVPR 2007, pp. 1–8 (2007)
Tan, P., Zickler, T.: A projective framework for radiometric image analysis. In: Proc. CVPR 2009, pp. 2977–2984 (2009)
Tan, P., Lin, S., Quan, L.: Resolution-Enhanced Photometric Stereo. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part III. LNCS, vol. 3953, pp. 58–71. Springer, Heidelberg (2006)
Torrance, K., Sparrow, E.: Theory for off-specular reflection from roughened surfaces. J. Opt. Soc. Am. 57, 1105–1114 (1967)
Yuille, A., Snow, D., Epstein, R., Belhumeur, P.: Determining generative models of objects under varying illumination: Shape and albedo from multiple mages using svd and integrability. Intl. J. of Computer Vision 35(3), 203–222 (1999)
Zickler, T., Mallick, S.P., Kriegman, D.J., Belhumeur, P.N.: Color subspaces as photometric invariants. Intl. J. of Computer Vision 79(1), 13–30 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Migita, T., Sogawa, K., Shakunaga, T. (2011). Specular-Free Residual Minimization for Photometric Stereo with Unknown Light Sources. In: Ho, YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7087. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25367-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-25367-6_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25366-9
Online ISBN: 978-3-642-25367-6
eBook Packages: Computer ScienceComputer Science (R0)