Abstract
We present a method for estimating intrinsic images from a fixed-viewpoint image sequence captured under changing illumination directions. Previous work on this problem reduces the influence of shadows on reflectance images, but does not address shading effects which can significantly degrade reflectance image estimation under the typically biased sampling of illumination directions. In this paper, we describe how biased illumination sampling leads to biased estimates of reflectance image derivatives. To avoid the effects of illumination bias, we propose a solution that explicitly models spatial and temporal constraints over the image sequence. With this constraint network, our technique minimizes a regularization function that takes advantage of the biased image derivatives to yield reflectance images less influenced by shading.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Barrow, H.G., Tenenbaum, J.M.: Recovering intrinsic scene characteristics from images. In: Hanson, A., Riseman, E. (eds.) Computer Vision Systems, pp. 3–26. Academic Press, New York (1978)
Adelson, E.H., Pentland, A.P.: The Perception of Shading and Reflectance. In: Knill, D., Richards, W. (eds.) Perception as Bayesian Inference, pp. 409–423 (1996)
Blake, A.: Boundary Conditions of lightness computation in mondrian world. Computer Vision, Graphics and Image Processing 32, 314–327 (1985)
Wolff, L.B., Angelopoulou, E.: 3-d stereo using photometric ratios. In: Eklundh, J.-O. (ed.) ECCV 1994. LNCS, vol. 801, pp. 247–258. Springer, Heidelberg (1994)
Kimmel, R., Elad, M., Shaked, D., Keshet, R., Sobel, I.: A Variational Framework for Retinex. International Journal of Computer Vision 52(1), 7–23 (2003)
Land, E.H.: An alternative technique for the computation of the designor in the Retinex theory of color vision. Proc. Nat. Acad. Sci. 83, 3078–3080 (1986)
Land, E.H.: The Retinex theory of color vision. Scientific American 237(G), 108–128 (1977)
Land, E.H., McCann, J.J.: Lightness and retinex theory. Journal of the Optical Society of America 61(1), 1–11 (1971)
Weiss, Y.: Deriving intrinsic images from image sequences. In: Proc. of 9th IEEE Int’l Conf. on Computer Vision, July 2001, pp. 68–75 (2001)
Tappen, M.F., Freeman, W.T., Adelson, E.H.: Recovering Intrinsic Images from a Single Image. In: Advances in Neural Information Processing Systems 15 (NIPS), MIT Press, Cambridge (2002)
Finlayson, G.D., Hordley, S.D., Drew, M.S.: Removing Shadows from Images. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 823–836. Springer, Heidelberg (2002)
Matsushita, Y., Nishino, K., Ikeuchi, K., Sakauchi, M.: Illumination Normalization with Time-dependent Intrinsic Images for Video Surveillance. In: Conf. on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 3–10 (2003)
Blake, A.: Comparison of the efficiency of deterministic and stochastic algorithms for visual reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence 11(1), 2–12 (1989)
Horn, B.K.P., Schunk, B.: Determining optical flow. Artificial Intelligence 17, 185–203 (1981)
Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 721–741 (1984)
Olshausen, B.A., Field, D.J.: Emergence of simplecell receptive field properties by learning a sparse code for natural images. Nature 381, 607–608 (1996)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: Generative models for recognition under variable pose and illumination. In: IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 277–284 (2000)
Shewchuck, J.R.: An introduction to the conjugate gradient method without agonizing pain. Tech. Rep. CMU-CS-94-125, Carnegie Mellon University (1994)
Hayakawa, H.: Photometric stereo under a light-source with arbitrary motion. Journal of Optical Society of America A 11(11), 3079–3089 (1994)
Basri, R., Jacobs, D.: Photometric stereo with general, unknown lighting. In: Proc. of Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 374–381 (2001)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: Illumination-Based Image Synthesis: Creating Novel Images of Human Faces Under Differing Pose and Lighting. In: Proc. Workshop on Multi-View Modeling and Analysis of Visual Scenes, pp. 47–54 (1999)
Yuille, A.L., Snow, D., Epstein, R., Belhumeur, P.: Determining Generative Models for Objects Under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability. International Journal on Computer Vision 35(3), 203–222 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Matsushita, Y., Lin, S., Kang, S.B., Shum, HY. (2004). Estimating Intrinsic Images from Image Sequences with Biased Illumination. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24671-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-24671-8_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21983-5
Online ISBN: 978-3-540-24671-8
eBook Packages: Springer Book Archive