Abstract
The visual system is concerned with the perception of objects in a dynamic world. A significant fact about natural time-varying images is that they do not change randomly over space-time; instead image intensities at different times and/or spatial positions are highly correlated. We measured the spatiotemporal correlation function — equivalently the power spectrum — of natural images and we find that it is non-separable, i.e., coupled in space and time, and exhibits a very interesting scaling behaviour. This behaviour is shown to be related to the motion in the images and the power spectrum is naturally separable into a spatial term and a velocity term. The same kind of spatiotemporal coupling and scaling exists in visual sensitivity measured in physiological and psychophysical experiments. By assuming that the visual system is optimized to process information of natural images, a quantitative relationship can be derived between the power spectrum of natural images and the visual sensitivity. This reveals some interesting aspects of motion vision.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Atick JJ (1992) Could information theory provide an ecological theory of sensory processing? Network: Comp Neural Syst 3: 213–251
Burton GJ, Moorhead IR (1987) Color and spatial structure in natural scenes. Appl Optics. 26: 157–170
Campbell FW, Gubisch RW (1966) Optical quality of the human eye. J Physiol 186: 558–578
Dong DW (1997) Spatiotemporal coupling and scaling of natural images and human visual sensitivities. In: Mozer MC, Jordan MI, Petsche T (eds) Advances in neural information processing systems 9. MIT Press, Cambridge, pp 859–865
Dong DW, Atick JJ (1995a) Statistics of natural time-varying images Network: Comp Neural Syst 6: 345–358
Dong DW, Atick JJ (1995b) Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus. Network: Comp Neural Sys 6: 159–178
Eckert MP, Buchsbaum G (1993) Efficient coding of natural time varying images in the early visual system. Phil Trans Roy Soc Lond B 339: 385–39
Eckert MP, Buchsbaum G, Watson AB (1992) Separability of spatiotemporal spectra of image sequences. IEEE Trans Pattern Anal Machine Intell 14: 1210–1213
van Essen DC, Anderson CC (1990) Information processing strategies and pathways in the primate retina and visual cortex. In: Zotnetzer SF, Davis JL, Lau C (eds) Introduction to neural and electronic networks. Academic Press, Orlando, pp 43–72
Field DJ (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc Am A 4: 2379–2394
Hancock PJB, Baddeley RJ, Smith LS (1992) The principal components of natural images Network: Comp Neural Syst 3: 61–70
van Hateren JH (1993) Spatiotemporal contrast sensitivity of early vision. Vision Res 33: 257–267
van Hateren JH (1997) Processing of natural time series of intensities by the visual system of the blowfly. Vision Res 37: 3407–3416
Horn BKP, Schunk BG (1981) Determining optical flow. Artif Intell 17: 185
Jain JR, Jain AK (1981) Displacement measurement and its application in interframe image coding IEEE Trans Commun 29.1799–1808
Kelly DH, (1979) Motion and vision II. Stabilized spatio-temporal threshold surface. J Opt Soc Am 69: 1340–1349
Kretzmer ER (1952) Statistics of television signals. The Bell System Technical Journal 751–763
Li Z (1992) Different retinal ganglion cells have different functional goals. Int J Neural Systems 3: 237–248
Ruderman DL (1997) Origins of scaling in natural images. Vision Res 37: 3385–3398
Ruderman DL, Bialek W (1994) Statistics of natural images: scaling in the woods. Phys Rev Let 73: 814–817
Schnapf IL, Baylor DA (1987) How photoreceptor cells respond to light. Scient Am 256: 40–47
Tolhurst DJ, Tadmor Y, Chao T (1992) Amplitude spectra of natural images. Opthal Physiol Optics 12: 229–232
Troy JB (1983a) Spatio-temporal interaction in neurons of the cats dorsal lateral geniculate nucleus. J Physiol 344: 419–423
Troy JB (1983b) Spatio contrast sensitivities of X and Y type neurons in the cats dorsal lateral geniculate nucleus. J Physiol 344: 399–417
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Dong, D.W. (2001). Spatiotemporal Inseparability of Natural Images and Visual Sensitivities. In: Zanker, J.M., Zeil, J. (eds) Motion Vision. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-56550-2_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-56550-2_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-62979-2
Online ISBN: 978-3-642-56550-2
eBook Packages: Springer Book Archive