Abstract
A solution to the correspondence problem for stereopsis is proposed using the differences in the complex phase of local spatial frequency components. One-dimensional spatial Gabor filters (Gabor 1946; Marcelja 1980), at different positions and spatial frequencies are convolved with each member of a stereo pair. The difference between the complex phase at corresponding points in the two images is used to find the stereo disparity. Disparity values are combined across spatial frequencies for each image location. Three-dimensional depth maps have been computed from real images under standard lighting conditions, as well as from random-dot stereograms (Julesz 1971). The algorithm can discriminate disparities significantly smaller than the width of a pixel. It is possible that a similar mechanism might be used in the human visual system.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Adelson EH, Bergen JR (1984) Motion channels based on spatiotemporal energy. Invest Opthalmol Vis Sci [Suppl] A 25:14
Adelson EH, Bergen JR (1985) Spatiotemporal energy models for the perception of motion. J Opt Soc Am A 2:284–299
Anstis SM, Howard IP, Rogers B (1978) A Craik-O'Brien-Cornsweet illusion for visual depth. Vision Res 18:213–217
Barnard ST, Thompson WB (1980) Disparity analysis of images. IEEE PAMI 2:333–340
Burgess A, Ghandeharian H (1984) Visual signal detection I. Ability to use phase information. J Opt Soc Am A 1:900–905
Burt P, Julesz B (1980) A disparity gradient limit for binocular fusion. Science 208:615–617
Campbell FW, Robson JG (1968) Application of Fourier analysis to the visibility of gratings. J Physiol 197:551–566
Foster KH, Gaska JP, Nagler M, Pollen DA (1985) Spatial and temporal frequency selectivity of neurones in visual cortical areas V1 and V2 of the macaque monkey. J Physiol 365:331–363
Gabor D (1946) Theory of communication. JIEE 93:429–459
Grimson WEL (1985) Computational experiments with a feature based stereo algorithm. IEEE PAMI 7:17–34
Hannah MJ (1974) Computer matching of areas in stereo imagery. Ph.D. thesis, Stanford University
Heeger DJ (1986) Depth and flow from motion energy. In: Proceedings of the Fifth National Conference on Artificial Intelligence (AAAI-86) Philadelphia, pp 657–661
Howard JH, Richardson KH (1986) Absolute phase uncertainty in sinusoidal grating detection. Catholic University of America, Human Performance Lab Tech Report ONR-86-27
Julesz B (1971) Foundations of cyclopean perception University of Chicago Press, Chicago
Julesz B, Miller JR (1975) Independent spatial-frequency-tuned channels in binocular fusion and rivalry. Perception 4:125–143
Julesz B, Schumer RA (1981) Early visual perception. Ann Rev Psychol 32:575–627
Kass M (1983) A computational framework for the visual correspondence problem. In: Proceedings IJCAI-8, Karlsruhe, FRG, pp 1043–1045
Krotkov EP (1986) Visual hyperacuity: representation and computation of high precision position information. Comput Vis Graphics Image Proc 33:99–115
Lawden MC (1983) An investigation of the ability of the human visual system to encode spatial phase relationships. Vision Res 23:1451–1463
Levinson E, Blake R (1979) Stereopsis by harmonic analysis. Vision Res 19:73–78
Lim HS, Binford TO (1987) Stereo correspondence: a hierarchical approach. In: Proceedings of the Image Understanding Workshop, Washington, DC, pp 234–241
MacVicar-Whelan PJ, Binford TO (1981) Line finding with subpixel precision. In: Proceedings of the Image Understanding Workshop, Washington, DC, pp 211–216
Maffei L, Fiorentini A (1973) The visual cortex as a spatial frequency analyzer. Vision Res 13:1255–1267
Marcelja S (1980) Mathematical description of the responses of simple cortical cells. J Opt Soc Am 70:1297–1300
Marr D, Poggio T (1979) A computational theory of human stereo vision. Proc R Soc Lond B 204:301–328
Marr D, Poggio T, Hildreth E (1979) The smallest channel in early human vision. J Opt Soc Am 70:868–870
Mayhew JEW, Frisby JP (1979) Convergent disparity discriminations in narrow-band-filtered random-dot stereograms. Vision Res 19:63–71
Mayhew JE, Frisby JP (1981) Psychophysical and computational studies towards a theory of human stereopsis. Artif. Intell 17:349–385
Moravec HP (1980) Obstacle avoidance and navigation in the real world by a seeing robot rover. Stanford Computer Science Dept. Report STANCS-880-813
Morgan MJ, Watt RJ (1982) Mechanisms of interpolation in human spatial vision. Nature 299:553–555
Mowforth P, Mayhew JEW, Frisby JP (1981) Vergence eye movements made in response to spatial-frequency filtered random-dot stereograms. Perception 10:299–304
Nishihara HK (1983) PRISM: a practical realtime imaging stereo matcher. In Rooks B (ed) Proceedings of the 3rd International Conference on Robotic Vision and Sensory Controls, Cambridge, Mass
Nishihara HK (1984) Prism: a practical real-time imaging stereo matcher. MIT AI Memo 780
Ohta Y, Kanade T (1985) Stereo by intra- and inter-scanline search using dynamic programming. IEEE PAMI 7:139–154
Oppenheim AV, Lim LS (1981) The importance of phase in signals. Proc IEEE 69:529–541
Panton DJ (1978) A flexible approach to digital stereo mapping. Photogramm Eng Remote Sensing 44:1499–1512
Poggio GF, Poggio T (1984) The analysis of stereopsis. Ann Rev Neurosci 7:379–412
Pollen DA, Ronner SF (1981) Phase relationships between adjacent simple cells in the visual cortex. Science 212:1409–1411
Pollen DA, Taylor JH (1971) How does the striate cortex begin the reconstruction of the visual world? Science 173:74–77
Robson JG (1975) Receptive fields: neural representation of the spatial and intensive atributes of the visual image. In: Carterette EC, Friedman MP (eds) Handbook of perception, vol 5, Academic Press, New York, pp 81–116
Schor C, Wood I, Ogawa J (1984) Binocular sensory fusion is limited by spatial resolution. Vision Res 24:661–665
Santen JPH van, Sperling G (1985) Elaborated Reichardt detectors. J Opt Soc Am A 2:300–321
Shapley R, Lennie P (1985) Spatial frequency analysis in the visual system. Ann Rev Neurosci 8:547–583
Sperling G (1970) Binocular vision: a physical and a neural theory. Am J Psychol 83:461–534
Sperling G, van Santen JPH (1984) Temporal covariance model of human motion perception. J Opt Soc Am A 1:451–473
Tyler CW (1973) Stereoscopic vision: cortical limitations and a disparity scaling effect. Science 181:276–278
Tyler CW, Sutter EE (1979) Depth from spatial frequency difference: an old kind of stereopsis? Vision Res 19:859–865
Verri A, Torre V (1986) Absolute depth estimate in stereopsis. J Opt Soc Am A 3:297–299
Watson AB, Ahumada AJ (1983) A look at motion in the frequency domain. NASA tech report 84352
Watson AB, Ahumada AJ (1985) Model of human visual-motion sensing. J Opt Soc Am A 2:322–341
Westheimer G (1979) Cooperative neural processes involved in stereoscopic acuity. Exp Brain Res 36:585–597
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sanger, T.D. Stereo disparity computation using Gabor filters. Biol. Cybern. 59, 405–418 (1988). https://doi.org/10.1007/BF00336114
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00336114