Abstract
The research described in the present article was designed to identify the minimal conditions for the visual perception of 3-dimensional structure from motion by comparing the theoretical limitations of ideal observers with the perceptual performance of actual human subjects on a variety of psychophysical tasks. The research began with a mathematical analysis, which showed that 2-frame apparent motion sequences are theoretically sufficient to distinguish between rigid and nonrigid motion and to identify structural properties of an object that remain invariant under affine transformations, but that 3 or more distinct frames are theoretically necessary to adequately specify properties of euclidean structure such as the relative 3-dimensional lengths or angles between nonparallel line segments. A series of four experiments was then performed to verify the psychological validity of this analysis. The results demonstrated that the determination of structure from motion in actual human observers may be restricted to the use of first order temporal relations, which are available within 2-frame apparent motion sequences. That is to say, the accuracy of observers’ judgments did not improve in any of these experiments as the number of distinct frames in an apparent motion sequence was increased from 2 to 8, and performance on tasks involving affine structure was of an order of magnitude greater than performance on similar tasks involving euclidean structure.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bennett, B., Hoffman, D., Nicola, J., &Prakash, C. (1989). Structure from two orthographic views of rigid motion.Journal of the Optical Society of America,6, 1052–1069.
Biederman, I. (1987). Recognition-by-components: A theory of human image understanding.Psychological Review,94, 115–147
Braunstein, M. L. (1962). Depth perception in rotating dot patterns: Effects of numerosity and perspectiveJournal of Experimental Psychology,64, 415–420.
Braunstein, M.L.,&Andersen, G. J. (1984). Shape and depth perception from parallel projections of three-dimensional motion.Journal of Experimental Psychology: Human Perception A Performance,10, 749–760
Braunstein, M. L., Hoffman, D. D., &Poluck, F. E. (1990). Discriminating rigid from nonrigid motion: Minimum points and viewsPerception & Psychophysics,47, 205–214.
Braunstein, M. L., Hoffman, D. D., Shapiro, L. R., Andersen, G. J., &Bennett, B. M. (1987). Minimum points and views for the recovery of three-dimensional structure.Journal of Experimental Psychology: Human Perception & Performance,13, 335–343.
Braunstein, M. L., &Todd, J. T. (1990). On the distinction between artifacts and information.Journal of Experimental Psychology: Human Perception & Performance,16, 211–216.
Cutting, J. E. (1987). Rigidity in cinema seen from the front row, side aisleJournal of Experimental Psychology: Human Perception & Performance,13, 323–334.
Doner, J., Lappin, J. S., &Perfetto, G. (1984). Detection of threedimensional structure in moving optical patterns.Journal of Experimental Psychology: Human Perception & Performance,10, 1–11.
Dosher, B. A., Landy, M. S., &Sperling, G. (1989). Ratings of kinetic depth in multidot displays.Journal of Experimental Psychology: Human Perception & Performance,15, 816–825.
Dosher, B. A., Landy, M. S., &Sperling, G. (1990) Kinetic depth effect and optic flow—I. 3D shape from Fourier motion.Vision Research,29, 1789–1814.
Gottsdanker, R. M. (1952). The accuracy of predictiomotion.Journal of Experimental Psychology,43, 26–36.
Gottsdanker, R. M. (1955). A further study of prediction-motion.American Journal of Psychology,68, 432–437
Gottsdanker, R. M., Frick, J. W., &Lockard, R. B. (1961). Identifying the acceleration of visual targets.British Journal of Psychology,52, 3M2.
Green, B. F., Jr. (1961). Figure coherence in the kinetic depth effect.Journal of Experimental Psychology,62, 272–282.
Grzywacz, N., &Hildreth, E. (1987). Incremental rigidity scheme for recovering structure from motion: Position-based versus velocity-based formulations.Journal of the Optical Society of America A,4, 503–518.
Hildreth, E. C., Grzywacz, N. M., Adelson, E. H., &Inada, V. K. (1990). The perceptual buildup of three-dimensional structure from motion.Perception & Psychophysics,48, 19–36.
Hoffman, D. D., &Flinchbaugh, B. E. (1982). The interpretation of biological motion.Biological Cybernetics,42, 195–204.
Huang, T., &Lee, C. (1989). Motion and structure from orthographic projections.IEEE Transactions on Pattern Analysis &. Machine Intelligence,11, 536–540.
Koenderink, J. J., & Van Doorn, A. J. (in press). Affine structure from motion.Journal of the Optical Society of America A.
Lappin, J. S. (1990). Perceiving metric structure of environmental objects from motion, self-motion and stereopsis. In R. Warren and A. H. Wertheim (Eds.),The perception and control of self-motion (pp. 541–576). Hillsdale, NJ: Erlbaum.
Lappin, J. S., Doner, J. F., &Kottas, B. L. (1980). Minimal conditions for the visual detection of structure and motion in three dimensions.Science,209, 717–719.
Lappin, J. S., &Fuqua, M. A. (1983). Accurate visual measurement of three-dimensional moving patterns.Science,221, 480–482.
Longuet-Higgins, H. C. (1981). A computer algorithm for reconstructing a scene from two projections.Nature,293, 133–135.
Loomis, J. M., &Eby, D. W. (1988). Perceiving structure from motion: Failure of shape constancy. InProceedings from the second international conference on computer vision (pp. 383–391). Washington, DC: IEEE.
Loomis, J. M., &Eby, D. W. (1989). Relative motion parallax and the perception of structure from motion. InProceedings from the workshop on visual motion (pp. 204–211). Washington, DC: IEEE.
Petersik, J. T. (1979). Three-dimensional object constancy: Coherence of a simulated rotating sphere in noise.Perception & Psychophysics,25, 328–335.
Petersik, J. T. (1980). The effects of spatial and temporal factors on the perception of stroboscopic rotation simulations.Perception,9, 271–283.
Petersik, J. T. (1987). Recovery of structure from motion: Implications for a performance theory based on the structure-from-motion theorem.Perception & Psychophysics,42, 355–364.
Reichel, F. D., &Todd, J. T. (1990). Perceived depth inversion of smoothly curved surfaces due to image orientation.Journal of Experimental Psychology Human Perception & Performance,16, 653–664.
Sperling, G., Landy, M. S., Dosher, B. A., &Perkins, M. E. (1989). Kinetic depth effect and identification of shape.Journal of Experimental Psychology: Human Perception & Performance,15, 826–840.
Teghtsoonian, R. (1971). On the exponents of Stevens’ law and the constant in Ekman’s law.Psychological Review,78, 71–80.
Todd, J. (1981). Visual information about moving objects.Journal of Experimental Psychology: Human Perception & Performance,7, 795–810.
Todd, J. (1982). Visual information about rigid and nonrigid motion: A geometric analysis.Journal of Experimental Psychology: Human Perception & Performance,8, 238–252.
Todd, J. T. (1984). The perception of three-dimensional structure from rigid and nonrigid motion.Perception & Psychophysics,36, 97–103.
Todd, J. T. (1985). Perception of structure from motion: Is projective correspondence of moving elements a necessary condition?Journal of Experimental Psychology: Human Perception & Performance,11, 689–710.
Todd, J. T., Akerstrom, R. A., Reichel, F. D., &Hayes, W. (1988). Apparent rotation in three-dimensional space: Effects of temporal, spatial, and structural factors.Perception & Psychophysics,43, 179–188.
Todd, J. T., &Reichel, F. R. (1989). Ordinal structure in the visual perception and cognition of smoothly curved surfaces.Psychological Review,96, 643–657.
Ullman, S. (1977)The interpretation of visual motion. Unpublished doctoral dissertation, Massachusetts Institute of Technology.
Ullman, S. (1979).The interpretation of visual motion. Cambridge, MA: MIT Press.
Ullman, S. (1983). Recent computational studies m the interpretation of structure from motion. In J. Beck & A. Rosenfeld (Eds.)Human and machine vision (pp. 459–480). New York: Academic Press.
Ullman, S. (1984). Maximizing rigidity: The incremental recovery of 3-D structure from rigid and nonrigid motion.Perception,13, 255–274.
Wallach, H., &O’connell, D. N. (1953). The kinetic depth effect.Journal of Experimental Psychology,45, 205–217.
Author information
Authors and Affiliations
Additional information
This research was supported in part by Grant 89-0016 from the Air Force Office of Scientific Research and by Grant BNS-8908426 from the National Science Foundation, the Office of Naval Research and the Air Force Office of Scientific Research. The reported experiments were performed while Paola Bressan was a visiting researcher at the Boston University Center for AdapUve Systems.
Rights and permissions
About this article
Cite this article
Todd, J.T., Bressan, P. The perception of 3-dimensional affine structure from minimal apparent motion sequences. Perception & Psychophysics 48, 419–430 (1990). https://doi.org/10.3758/BF03211585
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03211585