Abstract
A new approach to determine motion from multiple images of a sequence is presented. Motion is regarded as orientation in a three-dimensional space with one time and two space coordinates. The algorithm is analogous to an eigenvalue analysis of the inertia tensor. Besides the determination of the displacement vector field it allows the classification of four regions with regard to motion: a) constant regions, where no velocity determination is possible; b) edges, where the velocity component perpendicular to the edge is determined; c) corners, where both components of the velocity vector are calculated; d) motion discontinuities, which are used to mark the boundaries between objects moving with different velocities.
The accuracy of the new algorithm has been tested with artificially generated image sequences with known velocity vector fields. An iterative refinement technique yields more accurate results than the usage of higher order approximations to the first spatial and temporal derivatives. Temporal smoothing significantly improves the velocity estimates in noisy images. Displacements between consecutive images can be computed with an accuracy well below 0.1 pixel distances.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
E. H. Adelson, J. R. Bergen, Spatio-temporal energy models for the perception of motion, J. Opt. Soc. America, A2, 284–299 (1985).
J. Bigün, G. H. Granlund, Optimal orientation detection of linear symmetry, In Proc. Int. Conference Computer Vision, London 1987,, ed., pp. 433–438, IEEE Computer Society Press, Washington (1987).
P. J. Burt, E. H. Adelson, The Laplacian pyramid as a compact image code, IEEE Trans. Comm., 31, 532–540 (1983).
D. J. Fleet, A. D. Jepson, Hierarchical construction of orientation and velocity selective filters, IEEE Trans. Pattern Analysis and Machine Intelligence, 11, 315–325 (1989).
H. Goldstein, Klassische Mechanik, Aula, Wiesbaden (1985).
D. J. Heeger, Optical flow using spatiotemporal filters, Int. J. Comp. Vision, 1, 279–302 (1988).
B. Jähne, Digitale Bildverarbeitung, Springer, Berlin, Heidelberg (1989).
B. Jähne, Energy balance in small-scale waves — an experimental approach using optical slope measuring technique and image processing, In Radar scattering from modulated wind waves, G. Komen, W. Oost, eds., pp. 105–120, Reidel, Dordrecht (1989).
B. Jähne, Image sequence analysis in environmental physics: water surface waves and air-sea gas exchange (in German), In Mustererkennung 1986, Proc. 8. DAGM-Symposium, Paderborn, G. Hartmann, ed., pp. 201–205, Springer, Berlin (1986).
B. Jähne, Image sequence analysis of complex physical objects: nonlinear small scale water surface waves, In Proc. Int. Conference Computer Vision, London 1987, pp. 191–200, IEEE Computer Society Press, Washington (1987).
B. Jähne, Motion determination in Space-Time Images, In Image Processing III, Conf. Proceedings 1135, SPIE, Washington (1989 in press).
B. Jähne, S. Waas, Optical measuring technique for small scale water surface waves, In Advanced Optical Instrumentation for Remote Sensing of the Earth's Surface, Conf. Proceedings 1129, SPIE, Washington (1989 in press).
J. K. Kearney, W. B. Thompson, D. L. Boley, Optical flow estimation: an error analysis of gradient based methods with local optimization, IEEE Trans. Pattern Analysis and Machine Intelligence, 9, 229–244 (1987).
H. Knutsson, Filtering and reconstruction in image processing, Dissertation, Linköping University (1982).
R. Lenz, Zur Genauigkeit der Videometrie mit CCD-Sensoren, In Mustererkennung 1988, Proc. 10. DAGM-Symposium, Zürich, pp. 179–189, Springer, Berlin (1988).
H. Nagel, Analyse und Interpretation von Bildfolgen I, Informatik Spektrum, 8, 178–200 (1985).
H. Nagel, Analyse und Interpretation von Bildfolgen II, Informatik Spektrum, 8, 312–327 (1985).
H. Nagel, Image sequences — ten (octal) years — from phenomenology towards a theoretical foundation, In Proc. Int. Conf. Pattern Recognition, Paris 1986,, ed., pp. 1174–1185, IEEE Computer Soc. Press, Washington (1986).
H. Nagel, On the constraint equation for the estimation of displacement rates in image sequences, IEEE Trans. Pattern Analysis and Machine Intelligence, 11, 13–30 (1989).
E. van Halsema, B. Jähne, W. A. Oost, C. Calkoen, P. Snoeij, First results of the VIERS-1 experiment, In Radar scattering from modulated wind waves, G. Komen, W. Oost, eds., p., Reidel, Dordrecht (1989).
A. Verri, T. Poggio, Motion field and optical flow: qualitative properties, IEEE Trans. Pattern Analysis and Machine Intelligence, 11, 490–498 (1989).
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1990 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jähne, B. (1990). Motion determination in space-time images. In: Faugeras, O. (eds) Computer Vision — ECCV 90. ECCV 1990. Lecture Notes in Computer Science, vol 427. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0014862
Download citation
DOI: https://doi.org/10.1007/BFb0014862
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-52522-6
Online ISBN: 978-3-540-47011-3
eBook Packages: Springer Book Archive