Abstract
In this work a combination of depth and silhouette information is presented to track the motion of a human from a single view. Depth data is acquired from a Photonic Mixer Device (PMD), which measures the time-of-flight of light. Correspondences between the silhouette of the projected model and the real image are established in a novel way, that can handle cluttered non-static backgrounds. Pose is estimated by Nonlinear Least Squares, which handles the underlying dynamics of the kinematic chain directly. Analytic Jacobians allow pose estimation with 5 FPS.
Acknowledgment: This work was partially funded by PACO-PLUS (IST-FP6-IP- 027657) and by German Science Foundation project DFG-3DPoseMap.
Chapter PDF
Similar content being viewed by others
References
Bray, M., Koller-Meier, E., Mueller, P., Van Gool, L., Schraudolph, N.N.: 3D Hand Tracking by Rapid Stochastic Gradient Descent Using a Skinning Model. In: CVMP, March 2004, IEE (2004)
Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: Proceeding IEEE CVPR, pp. 8–15 (1998)
Chong, E.K.P., Zak, S.H.: An Introduction to Optimization, 2nd edn. Wiley, Chichester (2001)
Mündermann, L., et al.: Validation Of A Markerless Motion Capture System For The Calculation Of Lower Extremity Kinematics. In: Proc. American Society of Biomechanics, Cleveland, USA (2005)
Goldenstein, S., Vogler, C., Metaxas, D.: Statistical Cue Integration in DAG Deformable Models. PAMI 25(7), 801–813 (2003)
Grest, D., Herzog, D., Koch, R.: Human Model Fitting from Monocular Posture Images. In: Proc. of VMV (November 2005)
Grest, D., Woetzel, J., Koch, R.: Nonlinear Body Pose Estimation from Depth Images. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds.) DAGM 2005. LNCS, vol. 3663, pp. 285–292. Springer, Heidelberg (2005)
Kakadiaris, I., Metaxas, D.: Model-Based Estimation of 3D Human Motion. IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI) 22(12) (2000)
Moeslund, T.B., Hilton, A., Krüger, V.: A Survey of Advances in Vision-Based Human Motion Capture Analysis. Journal of CVIU (2006)
Möller, T., Kraft, H., Frey, J., Albrecht, M., Lange, R.: Robust 3D Measurement with PMD Sensors. In: IEEE PacRim (2005)
Niskanen, M., Boyer, E., Horaud, R.: Articulated motion capture from 3-D points and normals. In: CVMP, London (2005)
Plänkers, R., Fua, P.: Model-Based Silhouette Extraction for Accurate People Tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 325–339. Springer, Heidelberg (2002)
Rosenhahn, B., Kersting, U.G., Smith, A.W., Gurney, J.K., Brox, T., Klette, R.: A System for Marker-Less Human Motion Estimation. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds.) DAGM 2005. LNCS, vol. 3663, pp. 230–237. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Grest, D., Krüger, V., Koch, R. (2007). Single View Motion Tracking by Depth and Silhouette Information. In: Ersbøll, B.K., Pedersen, K.S. (eds) Image Analysis. SCIA 2007. Lecture Notes in Computer Science, vol 4522. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73040-8_73
Download citation
DOI: https://doi.org/10.1007/978-3-540-73040-8_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73039-2
Online ISBN: 978-3-540-73040-8
eBook Packages: Computer ScienceComputer Science (R0)