Abstract
Motion capture is a prevalent technique for capturing and analyzing human articulations. A common problem encountered in motion capture is that some marker positions are often missing due to occlusions or ambiguities. Most methods for completing missing markers may quickly become ineffective and produce unsatisfactory results when a significant portion of the markers are missing for extended periods of time. We propose a data-driven, piecewise linear modeling approach to missing marker estimation that is especially beneficial in this scenario. We model motion sequences of a training set with a hierarchy of low-dimensional local linear models characterized by the principal components. For a new sequence with missing markers, we use a pre-trained classifier to identify the most appropriate local linear model for each frame and then recover the missing markers by finding the least squares solutions based on the available marker positions and the principal components of the associated model. Our experimental results demonstrate that our method is efficient in recovering the full-body motion and is robust to heterogeneous motion data.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Barbič, J., Safonova, A., Pan, J., Faloutsos, C., Hodgins, J., Pollard, N.: Segmenting motion capture data into distinct behaviors. In: Graphics Interface 2004, pp. 185–194. Canadian Human-Computer Communications Society, London, ON, Canada (2004)
Bregler, C., Omohundro, S.: Nonlinear image interpolation using manifold learning. In: Advances in Neural Information Processing Systems 1995, pp. 43–50. The MIT Press, Boston, MA, USA (1995)
Breiman, L.: Random forest. Mach. Learn. 45(1), 5–32 (2001)
Chai, J., Hodgins, J.: Performance animation from low-dimensional control signals. ACM Trans. Graph. 24(3), 686–696 (2005)
Dorfmuller-Ulhaas, K.: Robust optical user motion tracking using a Kalman filter. In: 10th ACM Symposium on Virtual Reality Software and Technology, Osaka, Japan (2003)
Fukunaga, K., Olsen, D.: An algorithm for finding intrinsic dimensionality of data. IEEE Trans. Comput. C-20, 176–183 (1971)
Grochow, K., Martin, S.L., Hertzmann, A., Popovic, Z.: Style-based inverse kinematics. In: Proceedings of SIGGRAPH, pp. 522–531. ACM Press, New York, NY, USA (2004)
Guo, S., Roberg, J.: A high-level mechanism for human locomotion based on parametric frame space interpolation. In: Comput. Anim. Simul., pp. 95–107. Springer, New York, NY, USA (1996)
Herda, L., Fua, P., Plankers, R., Boulic, R., Thalmann, D. Skeleton-based motion capture for robust reconstruction of human motion. In: Comput. Anim., pp. 77–85. IEEE Computer Society, Washington, DC, USA (2000)
Hinton, G., Revow, M., Dayan, P.: Recognizing handwriting digits using mixtures of linear models. Adv. Neural Inform. Process. Syst. 7, 1015–1022 (1995)
Hornung, A., Sar-Dessai, S.: Self-calibrating optical motion tracking for articulated bodies. In: Proceedings of the 2005 IEEE Conference on Virtual Reality, pp. 75–82 (2005)
Lawrence, N.D.: Gaussian process latent variable models for visualization of high dimensional data. Adv. Neural Inform. Process. Syst. 16, 329–336 (2004)
Liu, G., Zhang, J., Wang, W., Mcmillan, L.: Human motion estimation from a reduced marker set. In: Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics (I3D), pp. 35–42 (2006)
Peak Performance Inc. http://www.peakperform.com
Press, W.M., Flannery, B.P., Teukolsky, S.A., Vetterling, W.T.: Numerical Recipes: The art of Scientific Computing. Cambridge University Press, NY (1986)
Rose, C., Cohen, M., Bodenheimer, B.: Verbs and adverbs: Multidimensional motion interpolation. IEEE Comput. Graph. Appl. 18(5), 32–40 (1998)
Roweis, S.: EM algorithms for PCA and SPCA. In: Proceedings of Neural Information Processing Systems, vol. 10, pp. 626–632. The MIT Press, Boston, MA (1998)
Safonova, A., Hodgins, J., Pollard, N.P.: Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. In: Proceedings of SIGGRAPH, pp. 514–521, ACM Press, New York, NY, USA (2004)
Tipping, M.E., Bishop, C.M.: Probabilistic principal component analysis. J. Roy. Statist. Soc. Series B 61(3), 611–622 (1999)
Vicon Motion System Ltd, http://www.vicon.com/
Welch, G., Bishop, G., Vicci, L., Brumback, S., Keller, K., Colucci, D.: The HiBall tracker: High-performance wide-area tracking for virtual and augmented environments. In: Symposium on Virtual Reality Software and Technology, pp. 1–10, London, UK (1999)
Wiley, D.J., Hahn, J.K.: Interpolation synthesis of articulated figure motion. IEEE Comput. Graph. Appl. 17(6), 39–45 (1997)
Author information
Authors and Affiliations
Corresponding author
Electronic Supplementary Material
Movie 1MB
Rights and permissions
About this article
Cite this article
Liu, G., McMillan, L. Estimation of missing markers in human motion capture. Visual Comput 22, 721–728 (2006). https://doi.org/10.1007/s00371-006-0080-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-006-0080-9