Abstract
We present a generic framework to track shapes across large variations by learning non-linear shape manifold as overlapping, piecewise linear subspaces. We use landmark based shape analysis to train a Gaussian mixture model over the aligned shapes and learn a Point Distribution Model(PDM) for each of the mixture components. The target shape is searched by first maximizing the mixture probability density for the local feature intensity profiles along the normal followed by constraining the global shape using the most probable PDM cluster. The feature shapes are robustly tracked across multiple frames by dynamically switching between the PDMs. Our contribution is to apply ASM to the task of tracking shapes involving wide aspect changes and generic movements. This is achieved by incorporating shape priors that are learned over non-linear shape space and using them to learn the plausible shape space. We demonstrate the results on tracking facial features and provide several empirical results to validate our approach. Our framework runs close to real time at 25 frames per second and can be extended to predict pose angles using Mixture of Experts.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Cootes, T.: An Introduction to Active Shape Models. Oxford University Press, Oxford (2000)
Sozou, P., Cootes, T., Taylor, C., Dimauro, E.: Non-linear point distribution modelling using a multi-layer perceptron. BMVC (1995)
Cootes, T., Taylor, C.: A mixture model for representing shape variation. BMVC (1997)
Murase, H., Nayar, S.: Learning and recognition of 3D Objects from appearance. IJCV (1995)
Gong, S., Ong, E.J., McKenna, S.: Learning to associate faces across views in vector space of similarities to prototypes. BMVC (1998)
Romdhani, S., Gong, S., Psarrou, A.: A Multi-View Nonlinear Active Shape Model Using Kernel PCA. BMVC (1999)
Zhou, Y., Zhang, W., Tang, X., Shum, H.: A Bayesian Mixture Model for Multi-view Face Alignment. CVPR (2005)
Cootes, T., Wheeler, G., Walker, K., Taylor, C.: View-Based Active Appearance Models. BMVC (2001)
Edwards, G.J., Taylor, C.J., Cootes, T.F.: Learning to Identify and Track Faces in Image Sequences. BMVC (1997)
Heap, T., Hogg, D.: Improving specificity in pdms using a hierarchical approach. BMVC (1997)
Bregler, C., Omohundro, S.: Surface Learning with Applications to Lipreading. NIPS (1994)
Goodall, C.: Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society (1991)
Tomasi, C., Kanade, T.: Detection and Tracking of Point Features. Technical Report CMU-CS-91-132 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kanaujia, A., Huang, Y., Metaxas, D. (2006). Tracking Facial Features Using Mixture of Point Distribution Models. In: Kalra, P.K., Peleg, S. (eds) Computer Vision, Graphics and Image Processing. Lecture Notes in Computer Science, vol 4338. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11949619_44
Download citation
DOI: https://doi.org/10.1007/11949619_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68301-8
Online ISBN: 978-3-540-68302-5
eBook Packages: Computer ScienceComputer Science (R0)