Abstract
We describe a face modelling tool allowing image representation in a high-dimensional morph space, compression to a small number of coefficients using PCA [1], and expression transfer between face models by projection of the source morph description (a parameterisation of complex facial motion) into the target morph space. This technique allows creation of an identity-blended avatar model whose high degree of realism enables diverse applications in visual psychophysics, stimulus generation for perceptual experiments, animation and affective computing.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Jolliffe, I., MyiLibrary: Principal component analysis, vol. 2. Wiley Online Library (2002)
Haxby, J., Hoffman, E., Gobbini, M.: The distributed human neural system for face perception. Trends in Cognitive Sciences 4, 223–233 (2000)
Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., Nayar, S.: Face swapping: automatically replacing faces in photographs. ACM Transactions on Graphics (TOG) 27, 39 (2008)
Hasselmo, M., Rolls, E., Baylis, G.: The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural Brain Research 32, 203–218 (1989)
Parry, F., Young, A., Shona, J., Saul, M., Moss, A.: Dissociable face processing impairments after brain injury. Journal of Clinical and Experimental Neuropsychology 13, 545–558 (1991)
Calder, A., Burton, A., Miller, P., Young, A., Akamatsu, S.: A principal component analysis of facial expressions. Vision Research 41, 1179–1208 (2001)
Rosenblum, M., Yacoob, Y., Davis, L.: Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks 7, 1121–1138 (1996)
Essa, I., Pentland, A.: Facial expression recognition using a dynamic model and motion energy. In: Proceedings of the Fifth International Conference on Computer Vision, pp. 360–367. IEEE (1995)
Bassili, J.: Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance 4, 373 (1978)
Grossberg, S., Vladusich, T.: How do children learn to follow gaze, share joint attention, imitate their teachers, and use tools during social interactions? Neural Networks 23, 940–965 (2010)
Valentine, T.: Face-space models of face recognition. In: Computational, Geometric, and Process Perspectives on Facial Cognition: Contexts and Challenges, pp. 83–113 (2001)
Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1991, pp. 586–591. IEEE (1991)
Itti, L., Dhavale, N., Pighin, F.: Realistic avatar eye and head animation using a neurobiological model of visual attention. Technical report, DTIC Document (2003)
Rajan, V., Subramanian, S., Keenan, D., Johnson, A., Sandin, D., DeFanti, T.: A realistic video avatar system for networked virtual environments. In: Proceedings of IPT (2002)
Mori, M.: The uncanny valley. Energy 7, 33–35 (1970)
McOwan, P., Johnston, A.: The algorithms of natural vision: The multi-channel gradient model. In: First International Conference on Genetic Algorithms in Engineering Systems: Innovations and Applications, GALESIA (Conf. Publ. No. 414), pp. 319–324. IET (1995)
Anderson, K., McOwan, P.: Real-time Emotion Recognition Using Biologically Inspired Models. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 1056–1056. Springer, Heidelberg (2003)
Seeing Machines.: Faceapi product page (2012)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194. ACM Press/Addison-Wesley Publishing Co. (1999)
Brennan, S.: Caricature generator: The dynamic exaggeration of faces by computer. Leonardo 18, 170–178 (1985)
Rotshtein, P., Henson, R., Treves, A., Driver, J., Dolan, R.: Morphing marilyn into maggie dissociates physical and identity face representations in the brain. Nature Neuroscience 8, 107–113 (2004)
Galton, F.: Composite portraits, made by combining those of many different persons into a single resultant figure. The Journal of the Anthropological Institute of Great Britain and Ireland 8, 132–144 (1879)
Polesel, A., Ramponi, G., Mathews, V.: Image enhancement via adaptive unsharp masking. IEEE Transactions on Image Processing 9, 505–510 (2000)
Liu, Z., Shan, Y., Zhang, Z.: Expressive expression mapping with ratio images. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 271–276. ACM (2001)
Theobald, B., Matthews, I., Cohn, J., Boker, S.: Real-time expression cloning using appearance models. In: Proceedings of the 9th International Conference on Multimodal Interfaces, pp. 134–139. ACM (2007)
Cook, R., Johnston, A., Heyes, C.: Self-recognition of avatar motion: how do i know it’s me? Proceedings of the Royal Society B: Biological Sciences 279, 669–674 (2012)
Grammer, K., Thornhill, R.: Human (homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. Journal of Comparative Psychology 108, 233 (1994)
Müller, W., Spierling, U., Alexa, M., Rieger, T.: Face-to-face with your assistant. Realization issues of animated user interface agents for home appliances. Computers & Graphics 25, 593–600 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nagle, F., Griffin, H., Johnston, A., McOwan, P. (2013). Techniques for Mimicry and Identity Blending Using Morph Space PCA. In: Park, JI., Kim, J. (eds) Computer Vision - ACCV 2012 Workshops. ACCV 2012. Lecture Notes in Computer Science, vol 7729. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37484-5_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-37484-5_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37483-8
Online ISBN: 978-3-642-37484-5
eBook Packages: Computer ScienceComputer Science (R0)