Abstract
Smiling is an indispensable element of nonverbal social interaction. Besides, automatic distinction between spontaneous and posed expressions is important for visual analysis of social signals. Therefore, in this paper, we propose a method to distinguish between spontaneous and posed enjoyment smiles by using the dynamics of eyelid, cheek, and lip corner movements. The discriminative power of these movements, and the effect of different fusion levels are investigated on multiple databases. Our results improve the state-of-the-art. We also introduce the largest spontaneous/posed enjoyment smile database collected to date, and report new empirical and conceptual findings on smile dynamics. The collected database consists of 1240 samples of 400 subjects. Moreover, it has the unique property of having an age range from 8 to 76 years. Large scale experiments on the new database indicate that eyelid dynamics are highly relevant for smile classification, and there are age-related differences in smile dynamics.
Chapter PDF
Similar content being viewed by others
References
Ambadar, Z., Cohn, J.F., Reed, L.I.: All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. J. Nonverbal Behav. 33, 17–34 (2009)
Ekman, P.: Telling lies: Cues to deceit in the marketplace, politics, and marriage. WW. Norton & Company, New York (1992)
Ekman, P., Hager, J.C., Friesen, W.V.: The symmetry of emotional and deliberate facial actions. Psychophysiology 18, 101–106 (1981)
Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. J. Nonverbal Behav. 6, 238–252 (1982)
Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. Journal of Wavelets, Multiresolution and Information Processing 2, 121–132 (2004)
Ekman, P., Friesen, W.V.: The Facial Action Coding System: A technique for the measurement of facial movement. Consulting Psychologists Press Inc., San Francisco (1978)
Schmidt, K.L., Bhattacharya, S., Denlinger, R.: Comparison of deliberate and spontaneous facial movement in smiles and eyebrow raises. J. Nonverbal Behav. 33, 35–45 (2009)
Krumhuber, E.G., Manstead, A.S.R.: Can Duchenne smiles be feigned? New evidence on felt and false smiles. Emotion 9, 807–820 (2009)
Manera, V., Giudice, M.D., Grandi, E., Colle, L.: Individual differences in the recognition of enjoyment smiles: No role for perceptual–attentional factors and autistic-like traits. Frontiers in Psychology 2 (2011)
Cohn, J.F., Reed, L.I., Moriyama, T., Xiao, J., Schmidt, K.L., Ambadar, Z.: Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles. In: IEEE AFGR, pp. 129–135 (2004)
Valstar, M.F., Pantic, M.: How to distinguish posed from spontaneous smiles using geometric features. In: ACM ICMI, pp. 38–45 (2007)
Pfister, T., Li, X., Zhao, G., Pietikainen, M.: Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework. In: ICCV Workshops, pp. 868–875 (2011)
Dibeklioğlu, H., Valenti, R., Salah, A.A., Gevers, T.: Eyes do not lie: Spontaneous versus posed smiles. ACM Multimedia, 703–706 (2010)
Tao, H., Huang, T.: Explanation-based facial motion tracking using a piecewise Bézier volume deformation model. In: CVPR, pp. 611–617 (1999)
Schmidt, K.L., Cohn, J.F., Tian, Y.: Signal characteristics of spontaneous facial expressions: Automatic movement in solitary and social smiles. Biological Psychology 65, 49–66 (2003)
Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. on PAMI 27, 1226–1238 (2005)
Valstar, M.F., Pantic, M.: Induced disgust, happiness and surprise: An addition to the MMI facial expression database. In: LREC, Workshop on EMOTION, pp. 65–70 (2010)
Wang, S., Liu, Z., Lv, S., Lv, Y., Wu, G., Peng, P., Chen, F., Wang, X.: A natural visible and infrared facial expression database for expression recognition and emotion inference. IEEE Trans. on Multimedia 12, 682–691 (2010)
Dibeklioğlu, H., Salah, A.A., Gevers, T.: A statistical method for 2-d facial landmarking. IEEE Trans. on Image Processing 21, 844–858 (2012)
Schmidt, L.K., Ambadar, Z., Cohn, J.F., Reed, L.I.: Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. J. Nonverbal Behav. 30, 37–52 (2006)
Dibeklioğlu, H., Gevers, T., Salah, A.A., Valenti, R.: A smile can reveal your age: Enabling facial dynamics in age estimation. ACM Multimedia (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dibeklioğlu, H., Salah, A.A., Gevers, T. (2012). Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7574. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33712-3_38
Download citation
DOI: https://doi.org/10.1007/978-3-642-33712-3_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33711-6
Online ISBN: 978-3-642-33712-3
eBook Packages: Computer ScienceComputer Science (R0)