Abstract
In the field of biology, the study of bonding has been renewed by the discovery of non genetic transmission of behavioural traits through early mother-infant interaction and the role of stress hormones and ocytocin. However, the study of early interaction is complex and Social Signal Processing (SSP) can help in addressing some issues. Based on works from our group, we will show data from diverse sources (e.g. experiments, home movies) showing how SSP was used to address synchrony between partners (e.g. infant, child, care giver, agent) and characteristics that participates to interpersonal exchanges (e.g. motherese, emotional prosody or faces).
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Altmann, U.: Studying movement synchrony using time series and regression models. In: Esposito, I.A., Hoffmann, R., Hübler, S., Wrann, B. (eds.) Program and Abstracts of the COST 2102 Final Conference Held in Conjunction with the 4th COST 2102 International Training School on Cognitive Behavioural Systems, p. 23 (2011)
Ashenfelter, K.T., Boker, S.M., Waddell, J.R., Vitanov, N.: Spatiotemporal symmetry and multifractal structure of head movements during dyadic conversation. J. Exp. Psychol. Hum. Percept. Perform. 35(4), 1072–1091 (2009)
Bernieri, F.J., Reznick, J.S., Rosenthal, R.: Synchrony, pseudo synchrony, and dissynchrony: Measuring the entrainment process in mother-infant interactions. Journal of Personality and Social Psychology 54(2), 243–253 (1988)
Boucenna, S., Gaussier, P., Andry, P.: What should be taught first: the emotional expression or the face? In: epirob (2008)
Boucenna, S., Gaussier, P., Hafemeister, L., Bard, K.: Towards a new social referencing paradigm. In: epirob 2009, pp. 201–202 (2009)
Cappella, J.N.: Behavioral and judged coordination in adult informal social interactions: vocal and kinesic indicators. Pers. Soc. Psychol. 72, 119–131 (1997)
Cassel, R.S., Saint-Georges, C., Mahdhaoui, A., Chetouani, M., Laznik, M.-C., Muratori, F., Adrien, J.-L., Cohen, D.: Course of maternal prosodic incitation (motherese) during early development in autism: an exploratory home movie study. Interaction Studies (in Press)
Champagne, F., Diorio, J., Sharma, S., Meaney, M.J.: Naturally occurring variations in maternal behavior in the rat are associated with differences in estrogen-inducible central oxytocin receptors. Proceedings of the National Academy of Sciences of the United States of America 98, 12736–12741 (2001)
Delaherche, E., Chetouani, M.: Multimodal coordination: exploring relevant features and measures. In: Second International Workshop on Social Signal Processing. ACM Multimedia (2010)
Delaherche, E., Chetouani, M., Bigouret, F., Xavier, J., Plaza, M., Cohen, D.: Assessment of communicative and coordination skills of children with pervasive developmental disorders and typically developing children (submitted, 2012)
Delaherche, E., Chetouani, M., Mahdhaoui, M., Saint-Georges, C., Viaux, S., Cohen, D.: Interpersonal synchrony: A survey of evaluation methods across disciplines. IEEE Transactions on Affective Computing (to appear, 2012)
Denenberg, V.H., Whimby, A.E.: Behavior of adult rats is modified by the experiences their mothers had as infants. Science 142, 1192–1193 (1963)
Falk, D.: Prelinguistic evolution in early hominins: whence motherese? Behavioral and Brain Sciences 27(4), 491–503 (2004)
Feldman, R.: Infant-mother and infant-father synchrony: the coregulation of positive arousal. Infant Mental Health Journal 24(1), 1–23 (2003)
Feldman, R.: Parent-infant synchrony and the construction of shared timing; physiological precursors, developmental outcomes, and risk conditions. The Journal of Child Psychology and Psychiatry and Allied Disciplines 48(3-4), 329–354 (2007)
Francis, D., Diorio, J., Liu, D., Meaney, M.J.: Nongenomic transmission across generations of maternal behavior and stress responses in the rat. Science 286, 1155–1158 (1999)
Gaussier, P.: Toward a cognitive system algebra: A perception/action perspective. In: European Workshop on Learning Robots (EWRL), pp. 88–100 (2001)
Goldstein, M.H., King, A.P., West, M.J.: Social interaction shapes babbling: Testing parallels between birdsong and speech. Proceedings of the National Academy of Sciences of the United States of America 100(13), 8030–8035 (2003)
Harrist, A.W., Waugh, R.M.: Dyadic synchrony: Its structure and function in children‘s development. Developmental Review 22(4), 555–592 (2002)
Cappella, J.: Coding Mutual Adaptation in Dyadic Nonverbal Interaction, pp. 383–392. Lawrence Erlbaum (2005)
Kozima, H., Michalowski, M., Nakagawa, C.: Keepon. International Journal of Social Robotics 1, 3–18 (2009)
Kuhl, P.K.: Early language acquisition: cracking the speech code. Nat. Rev. Neurosci. 5(11), 831–843 (2004)
Liu, D., Diorio, J., Tannenbaum, B., Caldji, C., Francis, D., Freedman, A., Sharma, S., Pearson, D., Plotsky, P.M., Meaney, M.J.: Maternal care, hippocampal glucocorticoid receptors, and hypothalamic-pituitary-adrenal responses to stress. Science 277, 1659–1662 (1997)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 2, 91–110 (2004)
Mahdhaoui, A., Chetouani, M., Cassel, R.S., Saint-Georges, C., Parlato, E., Laznik, M.C., Apicella, F., Muratori, F., Maestro, S., Cohen, D.: Computerized home video detection for motherese may help to study impaired interaction between infants who become autistic and their parents. International Journal of Methods in Psychiatric Research (2011)
Marcelli, D., Cohen, D.: Enfance et psychopathologie. Masson (2012)
Mataruna, H.R., Varela, F.J.: Autopoiesis and Cognition: the realization of the living. Reidel, Dordrecht (1980)
Meltzoff, A.N., Kuhl, P.K., Movellan, J., Sejnowski, T.J.: Foundations for a new science of learning. Science 325(5938), 284–288 (2009)
Messinger, D.M., Ruvolo, P., Ekas, N.V., Fogel, A.: Applying machine learning to infant interaction: The development is in the details. Neural Networks 23(8-9), 1004 (2010); Social Cognition: From Babies to Robots
Morency, L.-P., de Kok, I., Gratch, J.: Predicting Listener Backchannels: A Probabilistic Multimodal Approach. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 176–190. Springer, Heidelberg (2008)
Oullier, O., de Guzman, G.C., Jantzen, K.J., Scott Kelso, J.A., Lagarde, J.: Social coordination dynamics: Measuring human bonding. Social Neuroscience 3(2), 178–192 (2008)
Ozkan, D., Sagae, K., Morency, L.-P.: Latent mixture of discriminative experts for multimodal prediction modeling. Computational Linguistics, 860–868 (August 2010)
Prepin, K., Pelachaud, C.: Shared understanding and synchrony emergence: Synchrony as an indice of the exchange of meaning between dialog partners. In: ICAART 2011 International Conference on Agent and Artificial Intelligence, vol. 2, pp. 25–30 (January 2011)
Ramseyer, F., Tschacher, W.: Nonverbal synchrony in psychotherapy: Coordinated body movement reflects relationship quality and outcome. Journal of Consulting and Clinical Psychology 79(3), 284–295 (2011)
Richardson, D., Dale, R., Shockley, K.: Synchrony and swing in conversation: Coordination, temporal dynamics, and communication. Oxford University Press (2008)
Richardson, D.C., Dale, R.: Looking to understand: The coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cognitive Science 29(6), 1045–1060 (2005)
Richardson, M.J., Marsh, K.L., Isenhower, R.W., Goodman, J.R.L., Schmidt, R.C.: Rocking together: Dynamics of intentional and unintentional interpersonal coordination. Human Movement Science 26(6), 867–891 (2007)
Saint-Georges, C., Mahdhaoui, A., Chetouani, M., Cassel, R.S., Laznik, M.-C., Apicella, F., Muratori, P., Maestro, S., Muratori, F., Cohen, D.: Do parents recognize autistic deviant behavior long before diagnosis? Taking into account interaction using computational methods. PLoS ONE 6(7), e22393 (2011)
Shockley, K., Santana, M.-V., Fowler, C.A.: Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance (29) (2003)
Sun, X., Truong, K., Nijholt, A., Pantic, M.: Automatic visual mimicry expression analysis in interpersonal interaction. In: Proceedings of IEEE Int’l Conf. Computer Vision and Pattern Recognition (CVPR-W 2011), Workshop on CVPR for Human Behaviour Analysis, Colorado Springs, USA, pp. 40–46 (2011)
Thorisson, K.R.: Natural Turn-Taking Needs No Manual: Computational Theory And Model, From Perception to Action, pp. 173–207. Kluwer Acedemic Publishers, Dordrecht (2002)
Varni, G., Volpe, G., Camurri, A.: A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media. IEEE Transactions on Multimedia 12(6), 576–590 (2010)
Ward, N.G., Fuentes, O., Vega, A.: Dialog prediction for a general model of turn-taking. In: INTERSPEECH, pp. 2662–2665 (2010)
Weaver, I.C., Cervoni, N., Champagne, F.A., D’Alessio, A.C., Sharma, S., Seckl, J.R., Dymov, S., Szyf, M., Meaney, M.J.: Epigenetic programming by maternal behavior. Nat. Neuroscience 7, 847–854 (2004)
Widrow, B., Hoff, M.E.: Adaptive switching circuits. In: IRE WESCON, New York, pp. 96–104 (1960); Convention Record
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Delaherche, E., Boucenna, S., Chetouani, M., Cohen, D. (2013). How Social Signal Processing (SSP) Can Help Assessment of Bonding Phenomena in Developmental Psychology?. In: Apolloni, B., Bassis, S., Esposito, A., Morabito, F. (eds) Neural Nets and Surroundings. Smart Innovation, Systems and Technologies, vol 19. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35467-0_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-35467-0_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35466-3
Online ISBN: 978-3-642-35467-0
eBook Packages: EngineeringEngineering (R0)