Abstract
This study explores the empirical basis for multimodal conversation control acts. Applying conversation analysis as an exploratory approach, we attempt to illuminate the control functions of paralinguistic behaviors in managing multiparty conversation. We contrast our multiparty analysis with an earlier dyadic analysis and, to the extent permitted by our small samples of the corpus, contrast (a) conversations where the conversants did or did not have an artifact, and (b) conversations in English among Americans with conversations in Spanish among Mexicans. Our analysis suggests that speakers tend not to use gaze shifts to cue nodding for grounding and that the presence of an artifact reduced listeners’ gaze at the speaker. These observations remained relatively consistent across the two languages.
Chapter PDF
Similar content being viewed by others
References
Nakano, Y.I., Reinstein, G., Stocky, T., Cassell, J.: Towards a model of face-to-face grounding. In: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, vol. 1, pp. 553–561 (2003)
Bavelas, J.B., Coates, L., Johnson, T.: Listener Responses as a Collaborative Process: The Role of Gaze. Journal of Communication 52, 566–580 (2002)
Branigan, H.: Perspectives on Multi-party Dialogue, Research on Language and Computation, vol. 4, pp. 153–177 (2006)
Traum, D.: Issues in multiparty dialogues, Advances in agent communication, pp. 201–211. Springer (2004)
Novick, D.: Paralinguistic behaviors in dialog as a continuous process. In: Proceedings of the Interdisciplinary Workshop on Feedback Behaviors in Dialog, Stevenson, Washington, September 7-8, pp. 54–57 (2012)
Otsuka, K., Takemae, Y., Yamato, J.: A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances. In: Proceedings of the 7th International Conference on Multimodal Interfaces, pp. 191–198 (October 2005)
Takemae, Y., Otsuka, K., Mukawa, N.: Impact of video editing based on participants’ gaze in multiparty conversation. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems, pp. 1333–1336 (2004)
Battersby, S.A.: Moving together: The organisation of non-verbal cues during multiparty conversation. Doctoral dissertation. University of London, Queen Mary (2011)
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, London (1976)
Gu, E., Badler, N.: Visual attention and eye gaze during multiparty conversations with distractions, Intelligent Virtual Agents, pp. 193–204. Springer (2006)
Shriberg, E., Stolcke, A., Baron, D.: Observations on overlap: Findings and implications for automatic processing of multi-party conversation. Proc. Eurospeech 2, 1359–1362 (2001)
Aoki, P.M., Szymanski, M.H., Plurkowski, L., Thornton, J.D., Woodruff, A., Yi, W.: Where’s the party in multi-party?: Analyzing the structure of small-group sociable talk. In: Proceedings of the 2006 20th Anniversary Conference on Computer-Supported Cooperative Work, pp. 393–402 (2006)
Herrera, D., Novick, D., Jan, D., Traum, D.: Dialog behaviors across culture and group size. In: Stephanidis, C. (ed.) Universal Access in HCI, Part II, HCII 2011. LNCS, vol. 6766, pp. 450–459. Springer, Heidelberg (2011)
Herrera, D., Novick, D., Jan, D., Traum, D.: The UTEP-ICT Cross-Cultural Multiparty Multimodal Dialog Corpus. In: Multimodal Corpora Workshop: Advances in Capturing, Coding and Analyzing Multimodality (MMC 2010), Valletta, Malta (2010)
Tacchetti, M.: ELAN User Guide, version 4.1.0 (2011), http://www.mpi.nl/corpus/html/elan_ug/index.html
Clark, H.H., Schaefer, E.F.: Contributing to discourse. Cognitive science 13(2), 259–294 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Novick, D., Gris, I. (2013). Grounding and Turn-Taking in Multimodal Multiparty Conversation. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Modalities and Techniques. HCI 2013. Lecture Notes in Computer Science, vol 8007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39330-3_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-39330-3_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39329-7
Online ISBN: 978-3-642-39330-3
eBook Packages: Computer ScienceComputer Science (R0)