Abstract
The paper presents an online search system built for the “Russian Pear Chats & Stories” corpus (RUPEX). RUPEX is a collection of communication sessions used for studying multichannel discourse. It aims at discovering how interlocutors use verbal, prosodic, oculomotor, manual gesticulation and other channels as they take part in natural monologic and dialogic communication. The sessions were recorded with microphones, video cameras, and eye trackers, and an integrated multichannel annotation scheme was implemented to them. The search system operates on these data and provides an intuitive graphic user interface that offers the following options: creating simple and complex queries, viewing search results in a multi-layered annotation format associated with video fragments, specifying search domain. To illustrate this functionality, we discuss search queries relevant to a specific multichannel research, that of dialogic elicitations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
British National Corpus. https://www.natcorp.ox.ac.uk/, Accessed 01 Nov 2020
Český národní korpus. https://www.korpus.cz/, Accessed 01 Nov 2020
Russian National Corpus, Haциoнaльный кopпyc pyccкoгo языкa. https://ruscorpora.ru/new/, Accessed 01 Nov 2020
Sketch Engine, https://www.sketchengine.eu/, Accessed 01 Nov 2020
Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., Tessendorf, S. (eds.): Body – Language – Communication: An international handbook on multimodality in human interaction. De Gruyter Mouton, Berlin (2013). https://doi.org/10.1515/9783110261318
Vigliocco, G., Perniss, P., Vinson, D.: Language as a multimodal phenomenon: implications for language learning, processing and evolution. Phil. Trans. Roy. Soc. B. Biol. Sci. 369(1651), 20130292 (2014). https://doi.org/10.1098/rstb.2013.0292
Kibrik, A.A.: Russian multichannel discourse. Part I. Setting up the problem, Pyccкиймyльтикaнaльный диcкypc. Чacть I. Пocтaнoвкa пpoблeмы. Psychol. J. 39, 70–80 (2018). https://doi.org/10.7868/S0205959218010075
Adolphs, S., Carter, R.: Spoken Corpus Linguistics : From Monomodal to Multimodal. Routledge, Abingdon (2013). https://doi.org/10.4324/9780203526149
Carletta, J.: Announcing the AMI meeting corpus. ELRA Newsl. 11(1), 3–5 (2006). https://groups.inf.ed.ac.uk/ami/corpus/overview.shtml
Kotov, A.A., Budyanskaya, E.M.: The Russian emotional corpus: communication in natural emotional situations. In: Computational Linguistics and Intellectual Technologies: Proceedings of the International Conference “Dialogue 2012”, vol. 11, pp. 296–306 (2012)
Joo, J., Steen, F.F., Turner, M.: Red hen lab: dataset and tools for multimodal human communication research. Künstl Intell. 31, 357–361 (2017). https://doi.org/10.1007/s13218-017-0505-9
Russian Multichannel Discourse, Pyccкий мyльтикaнaльный диcкypc, https://multidiscourse.ru/main/, Accessed 01 Nov 2020
Fedorova, O.V., Kibrik, A.A.: The MCD handbook: A practical guide to annotating multichannel discourse. Institute of Linguistics RAS (to appear)
Chafe, W. (ed.): The Pear Stories: COGNITIVE, Cultural, and Linguistic Aspects of Narrative Production. Ablex, Norwood (1980)
Kibrik, A.A., Fedorova, O.V.: An empirical study of multichannel communication: Russian Pear Chats and Stories. Psychol. J. High. School Econ. 15, 191–200 (2018). https://doi.org/10.17323/1813-8918-2018-2-191-200
ELAN [Computer software]. Max Planck Institute for Psycholinguistics, The Language Archive, Nijmegen (2020). https://archive.mpi.nl/tla/elan
Kibrik, A.A., Korotaev, N.A., Fedorova, O.V., Evdokimova, A.A.: Unified multichannel annotation: A tool for analysing natural communication, Eдинaя мyльтикaнaльнaя aннoтaция кaк инcтpyмeнт aнaлизa ecтecтвeннoй кoммyникaции. In: Computational Linguistics and Intellectual Technologies: Proceedings of the International Conference “Dialogue”, vol. 18, pp. 265–280 (2019)
Kibrik, A.A., Korotaev, N.A., Podlesskaya, V.I.: Russian spoken discourse: local structure and prosody. In: Izre’el, S., Mello, H., Panunzi, A., Raso, T. (eds.) In Search of Basic Units of Spoken Language: A Corpus-Driven Approach, pp. 37–76. John Benjamins, Amsterdam (2020). https://doi.org/10.1075/scl.94.01kib
Chafe, W.: Discourse, Consciousness, and Time: The Flow and Displacement of Conscious Experience in Speaking and Writing. The University of Chicago Press, Chicago (1994)
Korotaev, N.A.: Questions and semi-statements in multichannel discourse, Boпpoc и пoлyyтвepждeниe в cтpyктype мyльтикaнaльнoгo диcкypca. In: The Eighth International Conference on Cognitive Science. Abstracts. pp. 1311–1313. Institute of Psychology RAS, Svetlogorsk (2018)
Kendon, A.: Some functions of gaze-direction in social interaction. Acta Physiol. 26, 22–63 (1967). https://doi.org/10.1016/0001-6918(67)90005-4
McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. The University of Chicago Press, Chicago (1992)
Seyfeddinipur, M.: Disfluency: INTERRUPTING Speech and Gesture. Radboud Universiteit Nijmegen, Nijmegen (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Korotaev, N.A., Dobrov, G.B., Khitrov, A.N. (2021). RUPEX Search: Online Tool for Analyzing Multichannel Discourse. In: Velichkovsky, B.M., Balaban, P.M., Ushakov, V.L. (eds) Advances in Cognitive Research, Artificial Intelligence and Neuroinformatics. Intercognsci 2020. Advances in Intelligent Systems and Computing, vol 1358. Springer, Cham. https://doi.org/10.1007/978-3-030-71637-0_44
Download citation
DOI: https://doi.org/10.1007/978-3-030-71637-0_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-71636-3
Online ISBN: 978-3-030-71637-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)