Abstract
Previous research has found that iconic gestures (i.e., gestures that depict the actions, motions or shapes of entities) identify referents that are also lexically specified in the co-occurring speech produced by proficient speakers. This study examines whether concrete deictic gestures (i.e., gestures that point to physical entities) bear a different kind of relation to speech, and whether this relation is influenced by the language proficiency of the speakers. Two groups of speakers who had different levels of English proficiency were asked to retell a story in English. Their speech and gestures were transcribed and coded. Our findings showed that proficient speakers produced concrete deictic gestures for referents that were not specified in speech, and iconic gestures for referents that were specified in speech, suggesting that these two types of gestures bear different kinds of semantic relations with speech. In contrast, less proficient speakers produced concrete deictic gestures and iconic gestures whether or not referents were lexically specified in speech. Thus, both type of gesture and proficiency of speaker need to be considered when accounting for how gesture and speech are used in a narrative context.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Ariel M. (1990) Accessing noun phrase antecedents. Routledge, London
Arnold J. E., Eisenband J., Brown-Schmidt S., Trueswell J. C. (2000) The rapid use of gender information: Evidence of the time course of pronoun resolution from eyetracking. Cognition 76: B13–B26
Bangerter A. (2004) Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science 15(6): 415–419
Bloom P. (1990) Subjectless sentences in child’s language. Linguistic Inquiry 24: 721–734
Bosch P. (1983) Agreement and anaphora: A study of the roles of pronouns in discourse and syntax. Academic Press, London
Carroll M., Jorge M.-S., Marzena W., Alessandra B. (2000) The relevance of information organization to second language acquisition studies: The descriptive discourse of advanced adult learners of German. Studies in Second Language Acquisition 22(3): 441–466
Chafe W. L. (1987) Cognitive constraints on information flow.Tomlin R. (Ed.), Coherence and grounding in discourse. Amsterdam. John Benjamins
Chafe W. L. (1994) Discourse, consciousness, and time: The flow and displacement of conscious experience in speaking and writing. The University of Chicago Press, Chicago
de Ruiter J. P. (2006) Can gesticulation help aphasic people speak, or rather, communicate?. Advances in Speech-Language Pathology 8(2): 124–127
Dixon L. Q. (2005) Bilingual education policy in Singapore: An analysis of its sociohistorical roots and current academic outcomes. International Journal of Bilingual Education and Bilingualism 8(1): 25–47
Du Bois J. (1980) Beyond definiteness: The trace of identity in discourse. In: Chafe W. (eds) The pear stories: Cognitive, cultural and linguistic aspects of narrative production. Ablex, Norwood, pp 203–274
Francik E. P. (1985) Referential choice and focus of attention in narratives (discourse anaphora, topic continuity, language production). Dissertation Abstracts International 46(4): 1363
Fox B. (1987) Discourse structure and anaphora. Cambridge University Press, Cambridge
Garrod S. (2001) Anaphora resolution. In: Smelser N. J., Baltes P. B. (eds) International encyclopedia of the social and behavior sciences. Elsevier, Amsterdam, pp 490–494
Givon T. (1984) Universals of discourse structure and second language acquisition. In: Rutherford W. E. (eds) Language universals and second language acquisition. Benjamins, Amsterdam, pp 109–136
Givon T. (1985) Iconicity, isomorphism and non-arbitrary coding in syntax. In: Haiman J. (eds) Iconicity in syntax. Benjamins, Amsterdam, pp 187–219
Goldin-Meadow S., Butcher C. (2003) Pointing toward two-word speech in young children. In: Kita S. (eds) Pointing: Where language, culture, and cognition meet. Earlbaum Associates, Mahwah, pp 85–107
Grice H. P. (1975) Logic and conversation. In: Cole P., Morgan J. (eds) Syntax and semantics, Vol. 3. Academic Press, New York, pp 41–58
Gullberg M. (1998) Gesture as a communication strategy in second language discourse: A study of learners of French and Swedish. Lund University Press, Lund
Gullberg, M. (1999). Communication strategies, gestures, and grammar. Paper presented at the 8th EUROSLA Conference Paris.
Gullberg M. (2003) Gestures, referents, and anaphoric linkage in learner varieties. In: Dimroth C., Starren M. (eds) Information structure, linguistic structure and dynamics of language acquisition. Benjamin, Amsterdam, pp 311–328
Gullberg M. (2006) Handling discourse: Gestures, referent tracking, and communication strategies in early L2. Language Learning 56(1): 156–196
Hendriks H. (2003) Using nouns for reference maintenance: A seeming contradiction in L2 discourse. In: Ramat A. G. (eds) Typology and second language acquisition. Mouton de Gruyter, Berlin, pp 291–326
Huang C. T. J. (1984) On the distribution and reference of empty pronouns. Linguistic Inquiry 15: 531–574
Hyams N., Wexler K. (1993) On the grammatical basis of null subjects in child language. Linguistic Inquiry 24(3): 421–459
Iverson J. M., Goldin-Meadow S. (2005) Gesture paves the way for language development. Psychological Science 16: 367–371
Kita S., A. (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for and interface representation of spatial thinking and speaking. Journal of Memory and Language 48: 16–32
Kita S., Allen A., Allen S., Brown A., Furman R., Ishizuka T. (2007) Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production. Language and Cognitive Processes 22(8): 1212–1236
Lambrecht K. (1994) Information structure and sentence form. Topic focus and the mental representation of discourse referents. Cambridge University Press, Cambridge
Lim V., Rickard Liow S., Lincoln M., Chan Y. H., Onslow M. (2008) Determining language dominance in English–Mandarin bilinguals: Development of a self-report classification tool for clinical use. Applied Psycholinguistics 29: 389–412
Levinson S. C. (2000) Presumptive meanings: The theory of generalized conversational implicature. MIT press, Cambridge
Levy E. T., Carol A. F. (2000) The role of gestures and other graded language forms in the grounding of reference in perception. In: McNeill D. (eds) Language and gesture. Cambridge University Press, Cambridge, pp 215–234
Lyons J. (1977) Semantics, Vol. 2. Cambridge University Press, Cambridge
Mayberry R., Nicoladis E. (2000) Gesture reflects language development: Evidence from bilingual children. Current Directions in Psychological Science 9(6): 192–196
McNeill D. (1992) Hand and mind: What gesture reveals about thought. University of Chicago Press, Chicago
McNeill D. (2005) Gesture and thought. The University of Chicago Press, Chicago
Özyürek A., Kita S., Allen S., Brown A., Furman R., Ishizuka T. (2008) Development of cross-linguistic variation in speech and gesture: Motion events in English and Turkish. Developmental Psychology 44(4): 1040–1054
Padden C. (1988) Interaction of morphology and syntax in American Sign Language. Garland, NY
Pakir, A. (1998). English in Singapore: The codification of competing norms. In S. Gopinathan, A. Pakir, H. W. Kam, & V. Saravanan (Eds.), Language, society and education in Singapore: Issues and trends (2nd ed., pp. 65–84). Singapore: Times Academic Press.
Pakir, A. (1999). Bilingual education with English as an official language: Sociocultural implications. Georgetown University Roundtable on Language and Linguistics.
Sacks H., Schegloff E. A. (1979) Two preferences in the organization of reference to persons in conversation and their interaction. In: Psathas G. (eds) Everyday language: Studies in ethnomethodology. Irvington Press, New York, pp 15–21
Senghas A., Coppola M. (2001) Children creating language: How Nicaraguan Sign Language acquired a spatial grammar. Psychological Science 12: 323–328
Shepherd J. (2005) Striking a balance: The management of languages in Singapore. Peter Lang, Frankfurt am Main Germany
Slobin, D. (1987). Thinking for speaking. In J. Aske, N. Beery, L. Michaelis, & H. Filip (Eds.), Proceedings of the thirteenth annual meeting of the Berkeley Linguistic Society (pp. 435–445). Berkeley: Berkeley Linguistic Society.
Slobin D. I. (1996) From “thought and language” to “thinking to speaking”. In: Gumperz J. J., Levinson S. C. (eds) Rethinking linguistic relativity. Cambridge University Press, Cambridge, pp 70–96
So W. C., Coppola M., Liccidarello V., Goldin-Meadow S. (2005) The seeds of spatial grammar in the manual modality. Cognitive Science 29: 23–37
So W. C., Kita S., Goldin-Meadow S. (2009) Using the hands to identify who does what to whom: Speech and gesture go hand-in-hand. Cognitive Science 33: 115–125
So W. C., Demir E., Goldin-Meadow S. (2010) When speech is ambiguous gesture steps in: Sensitivity to discourse-pragmatic principles in early childhood. Applied Psycholinguistics 31(1): 209–224
So, W. C., & Lim, J. Y. (2012). Point to a referent, and say, “What is this?” Gesture as a potential cue to identify referents in discourse. Applied Psycholinguistics, 33(2), 329–342.
Sperber D., Wilson D. (1986) Relevance: Communication and cognition. Blackwell, Oxford
Stokoe, W. C. (1960). Sign language structure: An outline of the visual communication systems of the American deaf. Studies in Linguistics, Occasional Papers 8.
Tsao F.-F. (1990) Sentence and clause structure in Chinese: A function perspective. Student Book, Taipei
Williams J. (1989) Pronoun copies, pronominal anaphora and zero anaphora in second language acquisition. In: Gass S., Madden C., Preston D., Selinker L. (eds) Variation in second language acquisition: Discourse and pragmatics. Multilingual Matters, Philadelphia, pp 153–189
Yoshioka K. (2008) Gesture and information structure in first and second language. Gesture 8(2): 236–255
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
So, W.C., Kita, S. & Goldin-Meadow, S. When Do Speakers Use Gestures to Specify Who Does What to Whom? The Role of Language Proficiency and Type of Gestures in Narratives. J Psycholinguist Res 42, 581–594 (2013). https://doi.org/10.1007/s10936-012-9230-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10936-012-9230-6