Abstract
Multimodality has emerged out of relative obscurity over the past two decades as a term that has purchase in language and literacy research, theory, and practice. This chapter is concerned with research methods and approaches to the study of multimodality in language and education. Origins, early developments, and current uses of multimodality are discussed. Research methods that examine multimodal meaning-making operate across varied contexts and use diverse heuristics and research tools.
Multimodality explains communication as a combination of modes of representation and expression within text designs (with the term text referring to communicative acts beyond but including print or writing). The various multiple modes of expression can be visual (e.g., drawing, painting, video), print (e.g., books, newspapers, environmental print), gestural (e.g., miming, pointing, acting out), dramatic (e.g., role-playing, improvisation, formal acting), and oral (e.g., informal talk, public speaking) modes (Kress Multimodality. In: Cope B, Kalantzis M (eds) Multiliteracies: literacy learning and the design of social futures. Routledge, London, pp 182–202, 2000; Stein TESOL Q 32(3): 517–528, 1998). Kress often stands as a harbinger of multimodality with his theory and writings over the years, but this field can be traced to earlier theorists such as Halliday (with whom Kress studied).
Major research trends in response to early developments have emphasized design, digital and visual literacies, juxtapositions of home and school literacies, and interests in material culture, to name a few. Current explorations of embodiment, Deleuzian approaches, material culture, cultural geography, and gamification have resulted in innovative research methods. Challenges of multimodal applications to educational contexts that move beyond representation and that address earlier claims and issues of equity and social justice are described.
Similar content being viewed by others
References
Barton, D., & Hamilton, M. (1998). Local literacies: Reading and writing in one community. London: Routledge.
Bazalgette, C., & Buckingham, D. (2013). Literacy, media and multimodality: A critical response. Literacy, 2, 95–102.
Brandt, D., & Clinton, K. (2002). Limits of the local: Expanding perspectives on literacy as a social practice. Journal of Literacy Research, 34(3), 337–356.
Burnett, C. (2015). Immaterializing literacies. In J. Rowsell & K. Pahl (Eds.), The Routledge handbook of literacy studies. London: Routledge.
Canagarajah, S. (2013). Translingual practice: Global Englishes and cosmopolitan relations. London: Routledge.
Clay, M. (1975). What did I write?: Beginning writing behaviour. Portsmouth: Heinemann.
Collier, D. R. (2015). “I’m just trying to be tough, okay”: Masculine performances of everyday practices. Journal of Early Childhood Literacy, 15(2), 203–226.
De Castell, S., Boschman, L., & Jensen, J. (2008). In and out of control: Learning games differently. Loading…, 2(3), 1–16.
Deleuze, G., & Guattari, F. (1987). A thousand plateaus: Capitalism and schizophrenia (trans: Massumi B.). Minneapolis: University of Minnesota Press.
Dyson, A. H. (1982). The emergence of visible language: Interrelationships between drawing and early writing. Visible Language, 16(4), 360–381.
Gee, J. P. (2006). What is literacy? In P. I. Vandenberg, S. I. Hum, & J. I. Clary-Lemon (Eds.), Relations, locations, positions: Composition theory for writing teachers (pp. 29–39). Urbana: National Council of Teachers of English.
Hackett, A. (2014). Zigging and zooming all over the place: Young children’s meaning making and movement in the museum. Journal of Early Childhood Literacy, 14(1), 5–27.
Halliday, M. (1985). An introduction to functional grammar. London: Edward Arnold.
Hodge, R., & Kress, G. (1988). Social semiotics. Ithaca: Cornell University Press.
Hull, G., & Nelson, M. E. (2005). Locating the semiotic power of multimodality. Written Communication, 22(2), 224–261.
Jacobs, G. E. (2013/2014). Reimagining multiliteracies: A response to Leander and Boldt. Journal of Adolescent & Adult Literacy, 57, 270–273.
Jones, S. (2014, Dec). Attempting to do no harm: Inquiring into embodied literacies of space in community-based research. Symposium presentation at annual meeting of Literacy Research Association, Marcos Island, Florida.
Kenner, C. (2004). Becoming biliterate: Young children learning different writing systems. Stoke on Trent: Trentham Books.
Kress, G. (2000). Multimodality. In B. Cope & M. Kalantzis (Eds.), Multiliteracies: Literacy learning and the design of social futures (pp. 182–202). London: Routledge.
Kress, G. R., & Van Leeuwen, T. (2006). Reading images: The grammar of visual design. London: Routledge.
Latour, B. (2005). Like Halliday. Oxford: Oxford University Press.
Leander, K., & Boldt, G. (2013). Rereading “A pedagogy of multiliteracies”: Bodies, texts, and emergence. Journal of Literacy Research, 45, 22–46.
Lemke, J. L. (2000). Across the scales of time: Artifacts, activities, and meanings in ecosocial systems. Mind, Culture & Activity, 7(4), 273–290.
Lewis, C., & Tierney, J. D. (2013). Mobilizing emotion in an urban classroom: Producing identities and transforming signs in a race-related discussion. Linguistics and Education, 24, 289–304.
Marsh, J. (2005). Popular culture, new media, and digital literacy in early childhood. New York: Routledge.
Massey, D. (2005). For space. London: Sage.
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60–92.
Pahl, K. (2007). Timescales and ethnography: Understanding a child’s meaning-making across three sites, a home, a classroom, and a family literacy class. Ethnography and Education, 2(2), 175–190.
Pahl, K., & Rowsell, J. (2006). Travel notes from the new literacy studies. Clevedon: Multilingual Matters.
Peirce, C. S. (1977). Semiotics and significs. In C. S. Hardwick (Ed.), Semiotics and significs. The correspondence between Charles S. Peirce and Lady Victoria Welby. Bloomington: Indiana University Press.
Saussure, F. D. (1959). Course in general linguistics (trans: Baskin, W.). In C. Bally, A. Sechehaye, & A. Riedlinger (Eds.). New York: Philosophical Library.
Scollon, R., & Scollon, S. K. (2003). Discourses in place: Language in the material world. London: Routledge.
Sheridan-Rabideau, M. P., & Rowsell, J. (2010). Design literacies: Learning and innovation in the digital age. London: Routledge.
Siegel, M. (1995). More than words: The generative power of transmediation for learning. Canadian Journal of Education, 20(4), 455–475.
Siegel, M., & Panofsky, C. P. (2009). Designs for multimodality in literacy studies: Explorations in analysis. In K. M. Leander (Ed.), 58th yearbook of the national reading conference (pp. 99–111). Oak Creek: National Reading Conference.
Stein, P. (1998). Reconfiguring the past and the present: Performing literacy histories in a Johannesburg classroom. TESOL Quarterly, 32(3), 517–528.
Wohlwend, K. E. (2009). Damsels in discourse: Girls consuming and producing identity texts through Disney princess play. Reading Research Quarterly, 44(1), 57–83.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this entry
Cite this entry
Rowsell, J., Collier, D.R. (2016). Researching Multimodality in Language and Education. In: King, K., Lai, YJ., May, S. (eds) Research Methods in Language and Education. Encyclopedia of Language and Education. Springer, Cham. https://doi.org/10.1007/978-3-319-02329-8_23-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-02329-8_23-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Online ISBN: 978-3-319-02329-8
eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education