Abstract
In light of the shift towards incorporating multimodality in the curriculum, it is of interest and value to examine the extent to which multimodal literacy is assessed in national and international literacy tests. This is so as to surface any misalignment between the two and highlight gaps which curriculum planners and assessment designers can address. Given the significant influence that the nature of assessment has in shaping classroom practices and teaching priorities, it is imperative that assessment is aligned with curriculum goals. Our paper examines the assessment items in the visual text comprehension in Singapore’s national examinations, the Graduate Certificate of Education Ordinary Level (GCE O’ Level) and the Primary School Leaving Examination (PSLE), for the English Language exam, as well as the literacy components of Programme for International Student Assessment (PISA) and Progress in International Reading Literacy Study (PIRLS) reading items. We adopt the approach of an earlier study by Unsworth et al. (2019) and position our work as a replication study, extended to a new context. In adopting a common approach, we hope to offer an independent verification of the framework, analyses and findings from the earlier study and contribute towards consolidating and building up proven practices in the analysis of text-image relations within the field of multimodal studies. Our results similarly show an overall low proportion of test items that deal with images and image-language relations in the Singapore and international assessments. While the proportion of questions where the image is essential or supports answering the question is higher for the Singapore GCE O’ Level exams, the role of images in the PSLE and international assessments is limited, which suggests a greater focus on assessing multimodal literacy is required. As curriculum reforms to incorporate multimodality in education become more commonplace around the world, we argue that attention on assessment must be the next frontier of change.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Albright, J., & Kramer-Dahl, A. (2009). The legacy of instrumentality in policy and pedagogy in the teaching of English: The case of Singapore. Research Papers in Education, 24(2), 201–22. https://doi.org/10.1080/02671520902867200
Au, W. (2007). High-stakes testing and curricular control: A qualitative metasynthesis. Educational Researcher, 36(5), 258–267. https://doi.org/10.3102/0013189X07306523
Chia, A., & Chan, C. (2017). Re-defining ‘reading’ in the 21st century. Beyond Words: A Journal on Applied Linguistics and Language Education, 5(2), 98–105.
Curdt-Christiansen, X. L., & Silver, R. (2013). New wine into old skins: The enactment of literacy policy in Singapore. Language and Education, 27(3), 246–260. https://doi.org/10.1080/09500782.2012.704046
International Association for the Evaluation of Educational Achievement (IEA). (2015). PIRLS 2016 Assessment Framework 2nd Edition, https://timssandpirls.bc.edu/ pirls2016/downloads/P16_Framework_2ndEd.pdf.
Jewitt, C. (2009). The Routledge handbook of multimodal analysis. Routledge.
Jewitt, C, & Kress, G. (Eds.). (2003). Multimodal literacy. Peter Lang.
Klenowski, V. (2011). Assessment for learning in the accountability era: Queensland, Australia. Studies in Educational Evaluation, 37, 78–83. https://doi.org/10.1016/j.stueduc.2011.03.003
Lee, S-S., Hung, D., & Teh, L. W. (2016). An ecological view of conceptualising change in the Singapore education system. Educational Research for Policy and Practice, 15(1), 55–70. https://doi.org/10.1007/sl0671-015-9176-1
Liang, W.J., & Lim, F. V. (2020). A pedagogical framework for digital multimodal authoring in the English Language classroom. Innovation in Language Learning and Teaching. Online first, https://doi.org/10.1080/17501229.2020.1800709
Lim, F.V. (2018). Developing a systemic functional approach to teach multimodal literacy. Functional Linguistics, 5(13). https://doi.org/10.1186/s40554-018-0066-8
Lim, F.V. (2021). Towards Education 4.0: An agenda for teaching multiliteracies in the English language classroom. In F.A. Hamied (Ed.), Literacies, culture, and society towards Industrial Revolution 4.0: Reviewing policies, expanding research, enriching practices in Asia. Nova Science.
Lim, F.V., O’Halloran, K. L., Tan, S., & E. M. K. L. (2015). Teaching visual texts with multimodal analysis software. Educational Technology Research and Development, 63(6), 915–935. https://doi.org/10.1007/s11423-015-9395-4
Lim, F.V., & Tan, K.Y.S. (2018). Developing multimodal literacy through teaching the critical viewing of films in Singapore. Journal of Adolescent & Adult Literacy, 63(3), 291–300. https://doi.org/10.1002/jaal.882
Lim, F.V., Towndrow, P.A., & Tan, J.M. (2021). Unpacking the teachers’ multimodal pedagogies in the Singapore primary English language classroom. RELC Journal. Online first, https://doi.org/10.1177/00336882211011783
Lim, F.V., Weninger, C., & Nguyen, T.T.H. (2021). T expect boredom’ - Students’ experiences and expectations of multiliteracies learning. Literacy. Online first. https://doi.org/10.1111/lit.12243
Macken-Horarik, M., Love, K., Sandiford, C, & Unsworth, L. (2017). Functional grammatics. Routledge.
Ministry of Education (MOE). (2008). English language syllabus 2010 - primary & secondary (Express/Normal [Academic]). Ministry of Education.
Mitchell, W. J. T. (1995). Picture theory: Essays on verbal and visual representation. University of Chicago Press.
Mullis, I. V. S., & Martin, M. O.. (2015). PIRLS 2016 Assessment Framework (2nd ed.). Boston College, TIMSS & PIRLS International Study Centre website, http://timssandpirls.bc.edu/pirls2016/framework.html.
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60–92.
Organisation for Economic Cooperation and Development (OECD). (2018). PISA - Programme for International Student Assessment, https://www.oecd.org/pisa/.
Organisation for Economic Cooperation and Development (OECD). (2019a). PISA 2018 Released Field Trial and Main Survey New Reading Items. PISA - Programme for International Student Assessment, http://www.oecd.org/pisa/test/PISA2018_Released_REA_Items_12112019.pdf.
Organisation for Economic Cooperation and Development (OECD). (2019b). PISA 2018 Assessment and Analytical Framework. Paris: PISA, OECD Publishing. https://doi.org/10.1787/b25efab8-en.
Singapore Examinations and Assessment Board (SEAB). (n.d.) PSLE English Language - Implemented from the Year of Examination 2015. https://www.seab.gov.sg/home/examinations/psle/psle-formats-examined-in-2019.
Singapore Examinations and Assessment Board (SEAB). (2017). English Language - Singapore-Cambridge General Certificate of Education Ordinary Level (2019) (Syllabus 1128). https://www.seab.gov.sg/home/examinations/gce-o-level/o-level-syllabuses-examined-for-school-candidates-2019.
Singapore Examinations and Assessment Board (SEAB). (2020a). O’ Level Yearly Examination Papers 2010 to 2019 -English. Educational Publishing House Pte Ltd.
Singapore Examinations and Assessment Board (SEAB). (2020b). PSLE Yearly Examination Papers 2017 to 2019 -English Language. Educational Publishing House Pty Ltd.
Taylor, L. (2005). Key concepts in ELT: Washback and impact. ELT Journal, 59(2), 154–155. https://doi.org/10.1093/eltj/cci030
Teng, A. (2018, Jan 23). Singapore pupils No. 2 in global study on reading. The Straits Times. https://www.straitstimes.com/singapore/education/spore-pupils-no-2-in-global-study-on -reading.
Teng, A. (2019, Dec 3). PISA 2018: Singapore slips to second place behind China but still chalks up high scores. The Straits Times, https://www.straitstimes.com/singapore/education/pisa-2018-singapore-slips-to-second-place-behind-china-but-still-chalks-up-high.
Towndrow, P. A., Nelson, M. E., & Yusuf, W. F. B. M. (2013). Squaring literacy assessment with multimodal design: An analytic case for semiotic awareness. Journal of Literacy Research, 45(4), 327–355. https://doi.org/10.1177/1086296X13504155
Unsworth, L. (2014a). Multimodal reading comprehension: Curriculum expectations and large-scale literacy testing practices. Pedagogies: An International Journal, 9(1), 26–44. https://doi.org/10.1080/1554480X.2014.878968
Unsworth, L. (2014b). Towards a metalanguage for multimedia narrative interpretation and authoring pedagogy. In L. Unsworth & A. Thomas (Eds.), English teaching and new literacies pedagogy: Interpreting and authoring digital multimedia narratives (pp. 1–22). Peter Lang Publishing.
Unsworth, L. (2017). Image-language interaction in text comprehension: Reading reality and national reading tests. In C. Ng & B. Bartlett (Eds.), Improving reading and reading engagement in the 21st century: International research and innovation (pp. 99–118). Springer.
Unsworth, L., & Chan, E. (2009). Bridging multimodal literacies and national assessment programmes in literacy. Australian National Journal of Language and Literacy, 32(3), 245–257.
Unsworth, L., Cope, J., & Nicholls, L. (2019). Multimodal literacy and large-scale literacy tests: Curriculum relevance and responsibility. Australian Journal of Language and Literacy, 42(2), 128–139.
van Leeuwen, T. (2017). Multimodal literacy. Viden om laesning (Knowledge About Reading), 21, 4–11.
Weninger, C. (2019). From language skills to literacy: Broadening the scope of English language education through media literacy. Routledge.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lim, F.V., Tan, J.M. Curriculum and assessment mismatch: Examining the role of images in literacy assessments. AJLL 44, 22–34 (2021). https://doi.org/10.1007/BF03652078
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03652078