Abstract
In this chapter, we explore assessment that is performed automatically by the digital environment, what might be called assessment “through technology.” Based on experience with the design of three innovative content-specific automatic assessment platforms, the main goal of the chapter is to exemplify design considerations to map the development of digital assessments. These digital platforms use various methods to assess mathematics through student’s interaction with digital learning resources. We address the fit between an assessment’s task design and its goals, the analysis of student work by the platform, and the report that is then produced. We want tasks to offer opportunities for students to express mathematical ideas, to take advantage of the opportunities provided by automatic assessment, as well as to meet the goals of assessments. In writing tasks, designers must also take into account two other design considerations: How can the digital assessment platform interpret and analyze student work in variable and flexible ways? How can the platform “make sense” of student work, so as to be able to generate feedback or to report on learning achievements? What are the ways in which insights from this analysis will be made accessible and to whom? Taken together, examination of the design of the tasks given to students to collect data, how that data is analyzed by the machine, and how the machine reports on that analysis allows us to map current digital assessment practices. We close by emphasizing the importance of continued engagement of the mathematics education community with the design of digital assessment platforms because mathematics education stakeholders bring with them a content-specific focus on higher-level thinking in mathematics and on students’ conceptions and misconceptions.
Similar content being viewed by others
References
Anderson JR, Corbett AT, Koedinger KR, Pelletier R (1995) Cognitive tutors: lessons learned. J Learn Sci 4(2):167–207
Appleby J, Samuels PC, Jones TT (1997) Diagnosys: a knowledge-based diagnostic test of basic mathematical skills. Comput Educ 28:113–131
Beeson M (1998) Design principles of Mathpert: software to support education in algebra and calculus. In: Kajler N (ed) Computer-human interaction in symbolic computation. Springer, pp 89–115. https://doi.org/10.1007/978-3-7091-6461-7
Brusilovsky P, Millán E (2007) User models for adaptive hypermedia and adaptive educational systems. In: Brusilovsky P, Kobsa A, Nejdl W (eds) The adaptive web, LNCS 4321. Springer, pp 3–53. https://doi.org/10.1007/978-3-540-72079-9_1
Carless D (2015) Excellence in university assessment: learning from award-winning practice. Routledge, London
Carlson M, Oehrtman M, Engelke N (2010) The precalculus concept assessment: a tool for assessing students’ reasoning abilities and understandings. Cogn Instr 28(2):113–145. https://doi.org/10.1080/07370001003676587
Crowder NA, Martin GC (1960) Adventures in ALGEBRA. Doubleday, Garden City
Dougiamas M (2004) Moodle: A virtual learning environment for the rest of us. The Electronic Journal for English as a Second Language, 8(2)
Drijvers P (2020) Digital tools in Dutch mathematics education: a dialectic relationship. In: van den Heuvel-Panhuizen M (ed) National reflections on The Netherlands didactics of mathematics, pp 177–196). SpringerOpen. https://springerlink.bibliotecabuap.elogim.com/chapter/10.1007%2F978-3-030-33824-4_10
Drijvers P, Ball L, Barzel B, Heid MK, Cao Y, Maschietto M (2016) Uses of technology in lower secondary mathematics education; a concise topical survey. Springer. http://www.springer.com/us/book/9783319336657
Drijvers P, Thurm D, Vandervieren E, Klinger M, Moons F, Van der Ree H, Mol A, Barzel B, Doorman M (2021) Distance mathematics teaching in Flanders, Germany and The Netherlands during COVID-19 lockdown. Educ Stud Math 108:35–64. https://doi.org/10.1007/s10649-021-10094-5
Hattie J, Timperley H (2007) The power of feedback. Rev Educ Res 77(1):81–112. https://doi.org/10.3102/003465430298487
Johnson EG (1992) The design of the national assessment of educational progress. J Educ Meas 29(2):95–110
Kalyuga S, Rikers R, Paas F (2012) Educational implications of expertise reversal effects in learning and performance of complex cognitive and sensorimotor skills. Educ Psychol Rev 24(2):313–337. https://doi.org/10.1007/s10648-012-9195-x
Kinnear G, Wood AK, Gratwick R (2022) Designing and evaluating an online course to support transition to university mathematics. Int J Math Educ Sci Technol 53(1):11–34. https://doi.org/10.1080/0020739X.2021.1962554
Lane-Getaz S (2013) Development of a reliable measure of students’ inferential reasoning ability. Stat Educ Res J 12(1):20–47. https://doi.org/10.52041/serj.v12i1
Mejia-Ramos JP, Lew K, de la Torre J, Weber K (2017) Developing and validating proof comprehension tests in undergraduate mathematics. Res Math Educ 19(2):130–146. https://doi.org/10.1080/14794802.2017.1325776
Mullis IV, Martin MO (2017) TIMSS 2019 assessment frameworks. International Association for the Evaluation of Educational Achievement
Naftaliev E, Yerushalmy M (2017) Engagement with interactive diagrams: the role played by resources and constraints. In: Leung A, Baccaglini-Frank A (eds) Digital technologies in designing mathematics education tasks: potential and pitfalls. Springer International Publishing, pp 153–173. https://doi.org/10.1007/978-3-319-43423-0_8
Nicaud JF, Bouhineau D, Chaachoua H (2004) Mixing microworlds and CAS features in building computer systems that help students learn algebra. Int J Comput Math Learn 9(2):169–211. https://doi.org/10.1023/B:IJCO.0000040890.20374.37
Olsher S, Yerushalmy M, Chazan D (2016) How might the use of technology in formative assessment support changes in mathematics teaching? Learn Math 36(3):11–18. https://flm-journal.org/Articles/1083F0AD733094BDDDBD64476F743F.pdf
Pardo A, Jovanovic J, Dawson S, Gašević D, Mirriahi N (2019) Using learning analytics to scale the provision of personalised feedback. Br J Educ Technol 50(1):128–138. https://doi.org/10.1111/bjet.12592
Sangwin CJ (2013) Computer aided assessment of mathematics. Oxford University Press. ISBN 978-0-19-966035-3
Sangwin CJ (2019) Proof technology in mathematics research and teaching. Springer International. https://doi.org/10.1007/978-3-030-28483-1. 15
Sangwin CJ, Bickerton R (2021) Practical online assessment of mathematical proof. Int J Math Educ Sci Technol 53:2637. https://doi.org/10.1080/0020739X.2021.1896813
Sangwin CJ, Jones I (2017) Asymmetry in student achievement on multiple choice and constructed response items in reversible mathematics processes. Educ Stud Math 94:205–222. https://doi.org/10.1007/s10649-016-9725-4
Shute VJ (2008) Focus on formative feedback. Rev Educ Res 78(1):153–189. https://doi.org/10.3102/0034654307313795
Thoma A, Iannone P (2021) Learning about proof with the theorem prover lean: the abundant numbers task. Int J Res Undergrad Math Educ 8:64–93. https://doi.org/10.1007/s40753-021-00140-1
Watson A, Mason J (2005) Mathematics as a constructive activity: the role of learner generated examples. Erlbaum, Mahwah
Watters A (2021) Teaching machines: the history of personalized learning. MIT Press, Watters
Yerushalmy M, Olsher S (2020) Online assessment of students’ reasoning when solving example-eliciting tasks: using conjunction and disjunction to increase the power of examples. ZDM – Int J Math Educ 52:1033–1049. https://doi.org/10.1007/s11858-020-01134-0
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this entry
Cite this entry
Olsher, S., Chazan, D., Drijvers, P., Sangwin, C., Yerushalmy, M. (2023). Digital Assessment and the “Machine”. In: Pepin, B., Gueudet, G., Choppin, J. (eds) Handbook of Digital Resources in Mathematics Education. Springer International Handbooks of Education. Springer, Cham. https://doi.org/10.1007/978-3-030-95060-6_44-1
Download citation
DOI: https://doi.org/10.1007/978-3-030-95060-6_44-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95060-6
Online ISBN: 978-3-030-95060-6
eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education