Abstract
In recent years, the use of chatbots in education has been driven by advances in natural language processing and the increasing availability of digital education platforms. Although the added value of educational chatbots appears promising, researchers have noted that there is a need for empirical studies that explore the effects of incorporating chatbots into different learning scenarios. In this paper, we report on the integration of a rule-based chatbot into an information technology course. We conducted a controlled experiment in which half of the students were able to interact with the chatbot during Python lab sessions while the other half completed the sessions without the chatbot. Our results suggest that educational chatbots powered by short, simple, interactive scripts could have a positive impact on the user experience offered by learning technologies and could be pertinent to educators looking to integrate chatbots into their practice.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bad Arithmetic: Measuring tape measure up (2017). https://giphy.com/embed/3og0IQttlo3NfcsIiQ
Baum, T., Schneider, K.: On the need for a new generation of code review tools. In: Abrahamsson, P., Jedlitschka, A., Nguyen Duc, A., Felderer, M., Amasaki, S., Mikkonen, T. (eds.) Product-Focused Software Process Improvement, vol. 10027, pp. 301–308. Springer, Cham, Switzerland (2016). https://doi.org/10.1007/978-3-319-49094-6_19
Bergin, J.: Fourteen pedagogical patterns. In: Devos, M., Rüping, A. (eds.) Proceedings of the 5th European Conference on Pattern Languages of Programs (EuroPLoP 2000). Universitaetsverlag Konstanz, Irsee, Germany (2000)
Charmaz, K.: Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. Sage, London, UK (2006)
Coronado, M., Iglesias, C.A., Carrera, Á., Mardomingo, A.: A cognitive assistant for learning java featuring social dialogue. Int. J. Hum Comput Stud. 117, 55–67 (2018). https://doi.org/10.1016/j.ijhcs.2018.02.004
Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of Oz studies—Why and how. Knowl.-Based Syst. 6(4), 258–266 (1993)
Davids, M.R., Chikte, U.M.E., Halperin, M.L.: Effect of improving the usability of an e-learning resource: a randomized trial. Adv. Physiol. Educ. 38(2), 155–160 (2014). https://doi.org/10.1152/advan.00119.2013
Farah, J.C., Spaenlehauer, B., Bergram, K., Holzer, A., Gillet, D.: Challenges and opportunities in integrating interactive Chatbots into code review exercises: a pilot case study. In: EDULEARN22 Proceedings, pp. 3816–3825. IATED, Valencia, Spain (2022). https://doi.org/10.21125/edulearn.2022.0932
Farah, J.C., Spaenlehauer, B., Rodríguez-Triana, M.J., Ingram, S., Gillet, D.: Toward code review notebooks. In: 2022 International Conference on Advanced Learning Technologies (ICALT), pp. 209–211. IEEE, New York, NY, USA (2022). https://doi.org/10.1109/ICALT55010.2022.00068
Farah, J.C., Spaenlehauer, B., Sharma, V., Rodríguez-Triana, M.J., Ingram, S., Gillet, D.: Impersonating Chatbots in a code review exercise to teach software engineering best practices. In: 2022 IEEE Global Engineering Education Conference (EDUCON), pp. 1634–1642. IEEE, New York, NY, USA (2022). https://doi.org/10.1109/EDUCON52537.2022.9766793
Gillet, D., Vonèche-Cardia, I., Farah, J.C., Phan Hoang, K.L., Rodríguez-Triana, M.J.: Integrated model for comprehensive digital education platforms. In: 2022 IEEE Global Engineering Education Conference (EDUCON), IEEE Global Engineering Education Conference, pp. 1586–1592. IEEE, New York, NY, USA (2022). https://doi.org/10.1109/EDUCON52537.2022.9766795
Gruber, J., Swartz, A.: Markdown (2004). https://daringfireball.net/projects/markdown/
Hedberg, H.: Introducing the next generation of software inspection tools. In: Kanade, T., Kittler, J., Kleinberg, J.M., Mattern, F., Mitchell, J.C., Nierstrasz, O., Pandu Rangan, C., Steffen, B., Terzopoulos, D., Tygar, D., Vardi, M.Y., Bomarius, F., Iida, H. (eds.) Product Focused Software Process Improvement, vol. 3009, pp. 234–247. Springer, Berlin, Germany (2004). https://doi.org/10.1007/978-3-540-24659-6_17
Hobert, S.: Say hello to ‘Coding Tutor’! Design and evaluation of a Chatbot-based learning system supporting students to learn to program. In: 40th International Conference on Information Systems (ICIS 2019), vol. 3, pp. 1776–1792. Curran Associates, Inc., Red Hook, NY, USA (2020)
Hwang, G.J., Chang, C.Y.: A review of opportunities and challenges of Chatbots in education. Interact. Learn. Environ. (2021). https://doi.org/10.1080/10494820.2021.1952615
Joint Task Force on Computing Curricula: Software Engineering 2014: Curriculum Guidelines for Undergraduate Degree Programs in Software Engineering. Technical reports. IEEE & ACM (2015)
Kanuka, H., Szabo, M.: Conducting research on visual design and learning: pitfalls and promises. Canadian J. Learn. Technol./La revue canadienne de l’apprentissage et de la technologie 27(2) (1999). https://doi.org/10.21432/T2SW37
Kuhail, M.A., Alturki, N., Alramlawi, S., Alhejori, K.: Interacting with Educational Chatbots: a Systematic Review. Educ. Inf. Technol. 28(1), 973–1018 (2023). https://doi.org/10.1007/s10639-022-11177-3
Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) HCI and Usability for Education and Work. Lecture Notes in Computer Science, vol. 5298, pp. 63–76. Springer, Berlin, Germany (2008). https://doi.org/10.1007/978-3-540-89350-9_6
Lebeuf, C., Storey, M.A., Zagalsky, A.: Software bots. IEEE Softw. 35(1), 18–23 (2018). https://doi.org/10.1109/MS.2017.4541027
Liaw, S.S., Huang, H.M.: Perceived satisfaction, perceived usefulness and interactive learning environments as predictors to self-regulation in e-learning environments. Compu. Educ. 60(1), 14–24 (2013). https://doi.org/10.1016/j.compedu.2012.07.015
Mad Daud, S.H., Ibrahim Teo, N.H., Mat Zain, N.H.: E-JAVA Chatbot for learning programming language: a post-pandemic alternative virtual tutor. Int. J. Emerg. Trends Eng. Res. 8(7), 3290–3298 (2020). https://doi.org/10.30534/ijeter/2020/67872020
OpenAI: Introducing ChatGPT (2022). https://openai.com/blog/chatgpt
van Rossum, G., Warsaw, B., Coghlan, N.: Style guide for Python code. PEP 8, Python Software Foundation (2001). https://www.python.org/dev/peps/pep-0008/
Vector Stall: Assistant free icons. https://www.flaticon.com/free-icon/assistant_4818971
Wessel, M., Serebrenik, A., Wiese, I., Steinmacher, I., Gerosa, M.A.: Effects of adopting code review bots on pull requests to OSS projects. In: Proceedings of the 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, Adelaide, Australia (2020). https://doi.org/10.1109/ICSME46990.2020.00011
Wessel, M., Serebrenik, A., Wiese, I., Steinmacher, I., Gerosa, M.A.: What to expect from code review bots on GitHub?: A survey with OSS maintainers. In: Proceedings of the 34th Brazilian Symposium on Software Engineering, pp. 457–462. ACM, Natal, Brazil (2020). https://doi.org/10.1145/3422392.3422459
Wiegers, K.E.: Peer Reviews in Software: A Practical Guide. Addison-Wesley, Boston, MA, USA (2002)
Winkler, R., Hobert, S., Salovaara, A., Söllner, M., Leimeister, J.M.: Sara, the Lecturer: Improving learning in online education with a scaffolding-based conversational agent. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu, HI, USA (2020). https://doi.org/10.1145/3313831.3376781
Winkler, R., Soellner, M.: Unleashing the potential of chatbots in education: a state-of-the-art analysis. Acad. Manag. Proc. 2018(1), 15903 (2018). https://doi.org/10.5465/AMBPP.2018.15903abstract
Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., Drachsler, H.: Are we there yet?—a systematic literature review on chatbots in education. Front. Artif. Intell. 4, 654924 (2021). https://doi.org/10.3389/frai.2021.654924
Zaharias, P., Poylymenakou, A.: Developing a usability evaluation method for e-learning applications: beyond functional usability. International Journal of Human-Computer Interaction 25(1), 75–98 (2009). https://doi.org/10.1080/10447310802546716
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Farah, J.C., Spaenlehauer, B., Ingram, S., Purohit, A.K., Holzer, A., Gillet, D. (2024). Harnessing Rule-Based Chatbots to Support Teaching Python Programming Best Practices. In: Auer, M.E., Cukierman, U.R., Vendrell Vidal, E., Tovar Caro, E. (eds) Towards a Hybrid, Flexible and Socially Engaged Higher Education. ICL 2023. Lecture Notes in Networks and Systems, vol 899. Springer, Cham. https://doi.org/10.1007/978-3-031-51979-6_47
Download citation
DOI: https://doi.org/10.1007/978-3-031-51979-6_47
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-51978-9
Online ISBN: 978-3-031-51979-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)