Skip to main content

User Research Techniques for User Interface Design of Learning Management Systems: A Decade Review

  • Conference paper
  • First Online:
New Perspectives in Software Engineering (CIMPS 2021)

Abstract

From several years ago, learning management systems (LMS) have been widely adopted in higher education institutions around the world. There are some cases in which universities have decided to develop their own LMS, so the system’s user interface design turns out to be a key factor. It is desirable for the LMS to have a user friendly interface design that promotes easy, natural, and engaging interaction, allowing users to perform their required tasks. Through user research, which focuses on understanding user’s behaviors, needs, and motivations, it is possible to improve a user interface by employing techniques such as surveys, usability tests, user observations, interviews, among others. The review’s goal is to collect and classify research papers found in the literature focused in using user research techniques to improve user interfaces of learning systems in order to identify the most suitable ones, as well as to discover the ones that require a more extensive research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Aldiab, A., Chowdhury, H., Kootsookos, A., Alam, F., Allhibi, H.: Utilization of learning management systems (LMSs) in higher education system: a case review for Saudi Arabia. Energy Procedia 160, 731–737 (2019)

    Article  Google Scholar 

  2. Al-Sharhan, S., Al-Hunaiyyan, A., Alhajri, R., Al-Huwail, N.: Utilization of learning management system (LMS) among instructors and students. In: Zakaria, Z., Ahmad, R. (eds.) Advances in Electronics Engineering. LNEE, vol. 619, pp. 15–23. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-1289-6_2

    Chapter  Google Scholar 

  3. Liu, J.C., Brantmeier, N., Wilcox, D., Griffin, O., Calcagno-Roach, J., Brannon, R.: Faculty perceived functionality of learning management system: development and validation of a scale. In: Ma, W.W.K., Chan, W.W.L., Cheng, C.M. (eds.) Shaping the Future of Education, Communication and Technology. ECTY, pp. 165–177. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-6681-9_13

    Chapter  Google Scholar 

  4. Rhode, J., Richter, S., Gowen, P., Miller, T., Wills, C.: Understanding faculty use of the learning management system. Online Learn. 21(3), 68–86 (2017). https://doi.org/10.24059/olj.v21i3.1217

    Article  Google Scholar 

  5. Alberto Aning, A.B.: E-learning design in Malaysian higher educational institutions: principles and guidelines. J. Hunan Univ. Nat. Sci. 47, 123–130 (2020)

    Google Scholar 

  6. Por, F.P., Mustafa, Z., Osman, S., Phoon, H.S., Fong, S.F.: Design and development of multimedia pronunciation learning management system for non-native English speakers. Procedia Soc. Behav. Sci. 64, 584–593 (2012)

    Article  Google Scholar 

  7. Almarashdeh, I., Elias, N.F., Sahari, N., Zain, N.A.M.: Development of an interactive learning management system for Malaysian distance learning institutions. Middle East J. Sci. Res. 14, 10–5829 (2013)

    Google Scholar 

  8. Kotsifakos, D., Adamopoulos, P., Douligeris, C.: Design and development of a learning management system for vocational education. In: Proceedings of the SouthEast European Design Automation, Computer Engineering, Computer Networks and Social Media Conference on - SEEDA-CECNSM 2016. ACM Press, New York (2016)

    Google Scholar 

  9. Johnson, M.C., Seawright, L.L., McDonald, J.K.: A design case of an enterprise-wide learning management system. In: Bishop, M.J., Boling, E., Elen, J., Svihla, V. (eds.) Handbook of Research in Educational Communications and Technology, pp. 675–688. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-36119-8_31

    Chapter  Google Scholar 

  10. Muhardi, M., Gunawan, S.I., Irawan, Y., Devis, Y.: Design of web based LMS (learning management system) in SMAN 1 Kampar Kiri Hilir. J. Appl. Eng. Technol. Sci. (JAETS) 1, 70–76 (2020)

    Google Scholar 

  11. Rabiman, R., Nurtanto, M., Kholifah, N.: Design and development e-learning system by learning management system (LMS) in vocational education. Online Submission 9, 1059–1063 (2020)

    Google Scholar 

  12. Ghazal, S., Aldowah, H., Umar, I.: Critical factors to learning management system acceptance and satisfaction in a blended learning environment. In: Saeed, F., Gazem, N., Patnaik, S., Balaid, A.S.S., Mohammed, F. (eds.) IRICT 2017. LNDECT, vol. 5, pp. 688–698. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59427-9_71

    Chapter  Google Scholar 

  13. Ohliati, J., Abbas, B.S.: Measuring students satisfaction in using learning management system. Int. J. Emerg. Technol. Learn. 14, 180 (2019)

    Article  Google Scholar 

  14. Ghapanchi, A.H., Purarjomandlangrudi, A., McAndrew, A., Miao, Y.: Investigating the impact of space design, visual attractiveness and perceived instructor presence on student adoption of learning management systems. Educ. Inf. Technol. 25(6), 5053–5066 (2020). https://doi.org/10.1007/s10639-020-10204-5

    Article  Google Scholar 

  15. Amsal, A.A.: Meuthia: Students’ online learning satisfaction on learning management system. In: Proceedings of the 3rd International Conference on Educational Development and Quality Assurance, ICED-QA 2020, Paris, France. Atlantis Press (2021)

    Google Scholar 

  16. Nguyen, N.-T.: A study on satisfaction of users towards learning management system at International University – Vietnam National University HCMC. Asia Pac. Manag. Rev. (2021)

    Google Scholar 

  17. Goodman, E., Kuniavsky, M., Moed, A.: Observing the User Experience: A Practitioner’s Guide to User Research. Morgan Kaufmann, Oxford, England (2012)

    Google Scholar 

  18. Jesse, J.G.: The Elements of User Experience: User-Centered Design for the Web and Beyond. New Riders Publishing (2011)

    Google Scholar 

  19. Lowdermilk, T.: User-Centered Design: A Developer’s Guide to Building User-Friendly Applications. O’Reilly Media, Sebastopol, CA (2013)

    Google Scholar 

  20. Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Oxford, England (2012)

    Google Scholar 

  21. Raita, E.: User interviews revisited: identifying user positions and system interpretations. In: Proceedings of the 7th Nordic Conference on Human-Computer Interaction Making Sense Through Design - NordiCHI 2012. ACM Press, New York (2012)

    Google Scholar 

  22. Gomoll, K., Nicol, A.: Discussion of guidelines for user observation. User Observation: Guidelines for Apple Developers (1990)

    Google Scholar 

  23. Poole, A., Ball, L.J.: Eye tracking in HCI and usability research. In: Ghaoui, C. (eds.) Encyclopedia of Human Computer Interaction, pp. 211–219. IGI Global (2006)

    Google Scholar 

  24. Galitz, W.O.: The Essential Guide to User Interface Design: An Introduction to GUI Design, Principles and Techniques. Wiley (2007)

    Google Scholar 

  25. Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.: User Interface Design and Evaluation. Morgan Kaufmann, Oxford, England (2005)

    Google Scholar 

  26. Szabo, M.: CMI theory and practice: historical roots of learning management systems. In: E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, pp. 929–936.Association for the Advancement of Computing in Education, Montreal, Canada (2002)

    Google Scholar 

  27. Stone, D.E., Zheng, G.: Learning management systems in a changing environment. In: Handbook of Research on Education and Technology in a Changing Society, pp. 756–767. IGI Global (2014)

    Google Scholar 

  28. Kats, Y., (ed.): Learning Management System Technologies and Software Solutions for Online Teaching: Tools and Applications. Information Science Reference, Hershey, PA (2010)

    Google Scholar 

  29. Christensen, G., Steinmetz, A., Alcorn, B., Bennett, A., Woods, D., Emanuel, E.J.: The MOOC phenomenon: Who takes massive open online courses and why? SSRN Electron. J. (2013). https://doi.org/10.2139/ssrn.2350964

    Article  Google Scholar 

  30. Kaplan, A.M., Haenlein, M.: Higher education and the digital revolution: about MOOCs, SPOCs, social media, and the Cookie Monster. Bus. Horiz. 59, 441–450 (2016)

    Article  Google Scholar 

  31. Kitchenham, B.: Procedures for performing systematic reviews, vol. 33, pp. 1–26. Keele University, Keele, UK (2004)

    Google Scholar 

  32. Ramakrisnan, P., Jaafar, A., Razak, F.H.A., Ramba, D.A.: Evaluation of user interface design for leaning management system (LMS): investigating student’s eye tracking pattern and experiences. Procedia Soc. Behav. Sci. 67, 527–537 (2012)

    Article  Google Scholar 

  33. Ostrowski, S., Rolczyński, R., Pniewska, J., Garnik, I.: User-friendly e-learning platform: a case study of a design thinking approach use. In: Proceedings of the Mulitimedia, Interaction, Design and Innnovation on ZZZ, MIDI 2015. ACM Press, New York (2015)

    Google Scholar 

  34. Sahid, D.S.S., Santosa, P.I., Ferdiana, R., Lukito, E.N.: Evaluation and measurement of learning management system based on user experience. In: 2016 6th International Annual Engineering Seminar (InAES). IEEE (2016)

    Google Scholar 

  35. Lai, T.-L., Chen, P.-Y., Chou, C.-Y.: A user experience study of a web-based formative assessment system. In: 2017 International Conference on Applied System Innovation (ICASI). IEEE (2017)

    Google Scholar 

  36. Srimarong, S., Achalakul, T.: Usability evaluation of outcome-based education tool. In: 2017 IEEE 9th International Conference on Engineering Education (ICEED). IEEE (2017)

    Google Scholar 

  37. Yulianandra, P.V., Wibirama, S., Santosa, P.I.: Examining the effect of website complexity and task complexity in web-based learning management system. In: 2017 1st International Conference on Informatics and Computational Sciences (ICICoS). IEEE (2017)

    Google Scholar 

  38. Hasan, L.: Usability problems on desktop and mobile interfaces of the Moodle learning management system (LMS). In: Proceedings of the 2018 International Conference on E-Business and Applications, ICEBA 2018. ACM Press, New York (2018)

    Google Scholar 

  39. Wang, T.Y., Wang, C.H.: E-learning platform of STEAM aesthetic course materials based on user experience. In: 2018 1st International Cognitive Cities Conference (IC3). IEEE (2018)

    Google Scholar 

  40. Hasani, L.M., Santoso, H.B., Isal, R.Y.K.: Designing alternative interface design of e-learning modules based on Felder-Silverman learning styles and user centered design approach. In: 2019 International Conference on Advanced Computer Science and information Systems (ICACSIS). IEEE (2019)

    Google Scholar 

  41. Korableva, O., Durand, T., Kalimullina, O., Stepanova, I.: Studying user satisfaction with the MOOC platform interfaces using the example of coursera and open education platforms. In: Proceedings of the 2019 International Conference on Big Data and Education – ICBDE 2019. ACM Press, New York (2019)

    Google Scholar 

  42. Kirana, K.C., Wibawanto, S., Cahyono, G.P.: Design of teleconference-based learning management system for a learning tool in the co-19 pandemic. In: 2020 4th International Conference on Vocational Education and Training (ICOVET). IEEE (2020)

    Google Scholar 

  43. Andone, D., Vert, S., Mihaescu, V., Stoica, D., Ternauciuc, A.: Evaluation of the virtual mobility learning hub. In: Zaphiris, P., Ioannou, A. (eds.) HCII 2020. LNCS, vol. 12205, pp. 20–33. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50513-4_2

    Chapter  Google Scholar 

  44. Liu, S., Liang, T., Shao, S., Kong, J.: Evaluating localized MOOCs: the role of culture on interface design and user experience. IEEE Access 8, 107927–107940 (2020)

    Article  Google Scholar 

  45. Brooke, J.: SUS: a ‘quick and dirty’ usability scale. In: Usability Evaluation in Industry, vol. 189 (1996)

    Google Scholar 

  46. Lewis, J.R.: Psychometric evaluation of the post-study system usability questionnaire: the PSSUQ. Proc. Hum. Factors Soc. Annu. Meet. 36, 1259–1260 (1992)

    Article  Google Scholar 

  47. Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7, 57–78 (1995)

    Article  Google Scholar 

  48. Lewis, J.R.: Psychometric evaluation of an after-scenario questionnaire for computer usability studies: the ASQ. SIGCHI Bull. 23, 78–81 (1991)

    Article  Google Scholar 

  49. Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-89350-9_6

    Chapter  Google Scholar 

  50. Lewis, J.R., Utesch, B.S., Maher, D.E.: UMUX-LITE: when there’s no time for the SUS. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013. ACM Press, New York (2013)

    Google Scholar 

  51. Moshagen, M., Thielsch, M.T.: Facets of visual aesthetics. Int. J. Hum. Comput. Stud. 68, 689–709 (2010)

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially developed under the support of the National Council of Science and Technology (CONACYT) in the scope of the Catedras CONACYT project “Infraestructura para Agilizar el Desarrollo de Sistemas Centrados en el Usuario”, Ref. 3053. In addition, we thank CONACYT for the scholarship number 745392, as well as at Universidad Veracruzana for the support in the development of this research.

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Méndez-Becerra, L.R., Rosales-Morales, V.Y., Alor-Hernández, G., Mezura-Godoy, C. (2022). User Research Techniques for User Interface Design of Learning Management Systems: A Decade Review. In: Mejia, J., Muñoz, M., Rocha, Á., Avila-George, H., Martínez-Aguilar, G.M. (eds) New Perspectives in Software Engineering. CIMPS 2021. Advances in Intelligent Systems and Computing, vol 1416. Springer, Cham. https://doi.org/10.1007/978-3-030-89909-7_17

Download citation

Publish with us

Policies and ethics