Abstract
In this paper we describe the design and implementation of KALDI, a Computer Aided Usability Engineering (CAUsE) tool, built to automate many of the tedious and time consuming aspects of empirical usability testing. KALDI, uses only software techniques to record precise user actions as well as to capture a video-like recording of the user interface being tested. It also allows for the detailed analysis of the recorded user actions through the use of a sophisticated visualisation of data.
The KALDI tool has many advantages over other techniques, including the ability to conduct tests without using specialised equipment, visually represent user actions at different levels of detail, record user performances from remote locations, perform automatic classification of abstract event data into user actions and the synchronised display of video-like playback with an indication of the corresponding recorded action/event.
Furthermore, we discuss in this paper the benefits of integrating this class of CAUsE tool in future User Interface Management Systems (UIMS). These benefits include helping to encourage usability testing throughout the development lifecycle, as well as providing a basis for interactive system designers and usability specialists to make sound design decisions more efficiently.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Al-Qaimari, G. & McRostie, D. (1999), KALDI: A CAUsE Tool for Supporting Testing and Usability Analysis of Human-Computer Interaction, in J. Vanderdonckt & A. Puerta (eds.), Computer-Aided Design of User Interfaces II, Kluwer, chapter 30, pp.337–355.
Baxter, J. (1995), The Book of Coffee—The Connoisseurs Handbook, Quintet Publishing.
Bevan, N. & Macleod, M. (1994), “Usability Measurement in Context”, Behaviour & Information Technology 13(1-2), 132–45.
Boehm, B. W. (1988), “The Spiral Model of Software Development and Enhancement”, IEEE Computer 21(5), 61–72.
Butler, K., Bennett, J., Poison, P. & Karat, J. (1989), “Report on the Workshop on Analytical Methods: Predicting the Complexity of Human-Computer Interaction”, ACM SIGCHI Bulletin 20(4), 63–79.
Card, S., Moran, T. & Newell, A. (1993), The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates.
Chi, M., Glaser, H. R. & Farr, M. J. (1988), The Nature of Expertise, Lawrence Erlbaum Associates.
Crellin, J., Horn, T. & Preece, J. (1990), Evaluating Evaluation: A Case Study of the Use of Novel and Conventional Evaluation Techniques in a Small Company, in D. Diaper, D. Gilmore, G. Cockton & B. Shackel (eds.), Proceedings of INTERACT’ 90—Third IFIP Conference on Human-Computer Interaction, Elsevier Science, pp.329–35.
Geary, D. M. (1999), Graphic Java 2: Mastering the JFC—Volume 2, Swing Components, The Sun Microsystems Press Java Series,, third edition, Prentice-Hall.
Hammontree, M., Hendrickson, J. & Hensley, B. (1992), Integrated Data Capture and Analysis Tools for Research and Testing on Graphical User Interfaces, in P. Bauersfeld, J. Bennett & G. Lynch (eds.), Proceedings of CHI’92: Human Factors in Computing Systems, ACM Press, pp.431–2.
Hix, D. & Hartson, H. R. (1993), Developing User Interfaces: Ensuring Usability through Product and Process, John Wiley&Sons.
ISO (1998), “ISO 9241-11 International Standard. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). Part 11: Guidance for Specifying and Measuring Usability”. International Organization for Standardization, Geneve, Switzerland.
Jeffries, R., Turner, A., Poison, P. & Atwood, M. (1981), The Processes Involved in Designing Software, in J. Anderson (ed.), Cognitive Skills and Their Acquisition, Lawrence Erlbaum Associates, pp.255–83.
Karat, J. (1997), “Evolving the Scope of User-centred Design”, Communications of the ACM 40(7), 33–8.
Kieras, D. E. (1997), A Guide to GOMS Model Usability Evaluation using NGOMSL, in M. Helander, T. K. Landauer & P. V. Prabhu (eds.), Handbook of Human-Computer Interaction, second edition, North-Holland, pp.733–66.
Lewis, C. (1997), Cognitive Walkthroughs, in M. Heiander, T. K. Landauer & R V. Prabhu (eds.), Handbook of Human-Computer Interaction, second edition, North-Holland, pp.717–32.
Macleod, M. & Rengger, R. (1993), The Development of DRUM: A Software Tool for Videoassisted Usability Evaluation, in J. Alty, D. Diaper & S. Guest (eds.), People and Computers VIII (Proceedings of HCI’93), Cambridge University Press, pp.293–309.
Macleod, M., Bowren, R., Bevan, N. & Curson, I. (1997), “The MUSiC Performance Measurement Method”, Behaviour&Information Technology 16(4-5), 279–93.
Newman, W. & Lamming, M. (1995), Interactive System Design, Addison-Wesley.
Nielsen, J. (1992), Finding Usability Problems Through Heuristic Evaluation, in P. Bauersfeld, J. Bennett & G. Lynch (eds.), Proceedings of CHI’92: Human Factors in Computing Systems, ACM Press, pp.373–80.
Nielsen, J. (1993a), “Iterative User-Interface Design”, IEEE Computer 26(11), 32–41.
Nielsen, J. (1993b), Usability Engineering, Academic Press.
Norman, D. A. & Draper, S. W. (eds.) (1986), User Centered System Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates.
Rubin, J. (1994), Handbook of Usability Testing, John Wiley&Sons.
Ryan, C. & Al-Qaimari, G. (2000), The Orbital Model: A Methodology for the Development of Evolving Interactive Software Systems Based on Complex Domains, in M. Torres (ed.), Proceedings of the HIS International Conference on Information Systems Analysis and Synthesis (SCI/ISAS’00), pp.99–105.
Soloway, E., Adelson, B. & Ehrlich, K. (1988), Knowledge and Processes in the Comprehension of Computer Programs, in M. Chi, R. Glaser & M. Farr (eds.), The Nature of Expertise, Lawrence Erlbaum Associates, pp. 127–52.
Uehling, D. & Wolf, K. (1995), User Action Graphing Effort (UsAGE), in I. Katz, R. Mack, L. Marks, M. B. Rosson & J. Nielsen (eds.), Proceedings of CHI’95: Human Factors in Computing Systems, ACM Press, pp.290–1.
Wharton, C., Bradford, J., Jeffries, R. & Franzke, M. (1992), Applying Cognitive Walkthroughs to More Complex User Interfaces: Experiences, Issues and Recommendations, in P. Bauersfeld, J. Bennett & G. Lynch (eds.), Proceedings of CHI’92: Human Factors in Computing Systems, ACM Press, pp.381–8.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag London
About this paper
Cite this paper
Al-Qaimari, G., McRostie, D. (2001). KALDI: A CAUsE Tool for Supporting Testing and Analysis of User Interaction. In: Blandford, A., Vanderdonckt, J., Gray, P. (eds) People and Computers XV—Interaction without Frontiers. Springer, London. https://doi.org/10.1007/978-1-4471-0353-0_10
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0353-0_10
Publisher Name: Springer, London
Print ISBN: 978-1-85233-515-1
Online ISBN: 978-1-4471-0353-0
eBook Packages: Springer Book Archive