Abstract
In a world in which intelligent technologies are integrated in everyday objects and environments, users are at risk of being overburdened with information and interaction possibilities. Calm technology therefore aims at designing interactions that may reside in the periphery of the user’s attention and only shift to the center of the attention when required. However, for such designs to be effective, a detailed understanding of human attention abilities is needed. In this paper, we therefore present a qualitative study on the everyday periphery of the attention. As we expected, we found that sound plays a major role in this, which supports our approach to use interactive sonification as an interaction style for peripheral interaction. We present a range of rich examples of everyday situations that lay out the design space for peripheral interaction and support these findings by describing three initial designs that use interactive sonification for peripheral interaction.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Weiser M (1999) The computer for the 21st century. Mob Comput Commun Rev 3:3–11
Weiser M, Brown JS (1997) The coming age of calm technology. In: Denning PJ, Metcalfe RM (eds) Beyond calculation: the next fifty years of computing. Springer, New York, pp 75–85
Cherry EC (1993) Some experiments on the recognition of speech, with one and with two ears. J Acoust Soc Am 25:975–979
Gaver WW (1993) What in the world do we hear? An ecological approach to auditory event perception. Ecol Psychol 5:1–29
Hermann T, Hunt A (2005) An introduction to interactive sonification. IEEE Multimed 12(2):20–24
Eggen B, van Mensvoort K (2009) Making sense of what is going on ‘around’: designing environmental awareness information displays. In: Markopoulos P, de Ruyter B, Mackay W (eds) Awareness systems: advances in theory, methodology and design. Springer, London, pp 99–124
Matthews T, Dey AK, Mankoff J, Carter S, Rattenbury T (2004) A toolkit for managing user attention in peripheral displays. In: UIST’04: proceedings of the 17th annual ACM symposium on user interface software and technology. ACM, New York, pp 247–256
Ishii H, Wisneski C, Brave S, Dahley A, Gorbet M, Ullmer B, Yarin P (1998) AmbientROOM: integrating ambient media with architectural space. In: CHI’98: conference summary on human factors in computing systems. ACM, New York, pp 173–174
Walker BN, Nees MA (in press) Theory of sonification. In: Hermann T, Hunt A, Neuhoff J (eds) Handbook of sonification. Academic Press, New York. http://sonify.psych.gatech.edu
Markopoulos P (2009) A design framework for awareness systems. In: Markopoulos P, de Ruyter B, Mackay W (eds) Awareness systems: advances in theory, methodology and design. Springer, London, pp 49–72
Mynatt ED, Back M, Want R, Baer M, Ellis JB (1998) Designing audio aura. In: CHI’98: proceedings of the SIGCHI conference on human factors in computing systems, pp 566–573
Mauney BS, Walker BN (2004) Creating functional and livable soundscapes for peripheral monitoring of dynamic data. In: ICAD’04: proceedings of he 10th international conference on auditory display
Pashler HE (1998) The psychology of attention. MIT Press, Cambridge
Treisman AM (1964) Verbal cues, language, and meaning in selective attention. Am J Psychol 77:206–219
Moray N (1959) Attention in dichotic listening: affective cues and the influence of instructions. Q J Exp Psychol 11:56–60
Kahneman D (1973) Attention and effort. Prentice-Hall, Englewood Cliffs
Wickens CD, Hollands JG (2000) Engineering psychology and human performance. Prentice-Hall, Englewood Cliffs
Bakker S, van den Hoven E, Eggen B (2010) Design for the periphery. In: Eurohaptics 2010: proceedings of the special symposium haptic and audio-visual stimuli, pp 71–80
Sleeswijk Visser F, Stappers JP, van der Lugt R, Sanders EBN (2005) Contextmapping: experiences from practice. CoDesign 1:119–149
Gaver B, Dunne T, Pacenti E (1999) Design: cultural probes. ACM Interact 6:21–29
Liamputtong P, Ezzy D (2005) Qualitative research methods. Oxford University Press, Melbourne
Hsieh H, Shannon SE (2005) Three approaches to qualitative content analysis. Qual Health Res 15:1277–1288
Siegel S, Castellan NJ (1988) Nonparametric statistics for the behavioral sciences. McGraw-Hill, Boston
Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174
James W (1890) The principles of psychology. Dover, New York
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Bakker, S., van den Hoven, E. & Eggen, B. Knowing by ear: leveraging human attention abilities in interaction design. J Multimodal User Interfaces 5, 197–209 (2012). https://doi.org/10.1007/s12193-011-0062-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12193-011-0062-8