Abstract
With the rapid development of the touch screen technology, some usability issues of smartphones have been reported [1]. To tackle those user experience issues, there has been research on the use of non-speech sounds on the mobile devices [e.g., 2, 3-7]. However, most of them have focused on a single specific task of the device. Given the varying functions of the smartphone, the present study designed plausibly integrated auditory cues for diverse functions and evaluated user acceptance levels from the ecological interface design perspective. Results showed that sophisticated auditory design could change users’ preference and acceptance of the interface and the extent depended on usage contexts. Overall, participants gave significantly higher scores on the functional satisfaction and the fun scales in the sonically-enhanced smartphones than in the no-sound condition. The balanced sound design may free users from auditory pollution and allow them to use their devices more pleasantly.
Chapter PDF
Similar content being viewed by others
References
Norman, D.A., Nielsen, J.: Gestural interfaces: A step backward in usability. Interactions 17(5), 46–49 (2010)
Brewster, S.A., Leplâtre, G., Crease, M.G.: Using non-speech sounds in mobile computing devices. In: Proceedings of the 1st Mobile HCI 1998, Glasgow, UK (1998)
Leplâtre, G., Brewster, S.A.: Designing non-speech sounds to support navigation in mobile phone menus. In: Proceedings of the 6th ICAD 2000, Atlanta, GA, USA (2000)
Palladino, D., Walker, B.N.: Efficiency of spearcon-enhanced navigation of one dimensional electronic menus. In: Proceedings of the ICAD 2008, Paris, France (2008)
Brewster, S.A., Cryer, P.G.: Maximising screen-space on mobile computing devices. In: Proceedings of the ACM CHI 1999, Pittsburgh, PA, USA (1999)
Jeon, M., Walker, N.B.: “Spindex” (Speech Index) improves acceptance and performance in auditory menu navigation for visually impaired and sighted users. ACM Transactions on Accessible Computing 3(3), 10:1–26:1 (2011)
Jeon, M., Walker, B.N., Srivastava, A.: “Spindex” (speech index) enhances menu navigation on touch screen devices with tapping, wheeling, and flicking gestures. ACM Transactions on Computer-Human Interaction 19(2), 14:1–27:1 (2012)
Oh, J.W., Park, J.H., Jo, J.H., Lee, C., Yun, M.H.: Development of a kansei analysis system on the physical user interface. In: Proceedings of the HCI, Kangwon, Korea (2007)
Rasmussen, J., Vicente, K.J.: Coping with human errors through system design: Implications for ecological interface design. International Journal of Man-Machine Studies 31, 517–534 (1989)
Gaver, W.W.: Auditory icons: Using sound in computer interfaces. Human-Computer Interaction 2, 167–177 (1986)
Wilson, J., Walker, B.N., Lindsay, J., Cambias, C., Dellaert, F.: SWAN: System for wearable audio navigation. In: Proceedings of the 11th ISWC 2007 (2007)
Blattner, M.M., Sumikawa, D.A., Greenberg, R.M.: Earcons and icons: Their structure and common design principles. Human-Computer Interaction 4, 11–44 (1989)
Helle, S., Leplatre, G., Marila, J., Laine, P.: Menu sonification in a mobile phone – a prototype study. In: Proceedings of the ICAD 2001, Espoo, Finland (2001)
Brewster, S.A.: The design of sonically-enhanced widgets. Interacting with Computers 11(2), 211–235 (1998)
Yalla, P., Walker, B.N.: Advanced auditory menus: Design and evaluation of auditory scroll bars. In: Proceedings of the ASSETS 2008 (2008)
McGee-Lennon, M., Wolters, M.K., McLachlan, R., Brewster, S., Hall, C.: Name that tune: Musicons as reminders in the home. In: Proceedings of the CHI 2011, BC, Canada (2011)
Walker, B. N., Lindsay, J., Nance, A., Nakano, Y., Palladino, D. K., Dingler, T., Jeon, M.: Spearcons (speech-based earcons) improve navigation performance in advanced auditory menus. Human Factors (2012) (Published online July 2, 2012 Print edition pending)
Walker, B.N., Kogan, A.: Spearcon performance and preference for auditory menus on a mobile phone. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 445–454. Springer, Heidelberg (2009)
Jeon, M., Davison, B.K., Nees, M.A., Wilson, J., Walker, B.N.: Enhanced auditory menu cues improve dual task performance and are preferred with in-vehicle technologies. In: Proceedings of the AutomotiveUI 2009, Essen, Germany (2009)
Vicente, K.J.: Ecological interface design: Supporting operator adaptation, continuous learning, distributed collaborative work. In: Proceedings of the HCPC (1999)
Rasmussen, J.: The role of hierarchical knowledge representation in decision making and system management. IEEE Transactions on Systems, Man and Cybernetics 15, 234–243 (1985)
Sanderson, P.M., Anderson, J., Watson, M.: Extending ecological interface design to auditory displays. CSIRO (2000)
Walker, B.N., Kramer, G.: Ecological psychoacoustics and auditory displays: Hearing, grouping, and meaning making. In: Neuhoff, J. (ed.) Ecological psychoacoustics, pp. 150–175. Academic Press, New York (2004)
Jeon, M.: Two or three things you need to know about AUI design or designers. In: Proceedings of the ICAD (2010)
Kurakata, K., Mizunami, T., Yomogida, H.: Guidelines on the temporal patterns of auditory signals for electronics home appliances: Report of the association for electric home appliances. Acoust. Sci. & Tech. 29(2), 176–184 (2008)
Lee, J.-H., Jeon, M., Han, K.H.: Developing the design guideline of auditory user interface for domestic appliances. Korean Journal of the Science of Emotion & Sensibility 10(3), 307–320 (2007)
Kortum, P., Peres, S.C., Stallmann, K.: Mental workload measures of auditory stimuli heard during periods of waiting. In: Proceedings of the HFES (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jeon, M., Lee, JH. (2013). The Ecological AUI (Auditory User Interface) Design and Evaluation of User Acceptance for Various Tasks on Smartphones. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Modalities and Techniques. HCI 2013. Lecture Notes in Computer Science, vol 8007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39330-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-39330-3_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39329-7
Online ISBN: 978-3-642-39330-3
eBook Packages: Computer ScienceComputer Science (R0)