Abstract
This paper presents a number of different sonification approaches that aim to communicate geometrical data, specifically curve shape and curvature information, of virtual 3-D objects. The system described here is part of a multi-modal augmented reality environment in which users interact with virtual models through the modalities vision, hearing and touch. An experiment designed to assess the performance of the sonification strategies is described and the key findings are presented and discussed.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Catalano, C.A., Falcidieno, B., Giannini, F., Monti, M.: A survey of computer-aided modeling tools for aesthetic design. Journal of Computing and Information Science in Engineering 2, 11–20 (2002)
Rocchesso, D., Fontana, F. (eds.): The Sounding Object. Mondo Estremo (2003)
Van den Doel, K., Kry, P.G., Pai, D.K.: Foleyautomatic: Physically-based sound effects for interactive simulation and animation. In: Proceedings of ACM SIGGRAPH, Los Angeles, CA, USA, August 2001, pp. 12–17 (2001)
Van den Doel, K., Pai, D.K.: The sounds of physical shapes. Presence 7(4), 382–395 (1998)
Díaz, I., Hernantes, J., Mansa, I., Lozano, A., Borro, D., Gil, J., Sánchez, E.: Influence of multisensory feedback on haptic accessibility tasks. Virtual Reality 10, 31–40 (2006); Special Issue on Multisensory Interaction in Virtual Environments
Kjœr, H.P., Taylor, C.C., Serafin, S.: Influence of interactive auditory feedback on the haptic perception of virtual objects. In: Proceedings of the 2nd International Workshop on Interactive Sonification, New York, UK (2007)
Minghim, R., Forrest, A.R.: An illustrated analysis of sonification for scientific visualisation. In: Proceedings of the 6th IEEE Visualization Conference, pp. 110–117 (1995)
Kennel, A.R.: Audiograf: a diagram-reader for the blind. In: Proceedings of the second annual ACM conference on Assistive technologies, pp. 51–56 (1996)
Stevens, R.D., Edwards, A.D.N., Harling, P.A.: Access to mathematics for visually disabled students through multimodal interaction. Human–Computer Interaction 12(1), 47–92 (1997)
Mansur, D.L., Blattner, M.M., Joy, K.I.: Sound graphs: A numerical data analysis method for the blind. Journal of Medical Systems 9, 163–174 (1985)
Roth, P., Kamel, H., Petrucci, L., Pun, T.: A comparison of three nonvisual methods for presenting scientific graphs. Journal of Visual Impairment & Blindness 96(6), 420–428 (2002)
Mezrich, J., Frysinger, S., Slivjanovski, R.: Dynamic representation of multivariate time series data. Journal of the American Statistical Association 79(385), 34–40 (1984)
Janata, P., Childs, E.: Marketbuzz: Sonification of real-time financial data. In: Proceedings of the 10th International Conference on Auditory Display, Sydney, Australia, July 6-9 (2004)
Mauney, B.S., Walker, B.N.: Creating functional and livable soundscapes for peripheral monitoring of dynamic data. In: Proceedings of the 10th International Conference on Auditory Display, Sydney, Australia, July 6-9 (2004)
Wilson, C.M., Lodha, S.K.: Listen: A data sonification toolkit. In: Proceedings of the 3rd International Confonference on Auditory Display, Palo Alto, USA (1996)
Lodha, S.K., Beahan, J., Heppe, T., Joseph, A.J., Zne-Ulman, B.: Muse: A musical data sonificaton toolkit. In: Proceedings of the 4th International Confonference on Auditory Display, Palo Alto, USA (1997)
Joseph, A.J., Lodha, S.K.: Musart: Musical audio transfer function real-time toolkit. In: Proceedings of the 8th International Conference on Auditory Display, Kyoto, Japan (2002)
Walker, B.N., Cothran, J.T.: Sonification sandbox: A graphical toolkit for auditory graphs. In: Proceedings of the 9th International Conference on Auditory Display, Boston, MA, USA (2003)
Stockman, T., Nickerson, L.V., Hind, G.: Auditory graphs: A summary of current experience and towards a research agenda. In: Proceedings of the 11th International Conference on Auditory Display, Limerick, Ireland (July 2005)
Wier, C.C., Jesteadt, W., Green, D.M.: Frequency discrimination as a function of frequency and sensation level. Journal of the Acoustical Society of America 61, 178–183 (1977)
Moulines, E., Charpentier, F.: Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones. Speech Communication 9(5/6), 453–467 (1990)
Rossing, T.D., Fletcher, N.H.: Principles of Vibration and Sound, 2nd edn. Springer, Heidelberg (2004)
Van den Doel, K., Pai, D.K.: Modal Synthesis for Vibrating Objects. In: Audio anecdotes: tools, tips, and techniques for digital audio. AK Press (2004)
Alonso, M., Shelley, S., Hermes, D., Kohlrausch, A.: Evaluating geometrical properties of virtual shapes using interactive sonification. In: IEEE International Workshop on Haptic Audio visual Environments and Games, pp. 154–159 (2008)
Leissa, A.W.: Vibration of Plates, NASA SP-160. NASA, Washington (1969)
Hermes, D.J., van der Pol, K., Vankan, A., Boeren, F., Kuip, O.: Perception of rubbing sounds. In: Proceedings of the International Workshop on Haptic and Audio Interaction Design, Jyväskylä, Finland (2008)
Hollowood, J., Pettitt, M., Shelley, S.B., Alonso, M.A., Sharples, S., Hermes, D.: Results of investigation into use of sound for curvature and curve shape perception. Technical report, internal deliverable to SATIN project FP6-IST-5-054525 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shelley, S. et al. (2009). Interactive Sonification of Curve Shape and Curvature Data. In: Altinsoy, M.E., Jekosch, U., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2009. Lecture Notes in Computer Science, vol 5763. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04076-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-04076-4_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04075-7
Online ISBN: 978-3-642-04076-4
eBook Packages: Computer ScienceComputer Science (R0)