Abstract
In this paper we describe two experiments whose goal is to investigate the role of physics-based auditory and haptic feedback provided at feet level to enhance realism in a virtual environment. To achieve this goal, we designed a multimodal virtual environment where subjects could walk on a platform overlooking a canyon. Subjects were asked to visit the environment wearing an head-mounted display and a custom made pair of sandals enhanced with sensors and actuators. A 12-channels surround sound system delivered a soundscape which was consistent with the visual environment. In the first experiment, passive haptics was provided by having a physical wooden platform present in the laboratory. In the second experiment, no passive haptics was present. In both experiments, subjects reported of having a more realistic experience while auditory and haptic feedback are present. However, measured physiological data and post-experimental presence questionnaire do not show significant differences when audio-haptic feedback is provided.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Benbasat, A., Morris, S., Paradiso, J.: A wireless modular sensor architecture and its application in on-shoe gait analysis. In: Proceedings of IEEE Sensors 2003, vol. 2 (2003)
Bruder, G., Steinicke, F., Rothaus, K., Hinrichs, K.: Enhancing presence in head-mounted display environments by visual body feedback using head-mounted cameras. In: 2009 International Conference on CyberWorlds, pp. 43–50. IEEE (2009)
Insko, B.: Passive haptics significantly enhances virtual environments. PhD thesis, Citeseer (2001)
Kohli, L., Burns, E., Miller, D., Fuchs, H.: Combining passive haptics with redirected walking. In: Proceedings of the 2005 International Conference on Augmented Tele-Existence, pp. 253–254. ACM (2005)
Meehan, M., Insko, B., Whitton, M., Brooks Jr., F.: Physiological measures of presence in stressful virtual environments. ACM Transactions on Graphics (TOG) 21, 645–652 (2002)
Nordahl, R., Berrezag, A., Dimitrov, S., Turchet, L., Hayward, V., Serafin, S.: Preliminary experiment combining virtual reality haptic shoes and audio synthesis. Haptics: Generating and Perceiving Tangible Sensations, 123–129 (2010)
Paradiso, J., Hsiao, K., Hu, E.: Interactive music for instrumented dancing shoes. In: Proc. of the 1999 International Computer Music Conference, pp. 453–456 (1999)
Pelah, A., Koenderink, J.J.: Editorial: Walking in real and virtual environments. ACM Transactions on Applied Perception (TAP) 4(1), 1 (2007)
Slater, M., Lotto, B., Arnold, M.M., Sanchez-Vives, M.V.: How we experience immersive virtual environments: the concept of presence and its measurement. Anuario de Psicologia 40(2), 193–210 (2009)
Slater, M., Usoh, M., Steed, A.: Depth of presence in immersive virtual environments. Presence: Teleoperators and Virtual Environments 3(2), 130–144 (1994)
Turchet, L., Nordahl, R., Berrezag, A., Dimitrov, S., Hayward, V., Serafin, S.: Audio-haptic physically based simulation of walking on different grounds. In: Proceedings of IEEE International Workshop on Multimedia Signal Processing, pp. 269–273. IEEE Press (2010)
Turchet, L., Serafin, S., Dimitrov, S., Nordahl, R.: Physically based sound synthesis and control of footsteps sounds. In: Proceedings of Digital Audio Effects Conference, pp. 161–168 (2010)
Usoh, M., Catena, E., Arman, S., Slater, M.: Using presence questionnaires in reality. Presence: Teleoperators and Virtual Environments 9(5), 497–503 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nilsson, N.C., Nordahl, R., Turchet, L., Serafin, S. (2012). Audio-Haptic Simulation of Walking on Virtual Ground Surfaces to Enhance Realism. In: Magnusson, C., Szymczak, D., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2012. Lecture Notes in Computer Science, vol 7468. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32796-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-32796-4_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32795-7
Online ISBN: 978-3-642-32796-4
eBook Packages: Computer ScienceComputer Science (R0)