Abstract
In order to make a step further towards understanding the impact of multi-modal stimuli in Virtual Reality we conducted a user study with 80 participants performing tasks in a virtual pit environment. Participants were divided into four groups, each presented a different combination of multi-sensory stimuli. Those included real-time 3D graphics, audio stimuli (ambient, static and event sounds), and haptics consisting of wind and tactile feedback when touching objects. A presence questionnaire was used to evaluate subjectively reported presence on the one hand, and on the other physiological sensors were used to measure heart rate and skin conductance as an objective measure. Results strongly indicate that an increase of modalities does not automatically result in an increase of presence.
Chapter PDF
Similar content being viewed by others
References
Brenton, H., Gillies, M., Ballin, D., Chatting, D.: The uncanny valley: does it exist. In: 19th British HCI Group Annual Conference: Workshop on Human-animated Character Interaction (2005)
Cohen, D.C.: Comparison of self-report and overt-behavioral procedures for assessing acrophobia. Behavior Therapy 8(1), 17–23 (1977)
Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., Hart, J.C.: The cave: audio visual experience automatic virtual environment. Commun. ACM 35(6), 64–72 (1992)
Deligiannidis, L., Jacob, R.J.K.: The vr scooter: Wind and tactile feedback improve user performance. In: 3DUI 2006, pp. 143–150 (2006)
Dinh, H.Q., Walker, N., Song, C., Kobayashi, A., Hodges, L.F.: Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. In: Proceedings of the IEEE Virtual Reality, VR 1999, pp. 222–228. IEEE Computer Society, Washington, DC (1999)
Fellner, D., Behr, J., Bockholt, U.: Instantreality - a framework for industrial augmented and virtual reality applications. In: The 2nd Sino-German Workshop on Virtual Reality & Augmented Reality in Industry (2009)
Gibson, E., Walk, R.: The visual cliff. Scientific American 202, 64–71 (1960)
Heilig, M.L.: Sensorama simulator, u.s.patent no.3050870 (August 1962)
Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G.: Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology 3(3), 203–220 (1993)
Meehan, M., Insko, B., Whitton, M., Brooks Jr., F.P.: Physiological measures of presence in stressful virtual environments. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2002, pp. 645–652. ACM, New York (2002)
Meehan, M., Razzaque, S., Insko, B., Whitton, M., Brooks, J., Frederick, P.: Review of four studies on the use of physiological reaction as a measure of presence in stressful virtual environments. Applied Psychophysiology and Biofeedback 30, 239–258 (2005)
Mori, M., MacDorman, K., Kageki, N.: The uncanny valley (from the field). IEEE Robotics Automation Magazine 19(2), 98–100 (2012)
Pausch, R., Proffitt, D., Williams, G.: Quantifying immersion in virtual reality. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1997, pp. 13–18. ACM Press/Addison-Wesley Publishing Co, New York (1997)
Renner, P., Dankert, T., Schneider, D., Mattar, N., Pfeiffer, T.: Navigating and selecting in the virtual supermarket: Review and update of classic interaction techniques. In: Virtuelle und Erweiterte Realität: 7. Workshop der GI-Fachgruppe VR/AR, pp. 71–82. Shaker Verlag GmbH (2010)
Sheridan, T.: Further musings on the psychophysics of presence. In: 1994 IEEE International Conference on Systems, Man, and Cybernetics, Humans, Information and Technology, vol. 2, pp. 1073–1077 (October 1994)
Slater, M., Usoh, M., Steed, A.: Taking steps: the influence of a walking technique on presence in virtual reality. ACM Trans. Comput.-Hum. Interact. 2(3), 201–219 (1995)
Usoh, M., Catena, E., Arman, S., Slater, M.: Using presence questionnaires in reality. Presence: Teleoper. Virtual Environ. 9(5), 497–503 (2000)
Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: A presence questionnaire. Presence 7(3), 225–240 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fröhlich, J., Wachsmuth, I. (2013). The Visual, the Auditory and the Haptic – A User Study on Combining Modalities in Virtual Worlds. In: Shumaker, R. (eds) Virtual Augmented and Mixed Reality. Designing and Developing Augmented and Virtual Environments. VAMR 2013. Lecture Notes in Computer Science, vol 8021. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39405-8_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-39405-8_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39404-1
Online ISBN: 978-3-642-39405-8
eBook Packages: Computer ScienceComputer Science (R0)