Abstract
In order to make a significant step towards more realistic virtual experiences, we created a multi-sensory stimuli display for a CAVE-like environment. It comprises graphics, sound, tactile feedback, wind and warmth. In the present report we discuss the possibilities and constraints tied to such an enhancement. To use a multi-modal display in a proper way, many considerations have to be taken into account. This includes safety requirements, hardware devices and software integration. For each stimulus different possibilities are reviewed with regard to their assets and drawbacks. Eventually the resulting setup realized in our lab is described – to our knowledge one of the most comprehensive systems. Technical evaluations as well as user studies accompanied the development and gave hints with respect to necessities and chances.
Chapter PDF
Similar content being viewed by others
References
Fmod - interactive audio middleware (2010), http://www.fmod.org
Begault, D.R.: 3D Sound for Virtual Reality and Multimedia. Academic Press (1994)
Burdea, G., Burdea, G.C., Burdea, C.: Force and touch feedback for virtual reality. Wiley, New York (1996)
Cardin, S., Thalmann, D., Vexo, F.: Head Mounted Wind. In: Computer Animation and Social Agents, pp. 101–108 (2007)
Deligiannidis, L., Jacob, R.J.K.: The VR Scooter: Wind and Tactile Feedback Improve User Performance. In: 3DUI 2006, pp. 143–150 (2006)
Dinh, H.Q., Walker, N., Song, C., Kobayashi, A., Hodges, L.F.: Evaluating the Importance of Multi-sensory Input on Memory and the Sense of Presence in Virtual Environments. In: Proceedings of the IEEE Virtual Reality, VR 1999, pp. 222–228. IEEE Computer Society, Washington, DC (1999)
Dionisio, J.: Temperature feedback in Virtual Environments. In: Imaging Sciences and Display Technologies, pp. 233–243 (1996)
Dionisio, J.: Virtual Hell: A Trip Through the Flames. IEEE Comput. Graph. Appl. 17(3), 11–14 (1997)
Fellner, D., Behr, J., Bockholt, U.: Instantreality - a framework for industrial augmented and virtual reality applications. In: The 2nd Sino-German Workshop Virtual Reality & Augmented Reality in Industry
Fröhlich, J., Wachsmuth, I.: A phong-based concept for 3D-audio generation. In: Dickmann, L., Volkmann, G., Malaka, R., Boll, S., Krüger, A., Olivier, P. (eds.) SG 2011. LNCS, vol. 6815, pp. 184–187. Springer, Heidelberg (2011)
Fröhlich, J., Wachsmuth, I.: The Visual, the Auditory and the Haptic – A User Study on Combining Modalities in Virtual Worlds. In: Shumaker, R. (ed.) VAMR/HCII 2013, Part I. LNCS, vol. 8021, pp. 159–168. Springer, Heidelberg (2013)
Heilig, M.L.: Sensorama simulator, u.s.patent no.3050870 (August 1962)
Hirota, K., Ito, Y., Amemiya, T., Ikei, Y.: Presentation of Odor in Multi-Sensory Theater, pp. 372–379 (2013)
Hülsmann, F., Fröhlich, J., Mattar, N., Wachsmuth, I.: Wind and Warmth in Virtual Reality: Implementation and Evaluation. In: VRIC 2014: Proceedings of the Virtual Reality International Conference: Laval Virtual. ACM (in press, 2014)
Hülsmann, F., Mattar, N., Fröhlich, J., Wachsmuth, I.: Wind and Warmth in Virtual Reality – Requirements and Chances. In: Virtuelle und Erweiterte Realität: 10. Workshop der GI-Fachgruppe VR/AR, pp. 133–144 (2013)
Husung, S., Mikalauskas, R., Weber, C., Kästner, T.: Modelling of sound propagation of technical systems for real-time VR-applications. MECHANIKA (4), 33–37 (2010)
Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A conversational agent as museum guide - Design and evaluation of a real-world application. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 329–343. Springer, Heidelberg (2005)
Kopp, S., Jung, B., Leßmann, N., Wachsmuth, I.: Max - A multimodal assistant in virtual reality construction. KI - Künstliche Intelligenz 4(03), 11–17 (2003)
Larsson, P., Västfjäll, D., Kleiner, M.: Ecological acoustics and the multi-modal perception of rooms: Real and unreal experiences of auditory-visual virtual environments. In: Proc. of the Conf. on Auditory Display, pp. 245–249 (2001)
Lehmann, A., Geiger, C., Wöldecke, B., S.J.: Poster: Design and Evaluation of 3D Content with Wind Output. In: IEEE Symposium on 3D User Interfaces, pp. 152–152 (2009)
Luck, M., Aylett, R.: Applying Artificial Intelligence to Virtual Reality: Intelligent Virtual Environments. Applied Artificial Intelligence 14(1), 3–32 (2000)
Moon, T., Kim, G.J.: Design and Evaluation of a Wind Display for Virtual Reality. In: VRST 2004 Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 122–128 (2004)
Weber, B., Sagardia, M., Hulin, T., Preusche, C.: Visual, Vibrotactile, and Force Feedback of Collisions in Virtual Environments: Effects on Performance, Mental Workload and Spatial Orientation. In: Shumaker, R. (ed.) VAMR/HCII 2013, Part I. LNCS, vol. 8021, pp. 241–250. Springer, Heidelberg (2013)
Yamada, T., Yokoyama, S., Tanikawa, T., Hirota, K., Hirose, M.: Wearable Olfactory Display: Using Odor in Outdoor Environment. In: VR, pp. 199–206 (2006)
Yanagida, Y., Kawato, S., Noma, H., Tomono, A., Tetsutani, N.: Projection-Based Olfactory Display with Nose Tracking. In: VR, pp. 43–50 (2004)
Zeltzer, D.: Autonomy, interaction, and presence. Presence: Teleoper. Virtual Environ. 1(1), 127–132 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Fröhlich, J., Wachsmuth, I. (2014). Combining Multi-Sensory Stimuli in Virtual Worlds – A Progress Report. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)