Abstract
Interaction is an essential feature to achieve immersion in virtual reality. So that, virtual reality applications can achieve greater growth and diffusion by improving user interactions like exploration of virtual environments, select and transform virtual objects and text input. Hand-based interaction can provide naturalness, intuition, and creativity to these interaction techniques. In this paper, we present a literature survey of this broad field, including a comparative analysis of several hand-based interaction proposals through computer vision for virtual reality applications, where we considered the common features of the revised proposals. In addition, we propose two classifications, the first categorizes the interaction gestures, and the second group the used methods. Interaction guidelines are proposed to achieve hand gesture recognition with low computational cost.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bowman, D.A., Hodges, L.F.: An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics, pp. 35–ff, Apr 1997
Petersen, N., Stricker, D.: Continuous natural user interface: reducing the gap between real and digital world. In: ISMAR, pp. 23–26, Oct 2009
Cruz Bautista, A.G., González-Barbosa, J.J., Hurtado-Ramos, J.B., Ornelas-Rodriguez, F.J., González-Barbosa, E.A.: Hand features extractor using hand contour–a case study. Automatika 61(1), 99–108 (2020)
Saboo, S., Singha, J.: Vision based two-level hand tracking system for dynamic hand gestures in indoor environment. Multimedia Tools Appl. 80(13), 20579–20598 (2021). https://doi.org/10.1007/s11042-021-10669-7
Caputo, F.M.: Gestural interaction in virtual environments: user studies and applications. Doctoral Dissertation, University of Verona (2019)
Schäfer, A., Reis, G., Stricker, D.: Controlling teleportation-based locomotion in virtual reality with hand gestures: a comparative evaluation of two-handed and one-handed techniques. Electronics 10(6), 715 (2021)
Vaitkevičius, A., Taroza, M., Blažauskas, T., Damaševičius, R., Maskeliūnas, R., Woźniak, M.: Recognition of American sign language gestures in a virtual reality using leap motion. Appl. Sci. 9(3), 445 (2019)
Fittkau, F., Krause, A., Hasselbring, W.: Software landscape and application visualization for system comprehension with ExplorViz. Inf. Softw. Technol. 87, 259–277 (2017)
Melero, M., et al.: Upbeat: augmented reality-guided dancing for prosthetic rehabilitation of upper limb amputees. J. Healthc. Eng. 2019, 1–9 (2019)
Du, G., Zhang, B., Li, C., Yuan, H.: A novel natural mobile human-machine interaction method with augmented reality. IEEE Access 7, 154317–154330 (2019)
Rehman, I.U., et al.: Fingertip gestures recognition using leap motion and camera for interaction with virtual environment. Electronics 9(12), 1986 (2020)
Wang, Y., et al.: Investigating the performance of gesture-based input for mid-air text entry in a virtual environment: a comparison of hand-up versus hand-down postures. Sensors 21(5), 1582 (2021)
Raees, M., Ullah, S., Rehman, I.U., Azhar, M.: Thumb inclination-based manipulation and exploration, a machine learning based interaction technique for virtual environments. Mehran Univ. Res. J. Eng. Technol. 40(2), 358–370 (2021)
Korečko, Š, Hudák, M., Sobota, B., Sivý, M., Pleva, M., Steingartner, W.: Experimental performance evaluation of enhanced user interaction components for web-based collaborative extended reality. Appl. Sci. 11(9), 3811 (2021)
Du, G., Zhang, P.: A markerless human–robot interface using particle filter and Kalman filter for dual robots. IEEE Trans. Ind. Electron. 62(4), 2257–2264 (2014)
Du, G., Zhang, P., Liu, X.: Markerless human–manipulator interface using leap motion with interval Kalman filter and improved particle filter. IEEE Trans. Industr. Inf. 12(2), 694–704 (2016)
Kruse, D., Wen, J.T., Radke, R.J.: A sensor-based dual-arm tele-robotic system. IEEE Trans. Autom. Sci. Eng. 12(1), 4–18 (2014)
Wu, H., Zhang, S., Liu, J., Qiu, J., Zhang, X.: The gesture disagreement problem in free-hand gesture interaction. Int. J. Hum.-Comput. Interact. 35(12), 1102–1114 (2019)
Bekele, M.K., Champion, E.: A comparison of immersive realities and interaction methods: cultural learning in virtual heritage. Front. Robot. AI 6, 91 (2019)
Zhou, X., Jin, Y., Jia, L., Xue, C.: Study on hand-eye cordination area with bare-hand click interaction in virtual reality. Appl. Sci. 11(13), 6146 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Olvera, C., Lara, G., Valdivia, A., Peña, A. (2022). A Literature Review of Hand-Based Interaction in Virtual Environments Through Computer Vision. In: Mejia, J., Muñoz, M., Rocha, Á., Avila-George, H., Martínez-Aguilar, G.M. (eds) New Perspectives in Software Engineering. CIMPS 2021. Advances in Intelligent Systems and Computing, vol 1416. Springer, Cham. https://doi.org/10.1007/978-3-030-89909-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-89909-7_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89908-0
Online ISBN: 978-3-030-89909-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)