Abstract
For 3D transformations in immersive VR, we introduce a brand-new hand gesture-based user interface. Our approach relies on natural gestures that only involve the thumb and index finger moving in conjunction with the rotation of the hand. These movements enable the user to scale a 3D model as well as rotate it around the three axes. We use Meta Quest to implement these movements and share the implementation details. To show how effective our user interface is in terms of usability and user experience, we conducted a preliminary user study. A gesture-based user interface can be used as a workable mechanism for interactive 3D transformation in immersive VR, according to the user study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
MICROSOFT, Kinect for microsoft windows. http://www.kinectforwindows.org/ (2010). Accessed Jan 2017
Cheng, H., Yang, L., Liu, Z.: Survey on 3D hand gesture recognition. IEEE Trans. Circuits Syst. Video Technol. 26(9), 1659–1673 (2016)
Farhadi-Niaki, F., Etemad, S.A., Arya, A.: Design and usability analysis of gesture-based control for common desktop tasks. In: Proceedings of the 15th International Conference on Human-Computer Interaction: Interaction Modalities and Techniques - Volume Part IV, ser. HCI’13, pp. 215–224 (2013).https://doi.org/10.1007/978-3-642-39330-3_23
Bragdon, R., DeLine, K., Hinckley, Morris, M.R.: Code space: Touch + air gesture hybrid interactions for supporting developer meetings. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ser. ITS ’11, pp. 212–221 (2011)
Cabral, M.C., Morimoto, C.H., Zuffo, M.K.: On the usability of gesture interfaces in virtual reality environments. In: Proceedings of the 2005 Latin American Conference on Human-computer Interaction, ser. CLIHC ’05, 2005, pp. 100–108 (2005)
Villaroman, N., Rowe, D., Swan, B.: Teaching natural user interaction using openni and the microsoft kinect sensor. In: Proceedings of the 2011 Conference on Information Technology Education, ser. SIGITE ’11, 2011, pp. 227–232 (2011)
Bhuiyan, M., Picking, R.: A gesture controlled user interface for inclusive design and evaluative study of its usability. JSEA 4(9), 513–521 (2011)
Ebert, L.C., Hatch, G., Ampanozi, G., Thali, M.J., Ross, S.: You can’t touch this: touch-free navigation through radiological images. Surg. Innov. 19(3), 301–307 (2012)
Liao, C., Guimbretie`re, F., Hinckley, K.: Papiercraft: a command system for interactive paper. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, ser. UIST ’05. New York, NY, USA: ACM, pp. 241–244 (2005)
Wachs, J.P., Kölsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Commun. ACM 54(2), 60–71 (2011). https://doi.org/10.1145/1897816.1897838
LeapMotion, Leap motion controller. https://www.leapmotion.com/product/desktop (2012). Accessed Jan 2017
Potter, L.E., Araullo, J., Carter, L.: The leap motion controller: a view on sign language. In: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, ser. OzCHI ’13, 2013, pp. 175–178 (2013)
Guerrero-Rincon, C., Uribe-Quevedo, A., Leon-Rodriguez, H., Park, J.O.: Hand-based tracking animatronics interaction. In: Robotics (ISR), 2013 44th International Symposium on, Oct 2013, pp. 1–3 (2013)
Marin, G., Dominio, F., Zanuttigh, P.: Hand gesture recognition with leap motion and kinect devices. In: 2014 IEEE International Conference on Image Processing (ICIP), Oct 2014, pp. 1565–1569 (2014)
Kharoub, H., Lataifeh, M., Ahmed, N.: 3D user interface design and usability for immersive vr. Appl. Sci. 9(22) (2019). https://www.mdpi.com/2076-3417/9/22/4861
Ahmed, N., Lataifeh, M., Junejo, I.: Visual pseudo haptics for a dynamic squeeze/grab gesture in immersive virtual reality. In: 2021 IEEE 2nd International Conference on Human Machine Systems (ICHMS), pp. 1–4 (2021)
Ahmed, N., Theobalt, C., Magnor, M., Seidel, H.-P.: Spatio-temporal registration techniques for relightable 3D video. In: 2007 IEEE International Conference on Image Processing, vol. 2, 2007, pp. II-501–II-504 (2007)
Naveed Ahmed, N.J.: A system for 3D video acquisition and spatio-temporally coherent 3D animation reconstruction using multiple RGB-D cameras. Int. J. Signal Process., Image Process. Pattern Recogn. 6, 113–128 (2013). https://www.earticle.net/Article/A208880
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ahmed, N., Lataifeh, M. (2024). Natural Hand Gesture Interaction for 3D Transformations in Immersive VR. In: Rocha, A., Adeli, H., Dzemyda, G., Moreira, F., Colla, V. (eds) Information Systems and Technologies. WorldCIST 2023. Lecture Notes in Networks and Systems, vol 799. Springer, Cham. https://doi.org/10.1007/978-3-031-45642-8_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-45642-8_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-45641-1
Online ISBN: 978-3-031-45642-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)