Abstract
In latest era, human–computer interaction has gained more popularity. The mouse is one of the best inventions in human–computer interaction technology. It is used to point the digital world content by using the physical module. To give this existing traditional way of technology an intelligence, we proposed a computer vision-based hand gesture recognition system to interact with the digital world. Our system controls mouse pointer using finger count and finger strip. Our approach mainly focuses on color segmentation, color tracking, extraction of finger contour, and finger counting algorithm. To add-upon this, a speech recognition-based method is used to perform some basic operations on our system. Therefore, the proposed system eliminates the device dependency to interact with the computer, and it would be considered as a good approach to a gesture-based interface for HCI in future.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
O. Ozturk, A. Aksac, T. Ozyer, R. Alhajj, Boosting real-time recognition of hand posture and gesture for virtual mouse operations with segmentation. Appl. Intell. 43, 786–801 (2015)
C.M. Taing, P.L.P. Rau, H. Huang, Handpad: a virtual mouse for controlling laptops in a smart home. Human-Centric Comput. Inf. Sci. 7 (2017)
K.S. Varun, I. Puneeth, T.P. Jacob, Virtual mouse implementation using open CV, in Proceedings of International Conference on Trends Electronics Informatics, ICOEI (2019), pp. 435–438
A.O. B, Biomed. Eng. Neurosci. 720, 141–149 (2018)
A. Henzen, P. Nohama, Adaptable virtual keyboard and mouse for people with special needs, in FTC 2016—Proceedings of Future Technology Conference (2017), pp. 1357–1360
S. Kim, B. Lee, T. van Gemert, A. Oulasvirta, Optimal Sensor Position for a Computer Mouse (2020)
W.C. SON, "VIRTUAL MOUSE," A Report Submitted To University Tunku Abdul Rahman, (2016)
P. Robertson, R. Laddaga, M. Van Kleek, Virtual mouse vision based interface, in International Conference on Intelligence User Interfaces, Proceedings IUI, (2004), pp. 177–183
C.C. Hsieh, D.H. Liou, D. Lee, A real time hand gesture recognition system using motion history image, in ICSPS 2010—Proceedings of 2010 2nd International Conference on Signal Processing System vol 2 (2010), pp. 394–398
D.S. Suresh, I.V. Bhavana, Virtual Mouse Implementation using Color Pointer Detection, vol 1 (2014), pp. 23–32
M.C. Roh, D. Kang, S. Huh, S.W. Lee, A virtual mouse interface with a two-layered Bayesian network. Multimed. Tools Appl. 76, 1615–1638 (2017)
S.M.S. Shajideen, V.H. Preetha, Hand gestures—virtual mouse for human computer interaction, in Proceedings of International Conference on Smart System Invention and Technology ICSSIT 2018 (2018), pp. 543–546
K.H. Shibly, S. Kumar Dey, M.A. Islam, S. Iftekhar Showrav, Design and development of hand gesture based virtual mouse, in 1st International Conference on Advance in Science, Engineering and Robotics Technology, ICASERT 2019 (2019), pp. 1–5
D.S. Tran, N.H. Ho, H.J. Yang, E.T. Baek, S.H. Kim, G. Lee, Real-time hand gesture spotting and recognition using RGB-D Camera and 3D convolutional neural network. Appl. Sci. 10 (2020)
A. Ghodichor, B. Chirakattu, Virtual mouse using hand gesture and color detection. Int. J. Comput. Appl. 128, 6–10 (2015)
Y. Fu, T.S. Huang, HMouse: Head tracking driven virtual computer mouse, in Proceedings of—IEEE Working on Application of Computer Vision, WACV (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Chandresh, M., Pratik, P., Jagruti, B. (2022). Virtual Mouse Control Using Finger Action. In: Reddy, V.S., Prasad, V.K., Wang, J., Reddy, K.T.V. (eds) Soft Computing and Signal Processing. Advances in Intelligent Systems and Computing, vol 1340. Springer, Singapore. https://doi.org/10.1007/978-981-16-1249-7_5
Download citation
DOI: https://doi.org/10.1007/978-981-16-1249-7_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-1248-0
Online ISBN: 978-981-16-1249-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)