Skip to main content
SpringerLink
Log in

A Real-Time Human Computer Interaction Using Hand Gestures in OpenCV

  • Conference paper
  • First Online:
IOT with Smart Systems ( ICTIS 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 720))

Abstract

In today's rapidly advancing technological landscape, the field of HCI (Human–Computer Interaction) has undergone a significant transformation. One of the most notable developments in HCI is the use of hand gestures as a new method of interaction with computers. In this paper, we apply computer vision techniques to create a virtual mouse and keyboard that can be controlled by hand gestures. Our goal is to develop a system that can recognize and translate hand gestures into actions on the computer, such as clicking, typing and scrolling, which can improve the overall experience of users. Furthermore, this system can be especially beneficial for people with disabilities, as it provides an alternative way to access the computer and its resources. Through the implementation of hand gestures as a new means of communication, this research aims to enhance human–computer interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Jiao Z (2022) Research and application of human-computer interface based on user experience. In: 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi'an, China, pp 1417–1420. https://doi.org/10.1109/ICSP54964.2022.9778329

  2. Qingquan J, Yinming G, Rui Z, Qiaozhen L (2020) Research on the evolution law of human-computer interaction function in computer operating system and control mode. In: 2020 Management Science Informatization and Economic Innovation Development Conference (MSIEID), Guangzhou, China, pp 300–303. https://doi.org/10.1109/MSIEID52046.2020.00062

  3. Rakesh S, Kovács G, Mokayed H, Saini R, Pal U (2021) Static palm sign gesture recognition with leap motion and genetic algorithm. In: 2021 Swedish Artificial Intelligence Society Workshop (SAIS), Sweden, pp 1–5. https://doi.org/10.1109/SAIS53221.2021.9508468

  4. Islam MZ, Hossain MS, Islam R, Andersson K (2019) Static hand gesture recognition using convolutional neural network with data augmentation. In: 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), Spokane, WA, USA, pp 324–329. https://doi.org/10.1109/ICIEV.2019.8858563

  5. Karna RSN, Kode JS, Nadipalli S, Yadav S (2021) American sign language static gesture recognition using deep learning and computer vision. In: 2021 2nd International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India, pp 1432–1437. https://doi.org/10.1109/ICOSEC51865.2021.9591845

  6. Sharma S, Jain S, Khushboo (2019) A static hand gesture and face recognition system for blind people. In: 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India, pp 534–539. https://doi.org/10.1109/SPIN.2019.8711706

  7. Suja P, Purushothaman A (2020) Development of smart home using gesture recognition for disabled and elderly. J Comp Theo Nanosci 17:177–181

    Google Scholar 

  8. Megalingam RK, Rangan V, Veliyara P, Krishna RR, Prabhu R, Katoch R, Koppaka GSA, Sankaran R (2019) Design, analysis and performance evaluation of a hand gesture platform for navigation. Technol Health Care 27(4):417–430. https://doi.org/10.3233/THC-181294. PMID: 30909255

    Article  Google Scholar 

  9. Anant S, Veni S (2018) Safe driving using vision-based hand gesture recognition system in non-uniform illumination conditions. J ICT Res Appl 12:154

    Article  Google Scholar 

  10. Jacob A, Koshy M, Nisha KK (2021) Real time static and dynamic hand gestures cognizance for human computer interaction. In: 2021 International Conference on Advances in Computing and Communications (ICACC), Kochi, Kakkanad, India, pp 1–6. https://doi.org/10.1109/ICACC-202152719.2021.9708249

  11. Devaraj A, Nair AK (2020) Hand gesture signal classification using machine learning. In: 2020 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, pp 0390–0394. https://doi.org/10.1109/ICCSP48568.2020.9182045

  12. Qi J, Jiang G, Li G, Sun Y, Tao B (2019) Intelligent human-computer interaction based on surface EMG gesture recognition. IEEE Access 7:61378–61387. https://doi.org/10.1109/ACCESS.2019.2914728

    Article  Google Scholar 

  13. Zhang Z, Wu B, Jiang Y (2022) Gesture recognition system based on improved YOLO v3. In: 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi'an, China, pp 1540–1543. https://doi.org/10.1109/ICSP54964.2022.9778394.

  14. Köpüklü O, Gunduz A, Kose N, Rigoll G (2019) Real-time hand gesture detection and classification using convolutional neural networks. In: 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019), Lille, France, pp 1–8. https://doi.org/10.1109/FG.2019.8756576

  15. Bal D, Arfi AM, Dey S (2021) Dynamic hand gesture pattern recognition using probabilistic neural network. In: 2021 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), Toronto, ON, Canada, pp 1–4. s10.1109/IEMTRONICS52119.2021.9422496

    Google Scholar 

  16. Telluri P, Manam S, Somarouthu S, Oli JM, Ramesh C (2020) Low cost flex powered gesture detection system and its applications. In: 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India, pp 1128–1131. https://doi.org/10.1109/ICIRCA48905.2020.9182833

  17. Wong WK, Juwono FH, Khoo BTT (2021) Multi-features capacitive hand gesture recognition sensor: a machine learning approach. IEEE Sensors J 21(6):8441–8450, 15 March. https://doi.org/10.1109/JSEN.2021.3049273

  18. Ranawat M, Rajadhyaksha M, Lakhani N, Shankarmani R (2021) Hand gesture recognition based virtual mouse events. In: 2021 2nd International Conference for Emerging Technology (INCET), Belagavi, India, 2021, pp 1–4. https://doi.org/10.1109/INCET51464.2021.9456388

  19. Li K, Cheng J, Zhang Q, Liu J (2018) Hand gesture tracking and recognition based human-computer interaction system and its applications. IEEE International Conference on Information and Automation (ICIA) 2018:667–672. https://doi.org/10.1109/ICInfA.2018.8812508

    Article  Google Scholar 

  20. Chowdhury SR, Pathak S, Praveena MDA (2020) Gesture recognition based virtual mouse and keyboard. In: 2020 4th International Conference on Trends in Electronics and Informatics (ICOEI)(48184), pp 585–589. https://doi.org/10.1109/ICOEI48184.2020.9143016

  21. Nagalapuram GD, Nazareth DJ et al (2021) Controlling media player with hand gestures using convolutional neural network. In: 2021 IEEE Mysore Sub Section International Conference (MysuruCon), pp 79–86, https://doi.org/10.1109/MysuruCon52639.2021.9641567

  22. Shibly KH, Dey SD, Islam MA, Showrav SI (2019) Design and development of hand gesture based virtual mouse. In: 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), Dhaka, Bangladesh, pp 1–5. https://doi.org/10.1109/ICASERT.2019.8934612.

  23. Li Z, Lei Z, Yan A, Solovey E, Pahlavan K (2020) ThuMouse: a micro-gesture cursor input through mmWave Radar-based interaction. In: 2020 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, pp 1–9. https://doi.org/10.1109/ICCE46568.2020.9043082

  24. Enkhbat TK, Thaipisutikul ST, Hakim NL, Aditya W (2020) HandKey: an efficient hand typing recognition using CNN for virtual keyboard. In: 2020—5th International Conference on Information Technology (InCIT), pp 315–319. https://doi.org/10.1109/InCIT50588.2020.9310783

  25. Lee T-H, Lee H-J (2018) Ambidextrous virtual keyboard design with finger gesture recognition. IEEE International Symposium on Circuits and Systems (ISCAS) 2018:1–4. https://doi.org/10.1109/ISCAS.2018.8351485

    Article  Google Scholar 

  26. Niranjani V, Keerthana R, Priya BM, Nekalya K, Padmanabhan AK (2021) System application control based on Hand gesture using Deep learning. In: 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS), pp 1644–1649. https://doi.org/10.1109/ICACCS51430.2021.9441732

  27. Zhang W, Wang J, Lan F (2021) Dynamic hand gesture recognition based on short-term sampling neural networks. IEEE/CAA J Auto Sinica 8(1):110–120. https://doi.org/10.1109/JAS.2020.1003465

    Article  Google Scholar 

  28. Li Y et al (2019) A dynamic hand gesture recognition model based on the improved dynamic time warping algorithm. In: 2019 25th International Conference on Automation and Computing (ICAC), pp 1–6. https://doi.org/10.23919/IConAC.2019.8895002

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidyapeetham, Bengaluru, India

    Kedarisetty Vishnu Sainadh, Kukkadapu Satwik, Vadde Ashrith & D. K. Niranjan

Authors
  1. Kedarisetty Vishnu Sainadh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kukkadapu Satwik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vadde Ashrith
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. D. K. Niranjan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kedarisetty Vishnu Sainadh .

Editor information

Editors and Affiliations

  1. Hertfordshire Business School, University of Hertfordshire, Hatfield, Hertfordshire, UK

    Jyoti Choudrie

  2. Department of AI and DS, Vishwakarma Institute of Information Technology, Pune, India

    Parikshit N. Mahalle

  3. Department of Computer Science, Faculty of Computer Science and Information Technology, University Putra Malaysia, Serdang, Selangor, Malaysia

    Thinagaran Perumal

  4. Global Knowledge Research Foundation, Ahmedabad, Gujarat, India

    Amit Joshi

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sainadh, K.V., Satwik, K., Ashrith, V., Niranjan, D.K. (2023). A Real-Time Human Computer Interaction Using Hand Gestures in OpenCV. In: Choudrie, J., Mahalle, P.N., Perumal, T., Joshi, A. (eds) IOT with Smart Systems. ICTIS 2023. Lecture Notes in Networks and Systems, vol 720. Springer, Singapore. https://doi.org/10.1007/978-981-99-3761-5_26

Download citation

Publish with us

Policies and ethics

Search

Navigation