Abstract
In this paper we propose a finger tracking system that is suitable for gesture recognition in mobile devices. The initialisation of the system does not require the use of any I/O devices. The user covers the camera lense with his or her hand and then takes it to the operating distance. The statistical models used for hand segmentation are initialised from the first frames after the hand is removed from the lense. The hand segmentation does not need to be perfect because we do not use the hand contour in the recognition. In our method the fingertips are found using template matching. However, the template matching produces false detections. These false detections are pruned by searching a path from the fingertip to the estimated hand centre and discarding the paths that do not meet a predefined criteria. We evaluate the performance of the method against a fingertip detector proposed by Baldauf et al. [2] by using seven test subjects who initialise the system and then wave their hand in front of the camera. In testing we use one handheld USB camera that matches the image quality of most recent front cameras in mobile phones.
Chapter PDF
Similar content being viewed by others
References
An, J.-H., Min, J.-H., Hong, K.-S.: Finger Gesture-Based Mobile User Interface Using a Rear-facing Camera. In: Park, J.J., Yang, L.T., Lee, C. (eds.) FutureTech 2011, Part II. CCIS, vol. 185, pp. 230–237. Springer, Heidelberg (2011)
Baldauf, M., Zambanini, S., Frölich, P., Reichl, P.: Markerless Visual Fingertip Detection for Natural Mobile Device Interaction. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI, pp. 539–544 (2011)
Ben Jmaa, A., Mahdi, W., Ben Hmadou, A.: A new approach for digit recognition based on hand gesture analysis. International Journal of Computer Science and Information Security, 108–115 (2009)
Canny, J.: A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 679–698 (1986)
Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 790–799 (1995)
Collins, R.T., Zhou, X., Teh, S.K.: An Open Source Tracking Testbed and Evaluation Web Site. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (2005)
Davis, J.E., Gallo, O., Arteaga, S.M.: A camera-based pointing interface for mobile devices. In: IEEE International Conference on Image Processing, pp. 1420–1423 (2008)
Frati, V., Prattichizzo, D.: Using Kinect for hand tracking and rendering in wearable haptics. In: IEEE World Haptics Conference 2011, pp. 317–321 (2011)
Hasanuzzaman, M., Ampornaramveth, V., Zhang, T., Bhuyian, M.A., Shirai, Y., Ueno, H.: Real-time Vision-based Gesture Recognition for Human Robot Interaction. In: Proceedings of the IEEE International Conference on Robotics and Biomimetics, pp. 413–418 (2004)
Henrysson, A., Marshall, J., Billinghurst, M.: Experiments in 3d interaction for mobile phone AR. In: International Conference on Computer Graphics and Interactive Techniques in Australia and Southeast Asia, pp. 187–194 (2007)
Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-Learning-Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 6(1), 3789–3792 (2010)
Kölsch, M., Turk, M.: Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, p. 158 (2004)
Li, Z., Jarvis, R.: Real time Hand Gesture Recognition using a Range Camera. In: Australasian Conference on Robotics and Automation (2009)
Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: Proceedings of the 6th International Conference on Multimodal Interfaces, pp. 289–296 (2004)
Oikonomidis, I., Kyriazis, N., Argyros, A.: Efficient model-based 3D tracking of hand articulations using Kinect. In: Proceedings of the British Machine Vision Conference, pp. 101.1–101.11 (2011)
Oka, K., Sato, Y.: Real-Time Fingertip Tracking and Gesture Recognition. In: Computer Graphics and Applications, pp. 64–71 (2002)
Terajima, K., Komuro, T., Ishikawa, M.: Fast finger tracking system for in-air typing interface. In: Extended Abstracts on Human Factors in Computing Systems, pp. 3739–3744 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Matilainen, M., Hannuksela, J., Fan, L. (2013). Finger Tracking for Gestural Interaction in Mobile Devices. In: Kämäräinen, JK., Koskela, M. (eds) Image Analysis. SCIA 2013. Lecture Notes in Computer Science, vol 7944. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38886-6_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-38886-6_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38885-9
Online ISBN: 978-3-642-38886-6
eBook Packages: Computer ScienceComputer Science (R0)