Abstract
We present a new natural user interaction technique using finger gesture recognition and finger identification with Kinect depth data. We developed a gesture version drawing, multi-touch and mapping on 3d space interactions. We implemented three type interfaces using their interaction such as air-drawing, image manipulation and video manipulation. In this paper, we explain finger gesture recognition method, finger identification method and natural user interactions in detail. We show the preliminary experiment for evaluating accuracy of finger identification and finger gesture recognition accuracy, evaluating user questionnaire for interaction satisfaction. Finally, we discuss the result of evaluation and our contributions.
Chapter PDF
Similar content being viewed by others
References
Ren, Z., Meng, J., Zhang, Z.: Robust Hand Gesture Recognition with Kinect Sensor. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011 (2011)
Wigdor, D., Wixon, D.: Brave Nui World, pp. 9–15. Morgan Kaufmann (2011)
Cheoljong, Y., Yujeong, J., Jounghoon, B., David, H., Hanseok, K.: Gesture recognition using depth-based hand tracking for contactless controller application. In: 2012 IEEE International Conference on Consumer Electronics (ICCE), pp. 297–298 (2012)
Raheja, J., Ankit, C., Singal, S.: Tracking of fingertips and centers of palm using KINECT. In: 2011 Third International Conference on Computational Intelligence Modelling Simulation, pp. 248–252 (2011)
Chu, S., Tanaka, J.: Hand Gesture for Taking Self Portrait. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 238–247. Springer, Heidelberg (2011)
Kenn, H., Megan, F., Sugar, R.: A glove-based gesture interface for wearable computing applications. In: Proceedings of the IFAWC 4th International Forum on Applied Wearable Computing 2007, pp. 169–177 (2007)
Lenman, S., Bretzner, L., Thuresson, B.: Computer Vision Based Hand Gesture Interfaces for Human-Computer Interaction. Technical Report CID-172, Center for User Oriented IT Design, pp. 3–4 (2002)
Wachs, J., Kölsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Communications of the ACM 54(2), 60–70 (2011)
Frati, V., Prattichizzo, D.: Using Kinect for hand tracking and rendering in wearable haptics. In: IEEE World Haptics Conference, pp. 317–321 (2011)
Graham, R.: An efficient algorithm for determining the convex hull of a finite planar set. Information Processing Letter, 132–133 (1972)
Iwai, Y., Watanabe, K., Yagi, Y., Yachida, M.: Gesture recognition using colored gloves. In: IEEE Int. Conf. Pattern Recognition, vol. A, pp. 662–666 (1996)
Nanda, H., Fujimura, K.: Visual tracking using depth data. In: Conference on Computer Vision and Pattern Recognition Workshop, p. 37 (2004)
OpenNI organization. OpenNI User-Guide (2012)
He, G., Kang, S., Song, W., Jung, S.: Real time gesture recognition using 3D depth camera. In: 2011 IEEE 2nd International Conference on Software Engineering and Service Science (ICSESS), pp. 187–190 (2011)
Tang, M.: Hand Gesture Recognition Using Microsoft’s Kinect. Paper Written for CS228, Winter 2010. Technologies, UIST 2011, pp. 1–9. ACM (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, U., Tanaka, J. (2013). Finger Controller: Natural User Interaction Using Finger Gestures. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Modalities and Techniques. HCI 2013. Lecture Notes in Computer Science, vol 8007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39330-3_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-39330-3_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39329-7
Online ISBN: 978-3-642-39330-3
eBook Packages: Computer ScienceComputer Science (R0)