Abstract
This paper addresses the problem of using body gestures to control the Chinese shadow puppets with the Microsoft Kinect sensor. By analyzing the motion of the actors in the Chinese famous drama, Wusong Fights the Tiger, we propose a general framework for controlling two shadow puppets, a human model and an animal model. A performer can conduct simple actions such as turning the head, stretching the arms or kicking the legs. However, it is more difficult for a normal performer to simulate more complicated movements, for example, back flips and splits. Therefore we define some special postures to represent these difficult movements. Besides, in order to be compatible with the Chinese drama style, we use water color to paint the background scenery and the foreground characters. We show some preliminary results which demonstrate the effectiveness of this work.
Chapter PDF
Similar content being viewed by others
Keywords
References
Chen, F.P.L.: Visions for the Masses; Chinese Shadow Plays from Shaanxi and Shanxi. Cornell University (2004)
Leite, L., Orvalho, V.: Shape your body: Control a virtual silhouette using body motion. In: Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (2012)
Zhang, Z.R.M.Y.: Robust hand gesture recognition with kinect sensor. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 759–760 (2011)
banovic Volkan Isler Linnda R. Caporeal Jeff Trinkle, E.M.M.: Shadowplay: A generative model for nonverbal human-robot interaction. In: Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction, pp. 117–124 (2009)
Shao, L., Ji, L., Liu, Y., Zhang, J.: Human action segmentation and recognition via motion and shape analysis. Pattern Recognition Letters 33, 438–445 (2012)
Shao, L., Gao, R., Liu, Y., Zhang, H.: Transform based spatio-temporal descriptors for human action recognition. Neurocomputing 74, 962–973 (2011)
Wu, D., Shao, L.: Silhouette analysis based action recognition via exploiting human poses. IEEE Transactions on Circuits and Systems for Video Technology (2012)
Sturman, D.: Computer puppetry. IEEE Computer Graphics and Applications 18, 38–45 (1998)
Graham, W.: Course Notes: 3D Character Animation by Computer. In: Course Notes: 3D Character Animation by Computer, ACM SIGGRAPH, pp. 6–79 (1989)
Tardif, H.: Character animation in real time. In: Panel Proceedings: Applications of Virtual Reality I, ACM SIGGRAPH (1991)
Shin, H., Lee, J., Shin, S.Y., Gleicher, M.: Computer puppetry: An importance-based approach. ACM Trans. Graph., 67–94 (2001)
Hsu, W.S., Ye, T.: Planning character motions for shadow play animations. In: Proc. CASA, pp. 184–190 (2005)
Tan, K.L., Talib, A.Z., Osman, M.A.: Real-time simulation and interactive animation of shadow play puppets using opengl. International Journal of IJCIE 4, 1–8 (2010)
Lu, F., Tian, F., Jian, Y., Ca, X., Lu, W., Li, G., Zhang, X., Dai, G., Wang, H.: Shadowstory: creative and collaborative digital storytelling inspired by cultural heritage. In: Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 1919–1928 (2011)
Pan, J., Zhang, J.J.: Sketch-Based Skeleton-Driven 2D Animation and Motion Capture. In: Pan, Z., Cheok, A.D., Müller, W. (eds.) Transactions on Edutainment VI. LNCS, vol. 6758, pp. 164–181. Springer, Heidelberg (2011)
Kean, S., Hall, J.C., Perry, P.: Meet the Kinect: An Introduction to Programming Natural User Interfaces. Springer-Verlag New York Inc. (2011)
Emily Gobeille, T.W.: Interactive puppet prototype with xbox kinect (2011)
Walther, J.: Kinect digital puppeteering with openkinect (2010)
Boyle, C., Foster, A.: We be monsters: A collaborative kinect puppet (2011)
Lei, S.I.E., Chang, C.-F.: Real-Time Rendering of Watercolor Effects for Virtual Environments. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3333, pp. 474–481. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, H., Song, Y., Chen, Z., Cai, J., Lu, K. (2012). Chinese Shadow Puppetry with an Interactive Interface Using the Kinect Sensor. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7583. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33863-2_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-33863-2_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33862-5
Online ISBN: 978-3-642-33863-2
eBook Packages: Computer ScienceComputer Science (R0)