Abstract
This work proposes a preliminary study of an automatic recognition system for the Italian Sign Language (Lingua Italiana dei Segni - LIS). Several other attempts have been made in the literature, but they are typically oriented to international languages. The system is composed of a feature extraction stage, and a sign recognition stage. Each sign is represeted by a single Hidden Markov Model, with parameters estimated through the resubstitution method. Then, starting from a set of features related to the position and the shape of head and hands, the Sequential Forward Selection technique has been applied to obtain feature vectors with the minimum dimension and the best recognition performance. Experiments have been performed using the cross-validation method on the Italian Sign Language Database A3LIS-147, maintaining the orthogonality between training and test sets. The obtained recognition accuracy averaged across all signers is 47.24%, which represents an encouraging result and demonstrates the effectiveness of the idea.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
- Hide Markov Model
- Automatic Recognition
- Sequential Forward Selection
- Feature Extraction Stage
- Italian Sign
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
von Agris, U., Zieren, J., Canzler, U., Bauer, B., Kraiss, K.F.: Recent Developments in Visual Sign Language Recognition. Univers. Access Inf. Soc. 6(4), 323–362 (2008)
Bradski, G.: The OpenCV library. j-DDJ 25(11), 122–125 (2000)
Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly Media, Inc., Sebastopol (2008)
Canny, J.: A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8(6), 679–698 (1986)
Chaudhry, R., Ravichandran, A., Hager, G., Vidal, R.: Histograms of Oriented Optical Flow and Binet-Cauchy Kernels on Nonlinear Dynamical Systems for the Recognition of Human Actions. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1932–1939. IEEE Computer Society, Los Alamitos (2009)
Dreuw, P., Forster, J., Deselaers, T., Ney, H.: Efficient Approximations to Model-Based Joint Tracking and Recognition of Continuous Sign Language. In: 8th IEEE International Conference on Automatic Face Gesture Recognition, pp. 1–6. IEEE Computer Society, Los Alamitos (2008)
Dreuw, P., Neidle, C., Sclaroff, V.A.S., Ney, H.: Benchmark Databases for Video-Based Automatic Sign Language Recognition. In: Proc. of the Sixth International Conference on Language Resources and Evaluation (LREC 2008). European Language Resources Association (ELRA), Marrakech (2008)
Dreuw, P., Ney, H.: Visual Modeling and Feature Adaptation in Sign Language Recognition. In: ITG Conference on Voice Communication (SprachKommunikation), pp. 1–4 (2008)
Dreuw, P., Ney, H., Martinez, G., Crasborn, O., Piater, J., Moya, J.M., Wheatley, M.: The SignSpeak Project - Bridging the Gap Between Signers and Speakers. In: Proc. of the Seventh International Conference on Language Resources and Evaluation (LREC 2010). European Language Resources Association (ELRA), Valletta (2010)
Fagiani, M., Principi, E., Squartini, S., Piazza, F.: A New Italian Sign Language Database. In: Zhang, H., Hussain, A., Liu, D., Wang, Z. (eds.) BICS 2012. LNCS, vol. 7366, pp. 164–173. Springer, Heidelberg (2012)
Hu, M.-K.: Visual Pattern Recognition by Moment Invariants. IRE Trans. on Information Theory 8(2), 179–187 (1962)
Infantino, I., Rizzo, R., Gaglio, S.: A Framework for Sign Language Sentence Recognition by Commonsense Context. IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews 37(5), 1034–1039 (2007)
Kukharev, G., Nowosielski, A.: Visitor Identification - Elaborating Real Time Face Recognition System. In: Proc. of WSCG (Short Papers), pp. 157–164. UNION Agency, Plzen (2004)
Maebatake, M., Suzuki, I., Nishida, M., Horiuchi, Y., Kuroiwa, S.: Sign Language Recognition Based on Position and Movement Using Multi-Stream HMM. In: Proc. of the 2nd Int. Symposium on Universal Communication, pp. 478–481. IEEE Computer Society, Los Alamitos (2008)
Sandler, W., Lillo-Martin, D.: Sign Language and Linguistic Universals. Cambridge University Press, Cambridge (2006)
Serra, J.: Image Analysis and Mathematical Morphology. Academic Press, Inc., Orlando (1983)
Theodorakis, S., Katsamanis, A., Maragos, P.: Product-HMMs for Automatic Sign Language Recognition. In: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1601–1604. IEEE Computer Society, Washington (2009)
Theodoridis, S., Koutroumbas, K.: Pattern Recognition, Fourth Edition. Academic Press, Burlington (2008)
Young, S.J., Evermann, G., Gales, M.J.F., Hain, T., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P.C.: The HTK Book, version 3.4. Cambridge University Press, Cambridge (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Fagiani, M., Principi, E., Squartini, S., Piazza, F. (2013). A New System for Automatic Recognition of Italian Sign Language. In: Apolloni, B., Bassis, S., Esposito, A., Morabito, F. (eds) Neural Nets and Surroundings. Smart Innovation, Systems and Technologies, vol 19. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35467-0_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-35467-0_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35466-3
Online ISBN: 978-3-642-35467-0
eBook Packages: EngineeringEngineering (R0)