Abstract
In this paper, we present a study on the relationship between American Sign Language (ASL) statements and English written texts toward building a statistical machine translation (SMT) using 3D avatar for interpretation. The process included a novel algorithm which transforms an English part-of-speech sentence to ASL-Gloss. The algorithm uses a rule-based approach for building big parallel corpus from English to ASL-Gloss using dependency rules of grammatical parts of the sentence. The parallel corpus will be the input of the translation model of the SMT for ASL. The results we obtained are highly consistent, reproducible, with fairly high precision and accuracy.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Bangham, J., Cox, S., Elliott, R., Glauert, J., Marshall, I., Rankov, S., Wells, M.: Virtual signing: Capture, animation, storage and transmission - an overview of the visicast project. In: IEEE Seminar on Speech and Language Processing for Disabled and Elderly People, pp. 6/1–6/7 (2000)
Bellugi, U., Poizner, H., Klima, E.S.: Brain organization for language: Clues from sign aphasia. Human Neurobiology 2, 155–170 (1983)
Corbett, G.: Grammatical relations in a typology of agreement systems. In: Argument Structure and Grammatical Relations: A Crosslinguistic Typology. Studies in Language Companion Series, vol. 126, pp. 37–54 (2012)
Fischer, S.D.: The role of agreement and auxiliaries in sign languages. Sign Linguistics Phonetics, Phonology and Morphosyntax 98(3), 103–119 (1996)
Jaballah, K., Jemni, M.: Toward automatic sign language recognition from web3D based scenes. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 205–212. Springer, Heidelberg (2010)
Jemni, M., Elghoul, O.: A system to make signs using collaborative approach. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 670–677. Springer, Heidelberg (2008)
Jemni, M., Ghoul, O.E., Yahya, N.B., Boulares, M.: Sign language mms to make cell phones accessible to deaf and hard-of-hearing community. In: CVHI 2007 Euro-Assist Conference and Workshop on Assistive Technology for People with Vision and Hearing Impairments (2007)
Johnston, T., Schembri, A.: Australian Sign Language: An Introduction to Sign Language Linguistics. Cambridge University Press (2007)
Liddell, S.K.: Grammar, gesture, and meaning in American Sign Language. Cambridge University Press (2003)
Lillo-Martin, D., Klima, E.S.: Pointing out differences: Asl pronouns in syntactic theory. Theoretical Issues in Sign Language Research 1, 191–210 (1990)
Othman, A., Jemni, M.: Statistical sign language machine translation: from English written text to american sign language gloss. International Journal of Computer Science Issues 8, 65–73 (2011)
Othman, A., Tmar, Z., Jemni, M.: Toward developing a very big sign language parallel corpus. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 192–199. Springer, Heidelberg (2012)
Padden, C.: Interaction of morphology and syntax in american sign language. Doctoral thesis, University of California (1983)
de Quadros, R.M., Quer, J.: Back to back(wards) and moving on: On agreement, auxiliaries and verb classes. In: The 9th Theoretical Issues in Sign Language Research Conference (2008)
Rathmann, C.: The optionality of agreement phrase: Evidence from signed languages. Doctoral thesis, The University of Texas at Austin (2000)
Sáfár, É., Marshall, I.: The architecture of an English-text-to-sign-languages translation system. In: Recent Advances in Natural Language Processing (RANLP), pp. 223–228 (2001)
Sutton-Spence, R., Woll, B.: The Linguistics of British Sign Language: An Introduction. Cambridge University Press (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Othman, A., Jemni, M. (2014). A Novel Approach for Translating English Statements to American Sign Language Gloss. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8548. Springer, Cham. https://doi.org/10.1007/978-3-319-08599-9_65
Download citation
DOI: https://doi.org/10.1007/978-3-319-08599-9_65
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08598-2
Online ISBN: 978-3-319-08599-9
eBook Packages: Computer ScienceComputer Science (R0)