Abstract
Sign Language (SL) is the most important communication way between hearing-impaired community and normal persons. However, it is very common that the normal person does not know the SL. Thus, for assisting the hearing-impaired community to communicate in a world of spoken languages, there is a need to develop a translation tool to assist the communication between hearing-impaired community and normal persons. One of the translation tools available nowadays is Hearing Assistive Technology (HAT). HAT can dramatically improve the communication with hearing problem and increase the sustainability of social interaction in community. This paper presents an approach of HAT in the development of the sign language translation application for hearing-impaired communication by translating the SL gesture into a textual and audio form. This application integrates with a Microsoft Kinect Camera Sensor to detect the gesture of SL that is performed by the user who stands in front of the device. The SL translation application implements Dynamic Time Warping (DTW) algorithm. It measures the similarity between two sequences, which was the recorded gesture stored in text file and the current gesture performed by the user. This paper evaluates the application using a user acceptance test based on Technology Acceptance Model (TAM) that involved thirty (30) respondents to determine the effectiveness of the system. The evaluation shows that most of the participants positively accepted the proposed application. Therefore, this application provides insight on the role of HAT which has prepared opportunities for the hearing-impaired and normal person to compensate and empower the communication by using an automatic SL translation application.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abdallah EE, Fayyoumi E (2016) Assistive technology for deaf people based on android platform. Procedia Comput Sci 94:295–301
Ahmed W et al (2016) Vision based hand gesture recognition using dynamic time warping for Indian sign language. In: 2016 international conference on information science (ICIS), pp 120–125. IEEE
Bassil Y (2012) A simulation model for the waterfall software development life cycle. Int J Eng Technol 2(5):1–3
Edward AP et al (2012) Strategies for teaching learners with special needs. Pearson
Jabatan Kebajikan Masyarakat (JKM) Laporan Statistik Jabatan Kebajikan Masyarakat 2016. http://www.jkm.gov.my/jkm/uploads/files/penerbitan/Bukustatistik2016.pdf. Accessed 8 Apr 2019
Joseph P (2003) A study on certain factors influencing language performance of hearing impaired students. Asia Pac Disabil Rehabil J 14(2):201–208
Kazim A (2017) A study of software development life cycle process models. 8(1):15–23
Kbar G et al (2017) Assistive technologies for hearing, and speaking impaired people: a survey. Disabil Rehabil Assist Technol 12(1):3–20
LaPlante MP et al (1992) Assistive technology devices and home accessibility features: prevalence, payment, need, and trends. Advance data from vital and health statistics
Mokhtar SA, Anuar SMS (2015) Learning application for Malaysian sign language: content design, user interface and usability. In: Proceedings of the 9th international conference on ubiquitous information management and communication, pp 1–6. ACM, New York, NY, USA
Pollack ME (2005) Intelligent technology for an aging population: the use of AI to assist elders with cognitive impairment. 26(2):9–24
Sharma V, Droch B (2015) Gesture-controlled user interfaces. J Inf Sci Comput Technol 2(1):133–135
Shinohara K, Wobbrock JO (2011) In the shadow of misperception: assistive technology use and social interactions. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 705–714. ACM, New York, NY, USA
UNICEF Malaysia (2017) Childhood disability in Malaysia
Venkatesh V, Bala H (2008) Technology acceptance model 3 and a research agenda on interventions. Decis Sci 39:273–315
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Osman, M.N., Sedek, K.A., Zain, N.Z.M., Karim, M.A.N.A., Maghribi, M. (2020). Hearing Assistive Technology: Sign Language Translation Application for Hearing-Impaired Communication. In: Alias, N., Yusof, R. (eds) Charting the Sustainable Future of ASEAN in Science and Technology . Springer, Singapore. https://doi.org/10.1007/978-981-15-3434-8_1
Download citation
DOI: https://doi.org/10.1007/978-981-15-3434-8_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-3433-1
Online ISBN: 978-981-15-3434-8
eBook Packages: Social SciencesSocial Sciences (R0)