Abstract
Over the past few decades, research has focused heavily on automatic speech recognition (ASR). Although ASR for a few languages is close to reality; ASR for the low resource languages like Malayalam is still in its infancy. Here, in this work, the authors discuss the experiment conducted on accented data of Malayalam speech using two approaches. One approach uses the spectral features for modeling using deep convolutional neural network and the other uses the influential features of speech signals for modeling using LSTM-RNN approach. The proposed methodology comprises three distinct stages; dataset preparation, feature extraction, classification, and hence the construction of deep learning models that recognize the accent-based spoken sentences in the Malayalam language. Mel-frequency cepstral coefficient (MFCC) algorithm, short-term Fourier transform (STFT), and mel spectrogram methodologies are used for feature engineering and hence the features that represent the speech signals are used for constructing the accented ASR system for the Malayalam language using long short-term memory (LSTM) a recurrent neural network (RNN). The spectrogram dataset has been constructed for the speech dataset and used for constructing the ASR model with deep convolutional neural network (DCNN). The result of the experiment shows that LSTM-based RNN outperforms DCNN for the proposed dataset that has been constructed for the experiment in the natural recording environment.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Teferra S, Tachbelie MY, Schulkz T (2020) Deep neural networks based automatic speech recognition for four Ethiopian languages. In: ICASSP 2020—2020 IEEE international conference on acoustics, speech and signal processing (ICASSP)
El-Moneim SA, Nassar MA, Dessouky MI, Ismail NA, El-Fishawy AS, Abd El-Samie FE (2020) Text-independent speaker recognition using LSTM-RNN and speech enhancement. Multimedia Tools Appl. https://doi.org/10.1007/s11042-019-08293-7
Palaz D, Magimai-Doss M, Collobert R (2015) Convolutional neural networks-based continuous speech recognition using raw speech signal. In: 2015 IEEE international conference on acoustics, speech and signal processing (ICASSP). https://doi.org/10.1109/icassp.2015.7178781
Sasikuttan A, James A, Mathews AP, Abhishek MP, Sebastian K (2020) Malayalam speech to text conversion. Int Res J Eng Technol (IRJET) 7(6)
Abdel-Hamid O, Mohamed AR, Jiang H, Deng L, Penn G, Yu D (2014) Convolutional neural networks for speech recognition. In IEEE/ACM transactions on audio, speech, and language processing, vol 22, no. 10, pp 1533–1545. https://doi.org/10.1109/TASLP.2014.2339736
Issa D, Fatih Demirci M, Yazici A (2020) Speech emotion recognition with deep convolutional neural networks. Biomed Signal Process Control 59:101894
Passricha V, Kumar Aggarwal R (2018) Convolutional neural networks for raw speech recognition. From Book-natural to artificial intelligence algorithms and applications. https://doi.org/10.5772/intechopen.80026
Sak H, Senior A, Beaufays F (2014) Long short-term memory recurrent neural network architectures for large scale acoustic modeling. 10.48550/arXiv.1402.1128
Yi J, Wen Z, Tao J et al (2018) CTC regularized model adaptation for improving LSTM RNN based multi-accent mandarin speech recognition. J Sign Process Syst 90:985–997
Ghule KR, Deshmukh RR (2015) Automatic speech recognition of Marathi isolated words using neural network. (IJCSIT) Int J Comput Sci Inf Technol 6(5):4296–4298
Shanthi T, Chelpa L (2014) Isolated word speech recognition system using Htk. Int J Comput Sci Eng Inf Technol Res (IJCSEITR) 4(2):81–86. ISSN(P): 2249-6831; ISSN(E): 2249-7943
Radzikowski K, Wang L, Yoshie O et al (2021) Accent modification for speech recognition of non-native speakers using neural style transfer. J Audio Speech Music Proc 2021:11
https://aditi-mittal.medium.com/understanding-rnn-and-lstm-f7cdf6dfc14e.
https://www.analyticsvidhya.com/blog/2021/03/introduction-to-long-short-term-memory-lstm.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Thandil, R.K., Mohamed Basheer, K.P. (2023). Analysis of Influential Features with Spectral Features for Modeling Dialectal Variation in Malayalam Speech Using Deep Neural Networks. In: Khanna, A., Polkowski, Z., Castillo, O. (eds) Proceedings of Data Analytics and Management . Lecture Notes in Networks and Systems, vol 572. Springer, Singapore. https://doi.org/10.1007/978-981-19-7615-5_46
Download citation
DOI: https://doi.org/10.1007/978-981-19-7615-5_46
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-7614-8
Online ISBN: 978-981-19-7615-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)