Abstract
This paper presents the study of VoIP quality measurements from two popular codecs, G.711 and G.729, using the methods of Perceptual Evaluation of Speech Quality (PESQ) and Thai speech. In this study, from four lists of Thai speech, it has been found that G.711 provides better voice quality than G.729 in every condition of packet loss. Also, it has been found that Objective Listening Quality - Mean Opinion Score (MOS-LQO) of male speech is slightly higher than MOS-LQO of female speech, whereas MOS of child speech is the lowest. Then, MOS-LQO values from four Thai speech lists have been compared. Next, MOS-LQO from PESQ of male and female speech at the best condition have been compared with the Subjective Listening Quality Mean Opinion Score (MOS-LQS) from ACR listening tests in another laboratory. Lastly, referring to packet loss effects, objective MOS from PESQ have been compared with subjective MOS from conversation tests. It has been found that there is no significant difference among MOS-LQO from the four Thai speech lists, but it has been found that there is a significant difference between subjective MOS and objective MOS from each codec in each condition. Therefore, one can say that this is evidence that PESQ requires intensive study with Thai speech to modify PESQ for VoIP quality measurement in Thai environments confidently.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Daengsi, T., Wutiwiwatchai, C., Preechayasomboon, A., Sukparungsee, S.: A Study of VoIP Quality Evaluation: User Perception of Voice Quality from G.729, G.711 and G.722. In: Proc. 9th IEEE-CCNC 2012, Las Vegas, NV, pp. 342–345 (2012)
Triyason, T., Kanthamanon, P.: Perceptual Evaluation of Speech Quality Measurement on Speex Codec VoIP with Tonal Language Thai. In: Proc. 5th International Conference IAIT, Bangkok, Thailand, pp. 181–190 (2012)
Daengsi, T., et al.: The Development of a Thai Speech Set for Telephonometry, http://desceco.org/O-COCOSDA2010/proceedings/paper_53.pdf (accessed November 2012)
Daengsi, T., Preechayasomboon, A., Sukparungsee, S., Wutiwiwatchai, C.: Thai Text Resource: A Recommended Thai Text Set for Voice Quality Measurements and Its Comparative Study. KKU Science Journal 40(4), 1114–1127 (2012)
ITU-T Recommendation P.800 (Methods for subjective determination of transmission quality), http://www.itu.int/rec/T-REC-P.800-199608-I/en (accessed November 2012)
Telchemy. Voice Quality Measurement (Application Note), http://www.telchemy.com/appnotes/TelchemyVoiceQualityMeasurement.pdf (accessed August 2013)
Rango, F.D., et al.: Overview on VoIP: Subjective and Objective Measurement Methods. IJCSNC 6, 140–153 (2006)
Daengsi, T., Sukparungsee, S., Wutiwiwatchai, C., Preechayasomboon, A.: Comparison of Perceptual Voice Quality of VoIP Provided by G.711 and G.729 Using Conversation-Opinion Tests. IJCIM 20(1), 21–26 (2012)
Daengsi, T., Wutiwiwatchai, C., Preechayasomboon, A., Sukparungsee, S.: VoIP Quality Measurement: Insignificant Voice Quality of G.711 and G.729 Codecs in Listening-Opinion Tests by Thai Users. Information Technology Journal 8(1), 77–82 (2012)
http://ieeexplore.ieee.org/search/searchresult.jsp?queryText%3DVoIP+Quality+E-model&addRange=2009_2013_Publication_Year&pageNumber=1&resultAction=REFINE (accessed August 2013)
http://ieeexplore.ieee.org/search/searchresult.jsp?queryText%3DVoIP+Quality+PESQ&addRange=2009_2013_Publication_Year&pageNumber=1&resultAction=REFINE (accessed August 2013)
Goudarzi, M., Sun, L.: Performance analysis and comparison of PESQ and 3SQM in live 3G mobile networks, http://www.tech.plym.ac.uk/spmc/staff/mgoudarzi/Performance%20analysis%20and%20comparison%20of%20PESQ%20and%203SQM.pdf (accessed August 2013)
ITU-T Recommendation P.862. Perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of narrow-band telephone (2001)
ITU-T Recommendation P.862.2. Wideband extension to Recommendation P.862 for the assessment of wideband telephone networks and speech codecs (November 2007)
Karapantazis, S., Pavlidou, F.-N.: Voip: A comprehensive survey on a promising technology. Computer Networks 53, 2050–2090 (2009)
Ditech Networls. Limitations of PESQ for Measuring Voice Quality in Mobile and VoIP Networks https://www.google.co.th/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CDEQFjAA&url=http%3A%2F%2Fwww.packagingdigest.com%2Ffile%2F4534-white_paper_on_the_limitations_of_PESQ.pdf%3Fforce%3Dtrue&ei= NTdFUoXmHIHQrQfU2oHoDw&usg=AFQjCNGKfvZ5aWrk_kD2wr8IkamNfku5zw&bvm=bv.53217764,d.bmk (accessed September 2013)
Daengsi, T.: VoIP Quality Measurement: Recommendation of MOS and Enhance Objective Measurement Method for Standard Spoken Thai Language. Ph.D. Thesis, Faculty of Information Technology, King Mongkut’s University of Technology North Bangkok (November 2012)
Sodanil, M., Nitsuwat, S., Haruechaiyasak, C.: Thai Word Recognition Using Hybrid MLP-HMM. IJCSNS 10(3), 103–110 (2010)
Wutiwiwatchai, C., Furui, S.: Thai speech processing technology: A review. Speech Communication 49, 8–27 (2007)
Sittiprapaporn, W., Chindaduangratn, C., Kotchabhakdi, N.: Brain electric activity during the preattentive perception of speech sounds in tonal languages. SJST 26, 439–445 (2004)
Sittiprapaporn, W., Chindaduangratn, C., Kotchabhakdi, N.: Functional Specialization of the Human Auditory Cortex in Processing of Speech Prosody: A Low Resolution Electromagnetic Tomography (LORETA) Study, http://anchan.lib.ku.ac.th/kukr/bitstream/003/17786/1/KC4205011.pdf (accessed December 2012)
IEEE. Recommended practice for speech quality measurements. IEEE Trans. on Audio Electroacoust. 17(3), 225–246 (1969)
Suayroop, K., et al.: A VoIP Quality Measurement Study with Thai Speech Sets Using PESQ and G.711A-law. In: Proc. 34th Electricall Engineering Conference (EECON-34), Chonburi, Thailand (2011)
Sun, L., Ifeachor, E.: Perceived Speech Quality Prediction for Voice over IP-based Networks. In: Proc. IEEE Int. Conf. Communications 2002 (ICC 2002), New York, NY, pp. 2573–2577 (2002)
Ren, J., Zhang, H., Zhu, Y., Goa, C.: Assessment of effects of different language in VOIP. In: Proc. Int. Conf. Audio, Language and Image Processing (ICALIP 2008), Shanghai, China, pp. 1624–1628 (2008)
Daengsi, T., Wutiwiwatchai, C., Preechayasomboon, A., Sukparungsee, S.: Speech Quality Assessment of VoIP: G.711 VS G.722 Based on Interview Tests with Thai Users. IJITCS 4(2), 19–25 (2012)
ITU-T Recommendation P.862.3 (Application guide for objective quality measurement base on Recommendations P.862, P.862.1 and P.862.2) (November 2007)
Annex B Speech files, ITU-T Recommendation P.501, http://www.itu.int/net/itu-/sigdb/genaudio/AudioForm-.aspx?val=10000501 (accessed August 2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yochanang, K., Daengsi, T., Triyason, T., Wuttidittachotti, P. (2013). A Comparative Study of VoIP Quality Measurement from G.711 and G.729 Using PESQ and Thai Speech. In: Papasratorn, B., Charoenkitkarn, N., Vanijja, V., Chongsuphajaisiddhi, V. (eds) Advances in Information Technology. IAIT 2013. Communications in Computer and Information Science, vol 409. Springer, Cham. https://doi.org/10.1007/978-3-319-03783-7_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-03783-7_22
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03782-0
Online ISBN: 978-3-319-03783-7
eBook Packages: Computer ScienceComputer Science (R0)