Abstract
Web Real-Time Communication (WebRTC) technology has quickly become popular as a video conferencing platform since it enables cost-effective peer-to-peer communication via browsers. In order to test cost-effectiveness of using WebRTC technology, it is necessary to dispose of user feedback through Quality of Experience (QoE) scores, considering various Influence Factors (IFs). Several studies have analyzed the impact of Context IFs (CIFs) on perceived QoE so far. This paper considers the impact of two CIFs, i.e., conversational task and different types of WebRTC-based applications on the QoE of video communication. In this sense, it focuses on several QoE dimensions, i.e., the overall satisfaction, efficiency, ease of use, and acceptance of WebRTC. QoE scores were collected by survey, and then statistically analyzed using Analysis of Variance (ANOVA) and Pearson correlation. Multi-Layer Perceptron (MLP) Artificial Neural Network (ANN) model has been developed in order to predict QoE based on its dimensions (i.e., overall satisfaction, efficiency, ease of use, and acceptance). Results indicate that the developed MLP model has a medium strong ability to make accurate QoE predictions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Cisco: Cisco visual networking index: forecast and trends, 2017–2022. White Paper [Online]. Available: https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html (2019)
Baraković Husić, J., et al.: Quality of experience for unified communications: a survey. Int. J. Netw. Manag. (2019)
Baraković Husić, J., Baraković, S., Veispahić, A.: What factors influence the quality of experience for WebRTC video calls? In: Proceedings of the 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). Opatija, Croatia (2017)
GSMA: WebRTC to complement IP communication services. White Paper [Online]. Available: https://www.gsma.com/futurenetworks/wp-content/uploads/2016/02/WebRTC_to_complement_IP_Communication_Services_v1.0.pdf (2016)
Baraković, S., Baraković Husić, J.: Web categorization and end user survey addressing mobile web. Bosanskohercegovačka elektrotehnika 10, 36–45 (2016)
Brunnström, K., et al.: Qualinet white paper on definitions of quality of experience [Online]. Available: https://www.qualinet.eu/images/stories/QoE_whitepaper_v1.2.pdf (2013)
Reiter, U., et al.: Factors influencing quality of experience. In: Quality of Experience: Advanced Concepts, Applications and Methods, pp. 55–72. Springer, Berlin, Germany (2014)
De Moore, K., et al.: Exploring diverse measures for evaluating QoE in the context of WebRTC. In: Proceedings of the 9th International Conference on Quality of Multimedia Experience (QoMEX). Erfurt, Germany (2017)
Belmudez, B., et al.: Audio and video channel impact on perceived audio-visual quality in different interactive contexts. In: Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP'09). Rio de Janeiro, Brazil (2009)
Bernard, L., et al.: Capturing the effects of context on human performance in computing systems. Pers. Ubiquit. Comput. 11(2), 81–96 (2007)
Engl, S., Nacke, L.E.: Contextual influences on mobile player experience: a game user experience model. Entertain. Comput. 4(1), 83–91 (2013)
Borowiak, A., Reiter, U.: Long duration audiovisual content: impact of content type and impairment appearance on user quality expectations over time. In: Proceedings of the 5th International Conference on Quality of Multimedia Experience (QoMEX). Klagenfurt am Wörthersee, Austria (2013)
Korhonen, H., et al.: Analyzing user experience of personal mobile products through contextual factors. In: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia (MUM’10). Limassol, Cyprus (2010)
Schmitt, M., et al.: Towards context-aware interactive quality of experience evaluation for audiovisual multiparty conferencing. In: Proceedings of the 5th Workshop on Perceptual Quality of Systems (PQS 2016). Berlin, Germany (2016)
Schmitt, M., et al.: The influence of interactivity patterns on the quality of experience in multi-party video-mediated conversations under symmetric delay conditions. In: Proceedings of the 3rd International Workshop on Socially-Aware Multimedia (SAM’14). Orlando, Florida, USA (2014)
Guse, D., et al.: Web-QoE under real-world distractions: two test cases. In: Proceedings of the 6th International Workshop on Quality of Multimedia Experience (QoMEX). Singapore (2014)
Sackl, A., et al.: Got what you want? Modeling expectations to enhance web QoE prediction. In: Proceedings of the 6th International Workshop on Quality of Multimedia Experience (QoMEX). Singapore (2014)
Strohmeier, D., et al.: Toward task-dependent evaluation of Web-QoE: free exploration vs. “who ate what?” In: Proceedings of the GLOBECOM Workshops 2012. Anaheim, California, USA (2012)
Suznjević, M., et al.: The impact of bandwidth limitations and video resolution size on QoE for WebRTC-based mobile multi-party video conferencing. In: Proceedings of the 5th ISCA/DEGA Workshop on Perceptual Quality of Systems (PQS 2016). Berlin, Germany (2016)
Seufert, M., et al.: Unperturbed video streaming QoE under web page related context factors. In: Proceedings of the Conference on Quality of Multimedia Experience (QoMEX). Erfurt, Germany (2017)
Voigt-Antons, J.N., et al.: User experience of web browsing—the relationship of usability and quality of experience. In: Proceedings of the 10th International Conference on Quality of Multimedia Experience (QoMEX). Sardinia, Italy (2018)
Baraković Husić, J., et al.: The influence of task complexity and duration when testing QoE in WebRTC. In: Proceedings of the 18th International Symposium INFOTEH-JAHORINA, East Sarajevo, Bosnia and Herzegovina (2019)
Casas, P., et al.: Predicting QoE in cellular networks using machine learning and in-smartphone measurements. In: Proceedings of the 9th International Conference on Quality of Multimedia Experience (QoMEX). Erfurt, Germany (2017)
Abar, T., et al.: Machine learning based QoE prediction in SDN networks. In: Proceedings of the International Wireless Communications and Mobile Computing (IWCMC). Valencia, Spain (2017)
Menkovski, V., et al.: Predicting quality of experience in multimedia streaming. In: Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia (MoMM’09). Kuala Lumpur, Malaysia (2009)
Paudel, I. et al.: Estimation of video QoE from MAC parameters in wireless network: a random neural network approach. In: Proceedings of the 14th International Symposium on Communications and Information Technologies (ISCIT). Incheon, South Korea (2014)
Machado, V.A., et al.: A new proposal to provide estimation of QoS and QoE over WiMAX networks: an approach based on computational intelligence and discrete-event simulation. In: Proceedings of the 3rd Latin-American Conference on Communications (LATINCOM), Belem do Para, Brazil (2011)
Wassermann, S., et al.: Machine learning models for youtube QoE and user engagement prediction in smartphones. ACM SIGMETRICS Perform. Eval. Rev. 46(3), 155–158 (2018)
Begluk, T., Baraković Husić, J., Baraković, S.: Machine learning-based QoE prediction for video streaming over LTE network. In: Proceedings of the 17th International Symposium INFOTEH-JAHORINA, East Sarajevo, Bosnia and Herzegovina (2018)
Vucic, D., et al.: The impact of mobile device factors on QoE for multi-party video conferencing via WebRTC. In: Proceedings of the 13th International Conference on Telecommunication (ConTEL). Gratz. Austria (2015)
Subjective quality evaluation of audio and audiovisual multiparty telemeetings, ITU-T P.1301 (2017)
Baraković, S., Skorin-Kapov, L.: Multidimensional modelling of quality of experience for mobile web browsing. Comput. Hum. Behav. 50, 314–332 (2015)
Baraković, S., Skorin-Kapov, L.: Modelling the relationship between design/performance factors and perceptual features contributing to quality of experience for mobile web browsing. Comput. Hum. Behav. 74, 311–329 (2017)
Miller, J., Haden, P.: Statistical analysis with the general linear model. In: Creative Commons Attribution (2006)
Osmanović, I., Baraković Husić, J., Baraković, S.: Impact of media-related SIFs on QOE for H.265/HEVC video streaming. J. Commun. Softw. Syst. 14(2), 157–179 (2018)
Golić, D., Baraković Husić, J., Baraković, S.: Impact of mobile ad-hoc network parameters on quality of experience for video streaming. In: Proceedings of the 17th International Symposium INFOTEH-JAHORINA. East Sarajevo, Bosnia and Herzegovina (2018)
Kain, N.K.: Understanding of multilayer perceptron (MLP) [Online]. Available: https://medium.com/@AI_with_Kain/understanding-of-multilayer-perceptron-mlp-8f179c4a135f (2019)
Acknowledgements
Authors would like to thank the reviewers for their thoughtful comments and efforts towards improving our paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Karadža, A., Baraković Husić, J., Baraković, S., Nogo, S. (2021). Multidimensional QoE Prediction of WebRTC Video Communication with Machine Learning. In: Avdaković, S., Volić, I., Mujčić, A., Uzunović, T., Mujezinović, A. (eds) Advanced Technologies, Systems, and Applications V. IAT 2020. Lecture Notes in Networks and Systems, vol 142. Springer, Cham. https://doi.org/10.1007/978-3-030-54765-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-54765-3_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-54764-6
Online ISBN: 978-3-030-54765-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)