Abstract
Recommender systems (RS) have been gaining momentum with the advent of digitalization of our daily lives, accordingly, companies seek to attract most customers in this environment. One way of attracting more customers by advertisements is through online ads that make use of click-through rates (CTR) for the ads to build efficient RSS. For the RSS, frequently utilized methods are collaborative filtering (CF), content-based filtering (CBF) along with one of the traditional reinforcement learning approaches. The objective of this paper is to determine the best online ad among multiple advertisements to show the customers by reinforcement learning (RL). By treating the problem in multi-armed bandits, we modeled the problem with Bernoulli distribution by means of obtained CTRs. The best ad was tried to be chosen by the Bernoulli bandit with three settings; A/B/n testing, epsilon greedy, and Upper Confidence Bound (UCB) methods. The results show the explorations’ contribution (with UCB and epsilon greedy) to the performance of the methods. Each method chose the same ad to show for online ads. UCB found the most preferable ad with a CTR rate of around 27.01%. It was followed by the epsilon greedy strategy with a CTR of around 25%. All the methods used determined the same ad alternative as the best according to the results obtained.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ebesu, T., Shen, B., Fang, Y.: Collaborative memory network for recommendation systems. In: The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 515–524, June 2018
Khanal, S.S., Prasad, P.W.C., Alsadoon, A., Maag, A.: A systematic review: machine learning based recommendation systems for e-learning. Educ. Inf. Technol. 25(4), 2635–2664 (2019). https://doi.org/10.1007/s10639-019-10063-9
Al Hassanieh, L., Abou Jaoudeh, C., Abdo, J.B., Demerjian, J.: Similarity measures for collaborative filtering recommender systems. In: 2018 IEEE Middle East and North Africa Communications Conference (MENACOMM), pp. 1–5. IEEE, April 2018
Wu, C.S.M., Garg, D., Bhandary, U.: Movie recommendation system using collaborative filtering. In: 2018 IEEE 9th International Conference on Software Engineering and Service Science (ICSESS), pp. 11–15. IEEE, November 2018
Srifi, M., Oussous, A., Ait Lahcen, A., Mouline, S.: Recommender systems based on collaborative filtering using review texts—A survey. Information 11(6), 317 (2020)
Chen, R., Hua, Q., Chang, Y.S., Wang, B., Zhang, L., Kong, X.: A survey of collaborative filtering-based recommender systems: from traditional methods to hybrid methods based on social networks. IEEE Access 6, 64301–64320 (2018)
Aggarwal, C.C.: Recommender Systems, vol. 1. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29659-3
Melville, P., Sindhwani, V.: Recommender systems. Encycl. Mach. Learn. 1, 829–838 (2010)
Melville, P., Mooney, R.J., Nagarajan, R.: Content-boosted collaborative filtering for improved recommendations. AAAI/IAAI 23, 187–192 (2002)
Balabanović, M., Shoham, Y.: Fab: content-based, collaborative recommendation. Commun. ACM 40(3), 66–72 (1997)
Van Meteren, R., Van Someren, M.: Using content-based filtering for recommendation. In: Proceedings of the Machine Learning in the New Information Age: MLnet/ECML2000 Workshop, vol. 30, pp. 47–56, May 2000
Thorat, P.B., Goudar, R.M., Barve, S.: Survey on collaborative filtering, content-based filtering and hybrid recommendation system. Int. J. Comput. Appl. 110(4), 31–36 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yazici, I., Ari, E. (2022). Intelligent Systems Utilization in Recommender Systems: A Reinforcement Learning Approach. In: Kahraman, C., Tolga, A.C., Cevik Onar, S., Cebi, S., Oztaysi, B., Sari, I.U. (eds) Intelligent and Fuzzy Systems. INFUS 2022. Lecture Notes in Networks and Systems, vol 505. Springer, Cham. https://doi.org/10.1007/978-3-031-09176-6_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-09176-6_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-09175-9
Online ISBN: 978-3-031-09176-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)