Abstract
The task of next POI recommendations has been studied extensively in recent years. However, developing a unified recommendation framework to incorporate multiple factors associated with both POIs and users remains challenging, because of the heterogeneity nature of these information. Further, effective mechanisms to smoothly handle cold-start cases are also a difficult topic. Inspired by the recent success of neural networks in many areas, in this paper, we propose a simple yet effective neural network framework, named NEXT, for next POI recommendations. NEXT is a unified framework to learn the hidden intent regarding user’s next move, by incorporating different factors in a unified manner. Specifically, in NEXT, we incorporate meta-data information, e.g., user friendship and textual descriptions of POIs, and two kinds of temporal contexts (i.e., time interval and visit time). To leverage sequential relations and geographical influence, we propose to adopt DeepWalk, a network representation learning technique, to encode such knowledge. We evaluate the effectiveness of NEXT against other state-of-the-art alternatives and neural networks based solutions. Experimental results on three publicly available datasets demonstrate that NEXT significantly outperforms baselines in real-time next POI recommendations. Further experiments show inherent ability of NEXT in handling cold-start.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
He X, Liao L, Zhang H, Nie L, Hu X, Chua T S. Neural collaborative filtering. In: Proceedings of International Conference on World Wide Web. 2017, 173–182
Cheng C, Yang H, Lyu M R, King I. Where you like to go next: successive point-of-interest recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2013, 2605–2611
Feng S, Li X, Zeng Y, Cong G, Chee Y M, Yuan Q. Personalized ranking metric embedding for next new POI recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2069–2075
Ye M, Yin P, Lee W C, Lee D L. Exploiting geographical influence for collaborative point-of-interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2011, 325–334
Li X, Cong G, Li X L, Pham T A N, Krishnaswamy S. Rank-GeoFM: a ranking based geographical factorization method for point of interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 433–442
Ye M, Yin P, Lee W C. Location recommendation for location-based social networks. In: Proceedings of SIGSPATIAL International Conference on Advances in Geographic Information Systems. 2010, 458–461
Xiong L, Chen X, Huang T K, Schneider J G, Carbonell J G. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: Proceedings of SIAM International Conference on Data Mining. 2010, 211–222
Yuan Q, Cong G, Ma Z, Sun A, Thalmann N M. Time-aware point-of-interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2013, 363–372
Xie M, Yin H, Wang H, Xu F, Chen W, Wang S. Learning graph-based POI embedding for location-based recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2016, 15–24
Zhang W, Wang J. Location and time aware social collaborative retrieval for new successive point-of-interest recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2015, 1221–1230
Yin H, Cui B, Zhou X, Wang W, Huang Z, Sadiq S. Joint modeling of user check-in behaviors for real-time point-of-interest recommendation. ACM Transaction on Information Systems, 2016, 35(2): 11
Cheng C, Yang H, King I, Lyu M R. Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2012, 17–23
Liu B, Fu Y, Yao Z, Xiong H. Learning geographical preferences for point-of-interest recommendation. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2013, 1043–1051
Liu B, Xiong H, Papadimitriou S, Fu Y, Yao Z. A general geographical probabilistic factor model for point of interest recommendation. IEEE Transactions on Knowledge and Data Engineering, 2015, 27(5): 1167-1179
Gao H, Tang J, Liu H. gSCorr: modeling geo-social correlations for new check-ins on location-based social networks. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2012, 1582–1586
He J, Li X, Liao L, Song D, Cheung W K. Inferring a personalized next point-of-interest recommendation model with latent behavior patterns. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 137–143
Zhao S, Zhao T, Yang H, Lyu M R, King I. STELLAR: spatial-temporal latent ranking for successive point-of-interest recommendation. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 315–322
Mikolov T, Karafiát M, Burget L, Černocký J, Khudanpur S. Recurrent neural network based language model. In: Proceedings of Annual Conference of the International Speech Communication Association. 2010, 1045–1048
Mikolov T, Chen K, Corrada G, Dean J. Efficient estimation of word representations in vector space. 2013, arXiv preprint arXiv: 1301.3781
Cho K, Merrienboer B V, Gülçehre Ç, Bahdanau D, Bougares F, Schwenk H, Bengio Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014, 1724–1734
Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. In: Proceedings of International Conference on Learning Representations. 2015
Wang B, Liu K, Zhao J. Inner attention based recurrent neural networks for answer selection. In: Proceedings of Annual Meeting of the Association for Computational Linguistics. 2016, 1288–1297
Allamanis M, Peng H, Sutton C. A convolutional attention network for extreme summarization of source code. In: Proceedings of International Conference on Machine Learning. 2016, 2091–2100
Rumelhart D E, Hinton G E, Williams R J. Learning internal representations by error propagation. Technical Report, DTIC Document, 1985
Werbos P J. Generalization of backpropagation with application to a recurrent gas market model. Neural Networks, 1988, 1(4): 339–356
Bishop C M. Neural Networks for Pattern Recognition. Oxford: Oxford University Press, 1995
Hornik K, Stinchcombe M B, White H. Multilayer feedforward networks are universal approximators. Neural Networks, 1989, 2(5): 359–366
Covington P, Adams J, Sargin E. Deep neural networks for youtube recommendations. In: Proceedings of ACM Conference on Recommender Systems. 2016, 191–198
Kim D H, Park C, Oh J, Lee S, Yu H. Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of ACM Conference on Recommender Systems. 2016, 233–240
Liu Q, Wu S, Wang L, Tan T. Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 194–200
Zheng L, Noroozi V, Philip S Y. Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of ACM International Conference on Web Search and Data Mining. 2017, 425–434
Rendle S. Factorization machines with libFM. ACM Transactions Intelligent Systems and Technology, 2012, 3(3): 57
Elman J L. Finding structure in time. Cognitive Science, 1990, 14(2): 179–211
Yan R. i, poet: automatic poetry composition through recurrent neural networks with iterative polishing schema. In: Proceedings of International Joint Conference on Artificial Intelligence. 2016, 2238–2244
Zhang Y, Dai H, Xu C, Feng J, Wang T, Bian J, Wang B, Liu T Y. Sequential click prediction for sponsored search with recurrent neural networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2014, 1369–1375
Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735–1780
Chen X, Qiu X, Zhu C, Liu P, Huang X. Long short-term memory neural networks for Chinese word segmentation. In: Proceedings of Conference on Empirical Methods in Natural Language Processing. 2015, 1197–1206
Rocktäschel T, Grefenstette E, Hermann K M, Kociský T, Blunsom P. Reasoning about entailment with neural attention. In: Proceedings of International Conference on Learning Representations. 2016
Chung J, Gülçehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. In: Proceedings of 2014 Workshop on Deep Learning. 2014
Manotumruksa J, Macdonald C, Ounis I. A deep recurrent collaborative filtering framework for venue recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2017, 1429–1438
Feng J, Li Y, Zhang C, Sun F, Meng F, Guo A, Jin D. Deepmove: predicting human mobility with attentional recurrent networks. In: Proceedings of International Conference on World Wide Web. 2018, 1459–1468
Perozzi B, Rami A R, Skiena S. Deepwalk: online learning of social representations. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710
Cho E, Myers S A, Leskovec J. Friendship and mobility: user movement in location-based social networks. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2011, 1082–1090
Zhang J D, Chow C Y. Geosoca: exploiting geographical, social and categorical correlations for point-of-interest recommendations. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 443–452
Yang C, Liu Z, Zhao D, Sun M, Chang E Y. Network representation learning with rich text information. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2111–2117
Chen J, Zhang Q, Huang X. Incorporate group information to enhance network embedding. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2016, 1901–1904
Salakhutdinov R, Mnih A. Probabilistic matrix factorization. In: Proceedings of International Conference on Neural Information Processing Systems. 2007, 1257–1264
Hu Y, Koren Y, Volinsky C. Collaborative filtering for implicit feedback datasets. In: Proceedings of IEEE International Conference on Data Mining. 2008, 263–272
Srivastava N, Salakhutdinov R. Multimodal learning with deep boltzmann machines. In: Proceedings of International Conference on Neural Information Processing Systems. 2012, 2231–2239
Glorot X, Bordes A, Bengio Y. Deep sparse rectifier neural networks. In: Proceedings of International Conference on Artificial Intelligence and Statistics. 2011, 315–323
Acknowledgments
This research was supported by the National Natural Science Foundation of China (Grant Nos. 61872278, 61502344, 1636219, U1636101), Natural Science Foundation of Hubei Province (2017CFB502), Academic Team Building Plan for Young Scholars from Wuhan University (Whu2016012) and Singapore Ministry of Education Academic Research Fund Tier 2 (MOE2014-T2-2-066). We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan X GPU used for this research.
Author information
Authors and Affiliations
Corresponding author
Additional information
Zhiqian Zhang is currently a Master student at Wuhan University, under the supervision of Dr. Chenliang Li. She received Bachelor degree from Wuhan University, China in 2015. Her research interests include natural language processing, information retrieval, data mining, and social media analysis and mining.
Chenliang Li received PhD from Nanyang Technological University, Singapore in 2013. Currently, he is an associate professor at School of Cyber Science and Engineering, Wuhan University, China. His research interests include information retrieval, text/Web mining, data mining, and natural language processing. His papers appear in SIGIR, CIKM, ACL, AAAI, TOIS, TKDE, and JASIST.
Zhiyong Wu is a currently PhD student at Department of Computer Science, the University of Hong Kong, China. He received Bachelor degree from Wuhan University, China in 2017. His research interests include data mining, natural language processing, and database.
Aixin Sun is an associate professor with School of Computer Engineering, Nanyang Technological University, Singapore. He received PhD from the same school in 2004. His research interests include information retrieval, text mining, social computing, and multimedia. His papers appear in major international conferences like SIGIR, KDD, WSDM, ACM Multimedia, and journals including TOIS, TKDE, and JASIST.
Dengpan Ye is currently a professor in School of Cyber Science and Engineering, Wuhan University, China. He received the BASc in automatic control from SCUT in 1996 and PhD degree at NJUST in 2005 respectively. He worked as a Post-Doctoral Fellow in Information System School of Singapore Management University, Singapore.
His research interests include machine learning and multimedia security. He is the author or co-author of more than 30 refereed journal and conference papers.
Xiangyang Luo is currently a professor at Zhengzhou Science and Technology Institute and the State Key Laboratory of Mathematical Engineering and Advanced Computing, China. His research interests lie in multimedia security and cyberspace surveying and mapping. He is the author or co-author of more than 100 refereed international journal and conference papers. He has obtained the support of the National Natural Science Foundation of China and the National Key R&D Program of China.
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Zhang, Z., Li, C., Wu, Z. et al. NEXT: a neural network framework for next POI recommendation. Front. Comput. Sci. 14, 314–333 (2020). https://doi.org/10.1007/s11704-018-8011-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11704-018-8011-2