Skip to main content
SpringerLink
Log in

The Social Hashtag Recommendation for Image and Video Using Deep Learning Approach

  • Conference paper
  • First Online:
Sentiment Analysis and Deep Learning

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1432))

Abstract

There has been a lot of interest in the recent year in recommending hashtags for images/videos or posts on social media. Several researchers have researched the impact from numerous perspectives. In this paper, we enhance tag recommendation by recommending suitable hashtags considering both contents of the image/video and users’ history of the hashtag. On the social media image/video-sharing websites (such as Facebook, Instagram, Flickr, and Twitter), users can upload images or videos and tag them with tags. The proposed method generates candidate keywords, i.e., hashtag by combining techniques for textual tags, image and video activity/object recognition content, and acoustic data. To this end, this paper examines different methodologies that associate information that is multi-modal and suggests hashtags for image or video uploader users to generate tags for their images or videos. Although a substantial amount of study has been carried out on item/product recommendations for E-commerce websites, video recommendations for YouTube and Netflix, and friend suggestions on social media websites, research has not been carried out as much on hashtag recommendations for images/video on social media platform/app/websites, which have now turned out to be a vital role of these social media platforms. Here, in this paper, glance at hashtag recommendations for image/video has been carried.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Thomee, B., Elizalde, B., Shamma, D. A., Ni, K., Friedland, G., Poland, D., Borth, D., & Li, A. L. J. (2016). YFCC100M: The new data in multimedia research. Communications of the ACM, 59(2), 64–73. Association for Computing Machinery. https://doi.org/10.1145/2812802

  2. Baltrušaitis, T., Ahuja, C., & Morency, L. -P. (2017). Multimodal machine learning: A survey and taxonomy.

    Google Scholar 

  3. Shah, R. R., Samanta, A., Gupta, D., Yu, Y., Tang, S., & Zimmermann, R. (2017). PROMPT: Personalized user tag recommendation for social media photos leveraging personal and social contexts. In Proceedings—2016 IEEE International Symposium on Multimedia, ISM 2016 (pp. 486–492).

    Google Scholar 

  4. Cao, D., Miao, L., Rong, H., Qin, Z., & Nie, L. (2020). Hashtag our stories: Hashtag recommendation for micro-videos via harnessing multiple modalities. Knowledge-Based Systems, 203.

    Google Scholar 

  5. Zhou, R., Xia, D., Wan, J., & Zhang, S. (2020). An intelligent video tag recommendation method for improving video popularity in mobile computing environment. IEEE Access, 8, 6954–6967.

    Article  Google Scholar 

  6. Yang, Q., Wu, G., Li, Y., Li, R., Gu, X., Deng, H., & Wu, J. (2020). AMNN: Attention-based multimodal neural network model for hashtag recommendation. IEEE Transactions on Computational Social Systems, 7(3), 768–779.

    Article  Google Scholar 

  7. Wang, X., Zhang, Y., & Yamasaki, T. (2019). User-aware folk popularity rank: User-popularity-based tag recommendation that can enhance social popularity. In MM 2019—Proceedings of the 27th ACM International Conference on Multimedia (pp. 1970–1978).

    Google Scholar 

  8. Ma, R., Qiu, X., Zhang, Q., Hu, X., Jiang, Y. G., & Huang, X. (2021). Co-attention memory network for multimodal microblog’s hashtag recommendation. IEEE Transactions on Knowledge and Data Engineering, 33(2), 388–400.

    Google Scholar 

  9. Park, M., Li, H., & Kim, J. (2016). HARRISON: A benchmark on HAshtag recommendation for real-world images in social networks.

    Google Scholar 

  10. Isinkaye, F. O., Folajimi, Y. O., & Ojokoh, B. A. (2015). Recommendation systems: Principles, methods and evaluation. Egyptian Informatics Journal, 16(3), 261–273. Elsevier B.V.

    Google Scholar 

  11. Wei, Y., Zhao, Z., Cheng, Z., Zhu, L., Yu, X., & Nie, L. (2019). Personalized hashtag recommendation for micro-videos. In MM 2019—Proceedings of the 27th ACM International Conference on Multimedia (pp. 1446–1454).

    Google Scholar 

  12. Wei, Y., He, X., Wang, X., Hong, R., Nie, L., & Chua, T. S. (2019). MMGCN: Multi-modal graph convolution network for personalized recommendation of micro-video. In MM 2019—Proceedings of the 27th ACM International Conference on Multimedia (pp. 1437–1445).

    Google Scholar 

  13. Singh, A., Saini, S., Shah, R., & Narayanan, P. J. (2016, December 18). Learning to hash-tag videos with Tag2Vec. In ACM International Conference Proceeding Series.

    Google Scholar 

  14. Institute of Electrical and Electronics Engineers, IEEE Computer Society, IEEE Circuits and Systems Society, IEEE Communications Society, & IEEE Signal Processing Society. (n.d.). In 2020 IEEE International Conference on Multimedia and Expo (ICME), 06–10 July 2020, London, UK.

    Google Scholar 

  15. Nguyen, H. T. H., Wistuba, M., & Schmidt-Thieme, L. (n.d.). Personalized tag recommendation for images using deep transfer learning.

    Google Scholar 

  16. Zheng, L., Tianlong, Z., Huijian, H., & Caiming, Z. (2020). Personalized tag recommendation based on convolution feature and weighted random walk. International Journal of Computational Intelligence Systems, 13(1), 24–35.

    Article  Google Scholar 

  17. Hachaj, T., & Miazga, J. (2020). Image hashtag recommendations using a voting deep neural network and associative rules mining approach. Entropy, 22(12), 1–13.

    Article  Google Scholar 

  18. Association for Computing Machinery. Special Interest Group on Information Retrieval. (2008). In SIGIR ’08: The 31st annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 20–24, 2008, Singapore. Association for Computing Machinery.

    Google Scholar 

  19. Song, Y., Zhang, L., & Giles, C. L. (2011). Automatic tag recommendation algorithms for social recommender systems. ACM Transactions on the Web, 5(1).

    Google Scholar 

  20. Belém, F. M., Almeida, J. M., & Gonçalves, M. A. (2017). A survey on tag recommendation methods. Journal of the Association for Information Science and Technology, 68(4), 830–844. Wiley.

    Google Scholar 

  21. Li, M., Cheng, Z., Gan, T., Yin, J., Liu, M., & Nie, L. (2019). Long-tail hashtag recommendation for micro-videos with graph convolutional network. In International Conference on Information and Knowledge Management, Proceedings (pp. 509–518).

    Google Scholar 

  22. Yang, C., Wang, X., & Jiang, B. (2020). Sentiment enhanced multi-modal hashtag recommendation for micro-videos. IEEE Access, 8, 78252–78264.

    Article  Google Scholar 

  23. Toderici, G., Aradhye, H., Pasçca, M., Sbaiz, P. L., & Yagnik, J. (n.d.). Finding meaning on YouTube: Tag recommendation and category discovery.

    Google Scholar 

  24. Quintanilla, E., Rawat, Y., Sakryukin, A., Shah, M., & Kankanhalli, M. (2021). Adversarial learning for personalized tag recommendation. IEEE Transactions on Multimedia, 23, 1083–1094.

    Article  Google Scholar 

  25. Rappa, M., & ACM Digital Library. (2010). In Proceedings of the 19th international conference on World wide web. ACM.

    Google Scholar 

  26. Bharadwaj, P. N., Shivashankaran, T., & N, S. D. (n.d.). Prediction of hashtags for images. www.ijert.org

  27. Kumar, N., Baskaran, E., Konjengbam, A., & Singh, M. (2021). Hashtag recommendation for short social media texts using word-embeddings and external knowledge. Knowledge and Information Systems, 63(1), 175–198.

    Article  Google Scholar 

  28. IEEE Computational Intelligence Society, International Neural Network Society, Institute of Electrical and Electronics Engineers, & IEEE World Congress on Computational Intelligence (2016 : Vancouver, B. C.). (n.d.). In 2016 International Joint Conference on Neural Networks (IJCNN), 24–29 July 2016, Vancouver, Canada.

    Google Scholar 

  29. Smys, S., Chen, J. I. Z., & Shakya, S. (2020). Survey on neural network architectures with deep learning. Journal of Soft Computing Paradigm (JSCP), 2(03), 186–194.

    Google Scholar 

  30. Zhang, C., Yang, Z., He, X., & Deng, L. (2019). Multimodal intelligence: Representation learning, information fusion, and applications.

    Google Scholar 

  31. Tajbakhsh, M. S., & Bagherzadeh, J. (2016). Microblogging hashtag recommendation system based on semantic TF-IDF: Twitter use case. In Proceedings—2016 4th International Conference on Future Internet of Things and Cloud Workshops, W-FiCloud 2016 (pp. 252–257). https://doi.org/10.1109/W-FiCloud.2016.59

  32. Kim, J., & Shim, K. (2017). General chairs’ preface. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): Vol. 10235 LNAI. Springer.

    Google Scholar 

  33. Zhang, Y., Hu, J., Sano, S., Yamasaki, T., & Aizawa, K. (2017). A tag recommendation system for popularity boosting. In MM 2017—Proceedings of the 2017 ACM Multimedia Conference (pp. 1227–1228). https://doi.org/10.1145/3123266.3127913

  34. Tonge, A., Caragea, C., & Squicciarini, A. (2018). Privacy-aware tag recommendation for image sharing. In HT 2018—Proceedings of the 29th ACM Conference on Hypertext and Social Media (pp. 52–56).

    Google Scholar 

  35. Zhang, J., Nie, L., Wang, X., He, X., Huang, X., & Chua, T. S. (2016). Shorter-is-better: Venue category estimation from micro-video. In MM 2016—Proceedings of the 2016 ACM Multimedia Conference (pp. 1415–1424).

    Google Scholar 

  36. Lops, P., de Gemmis, M., Semeraro, G., Musto, C., & Narducci, F. (2013). Content-based and collaborative techniques for tag recommendation: An empirical evaluation. Journal of Intelligent Information Systems, 40(1), 41–61.

    Article  Google Scholar 

  37. Click-Through Rate Prediction with Multi-Modal Hypergraphs. (n.d.). https://www.tiktok.com/

  38. Wang, S., Lo, D., Vasilescu, B., & Serebrenik, A. (2018). EnTagRec ++: An enhanced tag recommendation system for software information sites. Empirical Software Engineering, 23(2), 800–832.

    Article  Google Scholar 

  39. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84–90.

    Article  Google Scholar 

  40. Yamasaki, T., Hu, J., Sano, S., & Aizawa, K. (2017). FolkPopularityRank: Tag recommendation for enhancing social popularity using text tags in content sharing services.

    Google Scholar 

  41. Tripathi, M. (2021). Analysis of convolutional neural network based image classification techniques. Journal of Innovative Image Processing (JIIP), 3(02), 100–117.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Gujarat Technological University, Ahmedabad, Gujarat, India

    Priyanka Panchal

  2. A. D. Patel Institute of Technology, CVM University, Anand, Gujarat, India

    Dinesh J. Prajapati

Authors
  1. Priyanka Panchal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dinesh J. Prajapati
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Priyanka Panchal .

Editor information

Editors and Affiliations

  1. Institute of Engineering, Tribhuvan University, Kirtipur, Nepal

    Subarna Shakya

  2. Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada

    Ke-Lin Du

  3. University of West Attica, Greece, Greece

    Klimis Ntalianis

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Panchal, P., Prajapati, D.J. (2023). The Social Hashtag Recommendation for Image and Video Using Deep Learning Approach. In: Shakya, S., Du, KL., Ntalianis, K. (eds) Sentiment Analysis and Deep Learning. Advances in Intelligent Systems and Computing, vol 1432. Springer, Singapore. https://doi.org/10.1007/978-981-19-5443-6_19

Download citation

Publish with us

Policies and ethics

Search

Navigation