Skip to main content

Arabic Hate Speech Identification by Enriching MARBERT Model with Hybrid Features

  • Conference paper
  • First Online:
Intelligent Sustainable Systems

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 579))

Abstract

The propagation of hate speech has grown more particularly apparent on social media sites as their usage for communication and unrestricted thought has increased on a worldwide scale. However, this could cause disagreement and antagonism among users, creating an unattractive online environment. Countries, companies, and academic institutions have all invested heavily in finding an effective solution to this challenge. There has been less study done in Arabic compared to other languages to develop automated systems for recognizing hate speech. Additionally, Arabic research on the correlation between personality traits and hate speech still remains rather limited. In this paper, we propose a novel method for enriching MARBERT model that incorporates static word embedding (AraVec 2.0) and personality trait features for Arabic hate speech detection. The experimental results indicate that the suggested methodology exceeds in terms of macro-F1 score by achieving 86.4% compared to previous research reported in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Al-Hassan, A., Al-Dossari, H.: Detection of hate speech in Arabic tweets using deep learning. Multimedia Syst. (2021). https://doi.org/10.1007/s00530-020-00742-w

    Article  Google Scholar 

  2. Husain, F., Uzuner, O.: A survey of offensive language detection for the Arabic language. ACM Trans. Asian Low-Resour. Lang. Inf. Process. 20, 1–44 (2021). https://doi.org/10.1145/3421504

    Article  Google Scholar 

  3. Elzayady, H., Mohamed, M.S., Badran, K.M., Salama, G.I.: Detecting Arabic textual threats in social media using artificial intelligence: an overview. Indonesian J. Electr. Eng. Comput. Sci. 25, 1712–1722 (2022). https://doi.org/10.11591/ijeecs.v25.i3.pp1712-1722

  4. Aljarah, I., Habib, M., Hijazi, N., Faris, H., Qaddoura, R., Hammo, B., Abushariah, M., Alfawareh, M.: Intelligent detection of hate speech in Arabic social network: a machine learning approach. J. Inf. Sci. (2020). https://doi.org/10.1177/0165551520917651

    Article  Google Scholar 

  5. Abuzayed, A., Elsayed, T.: Quick and simple approach for detecting hate speech in Arabic tweets. In: Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 109–114 (2020)

    Google Scholar 

  6. Elzayady, H., Mohamed, M.S., Badran, K.: Integrated bidirectional LSTM–CNN model for customers reviews classification (2021). https://doi.org/10.21608/JMTC.2021.66626.1172

  7. Alruily, M.: Classification of Arabic Tweets: A Review (2021)

    Google Scholar 

  8. Lee, K., Ram, S.: PERSONA: Personality-Based Deep Learning for Detecting Hate Speech. https://arizona.pure.elsevier.com/en/publications/persona-personality-based-deep-learning-for-detecting-hate-speech. Last accessed 2021/10/12

  9. Abdullah, I.: Enhancing contextualised language models with static character and word embeddings for emotional intensity and sentiment strength detection in Arabic tweets enhancing contextualised language models with static Ch. Proc. Comput. Sci. 189, 258–265 (2021). https://doi.org/10.1016/j.procs.2021.05.089

    Article  Google Scholar 

  10. Husain, F., Uzuner, O.: Transfer Learning Approach for Arabic Offensive Language Detection System—BERT-Based Model (2021)

    Google Scholar 

  11. Antoun, W., Baly, F., Hajj, H.: AraBERT: Transformer-Based Model for Arabic Language Understanding (2020)

    Google Scholar 

  12. Salim, M., Saad, S. and Aref, M.: Preprocessing the Egyptian Arabic dialect for personality traits prediction. Int. J. Intell. Comput. Inf. Sci. 19, 1–12 (2019). https://doi.org/10.21608/ijicis.2019.62603

  13. Djandji, M., Baly, F., Antoun, W., Hajj, H.: Multi-task learning using AraBert for offensive language detection. In: Proceedings of 4th Workshop Open-Source Arabic Corpora Processing Tools, with a Shared Task Offensive Language Detectection, pp. 97–101 (2020)

    Google Scholar 

  14. Haddad, H., Mulki, H., Oueslati, A.: T-HSAB: a Tunisian hate speech and abusive dataset. Commun. Comput. Inf. Sci. 1108, 251–263 (2019). https://doi.org/10.1007/978-3-030-32959-4_18

    Article  Google Scholar 

  15. Mulki, H., Haddad, H., Bechikh Ali, C., Alshabani, H.: L-HSAB: A Levantine Twitter Dataset for Hate Speech and Abusive Language, pp. 111–118 (2019). https://doi.org/10.18653/v1/w19-3512

  16. Elmadany, A., Zhang, C., Abdul-Mageed, M., Hashemi, A.: Leveraging Affective Bidirectional Transformers for Offensive Language Detection, pp. 102–108 (2020)

    Google Scholar 

  17. Omar, A., Mahmoud, T.M.: Comparative performance of machine learning and deep learning algorithms for Arabic hate speech detection in OSNs comparative performance of machine learning and deep learning algorithms for Arabic hate speech detection in OSNs. Springer International Publishing (2020). https://doi.org/10.1007/978-3-030-44289-7

    Article  Google Scholar 

  18. Albadi, N., Kurdi, M., Mishra, S.: Are they our brothers? Analysis and detection of religious hate speech in the Arabic Twittersphere. In: Proceedings of the 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2018, pp. 69–76 (2018). https://doi.org/10.1109/ASONAM.2018.8508247

  19. Faris, H., Aljarah, I., Habib, M., Castillo, P.A.: Hate Speech Detection using Word Embedding and Deep Learning in the Arabic Language Context Hate Speech Detection using Word Embedding and Deep Learning in the Arabic Language Context (2020).https://doi.org/10.5220/0008954004530460

  20. Abdul-Mageed, M., Elmadany, A., Nagoudi, E.M.B.: ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic (2020)

    Google Scholar 

  21. Duwairi, R., El-Orfali, M.: A study of the effects of preprocessing strategies on sentiment analysis for Arabic text. J. Inf. Sci. 40, 501–513 (2014). https://doi.org/10.1177/0165551514534143

    Article  Google Scholar 

  22. Salem, M.S., Ismail, S.S., Aref, M.: Personality Traits for Twitter Users in the Egyptian Dialect Writing Dataset. ICSIE, pp. 206–211 (2019)

    Google Scholar 

  23. Schick, T., Schütze, H.: Rare words: a major problem for contextualized embeddings and how to fix it by attentive mimicking. In: AAAI 2020—34th AAAI Conference on Artificial Intelligence, pp. 8766–8774 (2020). https://doi.org/10.1609/aaai.v34i05.6403

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hassam Elzayady .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Elzayady, H., Mohamed, M.S., Badran, K., Salama, G., Abdel-Rahim, A. (2023). Arabic Hate Speech Identification by Enriching MARBERT Model with Hybrid Features. In: Nagar, A.K., Singh Jat, D., Mishra, D.K., Joshi, A. (eds) Intelligent Sustainable Systems. Lecture Notes in Networks and Systems, vol 579. Springer, Singapore. https://doi.org/10.1007/978-981-19-7663-6_53

Download citation

Publish with us

Policies and ethics