Skip to main content

Evaluation of Machine Learning Methods for Fake News Detection

  • Chapter
  • First Online:
Combating Fake News with Computational Intelligence Techniques

Part of the book series: Studies in Computational Intelligence ((SCI,volume 1001))

  • 1256 Accesses

Abstract

In a cyber-connected world, fake information appears to be more enticing or interesting to the audience because of their limited attention spans and the plethora of content choices. Taking this into account, fake news detection/classification is definitely becoming of paramount importance in order to avoid the so-called reality vertigo, preclude misinformation and protect actual reality. This chapter presents a comprehensive performance evaluation of eight machine learning algorithms who perform fake news detection/classification based on regression, support vector machines, neural networks, decision trees and Bayes theorem. In every case, our study reaffirms that performance is governed by the nature of data, nevertheless, it sheds light and draws safe generic conclusions with respect to the dimensionality that each algorithm should have, the kind of training that should be performed beforehand for each one of them, and finally the method for generating vector representations of textual information.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://www.nature.com/news/astronomers-explore-uses-for-ai-generated-images-1.21398.

  2. 2.

    https://www.statista.com/statistics/1105067/coronavirus-fake-news-by-politics-us/.

  3. 3.

    https://yaledailynews.com/blog/2018/01/22/yale-students-design-chrome-extension-to-combat-fake-news/.

  4. 4.

    http://research.signalmedia.co/newsir16/signal-dataset.html.

  5. 5.

    https://www.kaggle.com/mrisdal/fake-news.

  6. 6.

    http://www.politifact.com/.

  7. 7.

    https://nlp.stanford.edu/projects/glove/

Referesnces

  1. Liu, X., Zhang, B., Susarla, A., & Padman, R. Go to YouTube and see me tomorrow: The role of social media in managing chronic conditions. Available at https://ssrn.com/abstract=3061149

  2. Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146–1151.

    Google Scholar 

  3. Gupta, A., & Kumaraguru, P. (2012). Credibility ranking of tweets during high impact events. In Proceedings of the workshop on privacy and security in online social media.

    Google Scholar 

  4. Hardalov, M., Koychev, I., & Nakov, P. (2016). In search of credible news. In Proceedings of the artificial intelligence: Methodology, systems and applications (pp. 172–180).

    Google Scholar 

  5. Horne, B. D., & Adali, S. This just in: Fake news packs a lot in title, uses simpler, repetitive content in text body, more similar to satire than real news. Technical Report. Available at http://arxiv.org/abs/1703.09398

  6. Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017). Fake news detection on social media: A data mining perspective. ACM SIGKDD Explorations, 19(1), 22–36.

    Google Scholar 

  7. Guacho, G. B., Abdali, S., Shah, N., & Papalexakis, E. (2018). Semi-supervised content-based detection of misinformation via tensor embeddings. Technical Report. Available at https://arxiv.org/abs/1804.09088

  8. Hosseinimotlagh, S., & Papalexakis, E. (2018). Unsupervised content-based identification of fake news articles with tensor decomposition ensembles. In Proceedings of the workshop on misinformation and misbehavior mining on the web (MIS2).

    Google Scholar 

  9. Gupta, M., Zhao, P., & Han, J. (2012). Evaluating event credibility on Twitter. In Proceedings of the SIAM international conference on data mining (SDM) (pp. 153–164).

    Google Scholar 

  10. Sansonetti, G., Gasparetti, F., D’aniello, G., & Micarelli, A. (2020). Unreliable users detection in social media: Deep learning techniques for automatic detection. IEEE Access, 213154–213167.

    Google Scholar 

  11. Vogel, I., & Meghana, M. (2020). Detecting fake news spreaders on Twitter from a multilingual perspective. In Proceedings of the 2020 IEEE 7th international conference on data science and advanced analytics (DSAA) (pp. 599–606).

    Google Scholar 

  12. Gupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2010). Faking sandy: Characterizing and identifying fake images on Twitter during hurricane sandy. In Proceedings of the ACM international conference on world wide web (WWW) (pp. 729–736).

    Google Scholar 

  13. Galbally, J., Marcel, S., & Fierrez, J. (2014). Image quality assessment for fake biometric detection: Application to iris, fingerprint, and face recognition. IEEE Transactions on Image Processing, 710–724.

    Google Scholar 

  14. Güera, D., & Delp, E. J. (2018). Deep fake video detection using recurrent neural networks. In 15th IEEE international conference on advanced video and signal based surveillance (AVSS) (pp. 1–6).

    Google Scholar 

  15. Agrawal, R., & Sharma, D. K. (2021). A survey on video-based fake news detection techniques. In 8th International conference on computing for sustainable global development (INDIACom) (pp. 663–669).

    Google Scholar 

  16. Guo, B., Ding, Y., Yao, L., Liang, Y., & Yu, Z. (2020). The future of false information detection on social media: New perspectives and trends. ACM Computing Surveys.

    Google Scholar 

  17. Zhou, X., & Zafarani, R. (2020). A survey of fake news: Fundamental theories, detection methods, and opportunities. ACM Computing Surveys, 1–40.

    Google Scholar 

  18. Ghafari, S. M., Beheshti, A., Joshi, A., Paris, C., Mahmood, A., Yakhchi, S., & Orgun, M. A. (2020). A survey on trust prediction in online social networks. IEEE Access, 144292–144309.

    Google Scholar 

  19. Collins, B., Hoang, D. T., Nguyen, N. T., & Hwang, D. (2021). Trends in combating fake news on social media—A survey. Journal of Information and Telecommunication, 247–266.

    Google Scholar 

  20. Kumar, S., Kumar, S., Yadav, P., & Bagri, M. (2021). A survey on analysis of fake news detection techniques. In Proceedings of the 2021 international conference on artificial intelligence and smart systems (ICAIS) (pp. 894–899).

    Google Scholar 

  21. Choudhary, M., Jha, S., Prashant, Saxena, D., & Singh, A. K. (2021). A review of fake news detection methods using machine learning. In Proceedings of the 2021 2nd international conference for emerging technology (INCET) (pp. 1–5).

    Google Scholar 

  22. Kumar, P. J. S., Devi, P. R., Kumar, S. S., & Benarji, T. (2021). Battling fake news: A survey on mitigation techniques and identification. In Proceedings of the 2021 5th international conference on trends in electronics and informatics (ICOEI) (pp. 829–835).

    Google Scholar 

  23. Cortes, C., & Vapnik, V. (1995). Support-vector network. Machine Learning, 20, 273–297.

    MATH  Google Scholar 

  24. Vapnik, V. (1998). Statistical learning theory. Wiley.

    Google Scholar 

  25. Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and regression trees. Brooks/Cole Publishing.

    Google Scholar 

  26. Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32.

    Article  Google Scholar 

  27. Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. The MIT Press.

    Google Scholar 

  28. Robbins, H., & Monro, S. (1951). A stochastic approximation method. The Annals of Mathematical Statistics, 22(3).

    Google Scholar 

  29. Kingma, D. P., & Ba, J. L. (2015). ADAM: A method for stochastic optimization. In Proceedings of the international conference on learning representations (ICLR).

    Google Scholar 

  30. Nocedal, J. (1980). Updating quasi-Newton matrices with limited storage. Mathematics of Computation, 35, 773–782.

    Google Scholar 

  31. Selva. CNN classifier using 1D, 2D and 3D feature vectors. MATLAB central file exchange. https://www.mathworks.com/matlabcentral/fileexchange/68882-cnn-classifier-using-1d-2d-and-3d-feature-vectors. Retrieved August 4, 2021.

    Google Scholar 

  32. Aggarwal, C. C. (2018). Neural networks and deep learning: A textbook. Springer.

    Google Scholar 

  33. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, E. (2011). Scikit-learn: Machine learning in python. Journal of Machine Learning Research, 12, 2825–2830.

    MathSciNet  MATH  Google Scholar 

  34. Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the empirical methods in natural language processing (EMNLP).

    Google Scholar 

  35. Porter, M. F. (1980). An algorithm for suffix stripping. Program, 14(3), 130–137.

    Article  Google Scholar 

  36. Wang, W. Y. (2017). “Liar, liar pants on fire: A new benchmark dataset for fake news detection. In Proceedings of the annual meeting of the association for computational linguistics (pp. 422–426).

    Google Scholar 

  37. Pennington, J., Socher, R., & Manning, C. D. (2014). Glove: Global vectors for word representation. In Proceedings of the empirical methods in natural language processing (EMNLP).

    Google Scholar 

  38. Manning, C. D., Ragnavan, P., & Schütze, H. (2008). Introduction to information retrieval. Cambridge University Press.

    Google Scholar 

  39. Katsaros, D., Stavropoulos, G., & Papakostas, D. (2019). Which machine learning paradigm for fake news detection? In Proceedings of the 2019 IEEE/WIC/ACM international conference on web intelligence (WI) (pp. 383–387).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dimitrios Papakostas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Papakostas, D., Stavropoulos, G., Katsaros, D. (2022). Evaluation of Machine Learning Methods for Fake News Detection. In: Lahby, M., Pathan, AS.K., Maleh, Y., Yafooz, W.M.S. (eds) Combating Fake News with Computational Intelligence Techniques. Studies in Computational Intelligence, vol 1001. Springer, Cham. https://doi.org/10.1007/978-3-030-90087-8_8

Download citation

Publish with us

Policies and ethics