Skip to main content

A Review on Natural Language Processing: Back to Basics

  • Conference paper
  • First Online:
Innovative Data Communication Technologies and Application

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 59))

Abstract

Deep learning models have made incredible progress in tackling an assortment of natural language processing (NLP) issues. An ever-developing assortment of research, in any case, outlines the dependence of deep neural systems (DNNs) to ill-disposed models—inputs adjusted by acquainting little irritations with knowingly fooling an objective model into yielding mistaken outcomes. The powerlessness to aggressive models has gotten one of the fundamental obstacles blocking neural system organization into security basic conditions. This paper talks about the contemporary utilization of ill-disposed guides to thwart DNNs and presents an extensive audit of their utilization to improve the robustness of DNNs in NLP applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Jones KS (1994) Natural language processing: a historical review. In: Current issues in computational linguistics: in honour of Don Walker. Dordrecht, The Netherlands. Springer, pp 3–16

    Google Scholar 

  2. Liddy ED (2001) Natural language processing. In: Encyclopedia of library and information science, 2nd edn. Marcel Decker Inc, New York

    Google Scholar 

  3. Coates A, Huval B, Wang T, Wu D, Catanzaro B, Andrew N (2013) Deep learning with cots HPC systems. In: Proceedings of ICML, pp 1337–1345

    Google Scholar 

  4. Raina R, Madhavan A, Ng AY (2009) Large-scale deep unsupervised learning using graphics processors. In: Proceedings of ICML, pp 873–880

    Google Scholar 

  5. Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning, vol 1. MIT Press, Cambridge

    MATH  Google Scholar 

  6. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444

    Article  Google Scholar 

  7. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  8. Ciresan DC et al (2011) Flexible, high performance convolutional neural networks for image classification. Proc IJCAI 22(1):1237

    Google Scholar 

  9. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537

    MATH  Google Scholar 

  10. Goldberg Y (2017) Neural network methods for natural language processing. Synth Lect Hum Lang Technol 10(1):1–309

    Article  Google Scholar 

  11. Liu Y, Zhang M (2018) Neural network methods for natural language processing. Comput Linguist 44(1):193–195

    Article  MathSciNet  Google Scholar 

  12. Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. IEEE Comput Intell Mag 13(3):55–75

    Article  Google Scholar 

  13. Brierley C, Atwell E (2008) ProPOSEL: a human-oriented prosody and PoS English lexicon for machine-learning and NLP. In: Coling 2008: Proceedings of the workshop on cognitive aspects of the Lexicon (COGALEX 2008), pp 25–31

    Google Scholar 

  14. Hofmann T (2013) Probabilistic latent semantic analysis. arXiv preprint arXiv:1301.6705

  15. Drucker H, Wu D, Vapnik VN (1999) Support vector machines for spam categorization. IEEE Trans Neural Netw 10(5):1048–1054

    Article  Google Scholar 

  16. Tripathy A, Agrawal A, Rath SK (2015) Classification of sentimental reviews using machine learning techniques. Proc Comput Sci 57:821–829

    Article  Google Scholar 

  17. Schmidt A, Wiegand M (2017) A survey on hate speech detection using natural language processing. In: Proceedings of the fifth international workshop on natural language processing for social media, pp 1–10

    Google Scholar 

  18. Nockleby JT (2000) Hate speech. Encycl Am const 3(2):1277–9

    Google Scholar 

  19. Xiang G, Fan B, Wang L, Hong J, Rose C (2012) Detecting offensive tweets via topical feature discovery over a large scale twitter corpus. In: Proceedings of the 21st ACM international conference on information and knowledge management Oct 29, pp 1980–1984

    Google Scholar 

  20. Ponti EM, O’horan H, Berzak Y, Vulić I, Reichart R, Poibeau R, Shutova T, Shutova E, Korhonen A (2019) Modeling language variation and universals: a survey on typological linguistics for natural language processing. Comput Linguist 45(3):559–601

    Article  Google Scholar 

  21. Snyder B, Barzilay R (2008) Unsupervised multilingual learning for morphological segmentation. In: Proceedings of acl-08: hlt 2008 Jun, pp 737–745

    Google Scholar 

  22. Comrie B (1989, Jul 15) Language universals and linguistic typology: syntax and morphology. University of Chicago press

    Google Scholar 

  23. Croft B, Lafferty J (eds) (2003, May 31) Language modeling for information retrieval. Springer Science & Business Media

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to P. M. Dinesh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dinesh, P.M., Sujitha, V., Salma, C., Srijayapriya, B. (2021). A Review on Natural Language Processing: Back to Basics. In: Raj, J.S., Iliyasu, A.M., Bestak, R., Baig, Z.A. (eds) Innovative Data Communication Technologies and Application. Lecture Notes on Data Engineering and Communications Technologies, vol 59. Springer, Singapore. https://doi.org/10.1007/978-981-15-9651-3_54

Download citation

Publish with us

Policies and ethics