Skip to main content

A Review on Network Intrusion Detection System Using Machine Learning

  • Conference paper
  • First Online:
Advances in Decision Sciences, Image Processing, Security and Computer Vision (ICETE 2019)

Part of the book series: Learning and Analytics in Intelligent Systems ((LAIS,volume 4))

Included in the following conference series:

Abstract

After digital revolution, large amount of data are produced from diverse networks from time to time. Hence security of this data is more important. So, there is a need to automate this security system. Intrusion detection systems are considered as the best solution to detect intrusions. Network intrusion detection systems (NIDS) are hired as a defense system to protect networks. Numerous techniques for the development of these defense systems are found in the literature. However, study on the enhancement of datasets used to train and test such security systems is also important. Improved datasets progress the detection capabilities for both offline and online intrusion detection models. Standard datasets like KDD 99, NSL-KDD cup 99 and DARPA 1999 are outdated and they don’t contain data of present attacks such as Denial of Service, therefore they are not suitable for evaluation. In this paper, in depth analysis of CIDDS-001 dataset is shown and the sightings are presented. In this paper, a gist of different papers available related to NIDS are given. This paper even compares all the research papers specifying their merits and demerits. This paper is concluded by providing a research method that can be applied to develop a better network intrusion detection system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Verma A, Ranga V Statistical analysis of CIDDS-001 dataset for network intrusion detection systems using distance-based machine learning, Department of Computer Engineering, NIT Kurukshetra, India

    Google Scholar 

  2. Medaglia CM, Serbanati A (2010) An overview of privacy and security issues in the Internet of Things. In: The Internet of Things, Springer, New York pp 389–395

    Google Scholar 

  3. Machine learning for network intrusion detection, Luke Hsiao, Stanford University. whsiao@stanford.edu, Stephen Ibanez, ibanez@stanford.edu

    Google Scholar 

  4. Shaya O (2008) Using machine learning in networks intrusion detection. https://doi.org/10.13140/rg.2.1.2586.0321

  5. Liao H, Lin C, Lin Y, Tung K (2013) Intrusion detection system: a comprehensive review. J Netw Comput Appl 16–24. https://www.researchgate.net/publication/281451813_Using_Machine_Learning_in_Networks_Intrusion_Detection. Accessed 01 Jan 2019. 2013 (PDF) Using Machine Learning in Networks Intrusion Detection

  6. Verma A, Ranga V (2018) On evaluation of network intrusion detection systems: statistical analysis of CIDDS-001 dataset using machine learning techniques, Department of Computer Engineering, National Institute of Technology, Kurukshetra, Haryana, India

    Google Scholar 

  7. Garcia-Teodoro P, Diaz-Verdejo J, Maciá-Fernández G, Vázquez E (2009) Anomaly-based network intrusion detection: techniques, systems and challenges. Comput Secur, 28(1):18–28

    Google Scholar 

  8. Sommer R, Paxson V (2010) Outside the closed world: on using machine learning for network intrusion detection. In: 2010 IEEE symposium on security and privacy (SP). IEEE, pp 305–316

    Google Scholar 

  9. Lippmann RP, Fried DJ, Graf I, Haines JW, Kendall KR, McClung D, Zissman MA (2000) Evaluating intrusion detection systems: the 1998 DARPA off-line intrusion detection evaluation. In: Proceedings of the DARPA information survivability conference and exposition, 2000, DISCEX 2000, vol 2. IEEE, pp 12–26

    Google Scholar 

  10. Flach P (2012) Machine learning: the art and science of algorithms that make sense of data. Cambridge University Press, Cambridge

    Book  Google Scholar 

  11. Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27

    Article  Google Scholar 

  12. CIDDS-001 dataset (2017). https://www.hs-coburg.de/forschung-kooperation/forschungsprojekte-oeffentlich/ingenieurwissenschaften/cidds-coburg-intrusion-detection-data-sets.html

  13. Hsiao L, Ibanez S. Machine Learning for Network Intrusion Detection, Stanford University

    Google Scholar 

  14. Alsallal M (2017) Applying machine learning to improve your intrusion detection system, 17 January

    Google Scholar 

  15. KarsligЕl ME, Yavuz AG, Güvensan MA, Hanifi K, Bank H (2017) Network intrusion detection using machine learning anomaly detection algorithms. In: 2017 25th signal processing and communications applications conference (SIU), Antalya. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7960616&isnumber=7960135

  16. Pasocal C, Oliveira M, Valdas R, Filzmoser P, Salvador P, Pacheco A (2012) Robust feature selection and robust PCA for Internet traffic anomaly detection. In Proceedings IEEE INFOCOM, pp 1755–1763

    Google Scholar 

  17. Sommer R, Paxson V (2010) Outside the closed world: on using machine learning for network intrusion detection. In: IEEE symposium on security and privacy, pp 305–316

    Google Scholar 

  18. Buczak AL, Guven E (2016) A survey of data mining and machine learning methods for cyber security intrusion detection. In: IEEE communications surveys & tutorials, vol 18, no. 2, pp 1153–1176. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7307098&isnumber=7475979

  19. Biswas S (2018) Intrusion detection using machine learning: a comparison study. Int J Pure Appl Math 118:101–114

    Google Scholar 

  20. Aggarwal P, Sharma SK (2015) Analysis of KDD dataset attributes-class wise for intrusion detection. Proc Comput Sci 57:842–851

    Article  Google Scholar 

  21. Siddiqui MK, Naahid S (2013) Analysis of KDD CUP 99 dataset using clustering based data mining. Int J Database Theor Appl 6(5):23–34

    Article  Google Scholar 

  22. Ingre B, Yadav A (2015) Performance analysis of NSL-KDD dataset using ANN. In: 2015 International conference on signal processing and communication engineering systems (SPACES). IEEE, pp 92–96

    Google Scholar 

  23. Moustafa N, Slay J (2015) The significant features of the UNSW-NB15 and the KDD99 data sets for network intrusion detection systems. In: 2015 4th International workshop on building analysis datasets and gathering experience returns for security (BADGERS). IEEE, pp. 25–31

    Google Scholar 

  24. KDD Cup 1999 (2014). http://kdd.ics.uci.edu/databases/kddcup99/

  25. UNSW-NB15 dataset (2017). https://www.unsw.adfa.edu.au/australian-centre-for-cybersecurity/cybersecurity/ADFA-NB15-Datasets/

  26. Parsazad S, Saboori E, Allahyar A (2012) Fast feature reduction in intrusion detection datasets. In: Proceedings of the 35th international convention MIPRO Opatija, Croatia. IEEE, pp 1023–1029

    Google Scholar 

  27. Rampure V, Tiwari A (2015) A rough set based feature selection on KDD CUP 99 data set. Int J Database Theor Appl 8(1):149–156

    Article  Google Scholar 

  28. Hasan MAM, Nasser M, Ahmad S, Molla KI (2016) Feature selection for intrusion detection using random forest. J Inf Secur 7(03):129–140

    Google Scholar 

  29. Janarthanan T, Zargari S (2017) Feature selection in UNSW-NB15 and KDDCUP’99 datasets. In: Proceedings of 26th international symposium on industrial electronics (ISIE), Edinburgh, UK. IEEE, pp 1881–1886

    Google Scholar 

  30. Aminanto ME, Choi R, Tanuwidjaja HC, Yoo PD, Kim K (2018) Deep abstraction and weighted feature selection for Wi-Fi impersonation detection. IEEE Trans Inf Forensics Secur 13(3):621–636

    Article  Google Scholar 

  31. AWID (2018) AWID dataset. Accessed 2 Jan 2018. http://icsdweb.aegean.gr/awid/download.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to T. Rupa Devi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rupa Devi, T., Badugu, S. (2020). A Review on Network Intrusion Detection System Using Machine Learning. In: Satapathy, S.C., Raju, K.S., Shyamala, K., Krishna, D.R., Favorskaya, M.N. (eds) Advances in Decision Sciences, Image Processing, Security and Computer Vision. ICETE 2019. Learning and Analytics in Intelligent Systems, vol 4. Springer, Cham. https://doi.org/10.1007/978-3-030-24318-0_69

Download citation

Publish with us

Policies and ethics