Abstract
Machine Learning (ML) has been a concern in Software Engineering (SE) over the past years. However, how to use ML and what it can offer for SE is still subject to debate among researchers. This paper investigates the application of ML in SE. The goal is to identify the used algorithms, the addressed topics and the main findings. It performs a Systematic Literature Review (SLR) of peer-reviewed studies published between 1995 and 2020. Data extracted from the studies show that ML algorithms are of great practical value in the different activities of software development process, especially “Software specification” and “Software validation” since “Software bug prediction” and “Software quality improvement” are the most recurring research topics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Rothman, D.: Artificial Intelligence by Example, 1st edn. Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK (2018)
Tack, C.: Artificial intelligence and machine learning | applications in musculoskeletal physiotherapy. Musculoskeletal Sci. Pract. 39, 164–169 (2019)
Alpaydın, E.: Introduction to Machine Learning, 2nd edn. The MIT Press Cambridge, Massachusetts (2010)
Partridge, D.: Artificial Intelligence and Software Engineering Understanding the Promise of the Future. AMACOM American Management Association, 1601 Broadway New York, New York 10019, USA (1998)
Dimitra, K., Yihao, L., Elvira, M.A., Misirlis, N., Wong, W.E.: A bibliometric assessment of software engineering scholars and institutions (2010–2017). J. Syst. Softw. 147, 246–261 (2019)
Zhang, D., Tsai, J.P.: Machine Learning Applications in Software Engineering (Series on Software Engineering and Knowledge Engineering). World Scientific Publishing Company, Singapore (2005)
Jesson, J., Matheson, L., Lacey, F.M.: Doing Your Literature Review: Traditional and Systematic Techniques, 1st edn. SAGE Publications Ltd, Newbury Park (2011)
Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering. Technical Report EBSE-2007-01, School of Computer Science and Mathematics, Keele University (2007)
Hamou-Lhadj, W., Nayrolles, M.: A project on software defect prevention at commit-time: a success story of university-industry research collaboration. In: The 5th International Workshop on Software Engineering Research and Industrial Practice on Proceedings, Gothenburg, Sweden, pp. 24–25 (2018)
Sai, Z., Congle, Z.: Software bug localization with Markov logic. In: The 36th International Conference on Software Engineering, Hyderabad, India, pp. 424–427 (2014)
Sunghun, K., Whitehead, E.J., Yi, Z.: Classifying software changes: clean or buggy? IEEE Trans. Softw. Eng. 34(2), 181–196 (2008)
Ruchika, M., Laavanye, B., Sushant, S., Pragati, P.: Empirical comparison of machine learning algorithms for bug prediction in open source software. In: The International Conference on Big Data Analytics and Computational Intelligence (ICBDAC), Chirala, India, pp. 40–45 (2017)
Meiliana, Syaeful, K., Harco, L.H.S.W., Ford, L.G., Edi, A.: Software metrics for fault prediction using machine learning approaches: a literature review with PROMISE repository dataset. In: The International Conference on Cybernetics and Computational Intelligence (CyberneticsCom), Phuket, Thailand, pp. 19–23 (2017)
Iker, G.: Applying machine learning to software fault-proneness prediction. J. Syst. Softw. 81, 186–195 (2008)
Ruchika, M.: A systematic review of machine learning techniques for software fault prediction. Appl. Soft Comput. 27, 504–518 (2015)
Jyoti, D.: A review of improving software quality using machine learning algorithms, Int. J. Comput. Sci. Mob. Comput. 6(3), 148–153 (2017)
Hanchate, D.B., Bichkar, R.S.: The machine learning in software project management: a journey. Part II. Appl. Discrete Math. Heuristic Alg. 1(4), 29–58 (2015)
Pandey, A.K., Gupta, M.: Software fault classification using extreme learning machine: a cognitive approach. Evol. Intel. 1, 1–8 (2018)
Kaur, A., Kaur, K., Chopra, D.: An empirical study of software entropy based bug prediction using machine learning. Int. J. Syst. Assur. Eng. Manage 8(2), 599–616 (2017)
Kumar, L., Tirkey, A., Rath, S.-K.: An effective fault prediction model developed using an extreme learning machine with various kernel methods. Front. Inform. Technol. Electron. Eng. 19(7), 864–888 (2018)
Nitish, P., Debarshi, K., Hudait, A., Amitava, S.: Automated classification of software issue reports using machine learning techniques: an empirical study. Innov. Syst. Softw. Eng. 13(4), 279–297 (2017)
Li, M., Zhang, H., Rongxin, W., Zhou, Z.-H.: Sample-based software defect prediction with active and semi-supervised learning. Autom. Softw. Eng. 19(2), 201–230 (2012)
Zhou, X., et al.: Software defect prediction based on kernel PCA and weighted extreme learning machine. Inf. Softw. Technol. 106, 182–200 (2019)
Malhotra, R.: An empirical framework for defect prediction using machine learning techniques with Android software. Appl. Soft Comput. 49, 1034–1050 (2016)
Hua, W., et al.: Establishing a software defect prediction model via effective reduction. Inf. Sci. 477, 399–409 (2019)
Laradji, I.H., et al.: Software defect prediction using ensemble learning on selected features. Inf. Softw. Technol. 58, 388–402 (2015)
Diego, P.P.M., et al.: Classification with reject option for software defect prediction. Appl. Soft Comput. 49, 1085–1093 (2016)
Turabiedh, H., Mafarja, M., Li, X.: Iterated feature selection algorithms with layered recurrent neural network for software fault prediction. Expert Syst. Appl. 122, 27–42 (2019)
Minku, L.L., Yao, X.: A principled evaluation of ensembles of learning machines for software effort estimation. In: The 7th International Conference on Predictive Models in Software Engineering, Banff, Alberta, Canada (2011)
Murwantara, I.M., Bordbar, B., Minku, L.L.: Measuring energy consumption for web service product configuration. In: The 16th International Conference on Information Integration and Web-based Applications & Services, Hanoi, Viet Nam, pp. 224–228 (2014)
Patel, K., Fogarty, J., Landay, J.A., Harrison, B.: Investigating statistical machine learning as a tool for software development. In: The SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, pp. 667–676 (2008)
Rashid, E., Patnayak, S., Bhattacherjee, V.: A survey in the area of machine learning and its application for software quality prediction. ACM SIGSOFT Softw. Eng. Notes 37(5), 1–7 (2012)
Twala, B., Cartwright, M., Shepperd, M.: Ensemble of missing data techniques to improve software prediction accuracy. In: The 28th International Conference on Software Engineering, Shanghai, China, pp. 909–912 (2006)
Cesar, J.C., Fehmi, J., Yasir, M.: Is predicting software security bugs using deep learning better than the traditional machine learning algorithms? In: The International Conference on Software Quality, Reliability and Security (QRS), Lisbon, Portugal, pp. 95–102 (2018)
Feng, Y., Chen, Z.: Multi-label software behavior learning. In: The 34th International Conference on Software Engineering, Zurich, Switzerland, pp. 1305–1308 (2012)
Lounis, H., Gayed, T.F., Boukadoum, M.: Machine-learning models for software quality: a compromise between performance and intelligibility. In: The 23rd International Conference on Tools with Artificial Intelligence, Boca Raton, FL, USA, pp. 919–921 (2011)
Zhang, P., Su, Y., Wang, C.: Statistical machine learning used in integrated anti-spam system. In: The 6th International Conference on Machine Learning and Cybernetics on Proceedings, Hong Kong, pp. 4055–4058 (2007)
Qinbao, S., et al.: A machine learning based software process model recommendation method. J. Syst. Softw. 118, 85–100 (2016)
Mehta, P., Srividya, A., Verma, A.K.: Application of machine learning paradigms for predicting quality in upstream software development life cycle. OPSEARCH 42(4), 332–339 (2005)
Haran, M., et al.: Applying classification techniques to remotely collected program execution data. In: the 10th European software engineering conference, Lisbon, Portugal, pp. 146–155 (2005)
Yazhan, M., et al.: Automatic classification of software artifacts in open-source applications. In: The 15th International Conference on Mining Software Repositories on Proceedings, New York, USA, pp. 414–425 (2018)
Cunningham, S.J., Summers, B.: Applying machine learning to subject classification and subject description for information retrieval. In: The 2nd New Zealand International Two-Stream Conference on Artificial Neural Networks and Expert Systems on Proceedings, Dunedin, New Zealand, pp. 243–246 (1995)
Bulbul, H.I., Unsal, O.: Comparison of classification techniques used in machine learning as applied on vocational guidance data. In: The 10th International Conference on Machine Learning and Applications and Workshops, Honolulu, HI, USA, pp. 298–301 (2011)
Navarro-Almanza, R., Juarez-Ramırez, R., Licea, G.: Towards supporting software engineering using deep learning: a case of software requirements classification. In: The 5th International Conference in Software Engineering Research and Innovation, Mérida, Mexico, pp. 116–120 (2017)
Wei-Zhi, W., Xiao-Ping, Y.: Information granules and approximations in incomplete information systems. In: The 6th International Conference on Machine Learning and Cybernetics, Hong Kong, pp. 3740–3745 (2007)
Zhou, J., Zhang, Q., Tong, S.: Decision rules based on rough set theory in generalized information systems. In: The 5th International Conference on Machine Learning and Cybernetics, Dalian, China, pp. 1477–1482 (2009)
Meinke, K., Bennaceur, A.: Machine learning for software engineering models, methods, and applications. In: The 40th International Conference on Software Engineering, Gothenburg, Sweden, pp. 548–549 (2018)
Myeongsu, K., Noel, J.J.: Prognostics and Health Management of Electronics: Fundamentals, Machine Learning, and the Internet of Things, 1st edn. John Wiley and Sons Ltd, USA (2018)
Louridas, P., Ebert, C.: Machine Learning. IEEE Softw. 33(5), 110–115 (2016)
Meinke, K., Bennaceur, A.: Machine learning for software engineering. In: The 40th International Conference on Software Engineering, Sweden, pp. 548–549 (2018)
Kwang, L.G., Ashutosh, K.S.: Comprehensive literature review on machine learning structures for web spam classification. Procedia Comput. Sci. 70, 434–441 (2015)
Zhang, D., Tsai, J.J.P.: Machine learning and software engineering. Softw. Qual. J. 11, 87–119 (2003)
Praveena, M., Jaiganesh, V.: A literature review on supervised machine learning algorithms and boosting process. Int. J. Comp. Appl. 169(8), 32–35 (2017)
Dragutin, P., et al.: Work in progress: a machine learning approach for assessment and prediction of teamwork effectiveness in software engineering education. In: The Frontiers in Education Conference, Seattle, WA, USA, pp. 1–3 (2012)
Pospieszny, P., Czarnacka-Chrobot, B., Kobylinski, A.: An effective approach for software project effort and duration estimation with machine learning algorithms. J. Syst. Softw. 137, 184–196 (2018)
Wen, J., Li, S., Lin, Z., Hu, Y., Huang, C.: Systematic literature review of machine learning based software development effort estimation models. Inf. Softw. Technol. 54, 41–59 (2012)
Satapathy, S.M., Rath, S.K.: Empirical assessment of machine learning models for agile software development effort estimation using story points. Innov. Syst. Softw. Eng. 13(2–3), 191–200 (2017)
Tao, L., Li, Y.: A synthetic intelligent system for web information mining. In: The International Conference on Machine Learning and Cybernetics, Shanghai, China, pp. 1357–1360 (2005)
Nawrocka, A., Kot, A., Nawrocki, M.: Application of machine learning in recommendation systems. In: The 19th International Carpathian Control Conference, Szilvasvarad, Hungary, pp. 328–331 (2018)
Hernandez, A.B., Perez, M.S., Gupta, S.: Using machine learning to optimize parallelism in big data applications. Futur. Gener. Comput. Syst. 86, 1076–1092 (2018)
Giger, E., Pinzger, M., Gall, H.C.: Can we predict types of code changes? An empirical analysis. In: The 9th IEEE Working Conference on Mining Software Repositories, Zurich, Switzerland, pp. 217–226 (2012)
Yang, J., Hotta, K., Higo, Y., Igaki, H., Kusumoto, S.: Classification model for code clones based on machine learning. Empir. Softw. Eng. 20(4), 1095–1125 (2014)
Tollin, I., Fontana, F.A., Zanoni, M.: Change prediction through coding rules violations. In: The 21st International Conference on Evaluation and Assessment in Software Engineering, New York, USA, pp. 61–64 (2017)
Deniz, E., Sen, A.: Using machine learning techniques to detect parallel patterns of multi-threaded applications. Int. J. Parallel Program. 44(4), 867–900 (2016)
Zanoni, M., Fontana, F.A., Stella, F.: On applying machine learning techniques for design pattern detection. J. Syst. Softw. 103, 102–117 (2015)
Hussain, S., et al.: Automated framework for classification and selection of software design patterns. Appl. Soft Comput. 75, 1–20 (2019)
Chen, N., Hoi, S.C.H., Xiao, X.: Software process evaluation: a machine learning approach. In: The 26th International Conference on Automated Software Engineering, Lawrence, KS, USA, pp. 333–342 (2011)
Linares-Vásquez, M., McMillan, C., Poshyvanyk, D., Grechanik, M.: On using machine learning to automatically classify software applications into domain categories. Empir. Softw. Eng. 19(3), 582–618 (2014)
Chen, N., Hoi, S.C.H., Xiao, X.: Software process evaluation: a machine learning framework with application to defect management process. Emp. Softw. Eng. 19(6), 1531–1564 (2014)
Kumar, P., Singh, Y.: An empirical study of software reliability prediction using machine learning techniques. Int. J. Syst. Assur. Eng. Manage. 3(3), 194–208 (2012)
Jaiswal, A., Malhotra, R.: Software reliability prediction using machine learning techniques. Int. J. Syst. Assur. Eng. Manage. 9(1), 230–244 (2016)
Jinyong, W., Ce, Z.: Software reliability prediction using a deep learning model based on the RNN encoder decoder. Reliab. Eng. Syst. Saf. 170, 73–82 (2018)
Lenz, A.R., Pozo, A., Vergilio, S.R.: Linking software testing results with a machine learning approach. Eng. Appl. Artif. Intell. 26, 1631–1640 (2013)
Briand, L.C.: Novel applications of machine learning in software testing. In: The 8th International Conference on Quality Software, Oxford, UK, pp. 3–10 (2008)
Gove, R., Faytong, J.: Machine learning and event-based software testing: classifiers for identifying infeasible GUI event sequences. Adv. Comput. 86, 109–135 (2012)
Czech, M., Hullermeier, E., Jakobs, M., Wehrheim, H.: Predicting rankings of software verification tools. In: The 3rd ACM SIGSOFT International Workshop on Software Analytics, New York, USA, pp. 23–26 (2017)
Satoshi, Y.: Deductively verifying embedded software in the era of artificial intelligence = Machine Learning + Software Science. In: The 6th Global Conference on Consumer Electronics, Nagoya, Japan, pp. 1–4 (2017)
Lee, W.-P., Cheng-Che, L.: Customising WAP-based information services on mobile networks. Personal Ubiquitous Comput. 7(6), 321–330 (2003)
Chang, C., Liu, H., Lin, J.: Constructing grading information system for words’ difficulty using a supervised learning method. In: The International Conference on Machine Learning and Cybernetics, Hong Kong, China, pp. 3991–3996 (2007)
Kong, L., Wu, J.:Dynamic single machine scheduling using Q-learning agent. In: The International Conference on Machine Learning and Cybernetics, Guangzhou, China, pp. 3237–3241 (2005)
Liu, Q., Li, X., Zhu, H., Fan, H.: Acquisition of open source software project maturity based on time series machine learning. In: The 10th International Symposium on Computational Intelligence and Design, Hangzhou, China, pp. 296–299 (2017)
Wang, Y.: Automatic semantic analysis of software requirements through machine learning and ontology approach. J. Shanghai Jiaotong Univ. (Sci.) 21(6), 692–701 (2016)
Harry, R.J.: Poster: software development risk management: using machine learning for generating risk prompts. In: The 37th IEEE International Conference on Software Engineering, Florence, Italy, pp. 833–834 (2015)
Chiu, M., Moss, E.: Run-time program-specific phase prediction for python programs. In: The 15th International Conference on Managed Languages & Runtimes, Linz, Austria (2018)
Mezouar, H., El Afia, A.: A 4-level reference for self-adaptive processes based on SCOR and integrating Q-Learning. In: The 4th International Conference on Big Data and Internet of Things (BDIoT 2019), 23 and 24 October 2019, Tangier-Tetuan, Morocco. ACM (2019). https://doi.org/10.1145/3372938.3372953
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mezouar, H., Afia, A.E. (2022). A Systematic Literature Review of Machine Learning Applications in Software Engineering. In: Lazaar, M., Duvallet, C., Touhafi, A., Al Achhab, M. (eds) Proceedings of the 5th International Conference on Big Data and Internet of Things. BDIoT 2021. Lecture Notes in Networks and Systems, vol 489. Springer, Cham. https://doi.org/10.1007/978-3-031-07969-6_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-07969-6_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-07968-9
Online ISBN: 978-3-031-07969-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)