Abstract
Students’ performance prediction is one of the essential educational data mining research fields. Predicting students’ performance aims at improving the learning process inside educational institutions. This is achieved by early prediction of at-risk students who are vulnerable to drop out to help them and improve their performance sooner. Therefore, several machine learning techniques were proposed to predict students’ performance. The aim of this research is to improve the prediction by proposing two 2-Stages classification models. Several machine learning techniques: Multilayer Perceptron (MLP), Decision Tree (J48), Random Forest (RF), Gradient Boosting Method (GBM) and Logistic Regression (LR), have been experimented as part of voting method. The classification models were trained and tested on a dataset generated from an e-learning system used in previous studies. The performance of the proposed models was evaluated not only using the accuracy measure, but also using F1-Score and Cohen’s kappa score measures. The best obtained result was with the proposed 2-Stages 3-Classifiers classification model implementing voting method. The classifiers of the first stage consist of MLP, J48, and RF. The classifiers of the second stage consist of J48, RF, and LR. The proposed 2-Stages 3-Classifiers classification model achieved an accuracy of 77.26%, F1-Score of 77.8%, and Cohen’s kappa score of 72.0%. The proposed 2-Stages 3-Classifiers classification models outperformed other classification models in predicting students’ performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dutt, A., Ismail, M.A., Herawan, T.: A systematic review on educational data mining. In: IEEE Access, vol. 5, pp. 15991–16005 (2017)
Thakar, P., Mehta, A., Manisha: Performance analysis and prediction in educational data mining: a research travelogue. Int. J. Comput. Appl. 100(12), 60–68 (2015)
Aulck, L., Nambi, D., Velagapudi, N., Blumenstock, J., West, J.: Mining university registrar records to predict first-year undergraduate attrition. The 12th International Conference on Educational Data Mining (2019)
Romero, C., Ventura, S.: Guest editorial: special issue on early prediction and supporting of learning performance. IEEE Transactions on Learning Technologies (2019)
Sønderlund, A.L., Hughes, E., Smith, J.: The efficacy of learning analytics interventions in higher education: a systematic review. British J. Edu.Technol., 1–25 (2018)
Marquez -Vera, C., Cano, A., Romero, C., Noaman, A.Y.M., Fardoun, H.M., Ventura, S.: Early dropout prediction using data mining: a case study with high school students. Expert Syst. 33(1), 107–124 (2016)
Romero, C., Ventura, S.: Data mining in education. Wiley Interdisciplinary reviews: data mining and knowledge discovery 3(1), 12–27 (2013)
Bakhshinategh, B., Zaiane, O.R., ElAtia, S., Ipperciel, D.: Educational data mining applications and tasks: a survey of the last 10 years. Educ. Inf. Technol. 23(1), 537–553 (2017). https://doi.org/10.1007/s10639-017-9616-z
Livieris, I.E., Drakopoulou, K., Tampakas, V.T., Mikropoulos, T.A., Pintelas, P.: Predicting secondary school students’ performance utilizing a semi-supervised learning approach. SAGE J. Educ. Comput. Res. (2018)
Livieris, I.E., Drakopoulou, K., Kotsilieris, T., Tampakas, V., Pintelas, P.: DSS-PSP—A Decision Support Software for Evaluating Students’ Performance. In: Boracchi, G., Iliadis, L., Jayne, C., Likas, A. (eds.) EANN 2017. CCIS, vol. 744, pp. 63–74. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65172-9_6
Wijayanto, F.: Indonesia education quality: does distance to the capital matter? (A clustering approach on elementary school intakes and outputs qualities). 2015 International Conference on Science and Technology (TICST), pp. 318–322 (2015)
Saa, A.A.: Educational data mining & students’ performance prediction. Int. J. Adv. Comput. Sci. Appl. 7(5) (2016)
Chen, G., Lang, D., Ferreira, R., Gasevic, D.: Predictors of student satisfaction: a large-scale study of human-human online tutorial dialogues. The 12th International Conference on Educational Data Mining (2019)
Johnson, W.G.: Data mining and machine learning in education with focus in undergraduate CS student success. 2018 International Computing Educational Research Conference (ICER ’18), ACM (2018)
Kärner, T., Kögler, K.: Emotional states during learning situations and students’ self-regulation: process-oriented analysis of person-situation interactions in the vocational classroom. Empirical Res. Vocat. Educ. Training 8(1), 1–23 (2016). https://doi.org/10.1186/s40461-016-0038-8
Bosch, N., D'Mello, S.K., Baker, R.S., Ocumpaugh, J., Shute, V., Ventura, M., Wang, L., Zhao, W.: Detecting student emotions in computer-enabled classrooms. IJCAI'16 Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 4125–4129 (2016)
Ahuja, S., Kaur, P., Panda, S.N.: Identification of influencing factors for enhancing online learning usage model: evidence from an Indian University. J. Med. Syst. (2019)
Xing, W., Du, D.: Dropout prediction in MOOCs: using deep learning for personalized intervention. J. Educ. Comput. Res. (2019)
Francis, B.K., Babu, S.S.: Predicting academic performance of students using a hybrid data mining approach. J. Med. Syst. 43(6), 1–15 (2019). https://doi.org/10.1007/s10916-019-1295-4
Silva, C., Fonseca, J.: Educational Data Mining: A Literature Review, 87–94. https://doi.org/10.1007/978-3-319-46568-5_9 (2017)
Hung, J.-L., Shelton, B.E., Yang, J., Du, X.: Improving predictive modeling for at-risk student identification: a multistage approach. IEEE Trans. Learn. Technol. 12(2), 148–157 (2019)
Sekeroglu, B., Dimililer, K., Tuncal, K.: Student performance prediction and classification using machine learning algorithms. The 2019 8th International Conference on Educational and Information Technology, pp. 7–11 (2019)
Gitinabard, N., Xu, Y., Heckman, S., Barnes, T., Lynch, C.F.: How widely can prediction models be generalized? performance prediction in blended courses. In: IEEE Transactions on Learning Technologies, vol. 12, no. 2, pp. 184–197 (2019)
Haiyang, L., Wang, Z., Benachour, P., Tubman, P.: A time series classification method for behaviour-based dropout prediction. 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT) (2018)
Wan, H., Liu, K., Yu, Q., Gao, X.: Pedagogical intervention practices: improving learning engagement based on early prediction. In: IEEE Transactions on Learning Technologies, vol. 12, no. 2, pp. 278–289 (2019)
Uzel, V.N., Turgut, S.S., Özel, S.A.: Prediction of students’ academic success using data mining methods. 2018 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 1–5 (2018)
Romero, C., Ventura, S.: Educational data mining and learning analytics: an updated survey. WIREs Data Min. Knowl. Discov. (2020)
Anvesh, K., Srilatha, M., Reddy, T.R., Chand, M.G., Jyothi, G.D.: Improving student academic performance using an attribute selection algorithm. First International Conference on Artificial Intelligence and Cognitive Computing, pp. 539–548 (2018)
Cortez, P.: [Students’ Academic Performance Dataset]. https://www.kaggle.com/aljarah/xAPI-Edu-Data (2008)
Ghorbani, R., Ghousi, R.: Comparing different resampling methods in predicting students’ performance using machine learning techniques. In: IEEE Access, vol. 8, pp. 67899–67911 (2020)
Rastrollo-Guerrero, J.L., Gómez-Pulido, J.A., Durán-Domínguez, A.: Analyzing and predicting students’ performance by means of machine learning: a review. Appl. Sci. 10, 1042 (2020)
Evwiekpaefe, A.E., Isa, M.M., Ajakaiye, F.: analyzing factors affecting academic performance of postgraduate students using data mining techniques. Pacific J. Sci. Technol. (2020)
Salloum, S.A., Alshurideh, M., Elnagar, A., Shaalan, K.: Mining in Educational Data: Review and Future Directions. In: Hassanien, A.-E., Azar, A.T., Gaber, T., Oliva, D., Tolba, F.M. (eds.) AICV 2020. AISC, vol. 1153, pp. 92–102. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-44289-7_9
Yaacob, W.F.W., Sobri, N.M., Nasir, S.A.M., Norshahidi, N.D., Husin, W.Z.W., Shaalan, K.: Predicting Student Drop-Out in Higher Institution Using Data Mining Techniques. IOPScience (2020)
Madnaik, Subhash, S.: Predicting Students’ Performance by Learning Analytics. San José State University, Master's Projects. 941 (2020). https://doi.org/10.31979/etd.6jjb-ua9w
Nidhi, W., Mukesh, K., Nandini, N., Gaurav, M.: Student’s academic performance prediction in academic using data mining techniques. The International Conference on Innovative Computing & Communications (ICICC) (2020)
Narvekar, A., Menezes, V., Angle, O.P., Lotlekar, M., Naik, S., Purohit, A.: Students performance prediction using data mining techniques. International Journal for Research in Applied Science and Engineering Technology (IJRASET) (2020)
Amrieh, E.A., Hamtini, T., Aljarah, I.: Mining educational data to predict student’s academic performance using ensemble methods. Int. J. Database Theory Appl. 9, 119–136 (2016)
Cortez, P.: [Student Performance Data Set]. https://archive.ics.uci.edu/ml/datasets/Student+Performance (2014)
Nuankaew, P., Nuankaew, W.S.: Student performance prediction model for predicting academic achievement of high school students. Europ. J. Ed. Res. 11(2), 949–963 (2022). https://doi.org/10.12973/eu-jer.11.2.949(2022)
Schröer, C., Kruse, F., Gómez, J.M.: A systematic literature review on applying CRISP-DM process model. Procedia Comput. Sci. 181, 526–534 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yacoub, M.F., Maghawry, H.A., Helal, N.A., Soto, S.V., Gharib, T.F. (2023). An Efficient 2-Stages Classification Model for Students Performance Prediction. In: Hassanien, A.E., Snášel, V., Tang, M., Sung, TW., Chang, KC. (eds) Proceedings of the 8th International Conference on Advanced Intelligent Systems and Informatics 2022. AISI 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 152. Springer, Cham. https://doi.org/10.1007/978-3-031-20601-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-20601-6_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20600-9
Online ISBN: 978-3-031-20601-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)