Abstract
Decision trees are among the most popular classification algorithms due to their knowledge representation in form of decision rules which are easy for interpretation and analysis. Nonetheless, a majority of decision trees training algorithms base on greedy top-down induction strategy which has the tendency to develop too complex tree structures. Therefore, they are not able to effectively generalise knowledge gathered in learning set. In this paper we propose EVO-Tree hybrid algorithm for decision tree induction. EVO-Tree utilizes evolutionary algorithm based training procedure which processes population of possible tree structures decoded in the form of tree-like chromosomes. Training process aims at minimizing objective functions with two components: misclassification rate and tree size. We test the predictive performance of EVO-Tree using several public UCI data sets, and we compare the results with various state-of-the-art classification algorithms.
Chapter PDF
Similar content being viewed by others
References
Quinlan, J.: Learning efficient classification procedures and their application to chess end games. Mach. Learn (1983)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann (1993)
Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Wadsworth (1984)
Hyafil, L., Rivest, R.L.: Constructing optimal binary decision trees is NP-complete. Inf. Process. Lett. 5, 15–17 (1976)
Papagelis, A., Kalles, D.: GATree: Genetically Evolved Decision Trees. In: IEEE Int. Conf. Tools with Artif. Intell., pp. 203–206 (2000)
Bramer, M.: Principles of Data Mining. Springer (2007)
Rokach, L., Maimon, O.: Data mining with decision trees: theory and applications. World Scientific Publishing Company (2008)
Aitkenhead, M.J.: A co-evolving decision tree classification method. Expert Syst. Appl. 34, 18–25 (2008)
Kennedy, H.C., Chinniah, C., Bradbeer, P., Morss, L.: The contruction and evaluation of decision trees: A comparison of evolutionary and concept learning methods. In: Corne, D.W. (ed.) AISB-WS 1997. LNCS, vol. 1305, pp. 147–161. Springer, Heidelberg (1997)
Bandar, Z., Al-Attar, H., McLean, D.: Genetic algorithm based multiple decision tree induction. In: ICONIP 1999. ANZIIS 1999 & ANNES 1999 & ACNN 1999. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378), pp. 429–434. IEEE (1999)
Dumitrescu, D., András, J.: Generalized Decision Trees Built With Evolutionary Techniques. Stud. Informatics Control 14, 15 (2005)
Czajkowski, M., Kretowski, M.: Global induction of oblique model trees: An evolutionary approach. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013, Part II. LNCS (LNAI), vol. 7895, pp. 1–11. Springer, Heidelberg (2013)
Chen, J., Wang, X., Zhai, J.: Pruning Decision Tree Using Genetic Algorithms. In: 2009 International Conference on Artificial Intelligence and Computational Intelligence, pp. 244–248. IEEE (2009)
Lomax, S., Vadera, S.: A survey of cost-sensitive decision tree induction algorithms. ACM Comput. Surv. 45, 1–35 (2013)
Bratu, C.V., Savin, C., Potolea, R.: A Hybrid Algorithm for Medical Diagnosis. In: EUROCON 2007 - The International Conference on Computer as a Tool, pp. 668–673. IEEE (2007)
Basgalupp, M.P., Carvalho, A., Barros, R.C., Freitas, A.: A Survey of Evolutionary Algorithms for Decision-Tree Induction. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 1–10 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Jankowski, D., Jackowski, K. (2014). Evolutionary Algorithm for Decision Tree Induction. In: Saeed, K., Snášel, V. (eds) Computer Information Systems and Industrial Management. CISIM 2015. Lecture Notes in Computer Science, vol 8838. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45237-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-662-45237-0_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-45236-3
Online ISBN: 978-3-662-45237-0
eBook Packages: Computer ScienceComputer Science (R0)