Abstract
The paper presents three algorithms of instance selection for regression problems, which extend the capabilities of the CNN, ENN and CA algorithms used for classification tasks. Various combinations of the algorithms are experimentally evaluated as data preprocessing for regression tree induction. The influence of the instance selection algorithms and their parameters on the accuracy and rules produced by regression trees is evaluated and compared to the results obtained with tree pruning.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Hart, P.E.: The condensed nearest neighbor rule. IEEE Transactions on Information Theory 14, 515–516 (1968)
Wilson, D.: Asymptotic properties of nearest neighbor rules using edited data. IEEE Transactions on Systems, Man, and Cybernetics 2, 408–421 (1972)
Chang, C.L.: Finding prototypes for nearest neighbor classifiers. IEEE Transactions on Computers 23, 1179–1184 (1974)
Wilson, D., Martinez, T.: Reduction techniques for instance-based learning algorithms. Machine Learning 38, 251–268 (2000)
Cameron-Jones, R.M.: Instance selection by encoding length heuristic with random mutation hill climbing. In: The Eighth Australian Joint Conference on Artificial Intelligence, pp. 99–106 (1995)
Salvador, G., Derrac, J., Ramon, C.: Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 417–435 (2012)
Jankowski, N., Grochowski, M.: Comparison of instances seletion algorithms I. Algorithms survey. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds.) ICAISC 2004. LNCS (LNAI), vol. 3070, pp. 598–603. Springer, Heidelberg (2004)
Kordos, M., Blachnik, M., Wieczorek, T.: Temperature Prediction in Electric Arc Furnace ith Neural Network Tree. In: Honkela, T. (ed.) ICANN 2011, Part II. LNCS, vol. 6792, pp. 71–78. Springer, Heidelberg (2011)
Zhang, J., et al.: Intelligent selection of instances for prediction functions in lazy learning algorithms. Artifcial Intelligence Review 11, 175–191 (1997)
Tolvi, J.: Genetic algorithms for outlier detection and variable selection in linear regression models. Soft Computing 8, 527–533 (2004)
Guillen, A., et al.: Applying Mutual Information for Prototype or Instance Selection in Regression Problems. In: ESANN 2009 Proceedings (2009)
Duch, W., Setiono, R., Zurada, J.: Computational intelligence methods for understanding of data. Proceedings of the IEEE 92(5), 771–805 (2008)
Wu, S.: Optimal instance selection for decision tree, PhD dissertation. Iowa State university (2007)
Ramon Cano, J., Herrera, F., Lozano, M.: Evolutionary Stratified Training Set Selection for Extracting Classification Rules with Trade off Precision-Interpretability. Data and Knowledge Engineering 60, 90–108 (2006)
Kordos, M., Blachnik, M., Strzempa, D.: Do We Need Whatever More Than k-NN? In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010, Part I. LNCS (LNAI), vol. 6113, pp. 414–421. Springer, Heidelberg (2010)
Kordos, M., Blachnik, M., Perzyk, M., Kozłowski, J., Bystrzycki, O., Gródek, M., Byrdziak, A., Motyka, Z.: A Hybrid System with Regression Trees in Steel-Making Process. In: Corchado, E., Kurzyński, M., Woźniak, M. (eds.) HAIS 2011, Part I. LNCS, vol. 6678, pp. 222–230. Springer, Heidelberg (2011)
Merz, C., Murphy, P.: UCI repository of machine learning databases, http://www.ics.uci.edu/mlearn/MLRepository.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kordos, M., Białka, S., Blachnik, M. (2013). Instance Selection in Logical Rule Extraction for Regression Problems. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds) Artificial Intelligence and Soft Computing. ICAISC 2013. Lecture Notes in Computer Science(), vol 7895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38610-7_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-38610-7_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38609-1
Online ISBN: 978-3-642-38610-7
eBook Packages: Computer ScienceComputer Science (R0)