Abstract
In this work, we proposed the use of Support Vector Machines (SVM) to predict the performance of machine learning algorithms based on features of the learning problems. This work is related to the Meta-Regression approach, which has been successfully applied to predict learning performance, supporting algorithm selection. Experiments were performed in a case study in which SVMs with different kernel functions were used to predict the performance of Multi-Layer Perceptron (MLP) networks. The SVMs obtained better results in the evaluated task, when compared to different algorithms that have been applied as meta-regressors in previous work.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Giraud-Carrier, C., Vilalta, R., Brazdil, P.: Introduction to the special issue on meta-learning. Machine Learning 54(3), 187–193 (2004)
Kalousis, A., Hilario, M.: Representational issues in meta-learning. In: Proceedings of the 20th International Conferente on Machine Learning, pp. 313–320 (2003)
Gama, J., Brazdil, P.: Characterization of classification algorithms. In: Pinto-Ferreira, C., Mamede, N.J. (eds.) EPIA 1995. LNCS, vol. 990, pp. 189–200. Springer, Heidelberg (1995)
Aha, D.: Generalizing from case studies: A case study. In: Proceedings of the 9th International Workshop on Machine Learning, pp. 1–10. Morgan Kaufmann, San Francisco (1992)
Koepf, C., Taylor, C., Keller, J.: Meta-analysis: Data characterisation for classification and regression on a meta-level. In: Proceedings of the International Symposium on Data Mining and Statistics (2000)
Bensusan, H., Alexandros, K.: Estimating the predictive accuracy of a classifier. In: Proceedings of the 12th European Conference on Machine Learning, pp. 25–36 (2001)
Brazdil, P., Soares, C., da Costa, J.: Ranking learning algorithms: Using IBL and meta-learning on accuracy and time results. Machine Learning 50(3), 251–277 (2003)
Kalousis, A., Gama, J., Hilario, M.: On data and algorithms - understanding inductive performance. Machine Learning 54(3), 275–312 (2004)
Prudêncio, R.B.C., Ludermir, T.B.: Meta-learning approaches to selecting time series models. Neurocomputing 61, 121–137 (2004)
Koepf, C.: Meta-regression: performance prediction, pp. 89–106 (2006)
Prudêncio, R.B.C., Ludermir, T.B.: Active learning to support the generation of meta-examples. In: Proc. of the International Conference on Artificial Neural Networks, pp. 817–826 (2007)
Prudêncio, R.B.C., Ludermir, T.B.: Active selection of training examples for meta-learning. In: Proc. of the International Conference on Hybrid Intelligent Systems (2007)
Smola, A., Scholkopf, B.: A tutorial on support vector regression. Statistics and Computing 14(3), 199–222 (2004)
Wang, L.: Support Vector Machines: Theory and Applications. Springer, Heidelberg (2005)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by backpropagating errors. Nature 323, 533–536 (1986)
Vilalta, R., Giraud-Carrier, C., Brazdil, P.: Using meta-learning to support data- mining. International Journal of Computer Science Application I(31), 31–45 (2004)
Prudêncio, R.B.C., Ludermir, T.B., de Carvalho, F.A.T.: A modal symbolic classifier to select time series models. Pattern Recognition Letters 25(8), 911–921 (2004)
Leite, R., Brazdil, P.: Predicting relative performance of classifiers from samples. In: Proceedings of the 22nd International Conference on Machine Learning (2005)
Demuth, H., Beale, M.: Neural Network Toolbox: For use with MATLAB: User’s Guide. The Mathworks (1993)
Prechelt, L.: A set of neural network benckmark problems and benchmarking rules. Technical Report 21/94, Fakultät für Information, Universitä Karlsruhe, Karlsruhe, Germany (Spetember 1994)
Soares, C., Brazdil, P., Kuba, P.: A meta-learning approach to select the kernel width in support vector regression. Machine Learning 54(3), 195–209 (2004)
Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Quarterly Journal of Applied Mathmatics II(2), 164–168 (1944)
Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Machine Learning 46(1), 131–159 (2002)
Witten, I.H., Frank, E.(eds.): WEKA: machine learning algorithms in Java. University of Waikato, New Zealand (2003)
Quinlan, J.: Learning with continuous classes. In: Proceedings of the Australian Joint Conference on Artificial Intelligence, pp. 343–348 (1992)
Aha, D., Kibler, D.: Instance-based learning algorithms. Machine Learning 6(3), 37–66 (1991)
Kuba, P., Brazdil, P., Soares, C., Woznica, A.: Exploiting sampling and meta-learning for parameter setting support vector machines. In: Garijo, F.J., Riquelme, J.-C., Toro, M. (eds.) IBERAMIA 2002. LNCS (LNAI), vol. 2527, pp. 217–225. Springer, Heidelberg (2002)
Cawley, G.: Model selection for support vector machines via adaptive step-size tabu search. In: Proceedings of the International Conference on Artificial Neural Networks and Genetic Algorithms, pp. 434–437 (2001)
Lessmann, S., Stahlbock, R., Crone, S.: Genetic algorithms for support vector machine model selection. In: Proceedings of the International Joint Conference on Neural Networks 2006, pp. 3063–3069 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guerra, S.B., Prudêncio, R.B.C., Ludermir, T.B. (2008). Predicting the Performance of Learning Algorithms Using Support Vector Machines as Meta-regressors. In: Kůrková, V., Neruda, R., Koutník, J. (eds) Artificial Neural Networks - ICANN 2008. ICANN 2008. Lecture Notes in Computer Science, vol 5163. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87536-9_54
Download citation
DOI: https://doi.org/10.1007/978-3-540-87536-9_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87535-2
Online ISBN: 978-3-540-87536-9
eBook Packages: Computer ScienceComputer Science (R0)