Abstract
In recent years, the unrestrainable growth of the volume of data has raised new challenges in machine learning regarding scalability. Scalability comprises not simply accuracy but several other measures regarding computational resources. In order to compare the scalability of algorithms it is necessary to establish a method allowing integrating all these measures into a single rank. These methods should be able to i) merge results of algorithms to be compared from different benchmark data sets, ii) quantitatively measure the difference between algorithms, and iii) weight some measures against others if necessary. In order to manage these issues, in this research we propose the use of TOPSIS as multiple-criteria decision-making method to rank algorithms. The use of this method will be illustrated to obtain a study on the scalability of five of the most well-known training algorithms for artificial neural networks (ANNs).
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Sonnenburg, S., Franc, V., Yom-Tov, E., Sebag, M.: PASCAL Large Scale Learning Challenge. Journal of Machine Learning Research (2009)
Strigl, D., Kofler, K., Podlipnig, S.: Performance and scalability of gpu-based convolutional neural networks. In: 18th Parallel, Distributed and Network-Based Processing (PDP), pp. 317–324. IEEE (2010)
Casey, K., Garrett, A., Gay, J., Montgomery, L., Dozier, G.: An evolutionary approach for achieving scalability with general regression neural networks. Natural Computing 8(1), 133–148 (2009)
Peteiro-Barral, D., Bolón-Canedo, V., Alonso-Betanzos, A., Guijarro-Berdiñas, B., Sánchez-Maroño, N.: Toward the scalability of neural networks through feature selection. Expert Systems with Applications 40(8), 2807–2816 (2013)
Bishop, C.M.: Neural networks for pattern recognition (1995)
Plaut, D.C., Nowlan, S.J., Hinton, G.E.: Experiments on learning by back propagation (1986)
Møller, M.F.: A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks 6(4), 525–533 (1993)
Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Quarterly Journal of Applied Mathmatics 2(2), 164–168 (1944)
Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. Society for Industrial & Applied Mathematics 11(2), 431–441 (1963)
Weiss, S.M., Kulikowski, C.A.: Computer systems that learn: classification and prediction methods from statistics, neural nets, machine learning, and expert systems. Morgan Kaufmann, San Francisco (1991)
Zeleny, M.: Multiple criteria decision making, vol. 25. McGraw-Hill, NY (1982)
Gang, K., Lu, Y., Peng, Y., Yong, S.: Evaluation of classification algorithms using mcdm and rank correlation. International Journal of Information Technology & Decision Making 11(01), 197–225 (2012)
Hwang, C.L., Yoon, K.: Multiple attribute decision making: methods and applications: a state-of-the-art survey, vol. 13. Springer, New York (1981)
Opricovic, S., Tzeng, G.H.: Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. European Journal of Operational Research 156(2), 445–455 (2004)
Olson, D.L.: Comparison of weights in TOPSIS models. Mathematical and Computer Modelling 40(7-8), 721–727 (2004)
Frank, A., Asuncion, A.: UCI machine learning repository (2010)
Hecht-Nielsen, R.: Neurocomputing. Addison-Wesley (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Peteiro-Barral, D., Guijarro-Berdiñas, B. (2013). A Study on the Scalability of Artificial Neural Networks Training Algorithms Using Multiple-Criteria Decision-Making Methods. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds) Artificial Intelligence and Soft Computing. ICAISC 2013. Lecture Notes in Computer Science(), vol 7894. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38658-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-38658-9_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38657-2
Online ISBN: 978-3-642-38658-9
eBook Packages: Computer ScienceComputer Science (R0)