Abstract
Nature inspired meta-heuristic algorithms provide derivative-free solutions to solve complex problems. Cuckoo Search (CS) algorithm is one of the latest additions to the group of nature inspired optimization heuristics. In this paper, Cuckoo Search (CS) is implemented in conjunction with Back propagation Neural Network (BPNN), Recurrent Neural Network (RNN), and Levenberg Marquardt back propagation (LMBP) algorithms to achieve faster convergence rate and to avoid local minima problem. The performances of the proposed Cuckoo Search Back propagation (CSBP), Cuckoo Search Levenberg Marquardt (CSLM) and Cuckoo Search Recurrent Neural Network (CSRNN) algorithms are compared by means of simulations on OR and XOR datasets. The simulation results show that the CSRNN performs better than other algorithms in terms of convergence speed and Mean Squared Error (MSE).
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Radhika, Y., Shashi, M.: Atmospheric Temperature Prediction using Support Vector Machines. Int. J. of Computer Theory and Engineering 1(1), 1793–8201 (2009)
Akcayol, M.A., Cinar, C.: Artificial neural network based modeling of heated catalytic converter performance. J. Applied thermal Engineering 25, 2341–2350 (2005)
Shereef, K.I., Baboo, S.S.: A New Weather Forecasting Technique using Back Propagation Neural Network with Modified Levenberg-Marquardt Algorithm for Learning. Int. J. of Computer Science 8(6-2), 1694–1814 (2011)
Kosko, B.: Neural Network and Fuzzy Systm, 1st edn. Prentice Hall of India (1994)
Krasnopolsky, V.M., Chevallier, F.: Some Neural Network application in environmental sciences. Part II: Advancing Computational Efficiency of environmental numerical models. J. Neural Networks 16(3-4), 335–348 (2003)
Coppin, B.: Artificial Intelligence Illuminated, USA. Jones and Bartlet Illuminated Series, ch. 11, pp. 291–324 (2004)
Basheer, I.A., Hajmeer, M.: Artificial neural networks: fundamentals, computing, design, and application. J. of Microbiological Methods 43(1), 3–31 (2000)
Zheng, H., Meng, W., Gong, B.: Neural Network and its Application on Machine fault Diagnosis. In: ICSYSE, pp. 576–579 (1992)
Rehman, M.Z., Nawi, N.M.: Improving the Accuracy of Gradient Descent Back Propagation Algorithm (GDAM) on Classification Problems. Int. J. of New Computer Architectures and their Applications (IJNCAA) 1(4), 838–847 (2012)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning Representations by Back– Propagating Errors. J. Nature 323, 533–536 (1986)
Lahmiri, S.: A comparative study of backpropagation algorithms in financial prediction. Int. J. of Computer Science, Engineering and Applications (IJCSEA) 1(4) (2011)
Nawi, M.N., Ransing, R.S., AbdulHamid, N.: BPGD-AG: A New Improvement of Back-Propagation Neural Network Learning Algorithms with Adaptive Gain. J. of Science and Technology 2(2) (2011)
Wam, A., Esm, S., Esa, A.: Modified Back Propagation Algorithm for Learning Artificial Neural Networks. In: 8th NRSC, pp. 345–352 (2001)
Wen, J., Zhao, J.L., Luo, S.W., Han, Z.: The Improvements of BP Neural Network Learning Algorithm. In: 5th WCCC-ICSP, vol. 3, pp. 1647–1649 (2000)
Lahmiri, S.: Wavelet transform, neural networks and the prediction of s & p price index: a comparative paper of back propagation numerical algorithms. J. Business Intelligence 5(2) (2012)
Nawi, N.M., Ransing, R.S., Salleh, M.N.M., Ghazali, R., Hamid, N.A.: An improved back propagation neural network algorithm on classification problems. In: Zhang, Y., Cuzzocrea, A., Ma, J., Chung, K.-i., Arslan, T., Song, X. (eds.) DTA and BSBT 2010. CCIS, vol. 118, pp. 177–188. Springer, Heidelberg (2010)
Gupta, J.N.D., Sexton, R.S.: Comparing back propagation with a genetic algorithm for neural network training. J. International Journal of Management Science 27, 679–684 (1999)
Rehman, M.Z., Nawi, N.M.: Studying the Effect of adaptive momentum in improving the accuracy of gradient descent back propagation algorithm on classification problems. J. Int. Journal of Modern Physics: Conference Series 9, 432–439 (2012)
Yam, J.Y.F., Chow, T.W.S.: Extended least squares based algorithm for training feed forward networks. J. IEEE Transactions on Neural Networks 8, 806–810 (1997)
Yam, J.Y.F., Chow, T.W.S.: A weight initialization method for improving training speed in feed forward neural networks. J. Neurocomputing 30, 219–232 (2000)
Yam, J.Y.F., Chow, T.W.S.: Feed forward networks training speed enhancement by optimal initialization of the synaptic coefficients. J. IEEE Transactions on Neural Networks 12, 430–434 (2001)
Kwok, T.Y., Yeung, D.Y.: Objective functions for training new hidden units in constructive neural networks. J. IEEE Transactions on Neural Networks 8, 1131–1147 (1997)
Zhang, J., Lok, T., Lyu, M.: A hybrid particle swarm optimization back propagation algorithm for feed forward neural network training. J. Applied Mathematics and Computation 185, 1026–1037 (2007)
Shah, H., Ghazali, R., Nawi, N.M., Deris, M.M.: Global hybrid ant bee colony algorithm for training artificial neural networks. In: Murgante, B., Gervasi, O., Misra, S., Nedjah, N., Rocha, A.M.A.C., Taniar, D., Apduhan, B.O. (eds.) ICCSA 2012, Part I. LNCS, vol. 7333, pp. 87–100. Springer, Heidelberg (2012)
Shah, H., Ghazali, R., Nawi, N.M.: Hybrid ant bee colony algorithm for volcano temperature prediction. In: Chowdhry, B.S., Shaikh, F.K., Hussain, D.M.A., Uqaili, M.A. (eds.) IMTIC 2012. CCIS, vol. 281, pp. 453–465. Springer, Heidelberg (2012)
Karaboga, D.: Artificial bee colony algorithm. J. Scholarpedia 5(3), 6915 (2010)
Yao, X.: Evolutionary artificial neural networks. J. International Journal of Neural Systems 4(3), 203–222 (1993)
Mendes, R., Cortez, P., Rocha, M., Neves, J.: Particle swarm for feedforward neural network training. In: Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 1895–1899 (2002)
Lonen, I., Kamarainen, I.J., Lampinen, J.I.: Differential Evolution Training Algorithm for Feed-Forward Neural Networks. J. Neural Processing Letters 17(1), 93–105 (2003)
Liu, Y.-P., Wu, M.-G., Qian, J.-X.: Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and BP Algorithms. In: Wang, J., Yi, Z., Żurada, J.M., Lu, B.-L., Yin, H. (eds.) ISNN 2006. LNCS, vol. 3971, pp. 714–722. Springer, Heidelberg (2006)
Khan, A.U., Bandopadhyaya, T.K., Sharma, S.: Comparisons of Stock Rates Prediction Accuracy using Different Technical Indicators with Back propagation Neural Network and Genetic Algorithm Based Back propagation Neural Network. In: The First International Conference on Emerging Trends in Engineering and Technology, pp. 575–580 (2008)
Yang, X.S., Deb, S.: Cuckoo search via Lévy flights. In: World Congress on Nature & Biologically Inspired Computing, India, pp. 210–214 (2009)
Yang, X.S., Deb, S.: Engineering Optimisation by Cuckoo Search. J. of Mathematical Modelling and Numerical Optimisation 1(4), 330–343 (2010)
Tuba, M., Subotic, M., Stanarevic, N.: Modified cuckoo search algorithm for unconstrainedoptimization problems. In: The European Computing Conference, pp. 263–268 (2011)
Tuba, M., Subotic, M., Stanarevic, N.: Performance of a Modified Cuckoo Search Algorithm for Unconstrained Optimization Problems. J. Faculty of Computer Science 11(2), 62–74 (2012)
Chaowanawate, K., Heednacram, A.: Implementation of Cuckoo Search in RBF Neural Network for Flood Forecasting. In: Fourth International Conference on Computational Intelligence, Communication Systems and Networks, pp. 22–26 (2012)
Pavlyukevich, I.: Levy flights, non-local search and simulated annealing. J. of Computational Physics 226(2), 1830–1844 (2007)
Walton, S., Hassan, O., Morgan, K., Brown, M.: Modified cuckoo search: A new gradient free optimisation algorithm. J. Chaos, Solitons& Fractals 44(9), 710–718 (2011)
Hagan, M.T., Menhaj, M.B.: Training Feedforward Networks with the Marquardt Algorithm. J. IEEE Transactions on Neural Networks 5(6), 989–993 (1994)
Nawi, N.M., Khan, A., Rehman, M.Z.: A New Cuckoo Search based Levenberg-Marquardt (CSLM) Algorithm. In: Murgante, B., Misra, S., Carlini, M., Torre, C.M., Nguyen, H.-Q., Taniar, D., Apduhan, B.O., Gervasi, O. (eds.) ICCSA 2013, Part I. LNCS, vol. 7971, pp. 438–451. Springer, Heidelberg (2013)
Nawi, N.M., Khan, A., Rehman, M.Z.: A New Back-propagation Neural Network optimized with Cuckoo Search Algorithm. In: Murgante, B., Misra, S., Carlini, M., Torre, C.M., Nguyen, H.-Q., Taniar, D., Apduhan, B.O., Gervasi, O. (eds.) ICCSA 2013, Part I. LNCS, vol. 7971, pp. 413–426. Springer, Heidelberg (2013)
Nawi, N.M., Khan, A., Rehman, M.Z.: A New Optimized Cuckoo Search Recurrent Neural Network (CSRNN) Algorithm. In: Sakim, H.A.M., Mustaffa, M.T. (eds.) ROVISP. LNEE, vol. 291, pp. 335–341. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Nawi, N.M., Khan, A., Rehman, M.Z., Herawan, T., Deris, M.M. (2014). Comparing Performances of Cuckoo Search Based Neural Networks. In: Herawan, T., Ghazali, R., Deris, M. (eds) Recent Advances on Soft Computing and Data Mining. Advances in Intelligent Systems and Computing, vol 287. Springer, Cham. https://doi.org/10.1007/978-3-319-07692-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-07692-8_16
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07691-1
Online ISBN: 978-3-319-07692-8
eBook Packages: EngineeringEngineering (R0)