Abstract
This paper studies the use of multiple scale factor values within distributed Differential Evolution structures employing the so-called exponential crossover. Four different scale factor schemes are proposed, tested, compared and analyzed. Two schemes simply employ multiple scale factor values and two also include an update logic during the evolution. The four schemes have been integrated for comparison within three recently proposed distributed Differential Evolution structures and tested on several various test problems. The results are then compared to those of a previous study where the so-called binomial crossover was employed. Numerical results show that, when associated to the exponential crossover, the employment of multiple scale factors is not systematically beneficial and in some cases even detrimental to the performance of the algorithm. The exponential crossover accentuates the exploitative character of the Differential Evolution, which cannot always be counterbalanced by the increase in the explorative aspect of the algorithm introduced by the employment of multiple scale factor values.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5): 443–462
Apolloni J, Leguizamón G, García-Nieto J, Alba E (2008) Island based distributed differential evolution: an experimental study on hybrid testbeds. In: Proceedings of the IEEE international conference on hybrid intelligent systems, pp 696–701
Brest J, Maučec MS (2008) Population size reduction for the differential evolution algorithm. Appl Intell 29(3): 228–247
Brest J, Greiner S, Bošković B, Mernik M, Žumer V (2006) Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6): 646–657
Brest J, Zamuda A, Bošković B, Maucec MS, Žumer V (2008) High-dimensional real-parameter optimization using self-adaptive differential evolution algorithm with population size reduction. In: Proceedings of the IEEE world congress on computational intelligence, pp 2032–2039
Caponio A, Neri F (2009) Differential evolution with noise analysis. In: Applications of evolutionary Computing, lecture notes in computer science, vol 5484. Springer, pp 715–724
Chakraborty, UK (ed) (2008) Advances in differential evolution, studies in computational intelligence, vol 143. Springer, Berlin
Das S, Konar A, Chakraborty UK (2005) Two improved differential evolution schemes for faster global search. In: Proceedings of the 2005 conference on genetic and evolutionary computation. ACM, New York, pp 991–998
De Falco I, Della Cioppa A, Maisto D, Scafuri U, Tarantino E (2007a) Satellite image registration by distributed differential evolution. In: Applications of evolutionary computing, lectures notes in computer science, vol 4448, Springer, pp 251–260
De Falco I, Maisto D, Scafuri U, Tarantino E, Della Cioppa A (2007b) Distributed differential evolution for the registration of remotely sensed images. In: Proceedings of the IEEE euromicro international conference on parallel, distributed and network-based processing, pp 358–362
De Falco I, Scafuri U, Tarantino E, Della Cioppa A (2007c) A distributed differential evolution approach for mapping in a grid environment. In: Proceedings of the IEEE euromicro international conference on parallel, distributed and network-based processing, pp 442–449
Fan HY, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27(1): 105–129
Feoktistov V (2006) Differential evolution in search of solutions. Springer, Berlin
Gämperle R, Müller SD, Koumoutsakos P (2002) A parameter study for differential evolution. In: Proceedings of the conference in neural networks and applications (NNA), fuzzy sets and fuzzy systems (FSFS) and evolutionary computation (EC), WSEAS, pp 293–298
Herrera F, Lozano M, Molina D (2010) Components and parameters of de, real-coded chc, and g-cmaes. Web document. http://sci2s.ugr.es/eamhco/descriptions.pdf
Karaboga D, Akay B (2009) A survey: algorithms simulating bee swarm intelligence. Artif Intell Rev 31(1–4): 61–85
Kozlov KN, Samsonov AM (2006) New migration scheme for parallel differential evolution. In: Proceedings of the international conference on bioinformatics of genome regulation and structure, pp 141–144
Kwedlo W, Bandurski K (2006) A parallel differential evolution algorithm. In: Proceedings of the IEEE international symposium on parallel computing in electrical engineering, pp 319–324
Lampinen J (1999) Differential evolution—new naturally parallel approach for engineering design optimization. In: Topping BH (ed) Developments in computational mechanics with high performance computing. Civil-Comp Press, UK, pp 217–228
Lampinen J, Zelinka I (2000) On stagnation of the differential evolution algorithm. In: Oŝmera P (ed) Proceedings of 6th international mendel conference on soft computing, pp 76–83
Liu J, Lampinen J (2002a) A fuzzy adaptive differential evolution algorithm. In: Proceedings of the 17th IEEE region 10 international conference on computer, communications, control and power engineering, vol 1, pp 606–611
Liu J, Lampinen J (2002b) On setting the control parameter of the differential evolution algorithm. In: Proceedings of the 8th international mendel conference on soft computing, pp 11–18
Mallipeddi R, Suganthan PN (2008) Empirical study on the effect of population size on differential evolution algorithm. In: Proceedings of the IEEE congress on evolutionary computation, pp 3663–3670
Neri F, Tirronen V (2008) On memetic differential evolution frameworks: a study of advantages and limitations in hybridization. In: Proceedings of the IEEE world congress on computational intelligence, pp 2135–2142
Neri F, Tirronen V (2009) Scale factor local search in differential evolution. Memet Comput 1(2): 153–171
Neri F, Tirronen V (2010) Recent advances in differential evolution: a review and experimental analysis. Artif Intell Rev 33(1): 61–106
Neri F, Tirronen V, Kärkkäinen T (2009) Enhancing differential evolution frameworks by scale factor local search—part II. In: Proceedings of the IEEE congress on evolutionary computation, pp 118–125
Nipteni MS, Valakos I, Nikolos I (2006) An asynchronous parallel differential evolution algorithm. In: Proceedings of the ERCOFTAC conference on design optimisation: methods and application
Noman N, Iba H (2005) Enhancing differential evolution performance with local search for high dimensional function optimization. In: Proceedings of the 2005 conference on genetic and evolutionary computation. ACM, New York, pp 967–974
Olorunda O, Engelbrecht A (2007) Differential evolution in high-dimensional search spaces. In: Proceedings of the IEEE congress on evolutionary computation, pp 1934–1941
Omran MG, Salman A, Engelbrecht AP (2005) Self-adaptive differential evolution. In: Computational intelligence and security, lecture notes in computer science, vol 3801. Springer, Berlin, pp 192–199
Pavlidis NG, Tasoulis DK, Plagianakos VP, Nikiforidis G, Vrahatis MN (2005) Spiking neural network training using evolutionary algorithms. In: Proceedings of the IEEE international joint conference on neural networks, pp 2190–2194
Price K, Storn R (1997) Differential evolution: a simple evolution strategy for fast optimization. Dr Dobb’s J Softw Tools 22(4): 18–24
Price KV (1999) Mechanical engineering design optimization by differential evolution. In: Corne D, Dorigo M, Glover F (eds) New ideas in optimization. McGraw-Hill, New Delhi, pp 293–298
Price KV, Storn R, Lampinen J (2005) Differential evolution: a practical approach to global optimization. Springer, Berlin
Qin AK, Suganthan PN (2005) Self-adaptive differential evolution algorithm for numerical optimization. In: Proceedings of the IEEE congress on evolutionary computation, vol 2, pp 1785–1791
Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13: 398–417
Rönkkönen J, Lampinen J (2003) On using normally distributed mutation step length for the differential evolution algorithm. In: Matousek R, Osmera P (eds) Proceedings of ninth international MENDEL conference on soft computing, pp 11–18
Rönkkönen J, Kukkonen S, Price KV (2005) Real-parameter optimization with differential evolution. In: Proceedings of IEEE international conference on evolutionary computation, vol 1, pp 506–513
Salman A, Engelbrecht AP, Omran MG (2007) Empirical analysis of self-adaptive differential evolution. Eur J Oper Res 183(2): 785–804
Salomon M, Perrin GR, Heitz F, Armspach JP (2005) Parallel differential evolution: Application to 3-d medical image registration. In: Price KV, Storn RM, Lampinen JA (eds) Differential evolution–a practical approach to global optimization chap 7, natural computing series. Springer, Berlin, pp 353–411
Soliman OS, Bui LT (2008) A self-adaptive strategy for controlling parameters in differential evolution. In: Proceedings of the IEEE congress on evolutionary computation, pp 2837–2842
Soliman OS, Bui LT, Abbass HA (2007) The effect of a stochastic step length on the performance of the differential evolution algorithm. In: Proceedings of the IEEE congress on evolutionary computation, pp 2850–2857
Storn R (1999) System design by constraint adaptation and differential evolution.IEEE Trans Evol Comput 3(1): 22–34
Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical Report TR-95-012, ICSI
Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11: 341–359
Tasoulis DK, Pavlidis NG, Plagianakos VP, Vrahatis MN (2004) Parallel differential evolution. In: Proceedings of the IEEE congress on evolutionary computation, pp 2023–2029
Tirronen V, Neri F, Rossi T (2009) Enhancing differential evolution frameworks by scale factor local search—part I. In: Proceedings of the IEEE congress on evolutionary computation, pp 94–101
Weber M, Neri F, Tirronen V (2009) Distributed differential evolution with explorative-exploitative population families. Genet Program Evolv Mach 10(4): 343–371
Weber M, Neri F, Tirronen V (2010) Shuffle or update parallel differential evolution for large-scale optimization. Soft Comput (To appear)
Weber M, Neri F, Tirronen V (2011) A study on scale factor in distributed differential evolution. Inf Sci 181: 2488–2511
Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6): 80–83
Zaharie D (2002a) Critical values for control parameters of differential evolution algorithm. In: Matuŝek R, Oŝmera P (eds) Proceedings of 8th international mendel conference on soft computing, pp 62–67
Zaharie D (2002b) Parameter adaptation in differential evolution by controlling the population diversity. In: D Petcu et al. (eds) Proceedings of the international workshop on symbolic and numeric algorithms for scientific computing, pp 385–397
Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Matoušek R, Ošmera P (eds) Proceedings of MENDEL international conference on soft computing, pp 41–46
Zaharie D, Petcu D (2003) Parallel implementation of multi-population differential evolution. In: Proceedings of the NATO advanced research workshop on concurrent information processing and computing. IOS Press, Amsterdam, pp 223–232
Zhang J, Sanderson AC (2009) Jade: Adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5): 945–958
Zielinski K, Weitkemper P, Laur R, Kammeyer KD (2006) Parameter study for differential evolution using a power allocation problem including interference cancellation. In: Proceedings of the IEEE congress on evolutionary computation, pp 1857–1864
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Weber, M., Neri, F. & Tirronen, V. A study on scale factor/crossover interaction in distributed differential evolution. Artif Intell Rev 39, 195–224 (2013). https://doi.org/10.1007/s10462-011-9267-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-011-9267-1