Abstract
In this paper we propose using interval type-2 fuzzy logic for the optimization of parameters the form dynamic using the Differential Evolution algorithm. For this particular work we use Benchmark mathematical functions for the experiments that were performed adhering to the rules of the competition for the IEEE Congress on Evolutionary Computation (CEC) benchmark set of 2015. We are presenting a comparison against the winning paper of the competition IEEE Congress on Evolutionary Computation (CEC) to verify how good the proposed method Fuzzy Differential Evolution algorithm really is.
Access provided by CONRICYT-eBooks. Download chapter PDF
Similar content being viewed by others
Keywords
1 Introduction
The use of algorithms based on nature has become very common in evolutionary computation and metaheuristics. In this paper we propose to use one of these algorithms, in particular the Differential Evolution integrating fuzzy logic for dynamically adapting its parameters.
Differential Evolution (DE) is one of the latest evolutionary algorithms that has been proposed in the literature. It was created in 1994 by Price and Storn in an attempt to solve the Chebychev polynomial problem. The following years after that these two authors also proposed the DE for optimization of nonlinear and non-differentiable functions on continuous spaces [20].
Fuzzy logic or multi-valued logic is based on the fuzzy set theory proposed by Zadeh in 1965, which can help us with modeling expert knowledge, through the use of if-then fuzzy rules. Fuzzy set theory provides a systematic calculus to deal with linguistic information, and improves the numerical computation by using linguistic labels stipulated by membership functions [16].
In addition, in reviewing the recent literature there are papers on Differential Evolution applications that use this algorithm to solve real world problems [23, 24]. In the last years the concept of fuzzy logic has been used to adapt certain parameters in metaheuristic algorithms [15, 17, 18, 26,27,28], which demonstrate the importance and the improvement of these algorithms.
Regarding related works that use fuzzy logic to optimize the performance of metaheuristic algorithms we can find some relevant ones in [4, 5, 11,12,13].
In addition, related work with regards to the Special Session & Competition on Real-Parameter Single Objective Optimization at CEC-2015 can also be mentioned, like the works that obtained the first place: A Self-Optimization Approach for L-SHADE Incorporated with Eigenvector-Based Crossover and Successful-Parent-Selecting Framework on CEC 2015 Benchmark Set [8] (rank 1).Finally, the other works presented in the Special Session & Competition on Real-Parameter Single Objective Optimization at CEC-2015 [1,2,3, 6, 8, 19, 21, 22, 29, 30].
The rest of the paper is organized in the following form: Sect. 2 describes the Differential Evolution algorithm. Section 3 describes the proposed methods using the fuzzy logic approach. Section 4 presents the experimentation with the Benchmark functions. Finally, Sect. 5 offers the Conclusions.
2 The Differential Evolution Algorithm
Differential Evolution algorithm (DE) is an optimization method belonging to the category of evolutionary computation that can be applied in solving complex optimization problems. The differential evolution consists mainly of 4 steps [20]:
-
Initialization
-
Mutation
-
Crossing
-
Selection
This is the mathematical form of the Differential Evolution algorithm [13, 14]:
Population structure
Initialization
Mutation
Crossover
Selection
3 Proposed Method
We propose using DE enhanced with fuzzy logic to dynamically modify the F parameter (mutation) during execution of the algorithm. We have previously work with the Differential Evolution algorithm using fuzzy logic and this method was called Fuzzy Differential Evolution, and we are now extending this previous work by using new and more complex functions to verify in more detail the efficiency of the proposed algorithm [14]. The way in which we integrate a fuzzy system algorithm can be found in Fig. 1, where we have the flowchart of the Differential Evolution algorithm and we have a component with Interval-type 2 fuzzy logic, which dynamically calculates the F parameter (mutation) to then make calculations in the algorithm. Figure 2 shows the structure for the Interval-type 2 fuzzy system, which contains one input and one output.
Figure 3 shows the input variable (Generation) that has 3 membership functions and is granulated in the Low, Medium and High values that were used by each membership function are symmetric the ranges are as follows:
-
Low: \( \left[ {\begin{array}{*{20}l} { - 0.5859} \hfill & { - 0.08598} \hfill & {0.4141} \hfill & { - 0.4193} \hfill & {0.08068} \hfill & {0.5807} \hfill \\ \end{array} } \right] \)
-
Medium: \( \left[ {\begin{array}{*{20}l} { - 0.08333} \hfill & {0.4167} \hfill & {0.9167} \hfill & {0.08333} \hfill & {0.5833} \hfill & {1.083} \hfill \\ \end{array} } \right] \)
-
High: \( \left[ {\begin{array}{*{20}l} {0.4167} \hfill & {0.9167} \hfill & {1.417} \hfill & {0.5833} \hfill & {1.083} \hfill & {1.583} \hfill \\ \end{array} } \right] \)
Figure 4 presents the output variable (F) has 3 membership functions and is granulated in Low, Medium and High values that were used by each membership function are symmetric the ranges are as follows:
-
Low: \( \left[ {\begin{array}{*{20}l} { - 0.5859} \hfill & { - 0.08598} \hfill & {0.4141} \hfill & { - 0.4193} \hfill & {0.08068} \hfill & {0.5807} \hfill \\ \end{array} } \right] \)
-
Medium: \( \left[ {\begin{array}{*{20}l} { - 0.0807} \hfill & {0.419} \hfill & {0.919} \hfill & {0.086} \hfill & {0.586} \hfill & {1.09} \hfill \\ \end{array} } \right] \)
-
High: \( \left[ {\begin{array}{*{20}l} {0.4167} \hfill & {0.9167} \hfill & {1.417} \hfill & {0.5833} \hfill & {1.083} \hfill & {1.583} \hfill \\ \end{array} } \right] \)
Figure 5 represents the rules of the interval-type 2 fuzzy logic and the Fig. 6 shows the surface of the interval-type 2 fuzzy system.
4 Results of the Experiments
In this paper we consider the set of CEC 2015 Benchmark Functions to perform the experiments and thereby be to [7, 9, 10, 25].
Below a brief description of the set of CEC 2015 Benchmark Functions is presented.
Table 1 shows the set of 15 CEC 2015 Benchmark Functions used in this paper.
For the experiments we use the metrics given by the comments of CEC’15 Benchmark Functions, are comprised of 15 minimization problems and the experiments for all functions are performed with different dimensions and for this competition are of D = 10, 30, 50, 100.
Tables 2 and 3 show the comparison between the article that obtained the first place in the competition of the CEC´15 and our proposed method [8].
Figures 7, 8, 9 and 10 represent the comparison graph for each dimension D = 10, D = 30, D = 50 and D = 100.
5 Conclusions
In conclusion, we can notice that the results obtained using interval-type 2 fuzzy logic are not as good as we expected, most likely because the fuzzy system is a simple one input and one output and another part of the footprint uncertainty membership functions the input and the output is symmetric and not optimized.
We will try to improve our fuzzy system and/or we will make the footprint uncertainty trail be optimized by some algorithm and thus be able to make a comparison with statistical test to be able to affirm or reject if our proposed method is good with the functions Benchmark, But we can also conclude that our diffuse system for some functions if it is competitive and for those cases means that the uncertainty footprint is the one indicated for certain functions Benchmark CEC’15.
References
A. Al-Dujaili, K. Subramanian, S. Suresh, HumanCog: a cognitive architecture for solving optimization problems, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 3220–3227
N. Awad, M.Z. Ali, R.G. Reynolds, A differential evolution algorithm with success-based parameter adaptation for CEC2015 learning-based optimization, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1098–1105
D. Aydın, T. Stutzle, A configurable generalized artificial bee colony algorithm with local search strategies, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1067–1074
O. Castillo, H. Neyoy, J. Soria, P. Melin, F. Valdez, A new approach for dynamic fuzzy logic parameter tuning in Ant Colony Optimization and its application in fuzzy control of a mobile robot. Appl. Soft Comput. 28, 150–159 (2015)
O. Castillo, P. Melin, Intelligent adaptive model-based control of robotic dynamic systems with a hybrid fuzzy-neural approach. Appl. Soft Comput. 3(4), 363–378 (2003)
Q. Chen, B. Liu, Q. Zhang, J.J. Liang, P.N. Suganthan, B.Y. Qu, Problem definition and evaluation criteria for CEC 2015 special session and competition on bound constrained single-objective computationally expensive numerical optimization. Computational Intelligence Laboratory, Zhengzhou University, China and Nanyang Technological University, Singapore, Technical report (2014)
L. Chen, C. Peng, H.L. Liu, S. Xie, An improved covariance matrix leaning and searching preference algorithm for solving CEC 2015 benchmark problems, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1041–1045
S.M. Guo, J.S.H. Tsai, C.C. Yang, P.H. Hsu, A self-optimization approach for L-SHADE incorporated with eigenvector-based crossover and successful-parent-selecting framework on CEC 2015 benchmark set. In 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1003–1010
X. Li, Decomposition and cooperative coevolution techniques for large scale global optimization. In Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation (ACM, New York, July 2014), pp. 819–838
J.J. Liang, L. Guo, R. Liu, B.Y. Qu, A self-adaptive dynamic particle swarm optimizer, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 3206–3213
R. Martínez-Soto, O. Castillo, L.T. Aguilar, Type-1 and Type-2 fuzzy logic controller design using a Hybrid PSO–GA optimization method. Inf. Sci. 285, 35–49 (2014)
P. Melin, O. Castillo, A review on type-2 fuzzy logic applications in clustering, classification and pattern recognition. Appl. Soft Comput. 21, 568–577 (2014)
P. Ochoa, O. Castillo, J. Soria, A fuzzy differential evolution method with dynamic adaptation of parameters for the optimization of fuzzy controllers, in 2014 IEEE Conference on Norbert Wiener in the 21st Century (21CW) (IEEE, June 2014), pp. 1–6
P. Ochoa, O. Castillo, J. Soria, Differential evolution with dynamic adaptation of parameters for the optimization of fuzzy controllers, in Recent Advances on Hybrid Approaches for designing intelligent systems (Springer International Publishing, 2014), pp. 275–288
F. Olivas, F. Valdez, O. Castillo, P. Melin, Dynamic parameter adaptation in particle swarm optimization using interval type-2 fuzzy logic. Soft. Comput. 20(3), 1057–1070 (2016)
F. Olivas, O. Castillo, Particle swarm optimization with dynamic parameter adaptation using fuzzy logic for benchmark mathematical functions, in Recent Advances on Hybrid Intelligent Systems (Springer, Berlin, 2013), pp. 247–258
C. Peraza, F. Valdez, O. Castillo, A Harmony search algorithm comparison with genetic algorithms, in Fuzzy Logic Augmentation of Nature-Inspired Optimization Metaheuristics (Springer International Publishing, 2015), pp. 105–123
C. Peraza, F. Valdez, O. Castillo, Fuzzy control of parameters to dynamically adapt the HS algorithm for optimization, in Fuzzy Information Processing Society (NAFIPS) held jointly with 2015 5th World Conference on Soft Computing (WConSC), 2015 Annual Conference of the North American (IEEE, New York, Aug 2015), pp. 1–6
R. Poláková, J. Tvrdík, P. Bujok, Cooperation of optimization algorithms: a simple hierarchical model, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1046–1052
K. Price, R.M. Storn, J.A. Lampinen, in Differential Evolution: A Practical Approach to Global Optimization (Springer Science & Business Media, 2006)
J.L. Rueda, I. Erlich, Testing MVMO on learning-based real-parameter single objective benchmark optimization problems, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, May 2015), pp. 1025–1032
K.M. Sallam, R.A. Sarker, D.L. Essam, S.M. Elsayed, Neurodynamic differential evolution algorithm and solving CEC2015 competition problems, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1033–1040
R. Storn, On the usage of differential evolution for function optimization, in Fuzzy Information Processing Society, 1996. NAFIPS. 1996 Biennial Conference of the North American (IEEE, New York, June 1996), pp. 519–523
R. Storn, K. Price, Differential Evolution—A Simple and Efficient Adaptive Scheme for Global Optimization Over Continuous Spaces, vol. 3 (ICSI, Berkeley, 1995)
R. Tanabe, A. Fukunaga, Success-history based parameter adaptation for differential evolution, in 2013 IEEE Congress on Evolutionary Computation (IEEE, New York, June 2013), pp. 71–78
F. Valdez, P. Melin, O. Castillo, Evolutionary method combining particle swarm optimization and genetic algorithms using fuzzy logic for decision making, in IEEE International Conference on Fuzzy Systems (2009), pp. 2114–2119
F. Valdez, P. Melin, O. Castillo, Evolutionary method combining particle swarm optimisation and genetic algorithms using fuzzy logic for parameter adaptation and aggregation: the case neural network optimisation for face recognition. Int. J. Artif. Intell. Soft Comput. 2(1–2), 77–102 (2010)
F. Valdez, P. Melin, O. Castillo, An improved evolutionary method with fuzzy logic for combining particle swarm optimization and genetic algorithms. Appl. Soft Comput. 11(2), 2625–2632 (2011)
C. Yu, L.C. Kelley, Y. Tan, Dynamic search fireworks algorithm with covariance mutation for solving the CEC 2015 learning based competition problems, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1106–1112
Y.J. Zheng, X.B. Wu, Tuning maturity model of ecogeography-based optimization on CEC 2015 single-objective optimization test problems, in 2015 IEEE Congress on Evolutionary Computation (CEC) (IEEE, New York, May 2015), pp. 1018–1024
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Ochoa, P., Castillo, O., Soria, J. (2018). Differential Evolution Algorithm with Interval Type-2 Fuzzy Logic for the Optimization of the Mutation Parameter. In: Castillo, O., Melin, P., Kacprzyk, J. (eds) Fuzzy Logic Augmentation of Neural and Optimization Algorithms: Theoretical Aspects and Real Applications. Studies in Computational Intelligence, vol 749. Springer, Cham. https://doi.org/10.1007/978-3-319-71008-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-71008-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-71007-5
Online ISBN: 978-3-319-71008-2
eBook Packages: EngineeringEngineering (R0)