Abstract
Evolutionary algorithms are a promising option for solving dynamic optimization problems. These problems have fitness landscapes whose topological features change dynamically with the run-time of the evolutionary algorithm. In this chapter, we study these landscapes by analyzing and quantifying their properties using topological and dynamical landscape measures such as modality, ruggedness, information content, dynamic severity and two types of dynamic complexity measures, Lyapunov exponents and bred vector dimension. Here, our main focus is on dynamic fitness landscapes that exhibit spatio-temporal chaotic behavior. We further discuss evolutionary algorithms and modifications needed to make them fit to perform in dynamic landscapes and present numerical experiments showing the algorithms’ performances. These results allow us to link the landscape measures to the behavior of the evolutionary algorithms.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
- Search Space
- Evolutionary Algorithm
- Lyapunov Exponent
- Evolutionary Optimization
- Partial Differential Equation
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Aoki, N., Hiraide, K.: Topological Theory of Dynamical Systems. North-Holland, Amsterdam (1994)
Arnold, D., Beyer, H.: Optimum tracking with evolution strategies. Evol. Comput. 14, 291–308 (2006)
Bäck, T.: Evolutionary Algorithms in Theory and Practice: Evolution Strategies. In: Evolutionary Programming, Genetic Algorithms. Oxford University Press, Oxford (1996)
Barreira, L., Pesin, Y.: Nonuniform Hyperbolicity: Dynamics of Systems with Nonzero Lyapunov Exponents. Cambridge University Press, Cambridge (2007)
Batterman, R., White, H.: Chaos and algorithmic complexity. Found. Phys. 26, 307–336 (1996)
Bosman, P.: Learning and anticipation in online dynamic optimization. In: Yang, S., Ong, Y., Jin, Y. (eds.) Evolutionary Computation in Dynamic and Uncertain Environments, pp. 129–152. Springer, Heidelberg (2007)
Boumaza, A.: Learning environment dynamics from self-adaptation. In: Yang, S., Branke, J. (eds.) GECCO Workshops 2005, pp. 48–54 (2005)
Branke, J.: Memory enhanced evolutionary algorithms for changing optimization problems. In: Angeline, P., Michalewicz, Z., Schoenauer, M., Yao, X., Zalzala, A. (eds.) Proc. Congress on Evolutionary Computation, IEEE CEC 1999, pp. 1875–1882. IEEE Press, Piscataway (1999)
Branke, J.: Evolutionary Optimization in Dynamic Environments. Kluwer Academic Publishers, Dordrecht (2001)
Branke, J., Kau, T., Schmidt, C., Schmeck, H.: A multi-population approach to dynamic optimization problems. In: Parmee, I. (ed.) Proc. of the 4th Int. Conf. on Adaptive Computing in Design and Manufacturing, pp. 299–308 (2000)
Bremen, H., Udwadia, F., Proskurowski, W.: An efficient method for the computation of Lyapunov numbers in dynamical systems. Physica D 101, 1–16 (1997)
Chazottes, J., Fernandez, B.: Dynamics of Coupled Map Lattices and of Related Spatially Extended Systems. Springer, Heidelberg (2005)
Chlouverakis, K., Sprott, J.: A comparison of correlation and Lyapunov dimensions. Physica D 200, 156–164 (2005)
Chrianti, A., Falconi, M., Mantic, G., Vulpiani, A.: Applying algorithmic complexity to define chaos in the motion of complex systems. Phys. Rev. E 50, 1959–1967 (1994)
Crutchfield, J., Kaneko, K.: Phenomenology of spatiotemporal chaos. In: Hao, B. (ed.) Directions in Chaos, vol. 1, pp. 272–353. World Scientific, Singapore (1987)
Eiben, A., Smith, J.: Introduction to Evolutionary Computing. Springer, Heidelberg (2003)
Francisco, G., Muruganandam, P.: Local dimension and finite time prediction in spatiotemporal chaotic systems. Phys. Rev. E 67, 066204-1-5 (2003)
Frederickson, P., Kaplan, P., Yorke, E., Yorke, J.: The Lyapunov dimension of strange attractors. J. Diff. Equations 49, 185–203 (1983)
Hordijk, W.: A measure of landscapes. Evol. Comput. 4, 335–360 (1996)
Hordijk, W.: Correlation analysis of the synchronizing-CA landscape. Physica D 107, 255–264 (1997)
Hordijk, W., Stadler, P.: Amplitude spectra of fitness landscapes. Adv. Complex Systems 1, 39–66 (1998)
Hordijk, W., Kauffman, S.: Correlation analysis of coupled fitness landscapes. Complexity 10, 42–49 (2005)
Horn, J., Goldberg, D., Deb, K.: Long path problems. In: Davidor, Y., Männer, R., Schwefel, H.-P. (eds.) PPSN 1994. LNCS, vol. 866, pp. 149–158. Springer, Heidelberg (1994)
Jin, Y., Branke, J.: Evolutionary optimization in uncertain environments — A survey. IEEE Trans. Evol. Comput. 9, 303–317 (2005)
Kaneko, K.: The coupled map lattice. In: Kaneko, K. (ed.) Theory and Application of Coupled Map Lattices, pp. 1–49. John Wiley, Chichester (1993)
Kaneko, K., Tsuda, I.: Complex Systems: Chaos and Beyond. Springer, Heidelberg (2001
Kallel, L., Naudts, B., Reeves, C.: Properties of fitness functions and search landscapes. pp. 177–208. Springer, Heidelberg (2001)
Kantz, H., Schreiber, T.: Nonlinear Time Series Analysis. Cambridge University Press, Cambridge (1999)
Kardar, M., Parisi, G., Zhang, Y.: Dynamic scaling of growing interfaces. Phys. Rev. Lett. 56, 889–892 (1986)
Katok, A., Hasselblatt, B.: Introduction to the Modern Theory of Dynamical Systems. Cambridge University Press, Cambridge (1995)
Katzav, E., Cugliandolo, L.: From coupled map lattices to the stochastic Kardar-Parisi-Zhang equation. Physica A 371, 96–99 (2006)
Kauffman, S.: The Origin of Order: Self-Organization and Selection in Evolution. Oxford University Press, Oxford (1993)
Ma, K., Jianga, J., Yanga, C.: Scaling behavior of roughness in the two-dimensional Kardar-Parisi-Zhang growth. Physica A 378, 194–200 (2007)
Meyer, S., Nieberg, B.H.: Self-adaptation in evolutionary algorithms. In: Lobo, F., Lima, C., Michalewicz, Z. (eds.) Parameter Setting in Evolutionary Algorithm, pp. 47–75. Springer, Heidelberg (2007)
Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs. Springer, Heidelberg (1996)
Miranda, V., Aarão Reis, F.: Numerical study of the Kardar-Parisi-Zhang equation. Phys. Rev. E 77, 031134-1-6 (2008)
Morrison, R.: Designing Evolutionary Algorithms for Dynamic Environments. Springer, Heidelberg (2004)
Morrison, R., De Jong, K.: A test problem generator for non-stationary environments. In: Angeline, P., Michalewicz, Z., Schoenauer, M., Yao, X., Zalzala, A. (eds.) Proc. Congress on Evolutionary Computation, IEEE CEC 1999, pp. 2047–2053. IEEE Press, Piscataway (1999)
Morrison, R., De Jong, K.: Triggered hypermutation revisited. In: Zalzala, A., Fonseca, C., Kim, J., Smith, A., Yao, X. (eds.) Proc. Congress on Evolutionary Computation, IEEE CEC 2000, pp. 1025–1032. IEEE Press, Piscataway (2000)
Ott, E.: Chaos in Dynamical Systems. Cambridge University Press, Cambridge (1993)
Patil, D., Hunt, B., Kalnay, E., Yorke, J., Ott, E.: Local low dimensionality of atmospheric dynamics. Phys. Rev. Lett. 86, 5878–5881 (2001)
Pesin, Y., Yurchenko, A.: Some physical models of the reaction-diffusion equation and coupled map lattices. Russ. Math. Surv. 59, 481–513 (2004)
Primo, C., Szendro, I., Rodríguez, M., López, J.: Dynamic scaling of bred vectors in spatially extended chaotic systems. Europhys. Lett. 765, 767–773 (2006)
Richter, H.: Behavior of evolutionary algorithms in chaotically changing fitness landscapes. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 111-120. Springer, Heidelberg (2004)
Richter, H.: A study of dynamic severity in chaotic fitness landscapes. In: Corne, D. (ed.) Proc. Congress on Evolutionary Computation, IEEE CEC 2005, pp. 2824–2831. IEEE Press, Piscataway (2005)
Richter, H.: Evolutionary optimization in spatio-temporal fitness landscapes. In: Runarsson, T.P., Beyer, H.-G., Burke, E.K., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) PPSN 2006. LNCS, vol. 4193, pp. 1–10. Springer, Heidelberg (2006)
Richter, H.: Coupled map lattices as spatio-temporal fitness functions: Landscape measures and evolutionary optimization. Physica D 237, 167–186 (2008)
Richter, H.: Detecting change in dynamic fitness landscapes. In: Tyrrell, A. (ed.) Proc. Congress on Evolutionary Computation, IEEE CEC 2009, pp. 1613–1620. IEEE Press, Piscataway (2009)
Richter, H.: Can a polynomial interpolation improve on the Kaplan-Yorke dimension? Phys. Lett. A 372, 4689–4693 (2008)
Richter, H., Yang, S.: Memory based on abstraction for dynamic fitness functions. In: Giacobini, M., Brabazon, A., Cagnoni, S., Di Caro, G.A., Drechsler, R., Ekárt, A., Esparcia-Alcázar, A.I., Farooq, M., Fink, A., McCormack, J., O’Neill, M., Romero, J., Rothlauf, F., Squillero, G., Uyar, A.Ş., Yang, S., et al. (eds.) EvoWorkshops 2008. LNCS, vol. 4974, pp. 597–606. Springer, Heidelberg (2008)
Richter, H., Yang, S.: Learning behavior in abstract memory schemes for dynamic optimization problems. Soft Computing 13, 1163–1173 (2009)
Sheskin, D.: Handbook of Parametric and Nonparametric Statistical Procedures. CRC Press, Boca Raton (1997)
Simões, A., Costa, E.: Variable-size memory evolutionary algorithm to deal with dynamic environments. In: Giacobini, M., et al. (eds.) EvoWorkshops 2007. LNCS, vol. 4448, pp. 617–626. Springer, Heidelberg (2007)
Simões, A., Costa, E.: Evolutionary algorithms for dynamic environments: Prediction using linear regression and Markov chains. In: Rudolph, G., Jansen, T., Lucas, S., Poloni, C., Beume, N. (eds.) PPSN 2008. LNCS, vol. 5199, pp. 306–315. Springer, Heidelberg (2008)
Smith, T., Husbands, P., Layzell, P., O’Shea, M.: Fitness landscapes and evolvability. Evol. Comput. 10, 1–34 (2002)
Stadler, P.: Landscapes and their correlation functions. J. Math. Chem. 20, 1–45 (1996)
Stadler, P., Stephens, C.: Landscapes and effective fitness. Comm. Theor. Biol. 8, 389–431 (2003)
Teo, J., Abbass, H.: An information-theoretic landscape analysis of neuro-controlled embodied organisms. Neural Comput. Appl. 13, 80–89 (2004)
Tereshko, V.: Selection and coexistence by reaction-diffusion dynamics in fitness landscapes. Phys. Lett. A 260, 522–527 (1999)
Tinós, R., Yang, S.: A self-organizing random immigrants genetic algorithm for dynamic optimization problems. Genet. Program Evol. Mach. 8, 255–286 (2007)
Vassilev, V.: Information analysis of fitness landscapes. In: Husbands, P., Harvey, I. (eds.) Proc. Fourth European Conference on Artificial Life, pp. 116–124. MIT Press, Cambridge (1997)
Vassilev, V., Fogarty, T., Miller, J.: Information characteristics and the structure of landscapes. Evol. Comput. 8, 31–60 (2000)
Weicker, K.: An analysis of dynamic severity and population size. In: Schoenauer, M., Deb, K., Rudolph, G., Yao, X., Lutton, E., Merelo Guervós, J., Schwefel, H. (eds.) Parallel Problem Solving from Nature-PPSN VI, pp. 159–168. Springer, Heidelberg (2000)
Weinberger, E.: Correlated and uncorrelated fitness landscapes and how to tell the difference. Biol. Cybern. 63, 325–336 (1990)
Wright, S.: The roles of mutation, inbreeding, crossbreeding and selection in evolution. In: Jones, D. (ed.) Proc. of the Sixth International Congress on Genetics, pp. 356–366 (1932)
Xie, F., Hu, G.: Spatio-temporal periodic and chaotic pattern in a two-dimensional coupled map lattice system. Phys. Rev. E 55, 79–86 (1997)
Yang, S.: Non-stationary problem optimization using the primal-dual genetic algorithm. In: Sarker, R., Reynolds, R., Abbass, H., Tan, K., Essam, D., McKay, R., Gedeon, T. (eds.) Proc. Congress on Evolutionary Computation, IEEE CEC 2003, pp. 2246–2253. IEEE Press, Piscataway (2003)
Yang, S.: Associative memory scheme for genetic algorithms in dynamic environments. In: Rothlauf, F., Branke, J., Cagnoni, S., Costa, E., Cotta, C., Drechsler, R., Lutton, E., Machado, P., Moore, J.H., Romero, J., Smith, G.D., Squillero, G., Takagi, H., et al. (eds.) EvoWorkshops 2006. LNCS, vol. 3907, pp. 788–799. Springer, Heidelberg (2006)
Yang, S., Yao, X.: Experimental study on population-based incremental learning algorithms for dynamic optimization problems. Soft Computing 9, 815–834 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Richter, H. (2010). Evolutionary Optimization and Dynamic Fitness Landscapes. In: Zelinka, I., Celikovsky, S., Richter, H., Chen, G. (eds) Evolutionary Algorithms and Chaotic Systems. Studies in Computational Intelligence, vol 267. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10707-8_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-10707-8_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10706-1
Online ISBN: 978-3-642-10707-8
eBook Packages: EngineeringEngineering (R0)