1 Summary
Memetic Evolutionary Algorithms (MAs) are a class of stochastic heuristics for global optimization which combine the parallel global search nature of Evolutionary Algorithms with Local Search to improve individual solutions. These techniques are being applied to an increasing range of application domains with successful results, and the aim of this book is both to highlight some of these applications, and to shed light on some of the design issues and considerations necessary to a successful implementation. In this chapter we provide a background for the rest of the volume by introducing Evolutionary Algorithms (EAs) and Local Search. We then move on to describe the synergy that arises when these two are combined in Memetic Algorithms, and to discuss some of the most salient design issues for a successful implementation. We conclude by describing various other ways in which EAs and MAs can be hybridized with domain-specific knowledge and other search techniques.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Merz, P.: Memetic Algorithms for Combinatorial Optimization Problems: Fitness Landscapes and Efective Search Strategies. PhD thesis, Department of Electrical Engineering and Computer Science, University of Siegen, Germany (2000)
Vavak, F., Fogarty, T., Jukes, K.: A genetic algorithm with variable range of local search for tracking changing environments. In Voigt, H.M., Ebeling, W., Rechenberg, I., Schwefel, H.P., eds.: Proceedings of the 4th Conference on Parallel Problem Solving from Nature. Number 1141 in Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, New York (1996) 376–385
Knowles, J., Corne, D.: A comparative assessment of memetic, evolutionary and constructive algorithms for the multi-objective d-msat problem. In: Gecco-2001 Workshop Program. (2001) 162–167
Moscato, P.: Memetic algorithms’ home page, visited july 2003: http://www.densis.fee.unicamp.br/~moscato/memetic-home.html (2003)
Moscato, P.: On evolution, search, optimization, genetic algorithms and martial arts: Towards memetic algorithms. Technical Report Caltech Concurrent Computation Program Report 826, Caltech, Caltech, Pasadena, California (1989)
Hinton, G., Nowlan, S.: How learning can guide evolution. Complex Systems 1 (1987) 495–502
Bull, L., Fogarty, T.: An evolutionary strategy and genetic algorithm hybrid: An initial implementation and first results. In Fogarty, T., ed.: Evolutionary Computation: Proceedings of the 1994 AISB Workshop on Evolutionary Computing, Springer, Berlin, Heidelberg, New York (1994) 95–102
Houck, C, Joines, J., Kay, M., Wilson, J.: Empirical investigation of the benefits of partial Lamarckianism. Evolutionary Computation 5 (1997) 31–60
Mayley, G.: Landscapes, learning costs and genetic assimilation. Evolutionary Computation 4 (1996) 213–234
Turney, P.: How to shift bias: lessons from the Baldwin effect. Evolutionary Computation 4 (1996) 271–295
Whitley, L., Gordon, S., Mathias, K.: Lamarkian evolution, the Baldwin effect, and function optimisation. In Davidor, Y., Schwefel, H.P., Männer, R., eds.: Proceedings of the 3rd Conference on Parallel Problem Solving from Nature. Number 866 in Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, New York (1994) 6–15
Whitley, L., Gruau, F.: Adding learning to the cellular development of neural networks: evolution and the Baldwin effect. Evolutionary Computation 1 (1993) 213–233
Hart, W.: Adaptive Global Optimization with Local Search. PhD thesis, University of California, San Diego (1994)
Krasnogor, N.: Studies in the Theory and Design Space of Memetic Algorithms. PhD thesis, University of the West of England (2002)
Land, M.: Evolutionary Algorithms with Local Search for Combinatorial Optimization. PhD thesis, University of California, San Diego (1998)
Moscato, P.: Problemas de Otimizacão NP, Aproximabilidade e Computacão Evolutiva:Da Prática à Teoria. PhD thesis, Universidade Estadual de Campinas, Brasil (2001)
Eiben, A., Smith, J.: Introduction to Evolutionary Computing. Springer, Berlin, Heidelberg, New York (2003)
Aarts, E., Lenstra, J., eds.: Local Search in Combinatorial Optimization. Discrete Mathematics and Optimization. Wiley, Chichester, UK (1997)
Fogel, D., ed.: Evolutionary Computation: the Fossil Record. IEEE Press, Piscataway, NJ (1998)
Fogel, L., Owens, A., Walsh, M.: Artificial intelligence through a simulation of evolution. In Callahan, A., Maxfield, M., Fogel, L., eds.: Biophysics and Cybernetic Systems. Spartan, Washington DC (1965) 131–156
Fogel, L., Owens, A., Walsh, M.: Artificial Intelligence through Simulated Evolution. Wiley, Chichester, UK (1966)
De Jong, K.: An Analysis of the Behaviour of a Class of Genetic Adaptive Systems. PhD thesis, University of Michigan (1975)
Holland, J.: Genetic algorithms and the optimal allocation of trials. SIAM J. of Computing 2 (1973) 88–105
Holland, J.: Adaption in Natural and Artificial Systems. MIT Press, Cambridge, MA (1992) 1st edition: 1975, The University of Michigan Press, Ann Arbor.
Rechenberg, I.: Evolutionstrategie: Optimierung Technisher Systeme nach Prinzipien des Biologischen Evolution. Fromman-Hozlboog Verlag, Stuttgart (1973)
Schwefel, H.P.: Evolution and Optimum Seeking. Wiley, New York (1995)
Bäck, T.: Evolutionary Algorithms in Theory and Practice. Oxford University Press, Oxford, UK (1996)
Bäck, T., Fogel, D., Michalewicz, Z., eds.: Evolutionary Computation 1: Basic Algorithms and Operators. Institute of Physics Publishing, Bristol (2000)
Bäck, T., Fogel, D., Michalewicz, Z., eds.: Evolutionary Computation 2: Advanced Algorithms and Operators. Institute of Physics Publishing, Bristol (2000)
Eiben, A., Michalewicz, Z., eds.: Evolutionary Computation. IOS Press (1998)
Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs. 3rd edn. Springer, Berlin, Heidelberg, New York (1996)
Banzhaf, W., Nordin, P., Keller, R., Francone, F.: Genetic Programming: An Introduction. Morgan Kaufmann, San Francisco (1998)
Koza, J.: Genetic Programming. MIT Press, Cambridge, MA (1992)
Koza, J.: Genetic Programming II. MIT Press, Cambridge, MA (1994)
Eiben, A.: Multiparent recombination. Fogel, D., Michalewicz, Z., eds.: Evolutionary Computation 1: Basic Algorithms and Operators. Institute of Physics Publishing, Bristol (2000) [28] chapter 33.7 289–307
Johnson, D., Papadimitriou, C, Yannakakis, M.: How easy is local search. Journal of Computer And System Sciences 37 (1988) 79–100
Yannakakis, M.: Computational complexity. In Aarts, E., Lenstra, J., eds.: Local Search in Combinatorial Optimization, John Wiley & Sons Ltd. (1997) 19–55
Weinberger, E.D.: Correlated and Uncorrelated Fitness Landscapes and How to Tell the Difference. Biological Cybernetics 63 (1990) 325–336
Stadler, P.F.: Towards a Theory of Landscapes. In Lopéz-Peña, R., Capovilla, R., García-Pelayo, R., Waelbroeck, H., Zertuche, F., eds.: Complex Systems and Binary Networks. Volume 461 of Lecture Notes in Physics., Berlin, New York, Springer Verlag (1995) 77–163 SFI preprint 95-03-030.
Jones, T.: Evolutionary Algorithms, Fitness Landscapes and Search. PhD thesis, The University of New Mexico, Albuquerque, NM (1995)
Merz, P., Freisleben, B.: Fitness landscapes and memetic algorithm design. In Corne, D., Dorigo, M., Glover, F., eds.: New Ideas in Optimization. McGraw Hill, London (1999) 245–260
Krasnogor, N., Smith, J.: Emergence of profitable search strategies based on a simple inheritance mechanism. In Spector, L., Goodman, E., Wu, A., Langdon, W., Voigt, H.M., Gen, M., Sen, S., Dorigo, M., Pezeshk, S., Garzon, M., Burke, E., eds.: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001), Morgan Kaufmann, San Francisco (2001) 432–439
Krasnogor, N., Blackburne, B., Burke, E., Hirst, J.: Multimeme algorithms for protein structure prediction. [12] 769–778
Hansen, P., Mladenovic, N.: An introduction to variable neighborhood search. In Voß, S., Martello, S., Osman, I., Roucairol, C, eds.: Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization. Proceedings of MIC 97 Conference. Kluwer Academic Publishers, Dordrecht, The Netherlands (1998)
Lourenco, H.R., Martin, O., Stutzle, T.: Iterated local search. In Glover, F., Kochenberger, G., eds.: Handbook of Metaheuristics. Kluwer Academic Publishers, Norwell, MA (2002) 321–353
Glover, F.: Tabu search: 1. ORSA Journal on Computing 1 (1989) 190–206
Kirkpatrick, S., Gelatt, C, Vecchi, M.: Optimization by simulated anealing. Science 220 (1983) 671–680
Wolpert, D., Macready, W.: No Free Lunch theorems for optimisation. IEEE Transactions on Evolutionary Computation 1 (1997) 67–82
Dawkins, R.: The Selfish Gene. Oxford University Press, Oxford, UK (1976)
Cavalli-Sforza, L., Feldman, M.: Cultural Transmission and Evolution: A Quatitative Approach. Princeton University Press, Princeton, NJ. (1981)
Durham, W.: Coevolution: Genes, Culture and Human Diversity. Stanford University Press (1991)
Gabora, L.: Meme and variations: A computational model of cultural evolution. In L. Nadel, Stein, D., eds.: 1993 Lectures in Complex Systems. Addison Wesley (1993) 471–494
Blackmore, S.: The Meme Machine. Oxford University Press, Oxford, UK (1999)
of Memetics. Advisory Board: S. Blackmore, J., G. Cziko, R. Dawkins, D. Dennett, L. Gabora, D. Hull., eds.: Journal of Memetics: Evolutionary Models of Information Transmission, (http://jom-emit.cfpm.org/)
Krasnogor, N.: Co-evolution of genes and memes in memetic algorithms. In Wu, A., ed.: Proceedings of the 1999 Genetic And Evolutionary Computation Conference Workshop Program. (1999)
Krasnogor, N.: Self-generating metaheuristics in bioinformatics: The protein structure comparison case. Genetic Programming and Evolvable Machines. Kluwer academic Publishers 5 (2004) 181–201
Krasnogor, N., Gustafson, S.: A study on the use of “self-generation” in memetic algorithms. Natural Computing 3 (2004) 53–76
Smith, J.: Co-evolving memetic algorithms: A learning approach to robust scalable optimisation. [1] 498–505
Baldwin, J.: A new factor in evolution. American Naturalist 30 (1896)
Krasnogor, N., Pelta, D.: Fuzzy memes in multimeme algorithms: a fuzzy-evolutionary hybrid. In Verdegay, J., ed.: Fuzzy Sets based Heuristics for Optimization, Springer (2002)
Eshelman, L.: The CHC adaptive search algorithm: how to have safe search when engaging in non-traditional genetic recombination. In Rawlins, G., ed.: Foundations of Genetic Algorithms, Morgan Kaufmann, San Francisco (1990) 263–283
Aarts, E., Korst, J.: Simulated Annealing and Boltzmann Machines. Wiley, Chichester, UK (1989)
Krasnogor, N., Smith, J.: A memetic algorithm with self-adaptive local search: TSP as a case study. In Whitley, D., Goldberg, D., Cantu-Paz, E., Spector, L., Parmee, I., Beyer, H.G., eds.: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2000), Morgan Kaufmann, San Francisco (2000) 987–994
Kallel, L., Naudts, B., Reeves, C: Properties of fitness functions and search landscapes. In Kallel, L., Naudts, B., Rogers, A., eds.: Theoretical Aspects of Evolutionary Computing. Springer, Berlin, Heidelberg, New York (2001) 175–206
Bull, L., Holland, O., Blackmore, S.: On meme-gene coevolution. Artificial Life 6 (2000) 227–235
Krasnogor, N., Gustafson, S.: Toward truly “memetic” memetic algorithms: discussion and proofs of concept. In Corne, D., Fogel, G., Hart, W., Knowles, J., Krasnogor, N., Roy, R., Smith, J., Tiwari, A., eds.: Advances in Nature-Inspired Computation: The PPSN VII Workshops, Reading, UK, PEDAL (Parallel, Emergent & Distributed Architectures Lab), University of Reading (2002) 9–10
Smith, J.: Co-evolution of memetic algorithms: Initial investigations. [12] 537–548
Smith, J.: The co-evolution of memetic algorithms for protein structure prediction. In Corne, D., Fogel, G., Hart, W., Knowles, J., Krasnogor, N., Roy,. Smith, J., Tiwari, A., eds.: Advances in Nature-Inspired Computation: The PPSN VII Workshops, Reading, UK, PEDAL (Parallel, Emergent & Distributed Architectures Lab), University of Reading (2002) 14–15
Smith, J.: Protein structure prediction with co-evolving memetic algorithms. [1] 2346–2353
Rudolph, G.: Convergence of evolutionary algorithms in general search spaces. [82] 50–54
Hart, W., DeLaurentis, J., Ferguson, L.: On the convergence of an implicitly self-adaptive evolutionary algorithm on one-dimensional unimodal problems. IEEE Trans Evolutionary Computation (to appear) (2003)
Bramlette, M.: Initialization, mutation and selection methods in genetic algorithms for function optimization. In Belew, R., Booker, L., eds.: Proceedings of the 4th International Conference on Genetic Algorithms, Morgan Kaufmann, San Francisco (1991) 100–107
Surry, P., Radcliffe, N.: Innoculation to initialise evolutionary search. In T.C. Fogarty, ed.: Evolutionary Computing: Proceedings of the 1996 AISB Workshop, Springer, Berlin, Heidelberg, New York (1996) 269–285
Hart, E., Ross, P., Nelson, J.: Solving a real-world problem using an evolving heuristically driven schedule builder. Evolutionary Computation 6 (1998) 61–81
Thangiah, S., Vinayagamoorty, R., Gubbi, A.: Vehicle routing and time deadlines using genetic and local algorithms. [81] 506–515
Smith, J., Bartley, M., Fogarty, T.: Microprocessor design verification by two-phase evolution of variable length tests. In: Proceedings of the 1997 IEEE Conference on Evolutionary Computation, IEEE Press, Piscataway, NJ (1997) 453–458
Unger, R., Moult, J.: A genetic algorithm for 3D protein folding simulations. [81] 581–588
Friesleben, B., Merz, P.: A genetic local search algorithm for solving the symmetric and assymetric travelling salesman problem. [82] 616–621
Guervos, J.M., Adamidis, P., Beyer, H.G., Fernandez-Villacanas, J.L., Schwefel, H.P., eds.: Proceedings of the 7th Conference on Parallel Problem Solving from Nature. In Guervos, J.M., Adamidis, P., Beyer, H.G., Fernandez-Villacanas, J.L., Schwefel, H.P., eds.: Proceedings of the 7th Conference on Parallel Problem Solving from Nature. Number 2439 in Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, New York (2002)
2003 Congress on Evolutionary Computation (CEC 2003). In: 2003 Congress on Evolutionary Computation (CEC 2003), IEEE Press, Piscataway, NJ (2003)
Forrest, S., ed.: Proceedings of the 5th International Conference on Genetic Algorithms. In Forrest, S., ed.: Proceedings of the 5th International Conference on Genetic Algorithms, Morgan Kaufmann, San Francisco (1993)
Proceedings of the 1996 IEEE Conference on Evolutionary Computation. In: Proceedings of the 1996 IEEE Conference on Evolutionary Computation, IEEE Press, Piscataway, NJ (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Hart, W.E., Krasnogor, N., Smith, J.E. (2005). Memetic Evolutionary Algorithms. In: Hart, W.E., Smith, J.E., Krasnogor, N. (eds) Recent Advances in Memetic Algorithms. Studies in Fuzziness and Soft Computing, vol 166. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-32363-5_1
Download citation
DOI: https://doi.org/10.1007/3-540-32363-5_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22904-9
Online ISBN: 978-3-540-32363-1
eBook Packages: EngineeringEngineering (R0)