Abstract
This work is concerned with the identification of models for nonlinear dynamical systems using multiobjective evolutionary algorithms. Systems modelling involves the processes of structure selection, parameter estimation, model performance and model validation and involves a complex solution space. Evolutionary Algorithms (EAs) are search and optimisation tools founded on the principles of natural evolution and genetics, which are suitable for a wide range of application areas. Due to the versatility of these tools and motivated by the versatility of genetic programming (GP), this evolutionary paradigm is proposed for this modelling problem. GP is then combined with a multiobjective function definition scheme. Multiobjective genetic programming (MOGP) is applied to multiple, conflicting objectives and yields a set of candidate parsimonious and valid models, which reproduce the original system behaviour. The MOGP approach is then demonstrated as being applicable for system modelling with chaotic dynamics. The circuit introduced by Chua, being one of the most popular benchmarks for studying nonlinear oscillations, and the Duffing–Holmes oscillator are the systems to test the evolutionary-based modelling approach introduced in this paper.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aguirre LA, Mendes EMAM (1996) Global non-linear polynomial models: Structure, terms clusters and fixed points. Int J Bifurcation Chaos 6:279–294
Akaike H (1974) A new look at the statistical model identification. IEEE Trans Automat Control AC-19:716–723
Banzhaf WP, Nordin P, Keller RE, Francone FD (1998) Genetic programming: An introduction. Kaufmann, San Mateo, CA
Billings SA, Tao QH (1991) Model validity tests for non-linear signal processing applications. Int J Control 54:157–194
Chen S, Billings SA (1989) Representation of non-linear systems: the NARMAX model. Int J Control 49(3):1013–1032
Chen S-H, Yeh C-H (1996) Toward a computable approach to the efficient market hypothesis: an application of genetic programming. J Econ Dynamics Control 21:1043–1064
Chua LO, Hasler M (1993) Special issue on chaos in non-linear electronic circuits. IEEE Trans Circuits Syst 40:10–11
Chua LO, Kamuro M, Matsumoto T (1986) The double scroll family. IEEE Trans Circuits Syst 33:1072–1118
Coello-Coello CA, Toscano-Pulido G (2001) Multiobjective optimization using a micro-genetic algorithm. In: Zitzler E, Deb K, Thiele L, Coello-Coello CA, Corne D (eds) First international conference on evolutionary multi-criterion optimization. Lecture note in computer science. Springer, Berlin Heidelberg New York, pp 126–140
Coello-Coello CA, Van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer
Deb K, Agrawal S, Pratab A, Meyarivan T (2000) A fast elitism non-dominated sorting genetic algorithm for multiobjective optimization NSGA-II. In: Schoenauer M, Deb K, Rudolph G, Yao X, Lutton E, Merelo JJ, Schwefel H-P (eds), Proceedings of the parallel problem solving from nature VI conference. Lecture notes in computer science. Springer, Berlin Heidelberg New York, pp 849–858
Evans DC, Fleming PJ, Hill DC, Norton JP, Pratt I, Rees D, Rodríguez-Vázquez K (2001) System identification techniques in aircraft gas-turbine engines. Control Eng Pract IFAC 9:135–148
Fonseca CM, Fleming PJ (1995) Multiobjective optimization and multiple constraint handling with evolutionary algorithms I: a unified formulation. Research Report 564, Dept of automatic control and systems engineering. University of Sheffield, UK
Glover J, Mees A (1993) Reconstructing the dynamics of Chua’s circuit. J Circuits Syst Comput 3:201–214
Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley
Gray HF, Maxwell RJ, Martínez-Pérez I, Arus C, Cerdan S (1996) Genetic programming for classification of brain tumors from nuclear magnetic resonance biopsy spectra. In: Koza JR, Goldberg DE, Fogel DB, Riolo RL (eds) Proceedings of the first annual conference on genetic programming. Stanford University, CA, pp 424
Hinterding R (2001) Constrained parameter optimisation: equality constraints. In: IEEE Proceedings of congress on evolutionary computation 2001, vol 1, 27–30 May, Seoul, Korea, pp 687–692
Holmes P (1979) A non-linear oscillator with a strange attractor. Philos Trans Royal Soc London A 292:419–448
Hunter NF (1992) Applications of non-linear time series models to driven systems. In: Casdagli M, Eubank S (eds) Non-linear modeling and forecasting, pp 467–491
Kaboudan MA (1999) Genetic evolution of regression models for business and economic forecasting. In: IEEE congress on evolutionary computation 2:1260–1267
Knowles JD, Corne DW (2000) Approximating the non-dominated front using the Pareto archived evolution strategy. Evolution Comput 8:149–172
Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MA
Leontaritis IJ, Billings SA (1985) Input-output parametric models for non-linear systems, part I and part II. Int J Control 41:304–344
Mendes EMAM (1995) Identification of non-linear discrete systems with intelligent structure detection. PhD thesis, Department of Automatic Control and Systems Engineering, University of Sheffield, UK
Michalewicz Z, Nazhiyath G (1995) Genocop III: A co-evolutionary algorithm for numerical optimization problems with non-linear constraints. In: Fogel DB (ed) Proceedings of the second IEEE conference on evolutionary computation, Piscataway, NJ, pp 647–651
Miller JF, Job D, Vassilev VK (2000) Principles in the evolutionary design of digital circuits. Gen Program Evolv Mach 1:7–36
Mulloy BS, Riolo RL, Savit RS (1996) Dynamics of genetic programming and chaotic time series prediction. In: Koza JR, Goldberg DA, Fogel DB, Riolo RL (eds) Proceedings of the first annual conference on genetic programming, 13–16 July, Stanford University, CA, pp 157–165
Nikolaev NI, Iba H (2001) Accelerated genetic programming of polynomials. Gen Program Evolv Mach 2:231–275
Nordin P (1994) A compiling genetic programming system that directly manipulates the machine code. In: Kinnear KE (ed) Advances in genetic programming, chapter 14. MIT Press, Cambridge, MA, pp 311–331
Oakley EHN (1994) Two scientific applications of genetic programming: stack filters and non-linear equation fitting to chaotic data. In: Kinnear KE (ed) Advances in genetic programming, chapter 16. MIT Press, Cambridge, MA, pp 369–389
Poli R (2001) Exact schema theory for genetic programming and variable-length genetic algorithms with one-point crossover. Gen Program Evolv Mach 2:123–163
Rodríguez-Vázquez K, Fleming PJ (1999) Genetic programming for dynamic chaotic systems modelling. In: IEEE proceedings of congress on evolutionary computation, vol 1, 6–9 July, Washington, DC, pp 22–28
Rosca JP, Ballard DH (1999) Rooted-tree schemata in genetic programming. In: Spector L, Langdon WB, O’Reilly U, Angeline PJ (eds) Advances in genetic programming 3, chapter 11. MIT Press, Cambridge, MA, pp 243–271
Ryan C, Ivan L (1999) An automatic software re-engineering tool based on genetic programming. In: Spector L, Langdon WB, O’Reilly U, Angeline PJ (eds) Advances in genetic programming 3, chapter 2. MIT Press, Cambridge, MA, pp 15–40
Spector L, Alpern A (1995) Induction and recapitulation of deep musical structure. In: Proceedings of international joint conference on artificial intelligence, IJCAI’95 workshop on music and AI, Montreal, Quebec
Witbrock M, Neil-Reilly S (1999) Evolving genetic art. In: Bentley P (ed) Evolutionary design by computers, chapter 10. Kaufmann, San Francisco, CA, pp 251–259
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rodríguez-Vázquez, K., Fleming, P. Evolution of mathematical models of chaotic systems based on multiobjective genetic programming. Knowl Inf Syst 8, 235–256 (2005). https://doi.org/10.1007/s10115-004-0184-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-004-0184-3