Abstract
Practical engineering design problems have a black-box objective function whose forms are not explicitly known in terms of design variables. In those problems, it is very important to make the number of function evaluations as few as possible in finding an optimal solution. So, in this paper, we propose a multi-objective optimization method based on meta-modeling predicting a form of each objective function by using support vector regression. In addition, we discuss a way how to select additional experimental data for sequentially revising a form of objective function. Finally, we illustrate the effectiveness of the proposed method through some numerical examples.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Chafekar D, Shi L, Rasheed K, Xuan J (2005) Multi-objective GA optimization using reduced models. IEEE Trans Syst Man Cybern Part C Rev Appl 9(2):261–265
Coello Coello CA, Van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer Academic, Dordrecht
Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge
Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20:273–297
Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, New York
Deb K, Srinivasan A (2005) Innovization: innovative design principles through optimization. KanGAL Report #2005007, Indian Institute of Technology
Emmerich M, Giannakoglou K, Naujoks B (2006) Single and multi-objective evolutionary optimization assisted by Gaussian random field meta-models. IEEE Trans Evol Comput 10(4):421–439
Fonseca CM, Fleming PJ (1993) Genetic algorithms for multi-objective optimization: formulation, discussion and generalization. In: Proceedings of the fifth international conference on genetic algorithms, pp 416–426
Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft-Comput 9(1):3–12
Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13:455–492
Kiefer J (1959) Optimimum experimental designs. J R Stat Soc B 21(2):272–304
Nakayama H, Sawaragi Y (1984) Satisficing trade-off method for multi-objective programming. In: Interactive decision analysis. Springer, Berlin, pp 113–122
Nakayama H, Yun YB (2006a) Generating support vector machines using multiobjective optimization and goal programming. In: Multi-objective machine learning. Series on studies in computational intelligence. Springer, Berlin, pp 173–198
Nakayama H, Yun YB (2006b) Support vector regression based on goal programming and multiobjective programming. In: Proceedings of world congress on computational intelligence
Nakayama H, Arakawa M, Sasaki R (2001) A computational intelligence approach to optimization with unknown objective functions. In: Dorffner G, Bischof H, Hornik K (eds) Artificial neural networks (ICANN2001). Springer, Berlin, pp 73–80
Nakayama H, Arakawa M, Sasaki R (2002) Simulation based optimization for unknown objective functions. Optim Eng 3:201–214
Nakayama H, Arakawa M, Washino K (2003) Optimization for black-box objective functions. In: Pardalos PM, Tseveendorj I, Enkhbat R (eds) Optimization and optimal control. World Scientific, Singapore, pp 185–210
Sawaragi Y, Nakayama H, Tanino T (1985) Theory of multiobjective optimization. Academic Press, New York
Schölkopf B, Smola AJ (1998) New support vector algorithms. NeuroCOLT2 Technical report Series, NC2-TR-1998-031
Schölkopf B, Smola AJ (2002) Learning with kernels. MIT Press, Cambridge
Vapnik VN (1995) The nature of statistical learning theory. Springer, Berlin
Vapnik VN (1998) Statistical learning theory. Wiley, New York
Yun YB, Nakayama H, Tanino T, Arakawa M (2001) Generation of efficient frontiers in multi-objective optimization problems by generalized data envelopment analysis. Eur J Oper Res 129(3):586–595
Yun YB, Nakayama H, Arakawa M (2004) Multiple criteria decision making with generalized DEA and an aspiration level method. Eur J Oper Res 158(1):697–706
Yun YB, Nakayama H, Yoon M (2007) Sequential approximation method in multi-objective optimization by using computational intelligence. SICE Trans Soc Instrum Control Eng 43(8):672–678
Yoon M, Yun YB, Nakayama H (2004) Total margin algorithms in support vector machines. IEICE Trans Inf Syst E87(5):1223–1230
Zitzler E, Laumanns M, Thiele L (2001) SPEA2: improving the strength Pareto evolutionary algorithm. Technical Report 103, Computer Engineering and Networks Laboratory (TIK), Department of Electrical Engineering, Swiss Federal Institute of Technology (ETH)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yun, Y., Yoon, M. & Nakayama, H. Multi-objective optimization based on meta-modeling by using support vector regression. Optim Eng 10, 167–181 (2009). https://doi.org/10.1007/s11081-008-9063-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11081-008-9063-1