Abstract
Multi-objective optimization is widely found in many fields, such as logistics, economics, engineering, or whenever optimal decisions need to be made in the presence of tradeoff between two or more conflicting objectives. The synergy of probabilistic graphical approaches in evolutionary mechanism may enhance the iterative search process when interrelationships of the archived data has been learned, modeled, and used in the reproduction. This paper presents the implementation of probabilistic graphical approaches in solving multi-objective optimization problems under the evolutionary paradigm. First, the existing work on the synergy between probabilistic graphical models and evolutionary algorithms in the multi-objective framework will be presented. We will then show that the optimization problems can be solved using a restricted Boltzmann machine (RBM). The learning, modeling as well as sampling mechanisms of the RBM will be highlighted. Lastly, five studies that implement the RBM for solving multi-objective optimization problems will be discussed.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Deb, K.: Multi-objective Optimization using Evolutionary Algorithms. John Wiley & Sons, Chichester (2001)
Tan, K.C., Khor, E.F., Lee, L.H.: Multiobjective Evolutionary Algorithms and Applications. Springer (2005)
Larrañaga, P., Lozano, J.A.: Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation. Kluwer, Norwell (2001)
Lozano, J.A., Larran̈aga, P., Bengoetxea, E.: Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms. STUDFUZZ. Springer, New York (2006)
Neri, F., Mininno, E.: Memetic Compact Differential Evolution for Cartesian Robot Control. IEEE Computational Intelligence Magazine 5(2), 54–65 (2010)
Koller, D., Friedman, N.: Probabilistic Graphical Models: Principles and Techniques. MIT Press (2009)
Larrañaga, P.: Probabilistic Graphical Models and Evolutionary Computation. In: Plenary Lecturer in 2010 IEEE World Congress on Computational Intelligence (2010)
Ting, C.K., Zeng, W.M., Lin, T.C.: Linkage Discovery Through Data Mining. IEEE Computational Intelligence Magazine 5(1), 10–13 (2010)
Pelikan, M., Sastry, K., Goldberg, D.E.: Multiobjective Estimation of Distribution Algorithm. In: Scalable Optimization via Probabilistic Modeling, pp. 223–248. Springer (2006)
Bosman, P.A.N., Thierens, D.: Multi-objective Optimization with Diversity Preserving Mixture-based Iterated Density Estimation Evolutionary Algorithms. International Journal of Approximate Reasoning 31(3), 259–289 (2002)
Laumanns, M., Ocenasek, J.: Bayesian Optimization Algorithms for Multi-objective Optimization. In: Proceedings of the 7th International Conference on Parallel Problem Solving from Nature, pp. 298–307 (2002)
Costa, M., Minisci, E.: MOPED: A Multi-objective Parzen-Based Estimation of Distribution Algorithm for Continuous Problems. In: Fonseca, C.M., Fleming, P.J., Zitzler, E., Deb, K., Thiele, L. (eds.) EMO 2003. LNCS, vol. 2632, pp. 282–294. Springer, Heidelberg (2003)
Li, H., Zhang, Q., Tsang, E., Ford, J.A.: Hybrid Estimation of Distribution Algorithm for Multiobjective Knapsack Problem. In: Gottlieb, J., Raidl, G.R. (eds.) EvoCOP 2004. LNCS, vol. 3004, pp. 145–154. Springer, Heidelberg (2004)
Okabe, T., Jin, Y., Sendhoff, B., Olhofer, M.: Voronoi-based Estimation of Distribution Algorithm for Multi-objective Optimization. In: IEEE Congress on Evolutionary Computation, pp. 1594–1601 (2004)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)
Pelikan, M., Sastry, K., Goldberg, D.E.: Multiobjective hBOA, Clustering, and Scalability. In: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pp. 663–670 (2005)
Sastry, K., Goldberg, D.E., Pelikan, M.: Limits of Scalability of Multiobjective Estimation of Distribution Algorithms. In: IEEE Congress on Evolutionary Computation, pp. 2217–2224 (2005)
Soh, H., Kirley, M.: moPGA: Towards a New Generation of Multi-objective Genetic Algorithms. In: IEEE Congress on Evolutionary Computation, pp. 1702–1709 (2006)
Bosman, P.A.N., Thierens, D.: Adaptive Variance Scaling in Continuous Multi-objective Estimation of Distribution Algorithms. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 500–507 (2007)
Zhong, X., Li, W.: A Decision-tree-based Multi-objective Estimation of Distribution Algorithm. In: Proceedings of the 2007 International Conference on Computational Intelligence and Security, pp. 114–118 (2007)
Zhang, Q., Zhou, Z., Jin, Y.: RM-MEDA: A Regularity Model-based Multiobjective Estimation of Distribution Algorithm. IEEE Transactions on Evolutionary Computation 12(1), 41–63 (2008)
Zhou, A., Zhang, Q., Jin, Y.: Approximating the Set of Pareto-optimal Solutions in Both the Decision and Objective Spaces by an Estimation of Distribution Algorithm. IEEE Transactions on Evolutionary Computation 13(5), 1167–1189 (2009)
Martí, L., García, J., Berlanga, A., Molina, J.: Solving Complex High-dimensional Problems with the Multi-objective Neural Estimation of Distribution Algorithm. In: Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation, pp. 619–626 (2009)
Huband, S., Hingston, P., Barone, L., While, L.: A Review of Multiobjective Test Problems and a Scalable Test Problem Toolkit. IEEE Transactions on Evolutionary Computation 10(5), 477–506 (2006)
Gao, Y., Hu, X., Liu, H., Feng, Y.: Multiobjective Estimation of Distribution Algorithm Combined with PSO for RFID Network Optimization. In: International Conference on Measuring Technology and Mechatronics Automation, pp. 736–739 (2010)
Li, X.: Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology. IEEE Transactions on Evolutionary Computation 14(1), 150–169 (2010)
Salakhutdinov, R., Mnih, A., Hinton, G.: Restricted Boltzmann Machines for Collaborative Filtering. In: Proceedings of the 24th International Conference on Machine Learning, pp. 791–798 (2007)
Hinton, G.E.: Training Products of Experts by Minimizing Contrastive Divergence. Neural Computation 14(8), 1771–1800 (2002)
Hinton, G.E., Salakhutdinov, R.: Reducing the Dimensionality of Data with Neural Networks. Science 313(5786), 504–507 (2006)
Tieleman, T.: Training Restricted Boltzmann Machines Using Approximations to the Likelihood Gradient. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1064–1071 (2008)
Carreira-Perpiñán, M., Hinton, G.: On Contrastive Divergence Learning. In: 10th International Workshop on Artificial Intelligence and Statistics, pp. 59–66 (2005)
Lu, K., Yen, G.G.: Rank-density-based multiobjective genetic algorithm and benchmark test function study. IEEE Transactions on Evolutionary Computation 7(4), 325–343 (2003)
Deb, K., Sinha, A., Kukkonen, S.: Multi-objective Test Problems, Linkages, and Evolutionary Methodologies. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, pp. 1141–1148 (2006)
Tang, H., Shim, V.A., Tan, K.C., Chia, J.Y.: Restricted Boltzmann Machine Based Algorithm for Multi-objective Optimization. In: IEEE Congress on Evolutionary Computation, pp. 3958–3965 (2010)
Shim, V.A., Tan, K.C., Chia, J.Y.: An Investigation on Sampling Technique for Multi-objective Restricted Boltzmann Machine. In: IEEE Congress on Evolutionary Computation, pp. 1081–1088 (2010)
Shim, V.A., Tan, K.C., Chia, J.Y., Al Mamun, A.: Multi-objective Optimization with Estimation of Distribution Algorithm in a Noisy Environment. Evolutionary Computation (accepted)
Beyer, H.G.: Evolutionary Algorithms in Noisy Environments: Theoretical Issues and Guidelines for Practice. Computer Methods in Applied Mechanics and Engineering 186(2), 239–267 (2000)
Goh, C.K., Tan, K.C.: An Investigation on Noisy Environments in Evolutionary Multiobjective Optimization. IEEE Transactions on Evolutionary Computation 11(3), 354–381
Darwen, P., Pollack, J.: Coevolutionary learning on Noisy Tasks. In: IEEE Congress on Evolutionary Computation, pp. 1724–1731 (1999)
Hughes, E.J.: Evolutionary Multi-objective Ranking with Uncertainy and Noise. In: Proceedings of the First International Conference on Evolutionary Multi-Criterion Optimization, pp. 329–343 (2001)
Storn, R., Price, K.: Differential Evolution - A Simple and Efficient Heuristic for Global Optimization Over Continuous Spaces. Journal of Global Optimization 11(4), 341–359 (1997)
Shim, V.A., Tan, K.C., Cheong, C.Y.: A Hybrid Estimation of Distribution Algorithm with Decomposition for Solving the Multi-objective Multiple Traveling Salesmen Problem. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews (accepted)
Ishibuchi, H., Yoshida, T., Murata, T.: A Multi-objective Genetic Local Search Algorithm and Its Application to Flowshop Scheduling. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 28(3), 204–223 (1998)
Zhang, Q., Li, H.: MOEA/D: A Multiobjective Evolutinoary Algorithm Based On Decomposition. IEEE Transactions on Evolutionary Computation 11(6), 712–731 (2007)
Okonjo, C.: An Effective Method of Balancing the Workload Amongst Salesmen. Omega 16(2), 159–163 (1998)
Goh, C.K., Ong, Y.S., Tan, K.C., Teoh, E.J.: An Investigation on Evolutionary Gradient Search for Multi-objective Optimization. In: IEEE Congress on Evolutionary Computation, pp. 3741–3746 (2008)
Shim, V.A., Tan, K.C.: A Hybrid Adaptive Evolutionary Algorithm in the Domination-based and Decomposition-based Frameworks of Multi-objective Optimization. In: IEEE Congress on Evolutionary Computation (accepted, 2012)
Abbass, H.A., Sarker, R.: The Pareto Differential Evolution Algorithm. International Journal of Artificial Intelligence Tools 11(4), 531–552 (2002)
Kukkonen, S., Lampinen, J.: GDE3: The Third Evolution Step of Generalized Differential Evolution. In: IEEE Congress on Evolutionary Computation, pp. 443–450 (2005)
Li, H., Zhang, Q.: Multiobjective Optimization Problems with Complicated Pareto Sets, MOEA/D and NSGA-II. IEEE Transactions on Evolutionary Computation 13(2), 284–302 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Shim, V.A., Tan, K.C. (2012). Probabilistic Graphical Approaches for Learning, Modeling, and Sampling in Evolutionary Multi-objective Optimization. In: Liu, J., Alippi, C., Bouchon-Meunier, B., Greenwood, G.W., Abbass, H.A. (eds) Advances in Computational Intelligence. WCCI 2012. Lecture Notes in Computer Science, vol 7311. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30687-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-30687-7_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30686-0
Online ISBN: 978-3-642-30687-7
eBook Packages: Computer ScienceComputer Science (R0)