Abstract
Particle Swarm optimization (PSO) is a search method inspired from the social behaviors of animals. PSO has been found to outperform other methods in various tasks. Area Extended PSO (AEPSO) is an enhanced version of PSO that achieves better performance by balancing its essential intelligent behaviours more intelligently. AEPSO incorporates knowledge with the aim of choosing proper behaviors in each situation. This study provides a comparison between the variations of Basic PSO and AEPSO aiming to address dynamic and time dependent constraint problems in simulated robotic search. The problem is set up in a multi-robot learning scenario. The scenario is based on the use of a team of simulated robots (hereafter referred to as agents) who participate in survivor rescuing missions. The experiments are classified into three simulations. At first, agents employ variations of basic PSO as their decision maker and movement controllers. The first simulation investigates the impacts of swarm size, parameter adjustment, and population density on agents’ performance. Later, AEPSO is employed to improve the performance of the swarm in the same simulations. The final simulation investigates the feasibility of AEPSO in time-dependent, dynamic and uncertain environments. As shown by the results, AEPSO achieves an appreciable level of performance in dynamic, time-dependence and uncertain simulated environments and outperforms the variations of basic PSO, Linear Search and Random Search used in the simulations.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Kaewkamner, B., Bentley, P.J.: Perceptive particle swarm optimization: an investigation. In: Proceedings of 2005 IEEE Swarm Intelligence Symposium (2005)
Kennedy, J., Mendes, R.: Population structure and particle swarm performance. In: Proceedings of the 2002 Congress on Evolutionary Computation (CEC ’02), pp. 1671–1676 (2002)
Angeline, P.J.: Evolutionary optimization versus particle swarm optimization: philosophy and performance differences. Evolutionary programming VII. In: Lecture Notes in Computer Science, vol. 1447, pp. 601–610. Springer, New York (1998)
Vesterstrom, J., Riget, J.: Particle swarms extensions for improved local, multi-modal, and dynamic search in numerical optimization. MSc thesis, Dept. Computer Science, Univ Aarhus, Aarhus C, Denmark (2002)
Krink, T., Vesterstrom, J.S., Riget, J.: Particle swarm optimization with spatial particle extension. In: 2002 IEEE World Congress on Computational Intelligence. Congress on Evolutionary Computation (CEC) (2002)
Riget, J., Vesterstrom, J.S.: Controlling diversity in particle swarm optimization. In: 2002 IEEE World Congress on Computational Intelligence, Hawaiian, Honolulu. Congress on Evolutionary Computation (CEC) (2002)
Riget, J., Vesterstrom, J.S.: Division of labor in particle swarm optimization. In: 2002 IEEE World Congress on Computational Intelligence. Congress on Evolutionary Computation (CEC) (2002)
Ratnaweera, A., Halgamuge, S.K., Watson, H.C.: Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans. Evol. Comput. 8(3), 240–255 (2004)
Peram, T., Veeramachaneni, K., Mohan, C.K.: Fitness distance ratio based particle swarm optimization (FDR-PSO). In: Swarm Intelligence Symposium, SIS ’03, pp. 174–181 (2003)
Parsopoulos, K.E., Vrahatis, M.N.: Particle swarm optimization method in multi objective problems. In: IEEE 2002 ACM Symposium on Applied Computing (2002)
Yoshida, Y., Kawata, K., Fukuyama, Y., Takayama, S., Nakanishi, Y.: A particle swarm optimization for reactive power and voltage control considering voltage security assessment. IEEE Trans. Power Syst. (2001)
Nomura, Y.: An integrated fuzzy control system for structural vibration. Comput.-Aided Civil Infrastruct. Eng. 22(4), 306–316 (2007)
Ribeiro, P.F., Schlansker, W.K.: A particle swarm optimized fuzzy neural network for voice controlled robot systems. IEEE Trans. Ind. Electron., 1478–1489 (2005)
Brits, R., Engelbrecht, A.P., Van Den Bergh, F.: A niching particle swarm optimizer. In: 4th Asia-Pacific Conference on Simulated Evolution and Learning 2002 (SEAL 2002), pp. 692–696 (2002)
Brits, R., Engelbrecht, A.P., Van Den Bergh, F.: Scalability of niche PSO. In: Swarm Intelligence Symposium, SIS ’03, pp. 228–234 (2003)
Zhang, W., Xie, X.: DEPSO: hybrid particle swarm with differential evolution operator. In: IEEE, Systems, Man and Cybernetics (SMCC), Washington DC, pp. 3816–3821 (2003)
Chuanwen, J., Jiaotong, S.: A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimisation. Math. Comput. Simul. (2005)
Clerc, M.: The particle swarm—explosion, stability, and convergence in multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 57–73 (2002)
Atyabi, A., Phon-Amnuaisuk, S.: Particle swarm optimization with area extension (AEPSO). In: IEEE Congress on Evolutionary Computation (CEC), 2007, Singapore, pp. 1970–1976 (2007)
Atyabi, A., Phon-Amnuaisuk, S., Ho, C.K.: Effects of Communication Range, Noise and Help Request Signal on Particle Swarm Optimization with Area Extension (AEPSO), pp. 85–88. IEEE Computer Society, Washington DC (2007)
Atyabi, A., Phon-Amnuaisuk, S., Ho, C.K.: Effectiveness of a cooperative learning version of AEPSO in homogeneous and heterogeneous multi robot learning scenario. In: IEEE Congress on Evolutionary Computation (CEC 2008), Hong Kong, pp. 3889–3896 (2008)
Atyabi, A., Phon-Amnuaisuk, S., Ho, C.K.: Navigating agents in uncertain environments using particle swarm optimisation. MSc thesis, Dept. Information Technology, Univ Multimedia, Cyberjaya, Malaysia (2008)
Grosan, C., Abraham, A., Chis, M.: Swarm intelligence in data mining. In: Studies in Computational Intelligence (SCI), vol. 34, pp. 1–20. Springer, New York (2006)
Sousa, T., Neves, A., Silva, A.: Swarm optimization as a new tool for data mining. In: Proceeding of the International Parallel and Distributed Processing Symposium (IPDPS’03), Los Alamitos, p. 144.2 (2003)
Sousa, T., Neves, A., Silva, A.: Particle swarm based data mining algorithms for classification tasks. IEEE Parallel Comput. 30, 767–783 (2004)
Ahmadabadi, M.N., Asadpour, M., Nakano, E.: Cooperative Q-learning: the knowledge sharing issue. Adv. Robot. 15(8), 815–832 (2001)
Dowling, J., Cahill, V.: Self managed decentralized systems using K-components and collaborative reinforcement learning. In: 1st ACM SIGSOFT Workshop on Self-managed Systems, New Port Beach, pp. 39–43 (2004)
Tangamchit, P., Dolan, J.M., Khosla, P.K.: Crucial factors affecting cooperative multirobot learning. In: Conference on Intelligent Robots and Systems, Las Vegas, vol. 2, pp. 2023–2028 (2003)
Yamaguchi, T., Tanaka, Y., Yachida, M.: Speed up reinforcment learning between two agents with adaptive mimetism. In: IEEE/RSJ Intelligent Robots and Systems, vol. 2, pp. 594–600 (1997)
Yang, C., Sim on, D.: A new particle swarm optimization technique. In: 18th International Conference on Systems Engineering (ICSEng 2005), pp. 164–169 (2005)
Luke, S., Sullivan, K., Balan, G.C., Panait, L.: Tunably decentralized algorithms for cooperative target. In: Fourth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2005), Netherlands, pp. 911–917 (2005)
Lee, C., Kim, M., Kazadi, S.: Robot clustering. In: 2005 IEEE International Conference on Systems, Man and Cybernetics (2005)
Tan, M.: Multi agent reinforcement learning: independent vs. cooperative agents. In: 10th Int Machin Learning (1993)
Chang, K., Hwang, J., Lee, E., Kazadi, S.: The application of swarm engineering technique to robust multi chain robot systems. In: IEEE Conference on Systems, Man, and Cybernetics, vol. 2, pp. 1429–1434 (2005)
Bakker, P., Kuniyoshi, Y.: Robot see, robot do: an overview of robot imitation. In: AISB Workshop on Learning in Robots and Animals (1996)
Hayas, G., Demiris, J.: A robot controller using learning by imitation. In: 2nd Int. Symp on Intelligent Robotic Systems (1994)
Hettiarachchi, S.: Distributed online evolution for swarm robotics. Doctoral thesis, University of Wyoming, USA (2007)
Pasupuleti, S., Battiti, R.: The gregarious particle swarm optimizer (G-PSO). In: 8th Annual Conf Genetic and Evolutionary Computation, Seattle, Washington, USA, pp. 67–74 (2006)
Bogatyreva, O., Shillerov, A.: Robot swarms in an uncertain world: controllable adaptability. Int. J. Adv. Robot. Syst., 2(3), 187–196 (2005)
Werfel, J., Yaneer, B.Y., Negpal, R.: Building patterned structures with robot swarms. In: Nineteenth International Joint Conference on Artificial Intelligence (IJCAI’05), pp. 1495–1502 (2005)
Liu, Y., Passino, K.M.: Swarm Intelligence: Literature Overview (2000)
Beslon, G., Biennier, F., Hirsbrunner, B.: Multi-robot path-planning based on implicit cooperation in a robotic swarm. In: Proceedings of the Second International Conference on Autonomous Agents, Minneapolis, pp. 39–46 (1998)
Qin, Y.Q., Ssun, D.B., Li, N., Cen, Y.G.: Path planning for mobile robot using the Particle Swarm Optimization with mutation operator. In: Proceedmgs of the Third Intemational Conference on Machine Laming and Cybemetics, Shanghai, vol. 4, pp. 2473–2478 (2004)
Reggia, J.A., Rodriguez, A.: Extending Self-organizing Particle Systems to Problem Solving. MIT Press Artificial Life (2004)
Mondada, F., Pettinaro, G.C., Guignard, A., Kwee, I.W., Floreano, D., Deneubourg, J., Nolfi, S., Gambardella, L.M., Dorigo, M.: Swarm-Bot: a new distributed robotic concept. Auton. Robots 17(2–3), 193–221 (2004)
Martinson, E., Arkin, R.C.: Learning to role-switch in multi-robot systems. In: Autonomous Robots (ICRA’03), vol. 2, pp. 2727–2734 (2004)
Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, pp. 1942–1948. IEEE, Piscataway (1995)
Suganthan, P.N.: Particle swarm optimiser with neighbourhood operator. In: Proceedings of the 1999 Congress on Evolutionary Computation CEC 99, vol. 3, pp. 1958–1962 (1999)
Kennedy, J., Spears, W.M.: Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator. In: Proceedings of the IEEE Intl Conference on Evolutionary Computation, pp. 78–83 (1998)
Fourie, P.C., Groenwold, A.A.: The particle swarm optimization algorithm in size and shape optimization. Struct Multidisc Optim 23(4), 259–267 (2002)
Peer, E.S., Van Den Bergh, F., Engelbrecht, A.P.: Using neighbourhood with the guaranteed convergence PSO. In: Proceedings of the 2003 IEEE Swarm Intelligence Symposium SIS ’03, pp. 235–242 (2003)
Stacey, A., Jancic, M., Grundy, L.: Particle Swarm Optimization with mutation. In: IEEE Evolutionary Computation, CEC ’03, pp. 1425–1430 (2003)
Pugh, J., Zhang, Y.: Particle swarm optimization for unsupervised robotic learning. In: Proceedings 2005 IEEE Swarm Intelligence Symposium (SIS), pp. 92–99 (2005)
Pugh, J., Martinoli, A.: Multi-robot learning with Particle Swarm Optimization. In: AAMAS’06, Hakodate, pp. 41–448 (2006)
Pugh, J., Martinoli, A.: Parallel learning in heterogeneous multi-robot swarms. In: IEEE Congress on Evolutionery Computation CEC’07, Singapore, pp. 3839–3846 (2007)
Pugh, J., Martinoli, A.: Inspiring and modeling multi-robot search with Particle Swarm Optimization. In: Proceeding of the 2007 IEEE Swarm Intelligence Symposium (SIS 2007), pp. 332–339 (2007)
Zhao, Y., Zheng, J.: Particle Swarm Optimization algorithm in signal detection and blind extraction. In: IEEE Parallel Architectures, Algorithms and Networks, pp. 37–41 (2004)
Chang, B.C.H., Ratnaweera, A., Halgamuge, S.K., Watson, H.C.: Particle Swarm Optimization for protein motif discovery. Journal of Genetic Programming and Evolvable Machines, 203–214 (2004)
Martinoli, A., Easton, K., Agassounon, W.: Modeling swarm robotic systems: a case study in collaborative distributed manipulation. Int. J. Rob. Res. 23(4), 415–436 (2007)
Agassounon, W., Martinoli, A., Easton, K.: Macroscopic modeling of aggregation experiments using embodied agents in teams of constant and time-varying sizes. In: Autonomous Robots, Hingham, vol. 17, pp. 163–192 (2004)
Lerman, K., Galstyan, A., Martinoli, A.: A macroscopic analytical model of collaboration in distributed robotic systems. In: Artificial Life, vol. 7, pp. 375–393 (2001)
Kazadi, S., Abdul-Khaliq, A., Goodman, R.: On the convergence of puck clustering systems. Robot. Auton. Syst. 38(2), 93–117 (2002)
Li, L., Martinoli, A., Abu-Mostafa, Y. S.: Learning and Measuring Specialization in Collaborative Swarm Systems, vol. 12(3–4), pp. 199–212. International Society for Adaptive Behavior (2004)
Yang, E., Gu, D.: Multiagent reinforcement learning for multi-robot systems: a survey. Technical report, Department of Computer Science, University of Essex CSM-404 (2004)
Park, K.H., Kim, Y.J., Kim, J.H.: Modular Q-learning based multi-agent cooperation for robot soccer. Robot. Auton. Syst. 35, 109–122 (2001)
Fujii, T., Arai, Y., Asama, H., Endo, I.: Multilayered reinforcement learning for complicated collision avoidance problems. In: Proceeding of the IEEE International Conference on Robotics and Automation, vol. 3, pp. 2186–2191 (1998)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Atyabi, A., Phon-Amnuaisuk, S. & Ho, C.K. Applying Area Extension PSO in Robotic Swarm. J Intell Robot Syst 58, 253–285 (2010). https://doi.org/10.1007/s10846-009-9374-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-009-9374-2