Abstract
Testing systems developed using the agent paradigm is an important task in the quality assurance process. In this short paper, we give a state-of-the-art overview of the research that has been suggested for testing multi-agent systems (MAS). The aim is to eventually provide a new test method for multi-agent systems using the method of mutation analysis, as well as to provide software and efficient test tools that enable the automation of testing activities for these systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Babac, M.B., Jevtić, D.: AgentTest: a specification language for agent-based system testing. Neurocomputing 146, 230–248 (2014)
Coelho, R., Kulesza, U., von Staa, A., Lucena, C.: Unit testing in multi-agent systems using mock agents and aspects. In: SELMAS 2006: Proceedings of the 2006 International Workshop on Software Engineering for Large-scale Multi-agent Systems, pp. 83–90. ACM Press, New York (2006)
De Wolf, T., Samaey, G., Holvoet, T.: Engineering self-organising emergent systems with simulation-based scientific analysis. In: Brueckner, S., Serugendo, D.M., Hales, D., Zambonelli, F. (eds.) Third International Workshop on Engineering Self-organising Application, pp. 146–160. sUtrech, Netherlands (2005)
Dehimi, N.E.H., Mokhati, F.: A novel test case generation approach based on AUML sequence diagram. In: International Conference on Networking and Advanced Systems (ICNAS) (2019)
Dehimi, N.E.H., Mokhati, F., Badri, M.: Testing HMAS-based applications: an ASPECS-based approach. Eng. Appl. Artif. Intell. 46, 232–257 (2015)
Dehimi, N.E.H., Benkhalef, A.H., Tolba, Z.: A novel mutation analysis-based approach for testing parallel behavioural scenarios in multi-agent systems. Electronics 11(22), 3642 (2022)
Derdour, M., et al.: MMSA: metamodel multimedia software architecture. Adv. Multimed. 2010, 1–17 (2010)
Derdour, M., et al.: Typing of adaptation connectors in MMSA approach case study: sending MMS. Int. J. Res. Rev. Comput. Sci. 1(4), 39–49 (2010)
Ekinci, E.E., Tiryaki, A.M., Cetin, O., Dikenelli, O.: Goal-oriented agent testing revisited. In: Luck, M., Gomez-Sanz, J.J. (eds.) AOSE 2008. LNCS, vol. 5386, pp. 85–96. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-642-01338-6_13
El Houda, D.N., Soufiene, B., Djaber, G.: Towards a new dynamic model-based testing approach for multi-agent systems. In: 2022 4th International Conference on Pattern Analysis and Intelligent Systems (PAIS). IEEE (2022)
Huang, Z., Alexander, R., Clark, J.: Mutation testing for Jason agents. In: Dalpiaz, F., Dix, J., van Riemsdijk, M.B. (eds.) EMAS 2014. LNCS, vol. 8758, pp. 309–327. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-14484-9_16
Lam, D.N., Barber, K.S.: Debugging agent behavior in an implemented agent system. In: Bordini, R.H., Dastani, M.M., Dix, J., El Fallah Seghrouchni, A. (eds.) PROMAS 2004. LNCS (LNAI), vol. 3346, pp. 104–125. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-32260-3_6
Nguyen, C.D., Perini, A., Tonella, P.: Goal-oriented testing for MASs. Int. J. Agent-Oriented Softw. Eng. 4(1), 79–109 (2010)
Nunez, M., Rodríguez, I., Rubio, F.: Specification and testing of autonomous agents in e-commerce systems. Softw. Test. Verification Reliab. 15(4), 211–233 (2005)
Offutt, A.J., Rothermel, G., Zapf, C.: An experimental evaluation of selective mutation. In: Proceedings of the 15th International Conference on Software Engineering, pp. 100–107 (1993)
Sakellariou, I., et al.: Stream X-machines for agent simulation test case generation. In: Duval, B., van den Herik, J., Loiseau, S., Filipe, J. (eds.) ICAART 2015. LNCS, vol. 9494, pp. 37–57. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-27947-3_3
Savarimuthu, S., Winikoff, M.: Mutation operators for the GOAL agent language. In: Cossentino, M., El Fallah Seghrouchni, A., Winikoff, M. (eds.) EMAS 2013. LNCS, vol. 8245, pp. 255–273. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-45343-4_14
Thaler, J., Siebers, P.-O.: Show me your properties: the potential of property-based testing in agent-based simulation. In: Proceedings of the 2019 Summer Simulation Conference (2019)
Zhang, Z., Thangarajah, J., Padgham, L.: Automated unit testing intelligent agents in PDT. In: AAMAS (Demos), pp. 1673–1674 (2008)
Zhang, Z., Thangarajah, J., Padgham, L.: Model based testing for agent systems. In: AAMAS, vol. 2, pp. 1333–1334 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Boukeloul, S., Dehimi, N.E.H., Derdour, M. (2023). A State-of-the-Art Review of the Mutation Analysis Technique for Testing Multi-agent Systems. In: Kabassi, K., Mylonas, P., Caro, J. (eds) Novel & Intelligent Digital Systems: Proceedings of the 3rd International Conference (NiDS 2023). NiDS 2023. Lecture Notes in Networks and Systems, vol 784. Springer, Cham. https://doi.org/10.1007/978-3-031-44146-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-44146-2_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44145-5
Online ISBN: 978-3-031-44146-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)