Abstract
Mutation testing tasks are expensive in time and resources. Different cost reduction methods were developed to cope with this problem. In this chapter experimental evaluation of mutation clustering is presented. The approach was applied for object-oriented and standard mutation testing of C# programs. The quality metric was used to compare different solutions. It calculates a tradeoff between mutations score accuracy and mutation costs in terms of number of mutants and number of tests. The results show a substantive decrease in number of mutants and tests while suffering a small decline of mutation score accuracy. However the outcome is not superior to other cost reduction methods, as selective mutation or mutant sampling.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Transactions on Software Engineering 37(5), 649–678 (2011), doi:10.1109/TSE.2010.62
Usaola, M.P., Mateo, P.R.: Mutation testing cost reduction techniques: a survey. IEEE Software 27(3), 80–86 (2010), doi:10.1109/MS.2010.79
Hussain, S.: Mutation Clustering. Ms. Thesis, King’s College London, Strand, London (2008)
Jain, A.K., Murty, M.N., Flynn, P.J.: Data Clustering: A Review. ACM Computing Surveys 31(3), 264–323 (1999)
Ji, C., Chen, Z.Y., Xu, B.W., Zhao, Z.H.: A novel method of mutation clustering based on domain analysis. In: Proc. of 21st Inter. Conf. on Softw. Eng. & Knowledge Eng., pp. 422–425 (2009)
Derezińska, A., Szustek, A.: Object-oriented testing capabilities and performance evaluation of the C# mutation system. In: Szmuc, T., Szpyrka, M., Zendulka, J. (eds.) CEE-SET 2009. LNCS, vol. 7054, pp. 229–242. Springer, Heidelberg (2012)
Derezińska, A., Rudnik, M.: Quality evaluation of object-oriented and standard mutation operators applied to C# programs. In: Furia, C.A., Nanz, S. (eds.) TOOLS 2012. LNCS, vol. 7304, pp. 42–57. Springer, Heidelberg (2012)
Derezińska, A., Szustek, A.: Tool-supported mutation approach for verification of C# programs. In: Zamojski, W., et al. (eds.) Proc. of Inter. Conf. on Dependability of Computer Systems, DepCoS-RELCOMEX 2008, pp. 261–268 (2008), doi:10.1109/DepCoS-RELCOMEX.2008.51
Derezińska, A., Rudnik, M.: Empirical evaluation of cost reduction techniques of mutation testing for C# Programs, Warsaw University of Technology, ICS Res. Rep. 1/2012 (2012)
Offut, J., Rothermel, G., Zapf, C.: An experimental evaluation of selective mutation. In: Proc. of 15th Inter. Conf. on Software Engineering, pp. 100–107 (1993)
Zhang, L., Hou, S.-S., Hu, J.-J., Xie, T., Mei, H.: Is operator-based mutant selection superior to random mutant selection? In: Proc. of the 32nd International Conference on Software Engineering, ICSE 2010, pp. 435–444 (2010), doi:10.1145/1806799.1806863
Kaminski, G., Praphamontripong, U., Ammann, P., Offutt, J.: A logic mutation approach to selective mutation for programs and queries. Inform. and Softw. Technol. 53, 1137–1152 (2011), doi:10.1016/j.infsof.2011.03.009
Hu, J., Li, N., Offutt, J.: An analysis of OO mutation operators. In: Proc. of 4th Inter. Conf. Softw. Test. Verif. and Validation Workshops, pp. 334–341 (2011), doi:10.1109/ICSTW.2011.47
Mathur, A.P., Wong, W.E.: Reducing the cost of mutation testing: an empirical study. J. of Systems and Softw. 31, 185–196 (1995)
Derezińska, A., Kowalski, K.: Object-oriented mutation applied in Common Intermediate Language programs originated from C#. In: Proc. of 4th International Conference Software Testing Verification and Validation Workshops, pp. 342–350 (2011), doi:10.1109/ICSTW.2011.54
Kryszkiewicz, M.: Fast algorithm finding minima in monotonic Boolean functions, Warsaw Univ. of Technology, ICS Res. Rep. 42/93 (1993)
Just, R., Kapfhammer, G.M., Schweiggert, F.: Do redundant mutants affects the effectiveness and efficiency of mutation analysis? In: Proc. IEEE 5th Inter. Conf. on Software Testing, Verification and Validation, pp. 720–725 (2012), doi:10.1109/ICST.2012.162
Zhang, L., Marionov, D., Zhang, L., Khurshid, S.: Regression mutation testing. In: Proc. of Int. Symp. on Software Testing, ISSTA 2012, pp. 331–341 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Derezińska, A. (2013). A Quality Estimation of Mutation Clustering in C# Programs. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) New Results in Dependability and Computer Systems. Advances in Intelligent Systems and Computing, vol 224. Springer, Heidelberg. https://doi.org/10.1007/978-3-319-00945-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-00945-2_11
Publisher Name: Springer, Heidelberg
Print ISBN: 978-3-319-00944-5
Online ISBN: 978-3-319-00945-2
eBook Packages: Chemistry and Materials ScienceChemistry and Material Science (R0)