Abstract
The development of software tools for performance evaluation and modeling has been an active research area since the early years of computer science. In this paper, we offer a short overview of historical evolution of the field with an emphasis on popular performance modeling techniques such as queuing networks and Petri nets. A review of recent works that provide new perspectives to software tools for performance modeling is presented, followed by a number of ideas on future research directions for the area.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Baskett, F., Chandy, K.M., Muntz, R.R., Palacios, F.G.: Open, closed, and mixed networks of queues with different classes of customers. Journal of the ACM 22(2), 248–260 (1975)
Buchholz, P., Ciardo, G., Donatelli, S., Kemper, P.: Complexity of memory-efficient kronecker operations with applications to the solution of markov models. INFORMS Journal on Computing 12(3), 203–222 (2000)
Buzen, J.P.: Computational algorithms for closed queueing networks with exponential servers. Comm. of the ACM 16(9), 527–531 (1973)
Carlson, G.: A user’s view of hardware performance monitors. In: Proc. IFIP Congress, vol. 71, pp. 128–132. North-Holland (1971)
Casale, G., Muntz, R.R., Serazzi, G.: Tools for computer performance modeling and reliability analysis. ACM Performance Evaluation Review 36(4) (2009)
Chiola, G., Dutheillet, C., Franceschinis, G., Haddad, S.: Stochastic well-formed colored nets and symmetric modeling applications. IEEE Transactions on Computers 42(11), 1343–1360 (1993)
Chung, M.-Y., Ciardo, G., Donatelli, S., He, N., Plateau, B., Stewart, W., Sulaiman, E., Yu, J.: A comparison of structural formalisms for modeling large markov models. In: Proc. of IPDPS, vol. 11, p. 196 (2004)
Buzen, J.P., et al.: Best/1 - design of a tool for computer system capacity planning. In: Proc. of the 1978 National Computer Conf., pp. 447–455. AFIPS Press (1978)
Ferrari, D., Serazzi, G., Zeigner, A.: Measurement and Tuning of Computer Systems. Prentice-Hall (1983)
Fishman, G.S.: Statistical analysis for queueing simulations. Management Science 20(3), 363–369 (1973)
Gribaudo, M.: Fspnedit: a fluid stochastic petri net modeling and analysis tool. In: Proc. of Tools of Aachen 2001, pp. 24–28 (2001)
Reiser, M., Haring, G., Lindemann, C. (eds.): Dagstuhl Seminar 1997. LNCS, vol. 1769. Springer, Heidelberg (2000)
Heidelberger, P., Welch, P.D.: A spectral method for confidence interval generation and run length control in simulations. Comm. of the ACM 24(4), 233–245 (1981)
Herman, D.J.: Scert: a computer evaluation tool. Datamation 13(2), 26–28 (1967)
Herman, D.J., Ihrer, F.: The use of a computer to evaluate computers. In: Proc. Conf. 1964 SJCC, Washington DC, pp. 383–395. Spartan Books (1964)
Hillston, J.: Fluid flow approximation of pepa models. In: QEST 2005, pp. 33–42, 19–22 (2005)
IBM. General purpose systems simulator iii user’s manual. Technical Report Form H20-0163, IBM (1965)
Jensen, K.: Coloured Petri Nets: Basic Concepts, Analysis Methods, and Practical Use, 2nd edn. Springer, Heidelberg (1997)
Kartson, D., Balbo, G., Donatelli, S., Franceschinis, G., Conte, G.: Modelling with Generalized Stochastic Petri Nets. John Wiley & Sons, Inc., New York (1994)
Kleinrock, L.: Queueing Systems, Theory, vol. 1. John Wiley & Sons, New York (1976)
Lavenberg, S.S.: A perspective on queueing models of computer performance. Performance Evaluation 10(1), 53–76 (1989)
LeMay, E., Unkenholz, W., Parks, D., Muehrcke, C., Keefe, K., Sanders, W.H.: Adversary-driven state-based system security evaluation. In: MetriSec 2010: Proceedings of the 6th International Workshop on Security Measurements and Metrics, pp. 1–9. ACM, New York (2010)
Markowitz, H.M., Hausner, B., Karr, H.W.: Simscript: a simulation programming language. Prentice Hall (1963)
Martens, A., Koziolek, H., Becker, S., Reussner, R.: Automatically improve software architecture models for performance, reliability, and cost using evolutionary algorithms. In: WOSP/SIPEW, pp. 105–116 (2010)
Montani, S., Portinale, L., Bobbio, A., Codetta-Raiteri, D.: Radyban: A tool for reliability analysis of dynamic fault trees through conversion into dynamic bayesian networks. Reliability Engineering and System Safety 93(7), 922–932 (2008); Bayesian Networks in Dependability
Nielsen, N.R.: Computer simulation of computer system performance. In: Proc. of ACM National Meeting, pp. 581–590 (1967)
Pawlikowski, K.: Steady-sate simulation of queueing processes: A survey of problems and solutions. ACM Computing Surveys 22(2), 123–168 (1990)
Potier, D., Veran, M.: The markovian solver of QNAP2 and examples. In: Hasegawa, T., et al. (eds.) Computer Networking and Perf. Eval., pp. 259–279. North-Holland, Amsterdam (1986)
Sauer, C.H., Chandy, K.M.: Computer Systems Performance Modeling. Prentice-Hall (1981)
Sauer, C.H., McNair, E.A., Kurose, J.F.: The research queueing (RESQ) package, version 2: Introduction and examples. Technical Report IBM rep. no. RA 138, IBM (1982)
Saure, D., Glynn, P., Zeevi, A.: A linear programming algorithm for computing the stationary distribution of semi-martingale reflecting brownian motion (under submission)
Schwetman, H.: CSIM Reference Manual (1988)
Smith, C., Llado, C.: Performance model interchange format (pmif 2.0): Xml definition and implementation. In: Proc. of QUEST 2004. IEEE Press (2004)
Smith, C., Lladó, C., Puigjaner, R.: Performance model interchange format (pmif 2): A comprehensive approach to queueing network model interoperability. Perform. Eval. 67(7), 548–568 (2010)
Smith, C.U., Williams, L.G.: Performance Engineering Evaluation of CORBA-Based Distributed Systems with SPE∙ED. In: Puigjaner, R., Savino, N.N., Serra, B. (eds.) TOOLS 1998. LNCS, vol. 1469, pp. 321–335. Springer, Heidelberg (1998)
Smith, C., Williams, L.: Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software. Addison-Wesley (2001)
Stewart, W.J.: Introduction to the Numerical Solution of Markov Chains. Princeton University Press, Princeton (1994)
Trivedi, K.S., Bobbio, A., Ciardo, G., German, R., Puliafito, A., Telek, M.: Non-markovian petri nets. In: SIGMETRICS 1995/PERFORMANCE 1995, pp. 263–264. ACM, New York (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 IFIP International Federation for Information Processing
About this chapter
Cite this chapter
Casale, G., Gribaudo, M., Serazzi, G. (2011). Tools for Performance Evaluation of Computer Systems: Historical Evolution and Perspectives. In: Hummel, K.A., Hlavacs, H., Gansterer, W. (eds) Performance Evaluation of Computer and Communication Systems. Milestones and Future Challenges. PERFORM 2010. Lecture Notes in Computer Science, vol 6821. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25575-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-25575-5_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25574-8
Online ISBN: 978-3-642-25575-5
eBook Packages: Computer ScienceComputer Science (R0)