Abstract
Next Generation Data Centers are transforming labor-inten- sive, hard-coded systems into shared, virtualized, automated, and fully managed adaptive infrastructures. Virtualization technologies promise great opportunities for reducing energy and hardware costs through server consolidation. However, to safely transition an application running natively on real hardware to a virtualized environment, one needs to estimate the additional resource requirements incurred by virtualization overheads.
In this work, we design a general approach for estimating the resource requirements of applications when they are transferred to a virtual environment. Our approach has two key components: a set of microbenchmarks to profile the different types of virtualization overhead on a given platform, and a regression-based model that maps the native system usage profile into a virtualized one. This derived model can be used for estimating resource requirements of any application to be virtualized on a given platform. Our approach aims to eliminate error-prone manual processes and presents a fully automated solution. We illustrate the effectiveness of our methodology using Xen virtual machine monitor. Our evaluation shows that our automated model generation procedure effectively characterizes the different virtualization overheads of two diverse hardware platforms and that the models have median prediction error of less than 5% for both the RUBiS and TPC-W benchmarks.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Agostinelli, C.: Robust Stepwise Regression. Journal of Applied Statistics 29(6) (2002)
Ahmad, I., Anderson, J., Holler, A., Kambo, R., Makhija, V.: An Analysis of Disk Performance in VMware ESX Server Virtual Machines. In: Proc. of the Sixth Workshop on Workload Characterization (WWC 2003) (October 2003)
Amza, C., Cecchet, E., Chanda, A., Cox, A., Elnikety, S., Gil, R., Marguerite, J., Rajamani, K., Zwaenepoel, W.: Specification and implementation of dynamic Web site benchmarks. In: Proc. of WWC-5: IEEE 5th Annual Workshop on Workload Characterization (October 2002)
Apache JMeter, http://jakarta.apache.org/jmeter/
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: SOSP 2003 (2003)
Brown, A., Seltzer, M.: Operating System Benchmarking in the Wake of Lmbenc. In: Sigmetrics 1997 (1997)
Cherkasova, L., Gardner, R.: Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In: Proc. of USENIX AT (April 2005)
Draper, N.R., Smith, H.: Applied Regression Analysis. J. Wiley & Sons, Chichester (1998)
Fraser, K., Hand, S., Neugebauer, R., Pratt, I., Warfield, A., Williamson, M.: Reconstructing I/O. Technical report (2004)
Gmach, D., Rolia, J., Cherkasova, L., Kemper, A.: Capacity Management and Demand Prediction for Next Generation Data Centers. In: Proc. of the International IEEE Conference on Web Services (2007)
Gupta, D., Cherkasova, L., Gardner, R., Vahdat, A.: Enforcing Performance Isolation Across Virtual Machines in Xen. In: van Steen, M., Henning, M. (eds.) Middleware 2006. LNCS, vol. 4290, pp. 342–362. Springer, Heidelberg (2006)
Holland, P.W., Welsch, R.E.: Robust regression using iteratively reweighted least-squares. In: Communications in Statistics - Theory and Methods 6.9 (October 2007)
HP-UX Workload Manager, http://hp.com/products1/unix/operating/wlm/
HP Integrity Essentials Capacity Advisor, http://h71036.www7.hp.com/enterprise/cache/262379-0-0-0-121.html
IBM Enterprise Workload Manager, http://www.ibm.com/developerworks/autonomic/ewlm/
IBM Tivoli Performance Analyzer, http://www.ibm.com/software/tivoli/products/performance-analyzer/
King, S., Dunlap, G., Chen, P.: Operating system support for virtual machines. In: Proc. of the USENIX Annual Technical Conference, San Antonio, Texas (2003)
Liu, J., Huang, W., Abali, B., Panda, D.: High Performance VMM-Bypass I/O in Virtual Machines. In: Proc. of Usenix AT 2006 (2006)
Magenheimer, D., Christian, T.: VBlades: Optimized paravirtualization for the Itanium processor family. In: Proc. of USENIX VM Research and Technology Symposium (May 2004)
McVoy, L., Staelin, C.: lmbench: Portable tools for performance analysis. In: Proc. of the 1996 Winter USENIX, San Diego, CA (January 1996)
Menon, A., Santos, J.R., Turner, Y., Janakiraman, G.J., Zwaenepoel, W.: Diagnosing performance overheads in the Xen virtual machine environment. In: Proc. of Intl. Conf. on Virtual Execution Environments (VEE) (June 2005)
Mosberger, D., Jin, T.: Httperf—A Tool for Measuring Web Server Performance. In: Proc. of Workshop on Internet Server Performance (1998)
Padala, P., Zhu, X., Wang, Z., Singhal, S., Shin, K.: Performance Evaluation of Virtualization Technologies for Server Consolidation. HP Labs Tech. Report HPL-2007-59 (2007)
Santos, J.R., Turner, Y., Janakiraman, G.J., Pratt, I.: Bridging the Gap between Software and Hardware Techniques for I/O Virtualization. In: Proc. of Usenix (2008)
Rolia, J., Cherkasova, L., Arlitt, M., Andrzejak, A.: A Capacity Management Service for Resource Pools. In: Proc. of Intl. Workshop on Software and Performance (2005)
Seltzer, M., Krinsky, D., Smith, K., Zhang, X.: The Case for Appliction-Specific Benchmarking. In: Proc. of the 1999 Workshop on Hot Topics in Operating Systems (1999)
Seltzsam, S., Gmach, D., Krompass, S., Kemper, A.: AutoGlobe: An Automatic Administration Concept for Service-Oriented Database Applications. In: Proc. of the 22nd Intl. Conf. on Data Engineering (ICDE) (2006)
Staelin, C., McVoy, L.: mhz: Anatomy of a microbenchmark. In: Proc. of the USENIX Annual Technical Conference, New Orleans, LA (June 1998)
Sugerman, J., Venkitachalam, G., Lim, B.-H.: Virtualizing I/O Devices on VMware Workstation’s Hosted Virtual Machine Monitor. In: Proc. of the USENIX AT (2001)
Sysstat-7.0.4, http://perso.orange.fr/sebastien.godard/
TPC-W Benchmark, http://www.tpc.org
Urgaonkar, B., Shenoy, P., Roscoe, T.: Resource overbooking and application profiling in shared hosting platforms. In: Proc. of Operating Systems Design and Implementation (OSDI) (December 2002)
VMmark: A Scalable Benchmark for Virtualized Systems, www.vmware.com/pdf/vmmark_intro.pdf
VMware Capacity Planner, http://www.vmware.com/products/capacity_planner/
Waldspurger, C.: Memory resource management in VMware ESX server in Operating Systems Design and Implementation. In: Proc. of Operating Systems Design and Implementation (OSDI) (December 2002)
Wang, J., Wright, K., Gopalan, K.: XenLoop: A Transparent High Performance Inter-VM Network Loopback. In: Proc. of International Symposium on High Performance Distributed Computing (HPDC), Boston, MA (June 2008)
Whitaker, A., Shaw, M., Gribble, S.: Scale and Performance in the Denali isolation kernel. In: Proc. of Operating Systems Design and Implementation (OSDI) (December 2002)
Wood, T., Cherkasova, L., Ozonat, K., Shenoy, P.: Profiling and Modeling Resource Usage of Virtualized Applications. UMass Technical Report (September 2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 IFIP International Federation for Information Processing
About this paper
Cite this paper
Wood, T., Cherkasova, L., Ozonat, K., Shenoy, P. (2008). Profiling and Modeling Resource Usage of Virtualized Applications. In: Issarny, V., Schantz, R. (eds) Middleware 2008. Middleware 2008. Lecture Notes in Computer Science, vol 5346. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89856-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-540-89856-6_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89855-9
Online ISBN: 978-3-540-89856-6
eBook Packages: Computer ScienceComputer Science (R0)