Abstract
Due to the imperative need to reduce the costs of management, power and cooling in large data centers, operators multiplex several concurrent applications on each physical server of a server farm connected to a shared network attached storage. Determining and enforcing per-application resource quotas on the fly in this context poses a complex resource allocation and control problem spanning many levels including the CPU, memory and storage resources within each physical server and/or across the server farm. This problem is further complicated by the need to provide end-to-end Quality of Service (QoS) guarantees to hosted applications.
In this paper, we introduce a novel approach towards controlling application interference for resources in shared server farms. Specifically, we design and implement a minimally intrusive method for passing application-level QoS requirements through the software stack. We leverage high-level per-application requirements for controlling I/O interference between multiple database applications, by QoS-aware dynamic resource partitioning at the storage server. Our experimental evaluation, using the MySQL database engine and OLTP benchmarks, shows the effectiveness of our technique in enforcing high-level application Service Level Objectives (SLOs) in shared server farms.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Abbott, R.K., Garcia-Molina, H.: Scheduling real-time transactions with disk resident data. In: VLDB, pp. 385–396 (1989)
Banga, G., Druschel, P., Mogul, J.C.: Resource containers: A new facility for resource management in server systems. In: OSDI, pp. 45–58 (1999)
Barham, P.T., Dragovic, B., Fraser, K., Hand, S., Harris, T.L., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: SOSP, pp. 164–177 (2003)
Brown, K.P., Carey, M.J., Livny, M.: Managing memory to meet multiclass workload response time goals. In: VLDB, pp. 328–341 (1993)
Brown, K.P., Carey, M.J., Livny, M.: Goal-oriented buffer management revisited. In: Jagadish, H.V., Mumick, I.S. (eds.) SIGMOD Conference, pp. 353–364. ACM Press, New York (1996)
Bruno, J.L., Brustoloni, J.C., Gabber, E., Özden, B., Silberschatz, A.: Disk scheduling with quality of service guarantees. In: ICMCS, pp. 400–405 (1999)
Carey, M.J., Jauhari, R., Livny, M.: Priority in DBMS Resource Scheduling. In: VLDB, pp. 397–410 (1989)
Chambliss, D.D., Alvarez, G.A., Pandey, P., Jadav, D., Xu, J., Menon, R., Lee, T.P.: Performance virtualization for large-scale storage systems. In: SRDS, pp. 109–118. IEEE Computer Society, Los Alamitos (2003)
Goel, A., Walpole, J., Shor, M.: Real-rate scheduling. In: IEEE Real-Time and Embedded Technology and Applications Symposium, pp. 434–441. IEEE Computer Society, Los Alamitos (2004)
Goyal, P., Vin, H.M., Cheng, H.: Start-time fair queueing: a scheduling algorithm for integrated services packet switching networks. IEEE/ACM Trans. Netw. 5(5), 690–704 (1997)
Gulati, A., Merchant, A., Varman, P.J.: pclock: an arrival curve based approach for qos guarantees in shared storage systems. In: Golubchik, L., Ammar, M.H., Harchol-Balter, M. (eds.) SIGMETRICS, pp. 13–24. ACM, New York (2007)
Lumb, C.R., Merchant, A., Alvarez, G.A.: Façade: Virtual storage devices with performance guarantees. In: FAST (2003)
Narendra, K.S., Thathachar, M.A.L.: Learning Automata: An Introduction. Prentice Hall, Englewood Cliffs (1989)
Ozmen, O., Salem, K., Uysal, M., Attar, M.H.S.: Storage workload estimation for database management systems. In: Chan, C.Y., Ooi, B.C., Zhou, A. (eds.) SIGMOD Conference, pp. 377–388. ACM, New York (2007)
Padala, P., Shin, K.G., Zhu, X., Uysal, M., Wang, Z., Singhal, S., Merchant, A., Salem, K.: Adaptive control of virtualized resources in utility computing environments. In: EuroSys, pp. 289–302. ACM, New York (2007)
Raab, F.: TPC-C - The Standard Benchmark for Online transaction Processing (OLTP). In: Gray, J. (ed.) The Benchmark Handbook. Morgan Kaufmann, San Francisco (1993)
Shenoy, P.J., Vin, H.M.: Cello: a disk scheduling framework for next generation operating systems. SIGMETRICS Perform. Eval. Rev. 26(1), 44–55 (1998)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998), http://www.cs.ualberta.ca/~sutton/book/ebook/the-book.html
Wachs, M., Abd-El-Malek, M., Thereska, E., Ganger, G.R.: Argon: performance insulation for shared storage servers. In: FAST, Berkeley, CA, USA, pp. 61–76. USENIX Association (2007)
Waldspurger, C.A.: Memory Resource Management in VMware ESX Server. In: OSDI (2002)
Waldspurger, C.A., Weihl, W.E.: Lottery Scheduling: Flexible Proportional-Share Resource Management. In: OSDI, pp. 1–11 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 IFIP International Federation for Information Processing
About this paper
Cite this paper
Soundararajan, G., Amza, C. (2008). Towards End-to-End Quality of Service: Controlling I/O Interference in Shared Storage Servers. In: Issarny, V., Schantz, R. (eds) Middleware 2008. Middleware 2008. Lecture Notes in Computer Science, vol 5346. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89856-6_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-89856-6_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89855-9
Online ISBN: 978-3-540-89856-6
eBook Packages: Computer ScienceComputer Science (R0)