Abstract
In this paper, we investigate the impact of three job allocation strategies on the performance of four coscheduling algorithms (SB, DCS, PB and CC) in a 16-node Linux cluster. The job allocation factors include Multi Programming Level (MPL), job placement, and communication intensity. The experimental results show that the blocking based coscheduling schemes (SB and CC) have better tolerance to different job allocation techniques compared to the spin based schemes (DCS and PB), and the local scheduling. The results strengthen the case for using blocking based coscheduling schemes in a cluster.
This research has been supported by NSF grants CCR-9900701, CCR-0098149, CCR-0208734, and EIA-0202007.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Arpaci-Dusseau, A.C., Culler, D.E., Mainwaring, A.M.: Scheduling with Implicit Information in Distributed Systems. In: Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems (1998)
Nagar, S., Banerjee, A., Sivasubramaniam, A., Das, C.R.: A Closer Look at Coscheduling Approaches for a Network of Workstations. In: Proceedings of the Eleventh Annual ACM Symposium on Parallel Algorithms and Architectures, June 1999, pp. 96–105 (1999)
Sobalvarro, P.G., Pakin, S., Weihl, W.E., Chien, A.A.: Dynamic Coscheduling on Workstation Clusters. In: Feitelson, D.G., Rudolph, L. (eds.) IPPS-WS 1998, SPDP-WS 1998, and JSSPP 1998. LNCS, vol. 1459, pp. 231–256. Springer, Heidelberg (1998)
von Eicken, T., Basu, A., Buch, V., Vogels, W.: U-Net: A User-Level Networkb Interface for Parallel and Distributed Computing. In: Proceedings of the 15th ACM Symposium on Operating System Principles (December 1995)
Pakin, S., Karamcheti, V., Chien, A.A.: Fast Messages: Efficient, Portable Communication for Workstation Clusters and MPPs. IEEE Concurrency 5, 60–72 (1997)
Compaq, Intel and Microsoft Corporations, Virtual Interface Architecture Specification. Version 1.0 (December 1997), Available from http://www.vidf.org
Feitelson, D.G., Rudolph, L.: Mapping and scheduling in a shared parallel environment using distributed hierarchical control. In: International Conference on Parallel Processing, vol. 1, pp. 1–8 (1990)
Agarwal, S.: A Generic Infrastructure for Coscheduling Mechanisms on Clusters (December 2002), M.S. Thesis, Available from, http://www.cse.psu.edu/sagarwal/sagarwalMSThesis_OnlinePDF.pdf
Boden, N.J., et al.: Myrinet: A Gigabit-per-second Local Area Network. IEEE Micro 15, 29–36 (1995)
National Energy Research Scientific Computing Center, M-VIA: A High Performance Modular VIA for Linux (2001), Available from http://www.nersc.gov/research/FTG/via/
N. A. S. division, The nas parallel benchmarks (tech report and source code), Available from http://www.nas.nasa.gov/Software/NPB
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Choi, G.S., Agarwal, S., Kim, JH., Yoo, A.B., Das, C.R. (2003). Impact of Job Allocation Strategies on Communication-Driven Coscheduling in Clusters. In: Kosch, H., Böszörményi, L., Hellwagner, H. (eds) Euro-Par 2003 Parallel Processing. Euro-Par 2003. Lecture Notes in Computer Science, vol 2790. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45209-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-45209-6_25
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40788-1
Online ISBN: 978-3-540-45209-6
eBook Packages: Springer Book Archive