M. Hanzich, P. Hernández, E. Luque, F. Giné, and F. Solsona (Spain)
Space-Sharing, Non-Dedicated clusters, Backfilling, Coscheduling
The resource utilization level in open laboratories of se veral universities has been shown to be very low. Our aim is to take advantage of those idle resources for parallel com putation without disturbing the local load. In order to pro vide a system that lets us execute parallel applications in such a non-dedicated cluster, we use an integral scheduling system that considers both Space and Time sharing con cerns. To deal with the Time Sharing (TS) aspect, we use a technique based on the communication-driven coschedul ing principle. This kind of TS system has some implica tions on the Space Sharing (SS) system that force us to modify the way job scheduling is traditionally done. In this paper, we analyze the relation between the TS and the SS systems in a non-dedicated cluster. As a consequence of this analysis, we propose a new SS technique, termed 3DBackfilling. This proposal is applied to an environment with multiple concurrent execution of distributed applica tions. Besides, our technique considers the requirements of the local workload running on each node. 3DBackfilling was evaluated in a non-dedicated PVM/MPI Linux cluster, and it was compared with traditional SS poli cies.
Important Links:
Go Back
