Performance Problems of using System-Predicted Runtimes for Parallel Job Scheduling

S. Vasupongayya and S.-H. Chiang (USA)


Parallel job scheduling, backfill policies, job runtime pre dictions, error metrics.


Many prediction techniques based on historical data have been proposed to reduce over-estimations of job runtimes provided by users. They were shown to improve the accu racy of runtime estimates and scheduling performance of backfill policies, according to particular error metrics and average performance measures. However, using a more complete set of performance measures and a new error met ric, we show potential performance problems of using pre vious prediction techniques for job scheduling. Further more, we show simply adding half of the requested runtime to each initial prediction greatly reduces the problems.

Important Links:

Go Back