K. Ohno, A. Mita, M. Matsumoto, T. Sasaki, T. Kondo, and H. Nakashima (Japan)
Workflow, Parallel Programming Language, Parallel Computing, Grid Computing
The size of a workflow representation, used in program ming languages and runtime systems, depends on the num ber of included tasks and their connections. Therefore, the execution of large-scale workflows is limited by memory size of the master node and task scheduling/transfer cost. We propose a scheme largely reducing the size of workflow representation using array contraction. Focus ing on arrays in workflow representation, our scheme can contract such arrays dynamically, without static analysis of user code. Hierarchically parallel structures, often used in large-scale workflows, can also be contracted. As a result of evaluation on our object-oriented work flow language MegaScript, the number of API objects in fully-contracted random workflow representations was ap proximately 300 in average, independent from the number of tasks. The required memory size was also reduced to approximately 100KB in average.
Important Links:
Go Back
