Scheduling Workloads of Workflows with Unknown Task Runtimes

Alexey Ilyushkin, Bogdan Ghit, Dick Epema

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

14 Citations (Scopus)
248 Downloads (Pure)

Abstract

Workflows are important computational tools in many branches of science, and because of the dependencies among their tasks and their widely different characteristics, scheduling them is a difficult problem. Most research on scheduling workflows has focused on the offline problem of minimizing the makespan of single workflows with known task runtimes. The problem of scheduling multiple workflows has been addressed either in an offline fashion, or still with the assumption of known task runtimes. In this paper, we study the problem of scheduling workloads consisting of an arrival stream of workflows without task runtime estimates. The resource requirements of a workflow can significantly fluctuate during its execution. Thus, we present four scheduling policies for workloads of workflows with as their main feature the extent to which they reserve processors to workflows to deal with these fluctuations. We perform simulations with realistic synthetic workloads and we show that any form of processor reservation only decreases the overall system performance and that a greedy backfilling-like policy performs best.
Original languageEnglish
Title of host publication15th IEEE/ACM Int'l Symp. on Cluster, Cloud and Grid Computing
PublisherIEEE/CS
Pages606-616
Number of pages11
ISBN (Electronic)978-1-4799-8006-2
DOIs
Publication statusPublished - 2015

Keywords

  • workflows
  • workloads
  • task runtimes
  • scheduling

Fingerprint

Dive into the research topics of 'Scheduling Workloads of Workflows with Unknown Task Runtimes'. Together they form a unique fingerprint.

Cite this