A learning architecture for scheduling workflow applications in the cloud
View/ Open
Date
2011-09-15Author
Barrett, Enda
Howley, Enda
Duggan, Jim
Metadata
Show full item recordUsage
This item's downloads: 1224 (view details)
Cited 44 times in Scopus (view citations)
Recommended Citation
Barrett, E., Howley, E., & Duggan, J. (14-16 Sept. 2011). A learning architecture for scheduling workflow applications in the cloud. Paper presented at the Web Services (ECOWS), 2011 Ninth IEEE European Conference on.
Published Version
Abstract
The scheduling of workflow applications involves the mapping of individual workflow tasks to computational resources, based on a range of functional and non-functional quality of service requirements. Workflow applications such as scientific workflows often require extensive computational processing and generate significant amounts of experimental data. The emergence of cloud computing has introduced a utility-type market model, where computational resources of varying capacities can be procured on demand, in a pay-per-use fashion. In workflow based applications dependencies exist amongst tasks which requires the generation of schedules in accordance with defined precedence constraints. These constraints pose a difficult planning problem, where tasks must be scheduled for execution only once all their parent tasks have completed. In general the two most important objectives of workflow schedulers are the minimisation of both cost and make span. The cost of workflow execution consists of both computational costs incurred from processing individual tasks, and data transmission costs. With scientific workflows potentially large amounts of data must be transferred between compute and storage sites. This paper proposes a novel cloud workflow scheduling approach which employs a Markov Decision Process to optimally guide the workflow execution process depending on environmental state. In addition the system employs a genetic algorithm to evolve workflow schedules. The overall architecture is presented, and initial results indicate the potential of this approach for developing viable workflow schedules on the Cloud.
Description
Conference paper
Collections
Except where otherwise noted, this item's license is described as Attribution-NonCommercial-NoDerivs 3.0 Ireland
Related items
Showing items related by title, author, creator and subject.
-
A Learning Architecture to Support Autonomous Resource Scheduling and Allocation in the Cloud
Barrett, Enda (2013-09-30)The advent of on-demand computing facilitated by computational clouds, provides an almost unlimited resource supply to support the execution of applications and processes. Through a process known as virtualisation large ... -
Supporting Email-based Collaborative Work across a Social Semantic Space
Scerri, Simon (2010-10-31)The Social Semantic Desktop adopts Semantic Web technology on the desktop to provide a universal platform for personal - and distributed - information management, social networking and community creation. The social semantic ... -
A decision support tool for planning bills-of-material
CUNNINGHAM, MICHAEL; HIGGINS, PAUL; BROWNE, JIM (Informa UK Limited, 1996-05-01)In this paper, the framework for a decision support tool for planning bills-of-material is presented. This tool generates a set of modular planning bills-of-material from the manufacturing bills-of-material for a company. ...