Publications
179 results found
Patel Y, McGough AS, Darlington J, 2006, Grid workflow scheduling in WOSE, 5th UK e-Science All Hands Meeting (AHM 2006), Pages: 566-573
The success of web services has infuenced the way in which grid applications are being written. Grid users seek to use combinations of web services to perform the overall task they need to achieve. In general this can be seen as a set of services with a workflow document describing how these services should be combined. The user may also have certain constraints on the workflow operations, such as execution time or cost to the user, specified in the form of a Quality of Service (QoS) document. These workflows need to be mapped to a subset of the Grid services taking the QoS and state of the Grid into account service availability and performance. We propose in this paper an approach for generating constraint equations describing the workflow, the QoS requirements and the state of the Grid. This set of equations may be solved using Integer Linear Programming (ILP), which is the traditional method. We further develop a 2-stage stochastic ILP which is capable of dealing with the volatile nature of the Grid and adapting the selection of the services during the life of the workflow. We present experimental results comparing our approaches, showing that the 2-stage stochastic programming approach performs consistently better than other traditional approaches. This work forms the workflow scheduling service within WOSE (Workflow Optimisation Services for eScience Applications), which is a collaborative work between Imperial College, Cardiff University and Daresbury Laborartory.
Patel Y, Darlington J, 2006, A novel stochastic algorithm for scheduling QoS-constrained workflows in a web service-oriented Grid, IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT 2006), Publisher: IEEE COMPUTER SOC, Pages: 437-+
- Author Web Link
- Cite
- Citations: 3
Afzal A, Darlington J, McGough AS, 2006, Stochastic workflow scheduling with QoS guarantees in grid computing environments, 5th International Conference on Grid and Cooperative Computing (GCC 2006), Publisher: IEEE COMPUTER SOC, Pages: 185-+
- Author Web Link
- Cite
- Citations: 9
Patel Y, Darlington J, 2006, Allocating QOS-constrained applications in a web service-oriented grid, 3rd International Conference on Distributed Computing and Internet Technology, Publisher: SPRINGER-VERLAG BERLIN, Pages: 278-+, ISSN: 0302-9743
Cohen J, Lee W, Darlington J, et al., 2006, A service-oriented utility grid architecture utilising pay-per-use resources, 1st International Conference on Communication Systems Software and Middleware, Publisher: IEEE, Pages: 612-+
Patel Y, Darlington J, 2006, Average-Based Workload Allocation Strategy for QoS-Constrained Jobs In A Web Service-Oriented Grid, 10th IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW'06), 2006, Publisher: IEEE Computer Society
The success of web services has influenced the way in which Grid applications are being written. Web services are increasingly used as a means to realise service-oriented distributed computing. Grid users often submit their applications in the form of workflows with certain Quality of Service (QoS) requirements imposed on the workflows. These workflows detail the composition of web services and the level of service required from the Grid. This paper addresses workload allocation techniques for Grid workflows. We model a web service as a G/G/k queue and minimise failures (QoS requirement violation) of jobs by solving a mixed-integer non-linear program (MINLP). The novel approach is evaluated through an experimental simulation and the results confirm that the proposed workload allocation strategy performs considerably better in terms of satisfying QoS requirements of Grid workflows than scheduling algorithms that donÆt employ such workload allocation techniques.
Patel Y, McGough S, Darlington J, 2006, A Profitable Broker in a Volatile Utility Grid\r\n, International Transactions on Systems Science and Applications, Vol: 2, Pages: 167-176
Service-oriented Grid is quickly shaping towards a\r\nutility market with players such as end-users, brokers and\r\nservice providers co-operatively working together. End-users\r\nwish to use functionality of Grid services by paying the\r\nminimum possible price or price confined within a specified\r\nbudget, brokers aim to maximize profit whilst satisfying enduser\r\nneeds and resisting the uncertainty that prevails within a\r\nGrid and service providers aim to develop price models based\r\non end-user demands that will maximize their profit. We\r\ndevelop a novel method for Grid brokers that aims at\r\nmaximizing profit whilst satisfying end-user needs with a\r\nsufficient guarantee in a volatile utility Grid. We propose in\r\nthis paper an approach for generating constraint equations\r\ndescribing the workflow, the Quality of Service (QoS)\r\nrequirements and the state of the Grid. This set of equations\r\nmay be solved using Mixed-Integer Linear Programming\r\n(MILP), which is the traditional method. We further develop\r\na 2-stage stochastic MILP which is capable of dealing with\r\nthe volatile nature of the Grid and obtaining cost bounds that\r\nensure that end-user cost is minimized or satisfied and\r\nbroker's profit is maximized with sufficient guarantee. These\r\nbounds help brokers know beforehand whether the budget\r\nlimits of end-users can be satisfied and if not then obtain\r\nappropriate future leases from service providers.\r\nExperimental results confirm the efficacy of our approach.
McGough AS, Lee W, Darlington J, 2006, Workflow deployment in ICENI II, 6th International Conference on Computational Science (ICCS 2006), Publisher: SPRINGER-VERLAG BERLIN, Pages: 964-971, ISSN: 0302-9743
- Author Web Link
- Cite
- Citations: 2
Cohen J, James C, Rahman S, et al., 2006, Modelling Rail Passenger Movements through e-Science Methods
Patel Y, Darlington J, 2006, A Novel Approach to Workload Allocation of QoS-Constrained Workflow-Based Jobs in a Utility Grid, Second IEEE International Conference on e-Science and Grid Computing, Publisher: IEEE Computer Society, Pages: 150-150
The Grid can be seen as a collection of services each of which performs some functionality. Grid users often submit their applications in the form of workflows with certain Quality of Service (QoS) requirements imposed on the workflows. These workflows detail the composition of Grid services and the level of service required from the Grid. This paper addresses workload allocation techniques for Grid workflows. We model a Grid service as a G/G/1 queue and minimise failures (QoS requirement violation) of jobs by solving a mixed-integer non-linear program (MINLP). The novel approach is evaluated through an experimental simulation and the results confirm that the proposed workload allocation strategy performs considerably better in terms of satisfying QoS requirements of Grid workflows than scheduling algorithms that don't employ such workload allocation techniques.
Patel Y, Darlington J, 2006, Application Of Queueing Theory To Allocating QoS-constrained Workflow-based Jobs In A Scientific Grid, 2nd International Computer Engineering Conference Engineering the Information Society, Faculty of Engineering, Cairo University, Cairo, EGYPT\r\n, Publisher: IEEE
Panagiotidi S, Cohen J, Darlington J, et al., 2006, Service-enabling legacy applications for the GENIE project, 5th UK e-Science All Hands Meeting (AHM 2006), Publisher: NATL E-SCIENCE CENTRE, Pages: 305-+
Patel Y, Darlington J, 2006, Queueing Theory Approach to Allocating QoS-Constrained Workflow-based Applications in a Web Service based Grid\r\n, The IASTED Conference on Parallel and Distributed Computing and Systems, Publisher: ACTA Press
Web services have succeeded in influencing the way in which Grid applications are being written. Web services are increasingly used as a means to realise service-oriented distributed computing. Grid users often submit their ap plications in the form of workflows with certain Quality of Service (QoS) requirements imposed on the workflows. These workflows detail the composition of web services and the level of service required from the Grid. This paper addresses workload allocation techniques for Grid work flows. We model a web service as an M/M/1 queue and obtain a numerical solution for missed deadlines (failures) of Grid workflow tasks. The approach is evaluated through an experimental simulation and the results confirm that the proposed workload allocation strategy performs consider ably better in terms of satisfying QoS requirements of Grid workflows than scheduling algorithms that donÆt employ such workload allocation techniques.\r\n\r\n
McGough AS, Lee W, Darlington J, 2006, ICENI II, 1st International Conference on Communication Systems Software and Middleware, Publisher: IEEE, Pages: 608-+
Patel Y, Darlington J, 2006, A novel approach to allocating QoS-constrained workflow-based jobs in a multi-cluster grid, MGC: 4th international workshop on Middleware for grid computing, Publisher: ACM
Clusters are increasingly interconnected to form multi-cluster systems, which are becoming popular for scientific computation. Grid users often submit their applications in the form of workflows with certain Quality of Service (QoS) requirements imposed on the workflows. These workflows detail the composition of Grid services and the level of service required from the Grid. This paper addresses workload allocation techniques for Grid workflows. We model a resource within a cluster as a G/G/1 queue and minimise failures (QoS requirement violation) of jobs by solving a mixed-integer non-linear program (MINLP). The novel approach is evaluated through an experimental simulation and the results confirm that the proposed workload allocation strategy not only provides QoS guarantee but also performs considerably better in terms of satisfying QoS requirements of Grid workflows than reservation-based scheduling algorithms.
Patel Y, Darlington J, 2006, Average-Based Scheduling Of QoS-Constrained Workflows In A Web Service-Oriented Grid, 14thInternational Conference on Advanced Computing & Communications, Publisher: IEEE
Patel Y, Darlington J, 2006, Allocating QoS-constrained workflow-based jobs in a multi-cluster grid through queueing theory approach, 4th International Symposium on Parallel and Distributed Processing and Applications, Publisher: SPRINGER-VERLAG BERLIN, Pages: 499-+, ISSN: 0302-9743
- Author Web Link
- Cite
- Citations: 2
Patel Y, McGough AS, Darlington J, 2006, QoS support for workflows in a volatile Grid, 7th IEEE/ACM International Conference on Grid Computing, Publisher: IEEE, Pages: 64-+
- Author Web Link
- Cite
- Citations: 2
Baxter A, 2005, Imperial vision may reshape the net, Financial Times Digital Business Section, Financiaal Times Digital Business Section, Publisher: Pearson
Baxter A, 2005, Imperial Vision May Reshape the Net, Financial Times Digital Business Section
Baxter A, 2005, Imperial Vision May Reshape the Net, Financial Times Digital Business Section
Cohen J, Lee W, Darlington J, 2005, Payment and Negotiation for the Next Generation Grid, Concurrency and Computation: Practice and Experience, ISSN: 1532-0626
J Cohen, A S McGough, J Darlington, et al., 2005, RealityGrid: an integrated approach to middleware through ICENI, Phil. Trans. R. Soc. A.: Mathematical, Physical and Engineering Sciences, Vol: 363, Pages: 1817-1827, ISSN: 1364-503X
McGough S, Afzal A, Darlington J, et al., 2005, Making the Grid Predictable through Reservations and Performance Modeling, The Computer Journal, Vol: 48, Pages: 358-368, ISSN: 0010-4620
Unpredictable job execution environments pose a significant barrier to the widespread adoption of the Grid paradigm, because of the innate risk of jobs failing to execute at the time specified by the user. We demonstrate that predictability can be enhanced with a supporting infrastructure consisting of three parts: Performance modelling and monitoring, scheduling which exploits application structure and an advanced reservation resource management service. We prove theoretically that execution times using advanced reservations display less variance than those without. We also show that the costs of advanced reservations can be reduced by providing the system with more accurate performance models. Following the theoretical discussion, we describe the implementation of a fully functional workflow enactment framework that supports advanced reservations and performance modelling thereby providing predictable execution behavior. We further provide experimental results confirming our theoretical models.
McGough S, Cohen J, Darlington J, et al., 2005, An End-to-end Workflow Pipeline for Large-scale Grid Computing, Vol: 3, Pages: 259-281
In this paper we describe a service-based, software architecture that enables end-to-end, high-level workflow processing in a Grid environment consisting of many heterogeneous resources. Our architecture is essentially a pipeline that extends from the abstract application specification phase to the deployment and execution stages through to returning the results to the user. We envision a large-scale Grid environment that contains heterogeneous resources. Our architecture caters for flexible deployment, performance, reliability and charging for resource usage. These are addressed at the specification level as well as at the realisation (brokering) and execution levels. The proposed architecture is derived from previous work in LeSC that has produced the ICENI pipeline, and our experience with e-Science projects, such as GENIE, e-Protein and RealityGrid from which we derive a set of key requirements.\r\n
Mayer A, McGough S, Furmento N, et al., 2005, ICENI: An integrated grid middleware to support E-science, Workshop on Component Models and Systems for Grid Applications, Publisher: SPRINGER, Pages: 109-124
- Author Web Link
- Cite
- Citations: 5
J Cohen, A S McGough, J Darlington, et al., 2005, RealityGrid: An Integrated Approach to Middleware through ICENI, Phil. Trans. R. Soc. A.: Mathematical, Physical and Engineering Sciences
Mayer A, McGough S, Furmento N, et al., 2004, Component Models and Systems for Grid Applications, Publisher: Springer, ISBN: 978-0387233512
This data is extracted from the Web of Science and reproduced under a licence from Thomson Reuters. You may not copy or re-distribute this data in whole or in part without the written consent of the Science business of Thomson Reuters.