Imperial College London
Portrait Picture

ProfessorJulieMcCann

Faculty of Engineering, Department of Computing

Vice-Dean (Research) for the Faculty of Engineering
 
 
 
//

Contact

 

+44 (0)20 7594 8375j.mccann Website

 
 
//

Assistant

 

Miss Teresa Ng +44 (0)20 7594 8300

 
//

Location

 

260ACE ExtensionSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@inproceedings{Tahir:2015:10.1109/GLOCOM.2015.7417010,
author = {Tahir and Yang and Koliousis and McCann},
doi = {10.1109/GLOCOM.2015.7417010},
pages = {1--7},
publisher = {IEEE},
title = {UDRF: Multi-resource Fairness for Complex Jobs with Placement Constraints},
url = {http://dx.doi.org/10.1109/GLOCOM.2015.7417010},
year = {2015}
}
Download

RIS format (EndNote, RefMan)

TY  - CPAPER
AB  - In this paper, we study the problem of multi- resource fairness in systems running complex jobs that consist of multiple interconnected tasks. A job is considered finished when all its corresponding tasks have been executed in the system. Tasks can have different resource requirements. Because of special demands on particular hardware or software, tasks may have placement constraints limiting the type of machines they can run on. We develop User-Dependence Dominant Resource Fairness (UDRF), a generalized version of max-min fairness that combines graph theory and the notion of dominant re- source shares to ensure multi-resource fairness between complex workflows. UDRF satisfies several desirable properties including strategy proofness, which ensures that users do not benefit from misreporting their true resource demands. We propose an offline algorithm that computes optimal UDRF allocation. But optimality comes at a cost, especially for systems where schedulers need to make thousands of online scheduling decisions per second. Therefore, we develop a lightweight online algorithm that closely approximates UDRF. Besides that, we propose a simple mechanism to decentralize the UDRF scheduling process across multiple schedulers. Large-scale simulations driven by Google cluster-usage traces show that UDRF achieves better resource utilization and throughput compared to the current state-of-the-art in fair resource allocation.
AU  - Tahir
AU  - Yang
AU  - Koliousis
AU  - McCann
DO  - 10.1109/GLOCOM.2015.7417010
EP  - 7
PB  - IEEE
PY  - 2015///
SP  - 1
TI  - UDRF: Multi-resource Fairness for Complex Jobs with Placement Constraints
UR  - http://dx.doi.org/10.1109/GLOCOM.2015.7417010
UR  - http://hdl.handle.net/10044/1/24560
ER  -
Download