Imperial College London

ProfessorJulieMcCann

Faculty of EngineeringDepartment of Computing

Professor of Computer Systems
 
 
 
//

Contact

 

+44 (0)20 7594 8375j.mccann Website

 
 
//

Location

 

258ACE ExtensionSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@inproceedings{Tahir:2015:10.1109/GLOCOM.2014.7417010,
author = {Tahir, Y and Yang, S and Koliousis, A and McCann, J},
doi = {10.1109/GLOCOM.2014.7417010},
publisher = {IEEE},
title = {UDRF: Multi-Resource Fairness for Complex Jobs with Placement Constraints},
url = {http://dx.doi.org/10.1109/GLOCOM.2014.7417010},
year = {2015}
}

RIS format (EndNote, RefMan)

TY  - CPAPER
AB - In this paper, we study the problem of multi-resource fairness in systems with multiple users. Each user requires to run one or more complex jobs that consist of multiple interconnected tasks. A job is considered finished when all its corresponding tasks have been executed in the system. Tasks can have different resource requirements. Because of special demands on particular hardware or software, tasks can have placement constraints limiting the type of machines they can run on. We develop User-Dependence Dominant Resource Fairness (UDRF), a generalized version of max-min fairness that combines graph theory and the notion of dominant resource shares to ensure multi- resource fairness between users with complex jobs. UDRF satisfies several desirable properties including strategy proofness, which ensures that users do not benefit from misreporting their true resource demands. We propose an offline algorithm that computes optimal UDRF allocation while the scheduling process can be to be decentralize across multiple schedulers. But optimality comes at a cost, especially for systems where schedulers need to make thousands of online scheduling decisions per second. Therefore, we develop a lightweight online algorithm that closely approximates UDRF. Large-scale simulations driven by Google cluster- usage traces show that UDRF achieves better resource utilization and throughput compared to the current state-of-the-art in multi-resource fair allocation.
AU - Tahir,Y
AU - Yang,S
AU - Koliousis,A
AU - McCann,J
DO - 10.1109/GLOCOM.2014.7417010
PB - IEEE
PY - 2015///
TI - UDRF: Multi-Resource Fairness for Complex Jobs with Placement Constraints
UR - http://dx.doi.org/10.1109/GLOCOM.2014.7417010
UR - http://hdl.handle.net/10044/1/37494
ER -