Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2600057.2602889acmconferencesArticle/Chapter ViewAbstractPublication PagesecConference Proceedingsconference-collections
research-article

Strategyproof allocation of discrete jobs on multiple machines

Published: 01 June 2014 Publication History

Abstract

We present a model for fair strategyproof allocations in a realistic model of cloud computing centers. This model has the standard Leontief preferences but also captures a key property of virtualization, the use of containers to isolate jobs. We first present several impossibility results for deterministic mechanisms in this setting. We then construct an extension of the well known dominant resource fairness mechanism (DRF), which somewhat surprisingly does not involve the notion of a dominant resource. Our mechanism relies on the connection between the DRF mechanism and the Kalai-Smorodinsky bargaining solution; by computing a weighted max-min over the convex hull of the feasible region we can obtain an ex-ante fair, efficient and strategyproof randomized allocation. This randomized mechanism can be used to construct other mechanisms which do not rely on users' being expected (ex-ante) utility maximizers, in several ways. First, for the case of $m$ identical machines one can use the convex structure of the mechanism to get a simple mechanism which is approximately ex-post fair, efficient and strategyproof. Second, we present a more subtle construction for an arbitrary set of machines, using the Shapley-Folkman-Starr theorem to show the existence of an allocation which is approximately ex-post fair, efficient and strategyproof. This paper provides both a rigorous foundation for developing protocols that explicitly utilize the detailed structure of the modern cloud computing hardware and software, and a general method for extending the dominant resource fairness mechanism to more complex settings.

References

[1]
Ananthanarayanan, G., Ghodsi, A., Shenker, S., and Stoica, I. 2011. Disk-locality in datacenter computing considered irrelevant. In Proceedings of the 13th USENIX Conference on Hot Topics in Operating Systems. HotOS'13. USENIX Association, Berkeley, CA, USA, 12--12.
[2]
APACHE.ORG. 2014a. YARN DRF extension to the Capacity Scheduler. https://issues.apache.org/jira/browse/YARN-2.
[3]
APACHE.ORG. 2014b. YARN DRF extension to the Fair Scheduler. https://issues.apache.org/jira/browse/YARN-326.
[4]
Bhattacharya, A. A., Culler, D., Friedman, E., Ghodsi, A., Shenker, S., and Stoica, I. 2013. Hierarchical scheduling for diverse datacenter workloads. In Proceedings of the 4th Annual Symposium on Cloud Computing. SOCC '13. ACM, New York, NY, USA, 4:1--4:15.
[5]
Dean, J. and Ghemawat, S. 2001. Mapreduce: Simplified data processing on large clusters, osdi'04: Sixth symposium on operating system design and implementation, san francisco, ca, december, 2004. S. Dill, R. Kumar, K. McCurley, S. Rajagopalan, D. Sivakumar, ad A. Tomkins, Self-similarity in the Web, Proc VLDB.
[6]
Dolev, D., Feitelson, D. G., Halpern, J. Y., Kupferman, R., and Linial, N. 2012. No justified complaints: On fair sharing of multiple resources. In Proceedings of the 3rd Innovations in Theoretical Computer Science Conference. ITCS '12. ACM, New York, NY, USA, 68--75.
[7]
Dubins, L. E. and Spanier, E. H. 1961. How to cut a cake fairly. The American Mathematical Monthly 68, 1, pp. 1--17.
[8]
Friedman, E. J., Ghodsi, A., Shenker, S., and Stoica, I. 2011. Strategyproofness, leontief economies and the kalai-smorodinsky solution. Manuscript.
[9]
Ghodsi, A., Sekar, V., Zaharia, M., and Stoica, I. 2012. Multi-resource fair queueing for packet processing. SIGCOMM Comput. Commun. Rev. 42, 4, 1--12.
[10]
Ghodsi, A., Zaharia, M., Hindman, B., Konwinski, A., Shenker, S., and Stoica, I. 2011. Dominant resource fairness: Fair allocation of multiple resource types. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation. NSDI'11. USENIX Association, Berkeley, CA, USA, 24--24.
[11]
Ghodsi, A., Zaharia, M., Shenker, S., and Stoica, I. 2013. Choosy: Max-min fair sharing for datacenter jobs with constraints. In Proceedings of the 8th ACM European Conference on Computer Systems. EuroSys '13. ACM, New York, NY, USA, 365--378.
[12]
Gutman, A. and Nisan, N. 2012. Fair allocation without trade. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems-Volume 2. International Foundation for Autonomous Agents and Multiagent Systems, 719--728.
[13]
Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A. D., Katz, R., Shenker, S., and Stoica, I. 2011. Mesos: A platform for fine-grained resource sharing in the data center. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation. NSDI'11. USENIX Association, Berkeley, CA, USA, 22--22.
[14]
Joe-Wong, C., Sen, S., Lan, T., and Chiang, M. 2012. Multi-resource allocation: Fairness-efficiency tradeoffs in a unifying framework. In INFOCOM. 1206--1214.
[15]
Kalai, E. and Smorodinsky, M. 1975. Other solutions to nash's bargaining problem. Econometrica 43, 3, pp. 513--518.
[16]
Li, J. and Xue, J. 2013. Egalitarian division under leontief preferences. Economic Theory 54, 3, 597--622.
[17]
Linuxcontainers.org. 2014. http://linuxcontainers.org/.
[18]
Parkes, D. C., Procaccia, A. D., and Shah, N. 2012. Beyond dominant resource fairness: Extensions, limitations, and indivisibilities. In Proceedings of the 13th ACM Conference on Electronic Commerce. EC '12. ACM, New York, NY, USA, 808--825.
[19]
Starr, R. M. 1969. Quasi-equilibria in markets with non-convex preferences. Econometrica 37, 1, pp. 25--38.
[20]
Starr, R. M. 1981. Approximation of points of the convex hull of a sum of sets by points of the sum: an elementary approach. Journal of Economic Theory 25, 2, 314--317.
[21]
Wang, W., Li, B., and Liang, B. 2013. Dominant resource fairness in cloud computing systems with heterogeneous servers. CoRR abs/1308.0083.

Cited By

View all
  • (2024)Getting more by knowing lessProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/311(2807-2815)Online publication date: 3-Aug-2024
  • (2023)Keep-alive caching for the hawkes processProceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence10.5555/3625834.3625975(1499-1509)Online publication date: 31-Jul-2023
  • (2023)Fair Multi-Resource Allocation in Heterogeneous Servers With an External Resource TypeIEEE/ACM Transactions on Networking10.1109/TNET.2022.321342631:3(1244-1262)Online publication date: Jun-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
EC '14: Proceedings of the fifteenth ACM conference on Economics and computation
June 2014
1028 pages
ISBN:9781450325653
DOI:10.1145/2600057
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fair division
  2. resource allocation

Qualifiers

  • Research-article

Funding Sources

Conference

EC '14
Sponsor:
EC '14: ACM Conference on Economics and Computation
June 8 - 12, 2014
California, Palo Alto, USA

Acceptance Rates

EC '14 Paper Acceptance Rate 80 of 290 submissions, 28%;
Overall Acceptance Rate 664 of 2,389 submissions, 28%

Upcoming Conference

EC '25
The 25th ACM Conference on Economics and Computation
July 7 - 11, 2025
Stanford , CA , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)1
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Getting more by knowing lessProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/311(2807-2815)Online publication date: 3-Aug-2024
  • (2023)Keep-alive caching for the hawkes processProceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence10.5555/3625834.3625975(1499-1509)Online publication date: 31-Jul-2023
  • (2023)Fair Multi-Resource Allocation in Heterogeneous Servers With an External Resource TypeIEEE/ACM Transactions on Networking10.1109/TNET.2022.321342631:3(1244-1262)Online publication date: Jun-2023
  • (2022)Fair and efficient allocations without obvious manipulationsProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3601240(13342-13354)Online publication date: 28-Nov-2022
  • (2022)Maximin Share Based Mechanisms for Multi-resource Fair Allocation with Divisible and Indivisible TasksTheoretical Computer Science10.1007/978-981-19-8152-4_19(263-272)Online publication date: 10-Dec-2022
  • (2022)Fair and Efficient Multi-resource Allocation for Cloud ComputingWeb and Internet Economics10.1007/978-3-031-22832-2_10(169-186)Online publication date: 9-Dec-2022
  • (2021)Stateful DRF: Considering the Past in a Multi-Resource AllocationIEEE Transactions on Computers10.1109/TC.2020.300600770:7(1094-1105)Online publication date: 1-Jul-2021
  • (2020)Fair multi-resource allocation in mobile edge computing with multiple access pointsProceedings of the Twenty-First International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing10.1145/3397166.3409144(11-20)Online publication date: 11-Oct-2020
  • (2020)Dynamic Weighted Fairness with Minimal DisruptionsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/33794854:1(1-18)Online publication date: 27-May-2020
  • (2020)Multi‐resource allocation in cloud data centers: A trade‐off on fairness and efficiencyConcurrency and Computation: Practice and Experience10.1002/cpe.606133:6Online publication date: 23-Nov-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media