Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2745844.2745855acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
research-article

Online Auctions in IaaS Clouds: Welfare and Profit Maximization with Server Costs

Published: 15 June 2015 Publication History
  • Get Citation Alerts
  • Abstract

    Auction design has recently been studied for dynamic resource bundling and VM provisioning in IaaS clouds, but is mostly restricted to the one-shot or offline setting. This work targets a more realistic case of online VM auction design, where: (i) cloud users bid for resources into the future to assemble customized VMs with desired occupation durations; (ii) the cloud provider dynamically packs multiple types of resources on heterogeneous physical machines (servers) into the requested VMs; (iii) the operational costs of servers are considered in resource allocation; (iv) both social welfare and the cloud provider's net profit are to be maximized over the system running span. We design truthful, polynomial time auctions to achieve social welfare maximization and/or the provider's profit maximization with good competitive ratios. Our mechanisms consist of two main modules: (1) an online primal-dual optimization framework for VM allocation to maximize the social welfare with server costs, and for revealing the payments through the dual variables to guarantee truthfulness; and (2) a randomized reduction algorithm to convert the social welfare maximizing auctions to ones that provide a maximal expected profit for the provider, with competitive ratios comparable to those for social welfare. We adopt a new application of Fenchel duality in our primal-dual framework, which provides richer structures for convex programs than the commonly used Lagrangian duality, and our optimization framework is general and expressive enough to handle various convex server cost functions. The efficacy of the online auctions is validated through careful theoretical analysis and trace-driven simulation studies.

    References

    [1]
    "Amazon EC2 Instances," http://aws.amazon.com/ec2/instance-types/.
    [2]
    "ProfitBricks," https://www.profitbricks.com.
    [3]
    "CloudSigma," https://www.cloudsigma.com.
    [4]
    O. Agmon Ben-Yehuda, M. Ben-Yehuda, A. Schuster, and D. Tsafrir, "Deconstructing Amazon EC2 Spot Instance Pricing," in Proc. of IEEE CloudCom, 2011.
    [5]
    S. Zaman and D. Grosu, "Combinatorial Auction-based Allocation of Virtual Machine Instances in Clouds," Journal of Parallel and Distributed Computing, vol. 73, no. 4, pp. 495--508, 2013.
    [6]
    W.-Y. Lin, G.-Y. Lin, and H.-Y. Wei, "Dynamic Auction Mechanism for Cloud Resource Allocation," in IEEE/ACM CCGrid, 2010.
    [7]
    W. Shi, L. Zhang, C. Wu, Z. Li, and F. C. Lau, "An Online Auction Framework for Dynamic Resource Provisioning in Cloud Computing," in Proc. of ACM SIGMETRICS, 2014.
    [8]
    L. Zhang, Z. Li, and C. Wu, "Dynamic Resource Provisioning in Cloud Computing: A Randomized Auction Approach," in Proc. of IEEE INFOCOM, 2014.
    [9]
    W. Shi, C. Wu, and Z. Li, "RSMOA: A Revenue and Social Welfare Maximizing Online Auction for Dynamic Cloud Resource Provisioning," in Proc. of IWQoS, 2014.
    [10]
    W. Wang, B. Liang, and B. Li, "Revenue Maximization with Dynamic Auctions in IaaS Cloud Markets," in Proc. of IEEE ICDCS, 2013.
    [11]
    H. Zhang, B. Li, H. Jiang, F. Liu, A. V. Vasilakos, and J. Liu, "A Framework for Truthful Online Auctions in Cloud Computing with Heterogeneous User Demands," in Proc. of IEEE INFOCOM, 2013.
    [12]
    N. Buchbinder, K. Jain, and J. S. Naor, "Online Primal-Dual Algorithms for Maximizing Ad-Auctions Revenue," in Proc. of the 15th Annual European Symposium on Algorithms, 2007.
    [13]
    A. Mu'Alem and N. Nisan, "Truthful Approximation Mechanisms for Restricted Combinatorial Auctions," Games and Economic Behavior, vol. 64, no. 2, pp. 612--631, 2008.
    [14]
    Y. Azar, U. Bhaskar, L. Fleischer, and D. Panigrahi, "Online Mixed Packing and Covering," in Proc. of ACM-SIAM SODA, 2013.
    [15]
    N. Buchbinder and J. Naor, "The Design of Competitive Online Algorithms via a Primal-dual Approach," Foundations and Trends in Theoretical Computer Science, vol. 3, no. 2--3, pp. 93--263, 2009.
    [16]
    Z. Huang and A. Kim, "Welfare Maximization with Production Costs: a Primal Dual Approach," in Proc. of the ACM-SIAM SODA, 2015.
    [17]
    N. R. Devanur and Z. Huang, "Primal Dual Gives Almost Optimal Energy Efficient Online Algorithms," in Proc. of ACM-SIAM SODA, 2014.
    [18]
    A. Beloglazov, J. Abawajy, and R. Buyya, "Energy-Aware Resource Allocation Heuristics for Efficient Management of Data Centers for Cloud Computing," Future Generation Computer Systems, vol. 28, no. 5, pp. 755--768, 2012.
    [19]
    C. Joe-Wong, S. Sen, T. Lan, and M. Chiang, "Multi Resource Allocation: Fairness-Efficiency Tradeoffs in a Unifying Framework," in Proc. of IEEE INFOCOM, 2012.
    [20]
    S. T. Maguluri, R. Srikant, and L. Ying, "Stochastic Models of Load Balancing and Scheduling in Cloud Computing Clusters," in Proc. of IEEE INFOCOM, 2012.
    [21]
    Q. Wang, K. Ren, and X. Meng, "When Cloud meets eBay: Towards Effective Pricing for Cloud Computing," in Proc. of IEEE INFOCOM, 2012.
    [22]
    S. Anand, N. Garg, and A. Kumar, "Resource Augmentation for Weighted Flow-time Explained by Dual Fitting," in Proc. of ACM-SIAM SODA, 2012.
    [23]
    A. Blum, A. Gupta, Y. Mansour, and A. Sharma, "Welfare and Profit Maximization with Production Costs," in Proc. of IEEE FOCS, 2011.
    [24]
    R. Grandl, G. Ananthanarayanan, S. Kandula, S. Rao, and A. Akella, "Multi-Resource Packing for Cluster Schedulers," in Proc. of ACM SIGCOMM, 2014.
    [25]
    P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," in Proc. of ACM SOSP, 2003.
    [26]
    "KVM CPU Hotplug," http://www.linux-kvm.org/page/CPUHotPlug.
    [27]
    H. Chen, M. C. Caramanis, and A. K. Coskun, "Reducing the Data Center Electricity Costs Through Participation in Smart Grid Programs," in Proc. of IGCC, 2014.
    [28]
    "Xen DVFS," http://lists.xen.org/archives/html/xen-devel/2009-09/msg00585.html.
    [29]
    K. H. Kim, A. Beloglazov, and R. Buyya, "Power-aware Provisioning of Virtual Machines for Real-time Cloud Services," Concurrency and Computation: Practice and Experience archive, vol. 23, no. 13, pp. 1491--1505, 2011.
    [30]
    B. Krishnan, H. Amur, A. Gavrilovska, and K. Schwan, "VM Power Metering: Feasibility and Challenges," ACM SIGMETRICS Performance Evaluation Review, vol. 38, no. 3, pp. 56--60, 2010.
    [31]
    J. Kansal, F. Zhao, J. Liu, N. Kothari, and A. A. Bhattacharya, "Virtual Machine Power Metering and Provisioning," in Proc. of ACM SoCC, 2010.
    [32]
    N. R. Devanur and Z. Huang, "Primal dual gives optimal energy efficient online algorithms," in Proc. of ACM-SIAM SODA, 2014.
    [33]
    S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004.
    [34]
    N. Buchbinder and J. Naor, "Online Primal-Dual Algorithms for Covering and Packing Problems," in Algorithms--ESA 2005.\hskip 1em plus 0.5em minus 0.4em\relax Springer, 2005, pp. 689--701.
    [35]
    B. Awerbuch, Y. Azar, and A. Meyerson, "Reducing Truth-telling Online Mechanisms to Online Optimization," in Proc. of ACM STOC, 2003.
    [36]
    C. Reiss, J. Wilkes, and J. L. Hellerstein, "Google cluster-usage traces: format
    [37]
    "schema," Google Inc., Mountain View, CA, USA, Technical Report, Nov. 2011, revised 2012.03.20. Posted at URL http://code.google.com/p/googleclusterdata/wiki/TraceVersion2.
    [38]
    C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch, "Heterogeneity and Dynamicity of Clouds at Scale: Google Trace Analysis," in Proc. of ACM SoCC, 2012.
    [39]
    S. Chawla, J. D. Hartline, D. L. Malec, and B. Sivan, "Multi-Parameter Mechanism Design and Sequential Posted Pricing," in Proc. of ACM STOC, 2010.

    Cited By

    View all
    • (2023)Social Cost Analysis of Shared/Buy-in Computing SystemsACM Transactions on Economics and Computation10.1145/3624355Online publication date: 24-Sep-2023
    • (2023)Delay and Price Differentiation in Cloud Computing: A Service Model, Supporting Architectures, and PerformanceACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/35928528:3(1-40)Online publication date: 24-Jun-2023
    • (2023)Online Scheduling Algorithm for Heterogeneous Distributed Machine Learning JobsIEEE Transactions on Cloud Computing10.1109/TCC.2022.314315311:2(1514-1529)Online publication date: 1-Apr-2023
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMETRICS '15: Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems
    June 2015
    488 pages
    ISBN:9781450334860
    DOI:10.1145/2745844
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 June 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. auction
    2. cloud computing
    3. online algorithms
    4. pricing
    5. resource allocation
    6. truthful mechanisms

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    SIGMETRICS '15
    Sponsor:

    Acceptance Rates

    SIGMETRICS '15 Paper Acceptance Rate 32 of 239 submissions, 13%;
    Overall Acceptance Rate 459 of 2,691 submissions, 17%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)24
    • Downloads (Last 6 weeks)2

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Social Cost Analysis of Shared/Buy-in Computing SystemsACM Transactions on Economics and Computation10.1145/3624355Online publication date: 24-Sep-2023
    • (2023)Delay and Price Differentiation in Cloud Computing: A Service Model, Supporting Architectures, and PerformanceACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/35928528:3(1-40)Online publication date: 24-Jun-2023
    • (2023)Online Scheduling Algorithm for Heterogeneous Distributed Machine Learning JobsIEEE Transactions on Cloud Computing10.1109/TCC.2022.314315311:2(1514-1529)Online publication date: 1-Apr-2023
    • (2022)The Online Knapsack Problem with DeparturesProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/35706186:3(1-32)Online publication date: 8-Dec-2022
    • (2022)Customer Adaptive Resource Provisioning for Long-Term Cloud Profit Maximization under Constrained BudgetIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2021.311256233:6(1373-1392)Online publication date: 1-Jun-2022
    • (2022)A Reinforcement Learning Approach to Price Cloud Resources With Provable Convergence GuaranteesIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2021.308508833:12(7448-7460)Online publication date: Dec-2022
    • (2022)Coded Distributed Computing With Predictive Heterogeneous User Demands: A Learning Auction ApproachIEEE Journal on Selected Areas in Communications10.1109/JSAC.2022.318081140:8(2426-2439)Online publication date: Aug-2022
    • (2022)Pricing-based resource allocation in three-tier edge computing for social welfare maximizationComputer Networks10.1016/j.comnet.2022.109311217(109311)Online publication date: Nov-2022
    • (2021)Competitive Algorithms for Online Multidimensional Knapsack ProblemsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/34910425:3(1-30)Online publication date: 15-Dec-2021
    • (2021)Dynamic VM Scaling: Provisioning and Pricing through an Online AuctionIEEE Transactions on Cloud Computing10.1109/TCC.2018.28409999:1(131-144)Online publication date: 1-Jan-2021
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media