research-article

RTP: robust tenant placement for elastic in-memory database clusters

Authors:

Tim Januschowski,

Hasso Plattner,

Michael J. Franklin,

Dean JacobsAuthors Info & Claims

SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data

Pages 773 - 784

https://doi.org/10.1145/2463676.2465302

Published: 22 June 2013 Publication History

Abstract

In the cloud services industry, a key issue for cloud operators is to minimize operational costs. In this paper, we consider algorithms that elastically contract and expand a cluster of in-memory databases depending on tenants' behavior over time while maintaining response time guarantees.

We evaluate our tenant placement algorithms using traces obtained from one of SAP's production on-demand applications. Our experiments reveal that our approach lowers operating costs for the database cluster of this application by a factor of 2.2 to 10, measured in Amazon EC2 hourly rates, in comparison to the state of the art. In addition, we carefully study the trade-off between cost savings obtained by continuously migrating tenants and the robustness of servers towards load spikes and failures.

References

[1]

P. A. Bernstein, I. Cseri, N. Dani, N. Ellis, A. Kalhan, G. Kakivaya, D. B. Lomet, R. Manne, L. Novik, and T. Talius. Adapting microsoft SQL server for cloud computing. In ICDE, pages 1255--1263. IEEE Computer Society, 2011.

Digital Library

[2]

C. Chekuri and S. Khanna. On multi-dimensional packing problems. In ACM SODA, 1999.

Digital Library

[3]

J. Chen, G. Soundararajan, and C. Amza. Autonomic Provisioning of Backend Databases in Dynamic Content Web Servers. In ICAC, pages 231--242. IEEE, 2006.

Digital Library

[4]

J. Csirik and D. S. Johnson. Bounded Space On-Line Bin Packing: Best is Better than First. In SODA, pages 309--319. ACM/SIAM, 1991.

Digital Library

[5]

C. Curino, E. P. C. Jones, S. Madden, and H. Balakrishnan. Workload-aware database monitoring and consolidation. In SIGMOD Conference, pages 313--324. ACM, 2011.

Digital Library

[6]

S. Das, S. Nishimura, D. Agrawal, and A. El Abbadi. Albatross: Lightweight Elasticity in Shared Storage Databases for the Cloud using Live Data Migration. PVLDB, 4(8):494--505, 2011.

Digital Library

[7]

J. Duggan, U. Çetintemel, O. Papaemmanouil, and E. Upfal. Performance prediction for concurrent database workloads. In SIGMOD Conference, pages 337--348. ACM, 2011.

Digital Library

[8]

A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zephyr: live migration in shared nothing databases for elastic cloud platforms. In SIGMOD Conference, pages 301--312. ACM, 2011.

Digital Library

[9]

T. C. Ferreto, M. A. S. Netto, R. N. Calheiros, and C. A. F. D. Rose. Server consolidation with migration control for virtualized data centers. Future Generation Comp. Syst., 27(8):1027--1034, 2011.

Digital Library

[10]

French Operational Research and Decision Support Society. ROADEF Challenge 2012. http://challenge.roadef.org.

[11]

M. R. Garey and D. S. Johnson. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman, 1979.

Digital Library

[12]

F. Glover. Tabu Search - Part I. INFORMS Journal on Computing, 1(3):190--206, 1989.

[13]

D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, and A. Kemper. An integrated approach to resource pool management: Policies, efficiency and quality metrics. In DSN, pages 326--335. IEEE Computer Society, 2008.

[14]

L. Hedegard and J. Dietz. The benefits of enabling fallback in the active data warehouse, teradata, 2007.

[15]

D. S. Hochbaum and D. B. Shmoys. A Polynomial Approximation Scheme for Scheduling on Uniform Processors: Using the Dual Approximation Approach. SIAM J. Comput., 17(3):539--551, 1988.

Digital Library

[16]

H.-I. Hsiao and D. J. DeWitt. Chained Declustering: A New Availability Strategy for Multiprocessor Database Machines. In ICDE, pages 456--465. IEEE Computer Society, 1990.

Digital Library

[17]

J. Krüger, C. Kim, M. Grund, N. Satish, D. Schwalb, J. Chhugani, H. Plattner, P. Dubey, and A. Zeier. Fast Updates on Read-Optimized Databases Using Multi-Core CPUs. PVLDB, 5(1):61--72, 2011.

Digital Library

[18]

W. Lang, S. Shankar, J. M. Patel, and A. Kalhan. Towards Multi-tenant Performance SLOs. In ICDE, pages 702--713. IEEE Computer Society, 2012.

Digital Library

[19]

M. Mehta and D. J. DeWitt. Data Placement in Shared-Nothing Parallel Database Systems. VLDB J., 6(1):53--72, 1997.

Digital Library

[20]

J. M. Milán-Franco, R. Jiménez-Peris, M. Patino-Martınez, and B. Kemme. Adaptive Middleware for Data Replication. In Middleware, pages 175--194. Springer, 2004.

Digital Library

[21]

J. Schaffner, B. Eckart, D. Jacobs, C. Schwarz, H. Plattner, and A. Zeier. Predicting in-memory database performance for automating cluster management tasks. In ICDE, pages 1264--1275. IEEE Computer Society, 2011.

Digital Library

[22]

J. Schaffner and T. Januschowski. Realistic tenant traces for enterprise dbaas. In SMDB, ICDE Workshops, 2013.

[23]

J. M. Valério de Carvalho. Exact solution of bin-packing problems using column generation and branch-and-bound. Annals of Operations Research, 1999.

[24]

A. Watanabe and H. Yokota. Adaptive Lapped Declustering: A Highly Available Data-Placement Method Balancing Access Load and Space Utilization. In ICDE, pages 828--839. IEEE Computer Society, 2005.

Digital Library

[25]

F. Yang, J. Shanmugasundaram, and R. Yerneni. A Scalable Data Platform for a Large Number of Small Applications. In CIDR. www.cidrdb.org, 2009.

[26]

H. Zhu, P. Gu, and J. Wang. Shifted declustering: a placement-ideal layout scheme for multi-way replication storage architecture. In ICS, pages 134--144. ACM, 2008.

Digital Library

Cited By

Arora PChaudhuri SDas SDong JGeorge CKalhan AKönig ALang WLi CLi FLiu JMaas LMata AMenache IMoeller JNarasayya VOlma MOslake MRezai EShan YSyamala MXu SZois V(2023)Flexible Resource Allocation for Relational Database-as-a-ServiceProceedings of the VLDB Endowment10.14778/3625054.362505816:13(4202-4215)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.14778/3625054.3625058
Xiao WYang CWang JZhu XBao WFeng XXie YCao WYu FLiu L(2023)YISHAN: Managing Large-scale Cloud Database Instances via Machine LearningIEEE Transactions on Services Computing10.1109/TSC.2021.313124916:1(724-738)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TSC.2021.3131249
Li BWu B(2023)Online Robust Bin Packing for Resource Allocation in Cloud Computing2023 26th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD57460.2023.10152004(1063-1068)Online publication date: 24-May-2023
https://doi.org/10.1109/CSCWD57460.2023.10152004
Show More Cited By

Index Terms

RTP: robust tenant placement for elastic in-memory database clusters
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Parallel and distributed DBMSs

Recommendations

A Multi-agent System Architecture for Self-Healing Cloud Infrastructure
ICC '16: Proceedings of the International Conference on Internet of things and Cloud Computing

The popularity of Cloud computing has considerably increased during the last years. The increase of Cloud users and their interactions with the Cloud infrastructure raise the risk of resources faults. Such a problem can lead to a bad reputation of the ...
RACS: a case for cloud storage diversity
SoCC '10: Proceedings of the 1st ACM symposium on Cloud computing

The increasing popularity of cloud storage is leading organizations to consider moving data out of their own data centers and into the cloud. However, success for cloud storage providers can present a significant risk to customers; namely, it becomes ...
A Conceptual Platform of SLA in Cloud Computing
DASC '11: Proceedings of the 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing

Cloud computing is a promising technology, where the infrastructure, developing platform, software and storage are delivered as a service. With the development of cloud computing, more and more cloud service providers emerge. However, there are no ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data

June 2013

1322 pages

ISBN:9781450320375

DOI:10.1145/2463676

General Chairs:
Kenneth Ross
Columbia University
,
Divesh Srivastava
AT&T Research
,
Program Chair:
Dimitris Papadias
HKUST

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGMOD/PODS'13

Sponsor:

SIGMOD

SIGMOD/PODS'13: International Conference on Management of Data

June 22 - 27, 2013

New York, New York, USA

Acceptance Rates

SIGMOD '13 Paper Acceptance Rate 76 of 372 submissions, 20%;

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
546
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Arora PChaudhuri SDas SDong JGeorge CKalhan AKönig ALang WLi CLi FLiu JMaas LMata AMenache IMoeller JNarasayya VOlma MOslake MRezai EShan YSyamala MXu SZois V(2023)Flexible Resource Allocation for Relational Database-as-a-ServiceProceedings of the VLDB Endowment10.14778/3625054.362505816:13(4202-4215)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.14778/3625054.3625058
Xiao WYang CWang JZhu XBao WFeng XXie YCao WYu FLiu L(2023)YISHAN: Managing Large-scale Cloud Database Instances via Machine LearningIEEE Transactions on Services Computing10.1109/TSC.2021.313124916:1(724-738)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TSC.2021.3131249
Li BWu B(2023)Online Robust Bin Packing for Resource Allocation in Cloud Computing2023 26th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD57460.2023.10152004(1063-1068)Online publication date: 24-May-2023
https://doi.org/10.1109/CSCWD57460.2023.10152004
König AShan YZiegler TKakaraparthy ALang WMoeller JKalhan ANarasayya V(2022)Tenant placement in over-subscribed database-as-a-service clustersProceedings of the VLDB Endowment10.14778/3551793.355181415:11(2559-2571)Online publication date: 29-Sep-2022
https://dl.acm.org/doi/10.14778/3551793.3551814
Burckhardt SChandramouli BGillum CJusto DKallas KMcMahon CMeiklejohn CZhu X(2022)NetheriteProceedings of the VLDB Endowment10.14778/3529337.352934415:8(1591-1604)Online publication date: 22-Jun-2022
https://dl.acm.org/doi/10.14778/3529337.3529344
Kamali SNikbakht P(2021)On the Fault-Tolerant Online Bin Packing ProblemAlgorithmic Aspects of Cloud Computing10.1007/978-3-030-93043-1_1(1-17)Online publication date: 10-Dec-2021
https://doi.org/10.1007/978-3-030-93043-1_1
Rosinosky GLabba CFerme VYoucef SCharoy FPautasso C(2018)Evaluating Multi-tenant Live Migrations Effects on PerformanceOn the Move to Meaningful Internet Systems. OTM 2018 Conferences10.1007/978-3-030-02610-3_4(61-77)Online publication date: 18-Oct-2018
https://doi.org/10.1007/978-3-030-02610-3_4
Elmore A(2018)ElasticityEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_80806(1269-1270)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_80806
Elmore A(2018)MultitenancyEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_80639(2440-2443)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_80639
Molka KCasale G(2017)Energy-efficient resource allocation and provisioning for in-memory database clusters2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM)10.23919/INM.2017.7987260(19-27)Online publication date: May-2017
https://doi.org/10.23919/INM.2017.7987260
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents