research-article

Dolly: virtualization-driven database provisioning for the cloud

Authors:

Emmanuel Cecchet,

Upendra Sharma,

Prashant ShenoyAuthors Info & Claims

ACM SIGPLAN Notices, Volume 46, Issue 7

Pages 51 - 62

https://doi.org/10.1145/2007477.1952691

Published: 09 March 2011 Publication History

Abstract

Cloud computing platforms are becoming increasingly popular for e-commerce applications that can be scaled on-demand in a very cost effective way. Dynamic provisioning is used to autonomously add capacity in multi-tier cloud-based applications that see workload increases. While many solutions exist to provision tiers with little or no state in applications, the database tier remains problematic for dynamic provisioning due to the need to replicate its large disk state. In this paper, we explore virtual machine (VM) cloning techniques to spawn database replicas and address the challenges of provisioning shared-nothing replicated databases in the cloud. We argue that being able to determine state replication time is crucial for provisioning databases and show that VM cloning provides this property. We propose Dolly, a database provisioning system based on VM cloning and cost models to adapt the provisioning policy to the cloud infrastructure specifics and application requirements. We present an implementation of Dolly in a commercial-grade replication middleware and evaluate database provisioning strategies for a TPC-W workload on a private cloud and on Amazon EC2. By being aware of VM-based state replication cost, Dolly can solve the challenge of automated provisioning for replicated databases on cloud platforms.

References

[1]

Amazon Auto Scaling - http://aws.amazon.com/autoscaling/

[2]

Amazon RDS - http://aws.amazon.com/rds/

[3]

C. Amza, E. Cecchet, Anupam Chanda, Alan L. Cox, S. Elnikety, R. Gil, J. Marguerite, K. Rajamani, and W. Zwaenepoel -- Specification and implementation of dynamic Web site benchmarks -- WWC, 2002.

[4]

M. N. Bennani and D. A. Menasce -- Resource allocation for autonomic data centers using analytic performance models -- ICAC '05, Washington, DC, USA, 2005.

Digital Library

[5]

J. Blancet -- Snapshots in Xen -- Online FAQ, https://zagnut.storeit offsite.com/home/jim.blancet/FAQ/Snapshots%20in%20xen

[6]

E. Cecchet, R. Singh, U. Sharma and P. Shenoy -- Dolly: Virtualization-driven Database Provisioning for the Cloud -- UMass Technical Report UM-CS-2010-006.

[7]

E. Cecchet, G. Candea and A. Ailamaki -- Middleware-based Database Replication: The Gaps between Theory and Practice. -- ACM SIGMOD, June 10--12, 2008

Digital Library

[8]

J. Chen, G.Soundararajan, C.Amza -- Autonomic Provisioning of Backend Databases in Dynamic Content Web Servers -- ICAC '06, June 2006.

[9]

S. Elnikety, S. Dropsho, E. Cecchet and W. Zwaenepoel -- Predicting Replicated Database Scalability from Standalone Database Profiling -- EuroSys, April 2009.

Digital Library

[10]

S. Ghanbari, G. Soundararajan, J. Chen, and C. Amza -- Adaptive Learning of Metric Correlations for Temperature-Aware Database Provisioning -- ICAC, June 2007.

Digital Library

[11]

J. Hellerstein, F. Zhang, and P. Shahabuddin -- An Approach to Predictive Detection for Service Management -- Proceedings of the 12th Conference on Systems and Network Management, 1999.

Digital Library

[12]

K. Manassiev and C. Amza -- Scaling and Continuous Availability in Database Server Clusters through Multiversion Replication -- DSN 2007, June 2007.

Digital Library

[13]

Oracle -- Oracle Real Application Clusters 11g -- Oracle Technical White Paper, April 2007.

[14]

OpenNebula project. http://opennebula.org/

[15]

M. Otey -- SQL Server vs. SQL Azure: Where SQL Azure is Limited - SQL Server Magazine, August 2010.

[16]

Sequoia Project. http://sourceforge.net/projects/sequoiadb/

[17]

G. Soundararajan and C. Amza -- Online data migration for autonomic provisioning of databases in dynamic content web servers -- 2005 Conference of the Centre For Advanced Studies on Collaborative Research, Toronto, October 2005.

Digital Library

[18]

TPC-W Benchmark, ObjectWeb implementation, http://jmob.objectweb.org/tpcw.html.

[19]

Transaction Processing Council. http://www.tpc.org/.

[20]

B. Urgaonkar, P. Shenoy, A. Chandra, and P. Goyal -- Dynamic Provisioning for Multi-tier Internet Applications -- ICAC-05, Seattle, June 2005.

Digital Library

[21]

D. Villela, P. Pradhan, and D. Rubenstein -- Provisioning Servers in the Application Tier for E-commerce Systems -- IWQOS 2004, June 2004.

[22]

Q. Zhang, L. Cherkasova, and E. Smirni -- A regression based analytic model for dynamic resource provisioning of multi-tier applications -- ICAC '07, Washington, DC, 2007.

Digital Library

Cited By

Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Polyglotte Persistenz im DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_7(161-188)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_7
Pavlo AButrovich MMa LMenon PLim WVan Aken DZhang W(2021)Make your database system dream of electric sheepProceedings of the VLDB Endowment10.14778/3476311.347641114:12(3211-3221)Online publication date: 28-Oct-2021
https://dl.acm.org/doi/10.14778/3476311.3476411
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2020)Polyglot Persistence in Data ManagementFast and Scalable Cloud Data Management10.1007/978-3-030-43506-6_7(149-174)Online publication date: 15-May-2020
https://doi.org/10.1007/978-3-030-43506-6_7
Show More Cited By

Index Terms

Dolly: virtualization-driven database provisioning for the cloud
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Project and people management
2. Software and its engineering
  1. Software creation and management
    1. Software development process management
  2. Software notations and tools
    1. Software configuration management and version control systems

Recommendations

Dolly: virtualization-driven database provisioning for the cloud
VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

Cloud computing platforms are becoming increasingly popular for e-commerce applications that can be scaled on-demand in a very cost effective way. Dynamic provisioning is used to autonomously add capacity in multi-tier cloud-based applications that see ...
Analysis and Research of Cloud Computing System Instance
ICFN '10: Proceedings of the 2010 Second International Conference on Future Networks

As a kind of emerging business computational model, Cloud Computing distribute computation task on the resource pool which consists of massive computers, accordingly ,the application systems can gain the computation strength, the storage space and ...
Plug into the Supercloud

Cloud computing is often compared to the power utility model, but today's cloud providers don't simply supply raw computing resources as a commodity; they also act as distributors, dictating cloud services that aren't compatible across providers. A ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGPLAN Notices

ACM SIGPLAN Notices Volume 46, Issue 7

VEE '11

July 2011

231 pages

ISSN:0362-1340

EISSN:1558-1160

DOI:10.1145/2007477

Issue’s Table of Contents

VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
March 2011
250 pages
ISBN:9781450306874
DOI:10.1145/1952682
General Chair:
Erez Petrank
The Technion, Israel
,
Program Chair:
Doug Lea
SUNY Oswego, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2011

Published in SIGPLAN Volume 46, Issue 7

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
813
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Polyglotte Persistenz im DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_7(161-188)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_7
Pavlo AButrovich MMa LMenon PLim WVan Aken DZhang W(2021)Make your database system dream of electric sheepProceedings of the VLDB Endowment10.14778/3476311.347641114:12(3211-3221)Online publication date: 28-Oct-2021
https://dl.acm.org/doi/10.14778/3476311.3476411
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2020)Polyglot Persistence in Data ManagementFast and Scalable Cloud Data Management10.1007/978-3-030-43506-6_7(149-174)Online publication date: 15-May-2020
https://doi.org/10.1007/978-3-030-43506-6_7
Peer Mohamed MSwarnammal S(2017)An efficient framework to handle integrated VM workloads in heterogeneous cloud infrastructureSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-015-2014-921:12(3367-3376)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s00500-015-2014-9
Sakr S(2016)Cloud‐Hosted DatabasesEncyclopedia of Cloud Computing10.1002/9781118821930.ch46(562-571)Online publication date: 13-May-2016
https://doi.org/10.1002/9781118821930.ch46
Zou XPan JDu WChen S(2015)Elastic Database Replication in the CloudAlgorithms and Architectures for Parallel Processing10.1007/978-3-319-27140-8_46(667-681)Online publication date: 16-Dec-2015
https://doi.org/10.1007/978-3-319-27140-8_46
Deng JE. HChang QShu QYang JJiang H(2015)Research on Performance Comparison of Data Center Between PM and VMHuman Centered Computing10.1007/978-3-319-15554-8_19(226-238)Online publication date: 4-Mar-2015
https://doi.org/10.1007/978-3-319-15554-8_19
Zhao LSakr SLiu ABouguettaya AZhao LSakr SLiu ABouguettaya A(2014)SLA-Driven Database Replication on Virtualized Database ServersCloud Data Management10.1007/978-3-319-04765-2_7(97-118)Online publication date: 17-Feb-2014
https://doi.org/10.1007/978-3-319-04765-2_7
Zhao LSakr SLiu ABouguettaya AZhao LSakr SLiu ABouguettaya A(2014)Cloud-Hosted Data Storage SystemsCloud Data Management10.1007/978-3-319-04765-2_3(21-45)Online publication date: 17-Feb-2014
https://doi.org/10.1007/978-3-319-04765-2_3
Rauscher RAcharya R(2013)Performance of Private Clouds in Health Care OrganizationsProceedings of the 2013 IEEE International Conference on Cloud Computing Technology and Science - Volume 0110.1109/CloudCom.2013.113(693-698)Online publication date: 2-Dec-2013
https://dl.acm.org/doi/10.1109/CloudCom.2013.113
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents