research-article

FlurryDB: a dynamically scalable relational database with virtual machine cloning

Authors:

Michael J. Mior,

Eyal de LaraAuthors Info & Claims

SYSTOR '11: Proceedings of the 4th Annual International Conference on Systems and Storage

Article No.: 1, Pages 1 - 9

https://doi.org/10.1145/1987816.1987818

Published: 30 May 2011 Publication History

Abstract

Stateless services are easy to scale in the cloud since new replicas of these services can be created at any time and they operate completely independently of other instances. In contrast, scaling stateful services, such as a database system, can take minutes or even hours due to the need to present a consistent view of the system for users of the service. Currently, this problem is addressed by resource over-provisioning in anticipation of demand spikes. FlurryDB uses virtual machine cloning to improve resource utilization by drastically reducing the latency required to add a new replica. We also show that FlurryDB is capable of handling updates to resources in a fashion that preserves consistency across the cloning boundary.

References

[1]

Amza, C., Chanda, A., Cox, A. L., Elnikety, S., Gil, R., Rajamani, K., Zwaenepoel, W., Cecchet, E., and Marguerite, J. Specification and implementation of dynamic web site benchmarks. In 5th Workshop on Workload Characterization (November 2002).

[2]

Bernstein, P. A., Hadzilacos, V., and Goodman, N. Concurrency control and recovery in database systems. Addison Wesley, Massachusetts, 1987.

Digital Library

[3]

Bryant, R., Tumanov, A., Irzak, O., Scannell, A., Joshi, K., Lagar-Cavilla, H. A., and de Lara, E. Kaleidoscope: Cloud micro-elasticity via VM state coloring. In Proceedings of the 6th European Conference on Computer Systems (2011), ACM Press, pp. 273--286.

Digital Library

[4]

Cecchet, E., Candea, G., and Ailamaki, A. Middleware-based database replication: The gaps between theory and practice. In Proceedings of the 2008 ACM SIGMOD international conference on management of data (June 2008), ACM Press.

Digital Library

[5]

Ceri, S., Negri, M., and Pelagatti, G. Horizontal data partitioning in database design. In Proceedings of the 1982 ACM SIGMOD international conference on management of data (June 1982), ACM Press.

Digital Library

[6]

Curino, C., Jones, E., Popa, R. A., Malviya, N., Wu, E., Madden, S., Balakrishnan, H., and Zeldovich, N. Relational cloud: A database service for the cloud. In 5th Biennial Conference on Innovative Data Systems Research (2011).

[7]

DeCandia, G., Hastorun, D., Jampani, M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., and Vogels, W. Dynamo: Amazon's highly available key-value store. In Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles (Oct. 2007), vol. 41, ACM Press, pp. 205--220.

Digital Library

[8]

Gray, J., and Lamport, L. Consensus on transaction commit. ACM Transactions on Database Systems 31 (March 2006), 133--160.

Digital Library

[9]

Gustavsson, S., and Andler, S. F. Self-stabilization and eventual consistency in replicated real-time databases. In Proceedings of the first workshop on Self-healing systems (2002), ACM Press, pp. 105--107.

Digital Library

[10]

Kemme, B., and Alonso, G. A suite of database replication protocols based on group communication primitives. In Proceedings of the The 18th International Conference on Distributed Computing Systems (1998), IEEE Computer Society.

Digital Library

[11]

Kemper, A., and Neumann, T. HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots. In Proceedings of the IEEE 25th International Conference on Data Engineering (2011), IEEE Computer Society.

Digital Library

[12]

Lagar-Cavilla, H. A., Whitney, J. A., Scannell, A. M., Patchin, P., Rumble, S. M., de Lara, E., Brudno, M., and Satyanarayanan, M. SnowFlock: Rapid virtual machine cloning for cloud computing. European Conference on Computer Systems (2009), 1--12.

Digital Library

[13]

Lakshman, A., and Malik, P. Cassandra: A decentralized structured storage system. ACM SIGOPS Operating Systems Review 44, 2 (Apr. 2010), 35--40.

Digital Library

[14]

Lampson, B., and Sturgis, H. Crash recovery in a distributed storage system. Tech. rep., Xerox Palo Alto Research Centre, April 1979.

[15]

Mior, M. RUBBoS source repository. https://github.com/michaelmior/RUBBoS, 2011.

[16]

Soundararajan, G., Amza, C., and Goel, A. Database replication policies for dynamic content applications. ACM SIGOPS Operating Systems Review 40, 4 (Oct. 2006), 89--102.

Digital Library

[17]

Stonebraker, M. Concurrency control and consistency of multiple copies of data in distributed INGRES. IEEE Transactions Software Engineering 5, 3 (1979), 188--194.

Digital Library

[18]

Urgaonkar, B., Shenoy, P., Chandra, A., Goyal, P., and Wood, T. Agile dynamic provisioning of multi-tier Internet applications. ACM Transactions on Autonomous and Adaptive Systems 3, 1 (2008), 1--39.

Digital Library

[19]

Zhang, W., and Zhang, W. Build highly-scalable and highly-available network services at low cost. Linux Magazine (2003), 14--14.

Cited By

Pang PDeng GBai KChen QSun SLiu BXu YYao HWang ZWang XLiu ZSong ZYang YMa TGuo M(2023)Async-Fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS LevelProceedings of the VLDB Endowment10.14778/3579075.357907916:5(1033-1045)Online publication date: 6-Mar-2023
https://dl.acm.org/doi/10.14778/3579075.3579079
Suneja SKoller RIsci Cde Lara EHashemi ABhattacharyya AAmza C(2017)Safe Inspection of Live Virtual MachinesACM SIGPLAN Notices10.1145/3140607.305076652:7(97-111)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3140607.3050766
Suneja SKoller RIsci Cde Lara EHashemi ABhattacharyya AAmza C(2017)Safe Inspection of Live Virtual MachinesProceedings of the 13th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3050748.3050766(97-111)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3050748.3050766
Show More Cited By

Index Terms

FlurryDB: a dynamically scalable relational database with virtual machine cloning
1. Information systems
  1. Data management systems
    1. Database management system engines

Recommendations

The cost of migrating DBMS from a conventional environment to virtual machines
TELE-INFO'11/MINO'11/SIP'11: Proceedings of the 10th WSEAS international conference on Telecommunications and informatics and microelectronics, nanoelectronics, optoelectronics, and WSEAS international conference on Signal processing

Virtualization becomes a very common solution in enterprise and small systems. Therefore, virtualization decreases financial costs and decreases system administration efforts. Also virtualization has been proven to be one of the most efficient ...
Dolly: virtualization-driven database provisioning for the cloud
VEE '11

Cloud computing platforms are becoming increasingly popular for e-commerce applications that can be scaled on-demand in a very cost effective way. Dynamic provisioning is used to autonomously add capacity in multi-tier cloud-based applications that see ...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SYSTOR '11: Proceedings of the 4th Annual International Conference on Systems and Storage

May 2011

189 pages

ISBN:9781450307734

DOI:10.1145/1987816

General Chair:
Paula Ta-Shma
IBM
,
Program Chairs:
Jose Moreira
IBM
,
Liuba Shrira
Brandeis U

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

NetApp
Mellanox: Mellanox Technologies
Hewlett-Packard
Intel: Intel
Red Hat: Red Hat, Inc.
MARVELL: Marvell Technology Group
IBM: IBM

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SYSTOR '11

Sponsor:

Mellanox
Intel
Red Hat
MARVELL
IBM

SYSTOR '11: The 4th Annual International Conference on Systems and Storage

May 30 - June 1, 2011

Haifa, Israel

Acceptance Rates

SYSTOR '11 Paper Acceptance Rate 16 of 53 submissions, 30%;

Overall Acceptance Rate 108 of 323 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
326
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pang PDeng GBai KChen QSun SLiu BXu YYao HWang ZWang XLiu ZSong ZYang YMa TGuo M(2023)Async-Fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS LevelProceedings of the VLDB Endowment10.14778/3579075.357907916:5(1033-1045)Online publication date: 6-Mar-2023
https://dl.acm.org/doi/10.14778/3579075.3579079
Suneja SKoller RIsci Cde Lara EHashemi ABhattacharyya AAmza C(2017)Safe Inspection of Live Virtual MachinesACM SIGPLAN Notices10.1145/3140607.305076652:7(97-111)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3140607.3050766
Suneja SKoller RIsci Cde Lara EHashemi ABhattacharyya AAmza C(2017)Safe Inspection of Live Virtual MachinesProceedings of the 13th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3050748.3050766(97-111)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3050748.3050766
Deshmukh PAmdani S(2017)Survey of memory streaming techniques for virtual machine in cloud environment2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS)10.1109/ICECDS.2017.8389631(1198-1200)Online publication date: Aug-2017
https://doi.org/10.1109/ICECDS.2017.8389631
Nadgowda SSuneja SKanso A(2017)Comparing Scaling Methods for Linux Containers2017 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E.2017.42(266-272)Online publication date: Apr-2017
https://doi.org/10.1109/IC2E.2017.42
Samant DBellur U(2016)Handling Boot Storms in Virtualized Data Centers—A SurveyACM Computing Surveys10.1145/293270949:1(1-36)Online publication date: 14-Jun-2016
https://dl.acm.org/doi/10.1145/2932709
Leesatapornwongsa TGunawi HLazowska ETerry DArpaci-Dusseau RGehrke J(2014)The Case for Drill-Ready Cloud ComputingProceedings of the ACM Symposium on Cloud Computing10.1145/2670979.2670992(1-8)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2670979.2670992
Moniruzzaman ANafi KHossain S(2014)Virtual Memory Streaming Technique for virtual machines (VMs) for rapid scaling and high performance in cloud environment2014 International Conference on Informatics, Electronics & Vision (ICIEV)10.1109/ICIEV.2014.6850734(1-6)Online publication date: May-2014
https://doi.org/10.1109/ICIEV.2014.6850734
Lehner WSattler KLehner WSattler K(2013)Virtualization for Data Management ServicesWeb-Scale Data Management for the Cloud10.1007/978-1-4614-6856-1_2(13-58)Online publication date: 19-Feb-2013
https://doi.org/10.1007/978-1-4614-6856-1_2
Sousa FMachado J(2012)Towards Elastic Multi-Tenant Database Replication with Quality of ServiceProceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing10.1109/UCC.2012.36(168-175)Online publication date: 5-Nov-2012
https://dl.acm.org/doi/10.1109/UCC.2012.36

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents