research-article

VMTorrent: scalable P2P virtual machine streaming

Authors:

Dan RubensteinAuthors Info & Claims

CoNEXT '12: Proceedings of the 8th international conference on Emerging networking experiments and technologies

Pages 289 - 300

https://doi.org/10.1145/2413176.2413210

Published: 10 December 2012 Publication History

Abstract

Clouds commonly store Virtual Machine (VM) images on networked storage. This poses a serious potential scalability bottleneck as launching a single fresh VM instance requires, at minimum, several hundred MB of network reads. As this bottleneck occurs most severely during read-intensive launching of new VMs, we focus on scalably minimizing time to boot a VM and load its critical applications.

While effective scalable P2P streaming techniques for Video on Demand (VOD) scenarios where blocks arrive in-order and at constant rate are available, no techniques address scalable large-executable streaming. VM execution is non-deterministic, divergent, variable rate, and cannot miss blocks. VMTORRENT introduces a novel combination of block prioritization, profile-based execution prefetch, on-demand fetch, and decoupling of VM image presentation from underlying data-stream. VMTORRENT provides the first complete and effective solution to this growing scalability problem that is based on making better use of existing capacity, instead of throwing more hardware at it.

Supported by analytic modeling, we present comprehensive experimental evaluation of VMTORRENT on real systems at scale, demonstrating the effectiveness of VMTORRENT. We find that VMTORRENT supports comparable execution time to that achieved using local disk. VMTORRENT maintains this performance while scaling to 100 instances, providing up to 11x speedup over current state-of-the-art and 30x over traditional network storage.

References

[1]

IOMEGA Solid State Drive to Address Boot Storm Issues. Retrieved from http://iomega.com/about/prreleases/2011/20110526_vdi_bootstorm.html, May 2011.

[2]

Fusion-io VDI Overview. Retrieved from http:// www.fusionio.com/overviews/fusion-io-virtual -desktop-infrastructure-vdi-overview/, 2012.

[3]

Bindfs: Mount a Directory to Another Location and Alter Permission Bits. Retrieved from http://code.google.com/p/bindfs, n.d.

[4]

S. Annapureddy et al. Shark: Scaling File Servers via Cooperative Caching. In USENIX NSDI, May 2005.

Digital Library

[5]

S. H. Baek and K. H. Park. Prefetching with Adaptive Cache Culling for Striped Disk Arrays. In USENIX ATC, June 2008.

Digital Library

[6]

R. Chandra et al. The Collective: A Cache-Based System Management Architecture. In USENIX NSDI, May 2005.

Digital Library

[7]

Z. Chen et al. Rapid Provisioning of Cloud Infrastructure Leveraging Peer-to-Peer Networks. In IEEE ICDCS Workshops, June 2009.

Digital Library

[8]

C. Clark et al. Live Migration of Virtual Machines. In USENIX NSDI, May 2005.

Digital Library

[9]

B. Cohen. Incentives Build Robustness in BitTorrent. In P2PECON, June 2003.

[10]

L. P. Cox et al. Pastiche: Making Backup Cheap and Easy. In USENIX OSDI, December 2002.

Digital Library

[11]

F. Dabek et al. Wide-Area Cooperative Storage with CFS. ACM SOSP, October 2001.

Digital Library

[12]

A. El-Sayed et al. A Survey of Proposals for an Alternative Group Communication Service. IEEE Network, Vol. 17, January/February 2003.

Digital Library

[13]

Etsy. Turbocharging Solr Index Replication with BitTorrent. Retrieved from http://codeascraft.etsy.com/2012/01/23/solr-bittorrent-index-replication, January 2012.

[14]

R. Harris. OpenStack Proposal Blueprint: Download Images using BitTorrent (in XenServer). Retrieved from https://blueprints.launchpad.net/nova/+spec/xenserver-bittorrent-images, June 2012.

[15]

M. R. Hines and K. Gopalan. Post-Copy Based Live Virtual Machine Migration Using Adaptive Pre-Paging and Dynamic Self-Ballooning. In ACM VEE, March 2009.

Digital Library

[16]

R. Hirschfeld. OpenStack Deployments Abound at Austin Meetup. Retrieved from http://www.open stack.org/blog/2011/12/openstack-deployments-abound-at-austin-meetup-129/, December 2011.

[17]

M. Hosseini et al. A Survey of Application-Layer Multicast Protocols. IEEE Communications Surveys & Tutorials, Vol. 9, Third Quarter 2007.

Digital Library

[18]

Y. Huang et al. Challenges, Design and Analysis of a Large-scale P2P-VoD System. In ACM SIGCOMM, August 2008.

Digital Library

[19]

IANA. RFC 3171, 2001.

[20]

IANA. RFC 4291, 2006.

[21]

C. B. M. III and D. Grunwald. Content-Based Block Caching. In IEEE MSST, May 2006.

[22]

T. Kimbrel et al. A Trace-Driven Comparison of Algorithms for Parallel Prefetching and Caching. In USENIX OSDI, October 1996.

Digital Library

[23]

M. Kozuch and M. Satyanarayanan. Internet Suspend/Resume. In IEEE Hotmobile, February 2002.

Digital Library

[24]

H. A. Lagar-Cavilla et al. SnowFlock: Virtual Machine Cloning as a First-Class Cloud Primitive. ACM TOCS, February 2011.

Digital Library

[25]

libtorrent. libtorrent: C++ Bittorrent Library. Retrieved from http://www.rasterbar.com/products/libtorrent/index.html, n.d.

[26]

R. Mietzner and F. Leymann. Towards Provisioning the Cloud: On the Usage of Multi-Granularity Flows and Services to Realize a Unified Provisioning Infrastructure for SaaS Applications. In IEEE SERVICES, July 2008.

Digital Library

[27]

MokaFive. Retrieved from http://www.mokafive.com/products/components.php, n.d.

[28]

C. M. O'Donnell. Using BitTorrent to Distribute Virtual Machine Images for Classes. In ACM SIGUCCS, October 2008.

Digital Library

[29]

N. Parvez et al. Analysis of BitTorrent-Like Protocols for On-Demand Stored Media Streaming. In ACM SIGMETRICS, June 2008.

Digital Library

[30]

R. H. Patterson et al. Informed Prefetching and Caching. In ACM SOSP, December 1995.

Digital Library

[31]

C. Peng et al. VDN: Virtual Machine Image Distribution Network for Cloud Data Centers. In IEEE INFOCOM, July 2012.

[32]

L. Peterson et al. VICCI: A Programmable Cloud-Computing Research Testbed. Technical report, Princeton University, 2011.

[33]

M. Schmidt et al. Efficient Distribution of Virtual Machines for Cloud Computing. Euromicro PDP, February 2010.

Digital Library

[34]

L. Shi et al. Iceberg: An Image Streamer for Space and Time Efficient Provisioning of Virtual Machines. In IEEE ICPP Workshops, September 2008.

Digital Library

[35]

M. Szeredi. FUSE: File System in Userspace. Retrieved from http://fuse.sourceforge.net/, n.d.

[36]

Twitter. Twitter's Murder Project at Github. Retrieved from https://github.com/lg/murder, n.d.

[37]

A. Vlavianos et al. BiToS: Enhancing BitTorrent for Supporting Streaming Applications. In IEEE Global Internet Symposium, April 2006.

[38]

R. Wartel et al. Image Distribution Mechanisms in Large Scale Cloud Providers. IEEE CloudCom, November 2010.

Digital Library

[39]

M. Welsh, D. Culler, and E. Brewer. SEDA: An Architecture for Well-Conditioned, Scalable Internet Services. In ACM SOSP, October 2001.

Digital Library

[40]

B. White et al. An Integrated Experimental Environment for Distributed Systems and Networks. In USENIX OSDI, December 2002.

Digital Library

[41]

Y. Zhang et al. Portable Desktop Applications Based on P2P Transportation and Virtualization. In USENIX LISA, November 2008.

Digital Library

[42]

Y. Zhou et al. A Simple Model for Analyzing P2P Streaming Protocols. IEEE ICNP, October 2007.

Cited By

Chen XGu CGao XShen YSun ZHuang H(2024)Virtual Machine Placement for Minimizing Image Retrieval Cost and Communication Cost in Cloud Data CenterIEEE Transactions on Network and Service Management10.1109/TNSM.2024.335114821:2(1998-2011)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2024.3351148
Fei HZhang YWang WLi YXu HZhu HHao ZLi D(2022)Fast Provisioning of Virtual Machine Based on Intelligent Virtual Machine Image Prefetching2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta)10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120(778-787)Online publication date: Dec-2022
https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120
Fei HWang WChen YDing ZZhu HLiu YHao ZYu C(2022)A Cache-Aware Virtual Machine Placement With Network Constraints in Large-Scale Network Emulation2022 IEEE 24th Int Conf on High Performance Computing & Communications; 8th Int Conf on Data Science & Systems; 20th Int Conf on Smart City; 8th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys)10.1109/HPCC-DSS-SmartCity-DependSys57074.2022.00069(285-294)Online publication date: Dec-2022
https://doi.org/10.1109/HPCC-DSS-SmartCity-DependSys57074.2022.00069
Show More Cited By

Index Terms

VMTorrent: scalable P2P virtual machine streaming
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

VMtorrent: virtual appliances on-demand
SIGCOMM '10

Virtual Appliances (VAs) are Virtual Machines (VMs) geared towards a specific set of tasks. They require little or no configuration, working out-of-the-box. VAs fit neatly into the Cloud Computing paradigm - many copies of an identical machine can be ...
VMtorrent: virtual appliances on-demand
SIGCOMM '10: Proceedings of the ACM SIGCOMM 2010 conference

Virtual Appliances (VAs) are Virtual Machines (VMs) geared towards a specific set of tasks. They require little or no configuration, working out-of-the-box. VAs fit neatly into the Cloud Computing paradigm - many copies of an identical machine can be ...
SmartNIC-Enabled Live Migration for Storage-Optimized VMs
APSys '24: Proceedings of the 15th ACM SIGOPS Asia-Pacific Workshop on Systems

Cloud providers offer storage-optimized VMs equipped with locally attached storage to meet the high performance requirements of cloud users. However, current cloud providers cannot enable live migration for storage-optimized VMs due to the high resource ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '12: Proceedings of the 8th international conference on Emerging networking experiments and technologies

December 2012

384 pages

ISBN:9781450317757

DOI:10.1145/2413176

General Chairs:
Chadi Barakat
INRIA, Sophia Antipolis, France
,
Renata Teixeira
UPMC Sorbonne Universités and CNRS, Paris, France
,
Program Chairs:
K. K. Ramakrishnan
AT&T Labs Research, Florham Park, NJ, USA
,
Patrick Thiran
EPFL, Lausanne, Swizerland

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 December 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CoNEXT '12

Sponsor:

SIGCOMM

CoNEXT '12: Conference on emerging Networking Experiments and Technologies

December 10 - 13, 2012

Nice, France

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
366
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen XGu CGao XShen YSun ZHuang H(2024)Virtual Machine Placement for Minimizing Image Retrieval Cost and Communication Cost in Cloud Data CenterIEEE Transactions on Network and Service Management10.1109/TNSM.2024.335114821:2(1998-2011)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2024.3351148
Fei HZhang YWang WLi YXu HZhu HHao ZLi D(2022)Fast Provisioning of Virtual Machine Based on Intelligent Virtual Machine Image Prefetching2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta)10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120(778-787)Online publication date: Dec-2022
https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120
Fei HWang WChen YDing ZZhu HLiu YHao ZYu C(2022)A Cache-Aware Virtual Machine Placement With Network Constraints in Large-Scale Network Emulation2022 IEEE 24th Int Conf on High Performance Computing & Communications; 8th Int Conf on Data Science & Systems; 20th Int Conf on Smart City; 8th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys)10.1109/HPCC-DSS-SmartCity-DependSys57074.2022.00069(285-294)Online publication date: Dec-2022
https://doi.org/10.1109/HPCC-DSS-SmartCity-DependSys57074.2022.00069
潘瑭(2020)A Large-Scale Container Image Distribution Acceleration Model and its Implementation MethodComputer Science and Application10.12677/CSA.2020.101223710:12(2257-2269)Online publication date: 2020
https://doi.org/10.12677/CSA.2020.1012237
Luo SYu HLi KXing H(2020)Efficient File Dissemination in Data Center Networks With Priority-Based Adaptive MulticastIEEE Journal on Selected Areas in Communications10.1109/JSAC.2020.298661638:6(1161-1175)Online publication date: Jun-2020
https://doi.org/10.1109/JSAC.2020.2986616
Dhule CShrawankar U(2020)POF-SVLM: pareto optimized framework for seamless VM live migrationComputing10.1007/s00607-020-00815-8Online publication date: 16-May-2020
https://doi.org/10.1007/s00607-020-00815-8
Mahajan KMahajan SMisra VRubenstein D(2019)Exploiting content similarity to address cold start in container deploymentsProceedings of the 15th International Conference on emerging Networking EXperiments and Technologies10.1145/3360468.3366781(37-39)Online publication date: 9-Dec-2019
https://dl.acm.org/doi/10.1145/3360468.3366781
Li YAn BMa JCao D(2019)Comparison between Chunk-Based and Layer-Based Container Image Storage Approaches: an Empirical Study2019 IEEE International Conference on Service-Oriented System Engineering (SOSE)10.1109/SOSE.2019.00034(197-1975)Online publication date: Apr-2019
https://doi.org/10.1109/SOSE.2019.00034
Darrous JLambert TIbrahim S(2019)On the Importance of Container Image Placement for Service Provisioning in the Edge2019 28th International Conference on Computer Communication and Networks (ICCCN)10.1109/ICCCN.2019.8846920(1-9)Online publication date: Jul-2019
https://doi.org/10.1109/ICCCN.2019.8846920
Li HWang SRuan C(2019)A Fast Approach of Provisioning Virtual Machines by Using Image Content Similarity in CloudIEEE Access10.1109/ACCESS.2019.29075967(45099-45109)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2907596
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents