research-article

Scalable virtual machine deployment using VM image caches

Authors:

Thilo KielmannAuthors Info & Claims

SC '13: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

Article No.: 65, Pages 1 - 12

https://doi.org/10.1145/2503210.2503274

Published: 17 November 2013 Publication History

Abstract

In IaaS clouds, VM startup times are frequently perceived as slow, negatively impacting both dynamic scaling of web applications and the startup of high-performance computing applications consisting of many VM nodes. A significant part of the startup time is due to the large transfers of VM image content from a storage node to the actual compute nodes, even when copy-on-write schemes are used. We have observed that only a tiny part of the VM image is needed for the VM to be able to start up. Based on this observation, we propose using small caches for VM images to overcome the VM startup bottlenecks. We have implemented such caches as an extension to KVM/QEMU. Our evaluation with up to 64 VMs shows that using our caches reduces the time needed for simultaneous VM startups to the one of a single VM.

References

[1]

D. Arteaga, M. Zhao, P. V. Riezen, and L. Zwart. Dynamic Block-level Cache Management for Cloud Computing Systems. Poster, 10th USENIX conference on File and Storage Technologies, FAST'12, 2012.

[2]

V. Chadha and R. J. Figueiredo. ROW-FS: a user-level virtualized redirect-on-write distributed file system for wide area applications. In Proceedings of the 14th international conference on High performance computing, HiPC '07, pages 21--34, 2007.

Digital Library

[3]

R. Chandra, N. Zeldovich, C. Sapuntzakis, and M. S. Lam. The collective: a cache-based system management architecture. In Proceedings of the 2nd Symposium on Networked Systems Design & Implementation - Volume 2, NSDI '05, pages 259--272, 2005.

Digital Library

[4]

Z. Chen, Y. Zhao, X. Miao, Y. Chen, and Q. Wang. Rapid Provisioning of Cloud Infrastructure Leveraging Peer-to-Peer Networks. In Proceedings of the 2009 29th IEEE International Conference on Distributed Computing Systems Workshops, ICDCSW '09, pages 324--329, 2009.

Digital Library

[5]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd Symposium on Networked Systems Design & Implementation - Volume 2, NSDI '05, pages 273--286, 2005.

Digital Library

[6]

DAS-4 clusters. http://www.cs.vu.nl/das4/clusters.shtml. {Online; accessed 22-April-2013}.

[7]

L. Garces-Erice and S. Rooney. Scaling OS Streaming through Minimizing Cache Redundancy. In 31st International Conference on Distributed Computing Systems Workshops (ICDCSW), pages 47--53, 2011.

Digital Library

[8]

M. R. Hines and K. Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, VEE '09, pages 51--60, 2009.

Digital Library

[9]

M. Kozuch and M. Satyanarayanan. Internet Suspend/Resume. In Proceedings of the Fourth IEEE Workshop on Mobile Computing Systems and Applications, WMCSA '02, 2002.

Digital Library

[10]

H. A. Lagar-Cavilla, J. A. Whitney, A. M. Scannell, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. SnowFlock: rapid virtual machine cloning for cloud computing. In Proceedings of the 4th ACM European conference on Computer systems, EuroSys '09, pages 1--12, 2009.

Digital Library

[11]

M. McLoughlin. The QCOW2 Image Format. http://people.gnome.org/~markmc/qcow-image-format.html, 2008. {Online; accessed 16-April-2013}.

[12]

D. Milojičić I. Llorente, and R. S. Montero. OpenNebula: A Cloud Management Tool. IEEE Internet Computing, 15(2):11--14, 2011.

Digital Library

[13]

C. B. Morrey and D. Grunwald. Content-Based Block Caching. In 23rd IEEE, 14th NASA Goddard Conference on Mass Storage Systems and Technologies, MSST '06, 2006.

[14]

C.-H. Ng, M. Ma, T.-Y. Wong, P. P. C. Lee, and J. C. S. Lui. Live Deduplication Storage of Virtual Machine Images in an Open-Source Cloud. In Proc. Middleware 2011, number 7049 in LNCS, pages 81--100, 2011.

Digital Library

[15]

B. Nicolae, J. Bresnahan, K. Keahey, and G. Antoniu. Going Back and Forth: Efficient Multideployment and Multisnapshotting on Clouds. In Proceedings of the 20th International Symposium on High Performance Distributed Computing (HPDC '11), pages 147--158, 2011.

Digital Library

[16]

B. Nicolae, F. Cappello, and G. Antoniu. Optimizing multi-deployment on clouds by means of self-adaptive prefetching. In Proceedings of the 17th international conference on Parallel processing - Volume Part I, Euro-Par '11, pages 503--513, 2011.

Digital Library

[17]

Nimbus Project. LANTorrent. http://www.nimbusproject.org/docs/current/admin/reference.html#lantorrent, 2010. {Online; accessed 4-August-2013}.

[18]

C. M. O'Donnell. Using BitTorrent to distribute virtual machine images for classes. In Proceedings of the 36th annual ACM SIGUCCS fall conference: moving mountains, blazing trails, SIGUCCS '08, pages 287--290, 2008.

Digital Library

[19]

A.-M. Oprescu and T. Kielmann. Bag-of-Tasks Scheduling under Budget Constraints. In 2010 IEEE Second International Conference on Cloud Computing Technology and Science, CloudCom '10, pages 351--359, 2010.

Digital Library

[20]

S. Osman, D. Subhraveti, G. Su, and J. Nieh. The design and implementation of Zap: a system for migrating computing environments. SIGOPS Operating Systems Review, 36(SI):361--376, 2002.

Digital Library

[21]

R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. In Proceedings of the fifteenth ACM Symposium on Operating Systems Principles, SOSP '95, pages 79--95, 1995.

Digital Library

[22]

C. Peng, M. Kim, Z. Zhang, and H. Lei. VDN: Virtual machine image distribution network for cloud data centers. In 29th Conference on Computer Communications, INFOCOM '10, pages 181--189, 2012.

[23]

G. Pierre and C. Stratan. ConPaaS: a Platform for Hosting Elastic Cloud Applications. IEEE Internet Computing, 16(5):88--92, 2012.

Digital Library

[24]

J. Reich, O. Laadan, E. Brosh, A. Sherman, V. Misra, J. Nieh, and D. Rubenstein. VMTorrent: scalable P2P virtual machine streaming. In Proceedings of the 8th international conference on Emerging networking experiments and technologies, CoNEXT '12, pages 289--300, 2012.

Digital Library

[25]

M. Schmidt, N. Fallenbeck, M. Smith, and B. Freisleben. Efficient Distribution of Virtual Machines for Cloud Computing. In 18th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), PDP '10, pages 567--574, 2010.

Digital Library

[26]

C. Tang. FVD: a high-performance virtual machine image format for cloud. In Proceedings of the 2011 USENIX conference on USENIX annual technical conference, USENIXATC '11, pages 18--18, 2011.

Digital Library

[27]

R. Wartel, T. Cass, B. Moreira, E. Roche, M. Guijarro, S. Goasguen, and U. Schwickerath. Image Distribution Mechanisms in Large Scale Cloud Providers. In 2010 IEEE Second International Conference on Cloud Computing Technology and Science, CloudCom '10, pages 112--117, 2010.

Digital Library

[28]

M. Zhao, J. Zhang, and R. Figueiredo. Distributed File System Support for Virtual Machines in Grid Computing. In Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing, HPDC '04, pages 202--211, 2004.

Digital Library

Cited By

Kwon SNo JPark S(2023)Rio_DSA: Redirecting I/O Scheme for Dynamic Storage Allocation on Docker ContainerUbiquitous Networking10.1007/978-3-031-29419-8_9(113-125)Online publication date: 2-Apr-2023
https://doi.org/10.1007/978-3-031-29419-8_9
Fei HZhang YWang WLi YXu HZhu HHao ZLi D(2022)Fast Provisioning of Virtual Machine Based on Intelligent Virtual Machine Image Prefetching2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta)10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120(778-787)Online publication date: Dec-2022
https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120
Zhang YNiu KWu WLi KZhou Y(2021)Speeding Up VM Startup by Cooperative VM Image CachingIEEE Transactions on Cloud Computing10.1109/TCC.2018.27915099:1(360-371)Online publication date: 1-Jan-2021
https://doi.org/10.1109/TCC.2018.2791509
Show More Cited By

Index Terms

Scalable virtual machine deployment using VM image caches
1. General and reference
  1. Cross-computing tools and techniques
    1. Design
2. Information systems
  1. Information storage systems
    1. Storage management
      1. Hierarchical storage management

Recommendations

Migration of Multi-tier Applications to Infrastructure-as-a-Service Clouds: An Investigation Using Kernel-Based Virtual Machines
GRID '11: Proceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing

To investigate challenges of multi-tier application migration to Infrastructure-as-a-Service (IaaS) clouds we performed an experimental investigation by deploying a processor bound and input-output bound variant of the RUSLE2 erosion model to an IaaS ...
Scaling Non-elastic Applications Using Virtual Machines
CLOUD '11: Proceedings of the 2011 IEEE 4th International Conference on Cloud Computing

Hardware virtualization is a cost effective mean to reduce the number of physical machines (PMs) required to handle computational tasks. Virtualization also guarantees high levels of isolation (performance and security wise) between virtual machines ...
Scalable virtual machine multiplexing

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '13: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

November 2013

1123 pages

ISBN:9781450323789

DOI:10.1145/2503210

General Chair:
William Gropp
University of Illinois at Urbana-Champaign, Urbana, Illinois
,
Program Chair:
Satoshi Matsuoka
Tokyo Institute of Technology, Tokyo, Japan

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

SC13

Sponsor:

SIGHPC
SIGARCH
IEEE-CS

SC13: International Conference for High Performance Computing, Networking, Storage and Analysis

November 17 - 21, 2013

Colorado, Denver

Acceptance Rates

SC '13 Paper Acceptance Rate 91 of 449 submissions, 20%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
413
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kwon SNo JPark S(2023)Rio_DSA: Redirecting I/O Scheme for Dynamic Storage Allocation on Docker ContainerUbiquitous Networking10.1007/978-3-031-29419-8_9(113-125)Online publication date: 2-Apr-2023
https://doi.org/10.1007/978-3-031-29419-8_9
Fei HZhang YWang WLi YXu HZhu HHao ZLi D(2022)Fast Provisioning of Virtual Machine Based on Intelligent Virtual Machine Image Prefetching2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta)10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120(778-787)Online publication date: Dec-2022
https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00120
Zhang YNiu KWu WLi KZhou Y(2021)Speeding Up VM Startup by Cooperative VM Image CachingIEEE Transactions on Cloud Computing10.1109/TCC.2018.27915099:1(360-371)Online publication date: 1-Jan-2021
https://doi.org/10.1109/TCC.2018.2791509
Hao JJiang TWang WKim I(2021)An Empirical Analysis of VM Startup Times in Public IaaS Clouds2021 IEEE 14th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD53861.2021.00053(398-403)Online publication date: Sep-2021
https://doi.org/10.1109/CLOUD53861.2021.00053
No JPark S(2021)vRAS: An Efficient Virtualized Resource Allocation SchemeSmart Computing and Communication10.1007/978-3-030-74717-6_9(79-86)Online publication date: 17-Apr-2021
https://doi.org/10.1007/978-3-030-74717-6_9
Liu HHe BLiao XJin H(2019)Towards Declarative and Data-Centric Virtual Machine Image Management in IaaS CloudsIEEE Transactions on Cloud Computing10.1109/TCC.2017.27280667:4(1124-1138)Online publication date: 1-Oct-2019
https://doi.org/10.1109/TCC.2017.2728066
Saurabh NRemmers JKimovski DProdan RBarbosa J(2019)Semantics-Aware Virtual Machine Image Management in IaaS Clouds2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS.2019.00052(418-427)Online publication date: May-2019
https://doi.org/10.1109/IPDPS.2019.00052
No JPark S(2019)Multi-layered I/O Virtualization Cache on KVM/QEMU2019 Eleventh International Conference on Ubiquitous and Future Networks (ICUFN)10.1109/ICUFN.2019.8806166(695-699)Online publication date: Jul-2019
https://doi.org/10.1109/ICUFN.2019.8806166
Li HWang SRuan C(2019)A Fast Approach of Provisioning Virtual Machines by Using Image Content Similarity in CloudIEEE Access10.1109/ACCESS.2019.29075967(45099-45109)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2907596
Shi XLiao XZheng DJin HLiu H(2019)VMBKSThe Journal of Supercomputing10.1007/s11227-015-1554-175:1(4-19)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s11227-015-1554-1
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten