Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2287076.2287088acmconferencesArticle/Chapter ViewAbstractPublication PageshpdcConference Proceedingsconference-collections
research-article

A hybrid local storage transfer scheme for live migration of I/O intensive workloads

Published: 18 June 2012 Publication History

Abstract

Live migration of virtual machines (VMs) is key feature of virtualization that is extensively leveraged in IaaS cloud environments: it is the basic building block of several important features, such as load balancing, pro-active fault tolerance, power management, online maintenance, etc. While most live migration efforts concentrate on how to transfer the memory from source to destination during the migration process, comparatively little attention has been devoted to the transfer of storage. This problem is gaining increasing importance: due to performance reasons, virtual machines that run large-scale, data-intensive applications tend to rely on local storage, which poses a difficult challenge on live migration: it needs to handle storage transfer in addition to memory transfer. This paper proposes a memory migration independent approach that addresses this challenge. It relies on a hybrid active push / prioritized prefetch strategy, which makes it highly resilient to rapid changes of disk state exhibited by I/O intensive workloads. At the same time, it is minimally intrusive in order to ensure a maximum of portability with a wide range of hypervisors. Large scale experiments that involve multiple simultaneous migrations of both synthetic benchmarks and a real scientific application show improvements of up to 10x faster migration time, 10x less bandwidth consumption and 8x less performance degradation over state-of-art.

References

[1]
File System in UserspacE (FUSE). http://fuse.sourceforge.net.
[2]
IOR. http://sourceforge.net/projects/ior-sio/.
[3]
QEMU/KVM. http://www.linux-kvm.org.
[4]
S. Al-Kiswany, D. Subhraveti, P. Sarkar, and M. Ripeanu. Vmflock: virtual machine co-migration for the cloud. In HPDC '11: Proceedings of the 20th International Symposium on High Performance Distributed Computing, pages 159--170, San Jose, USA, 2011.
[5]
Amazon Elastic Compute Cloud (EC2). http://aws.amazon.com/ec2/.
[6]
Amazon Simple Storage Service (S3). http://aws.amazon.com/s3/.
[7]
M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. A view of cloud computing. Commun. ACM, 53:50--58, April 2010.
[8]
R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In VEE '07: Proceedings of the 3rd International Conference on Virtual Execution Environments, pages 169--179, San Diego, USA, 2007.
[9]
G. H. Bryan and R. Rotunno. The maximum intensity of tropical cyclones in axisymmetric numerical model simulations. Journal of the American Meteorological Society, 137:1770--1789, 2009.
[10]
P. H. Carns, W. B. Ligon, R. B. Ross, and R. Thakur. PVFS: A parallel file system for Linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317--327, Atlanta, USA, 2000.
[11]
C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In NSDI'05: Proceedings of the 2nd Symposium on Networked Systems Design & Implementation, pages 273--286, Boston, USA, 2005.
[12]
M. Gagné. Cooking with Linux--still searching for the ultimate Linux distro? Linux J., 2007(161):9, 2007.
[13]
J. G. Hansen and E. Jul. Scalable virtual machine storage using local disks. SIGOPS Oper. Syst. Rev., 44:71--79, December 2010.
[14]
K. Haselhorst, M. Schmidt, R. Schwarzkopf, N. Fallenbeck, and B. Freisleben. Efficient storage synchronization for live migration in cloud infrastructures. In PDP '11: Proceedings of the 19th Euromicro International Conference on Parallel, Distributed and Network-based Processing, pages 511--518, Ayia Napa, Cyprus, 2011.
[15]
M. R. Hines, U. Deshpande, and K. Gopalan. Post-copy live migration of virtual machines. SIGOPS Oper. Syst. Rev., 43:14--26, July 2009.
[16]
K. Z. Ibrahim, S. Hofmeyr, C. Iancu, and E. Roman. Optimized pre-copy live migration for memory intensive applications. In SC '11: 24th International Conference for High Performance Computing, Networking, Storage and Analysis, pages 40:1--40:11, Seattle, USA, 2011.
[17]
H. A. Lagar-Cavilla, J. A. Whitney, R. Bryant, P. Patchin, M. Brudno, E. de Lara, S. M. Rumble, M. Satyanarayanan, and A. Scannell. Snowflock: Virtual machine cloning as a first-class cloud primitive. ACM Trans. Comput. Syst., 29:2:1--2:45, February 2011.
[18]
H. Liu, H. Jin, X. Liao, L. Hu, and C. Yu. Live migration of virtual machine based on full system trace and replay. In HPDC '09: Proceedings the 18th ACM international symposium on High Performance Distributed Computing, pages 101--110, Garching, Germany, 2009.
[19]
A. Mashtizadeh, E. Celebi, T. Garfinkel, and M. Cai. The design and evolution of live storage migration in VMware ESX. In USENIX ATC '11: Proceedings of the 2011 USENIX Annual Technical Conference, pages 1--14, Portland, USA, 2011.
[20]
A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for hpc with xen virtualization. In ICS '07: Proceedings of the 21st Annual International Conference on Supercomputing, pages 23--32, Seattle, USA, 2007.
[21]
R. Nathuji and K. Schwan. Virtualpower: Coordinated power management in virtualized enterprise systems. In SOSP '07: Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles, pages 265--278, Stevenson, USA, 2007.
[22]
M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In ATEC '05: Proceedings of the 2005 USENIX Annual Technical Conference, pages 1--25, Anaheim, USA, 2005.
[23]
B. Nicolae. BlobSeer: Towards Efficient Data Storage Management for Large-Scale, Distributed Systems. PhD thesis, University of Rennes 1, November 2010.
[24]
B. Nicolae. On the benefits of transparent compression for cost-effective cloud data storage. Transactions on Large-Scale Data- and Knowledge-Centered Systems, 3:167--184, 2011.
[25]
B. Nicolae, G. Antoniu, L. Bougé, D. Moise, and A. Carpen-Amarie. Blobseer: Next-generation data management for large scale infrastructures. J. Parallel Distrib. Comput., 71:169--184, 2011.
[26]
B. Nicolae, J. Bresnahan, K. Keahey, and G. Antoniu. Going back and forth: Efficient multideployment and multisnapshotting on clouds. In HPDC '11: 20th International ACM Symposium on High-Performance Parallel and Distributed Computing, pages 147--158, San José, USA, 2011.
[27]
B. Nicolae and F. Cappello. BlobCR: Efficient checkpoint-restart for HPC applications on IaaS clouds using virtual disk image snapshots. In SC '11: 24th International Conference for High Performance Computing, Networking, Storage and Analysis, pages 34:1--34:12, Seattle, USA, 2011.
[28]
E. Park, B. Egger, and J. Lee. Fast and space-efficient virtual machine checkpointing. In VEE '11: Proceedings of the 7th International Conference on Virtual Execution Environments, pages 75--86, Newport Beach, USA, 2011.
[29]
P. Svard, B. Hudzia, J. Tordsson, and E. Elmroth. Evaluation of delta compression techniques for efficient live migration of large virtual machines. In VEE '11: Proceedings of the 7th International Conference on Virtual Execution Environments, pages 111--120, Newport Beach, USA, 2011.
[30]
C. Tang. Fvd: a high-performance virtual machine image format for cloud. In ATEC '11: Proc. of the 2011 USENIX Annual Technical Conference, pages 1--18, Portland, USA, 2011.
[31]
W. Voorsluys, J. Broberg, S. Venugopal, and R. Buyya. Cost of virtual machine live migration in clouds: A performance evaluation. In CloudCom '09: Proceedings of the 1st International Conference on Cloud Computing, pages 254--265, Beijing, China, 2009.

Cited By

View all
  • (2022)Radio: Reconciling Disk I/O Interference in a Para-virtualized Cloud2022 IEEE 15th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD55607.2022.00034(144-156)Online publication date: Jul-2022
  • (2021)Extending Intel PML for hardware-assisted working set size estimation of VMsProceedings of the 17th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3453933.3454018(111-124)Online publication date: 7-Apr-2021
  • (2018)SnapMig: Accelerating VM Live Storage Migration by Leveraging the Existing VM Snapshots in the CloudIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2018.279038929:6(1416-1427)Online publication date: 1-Jun-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HPDC '12: Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
June 2012
308 pages
ISBN:9781450308052
DOI:10.1145/2287076
  • General Chair:
  • Dick Epema,
  • Program Chairs:
  • Thilo Kielmann,
  • Matei Ripeanu
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. block migration
  2. data-intensive applications
  3. i/o intensive workloads
  4. iaas cloud computing
  5. live migration
  6. local storage transfer

Qualifiers

  • Research-article

Conference

HPDC'12
Sponsor:

Acceptance Rates

HPDC '12 Paper Acceptance Rate 23 of 143 submissions, 16%;
Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)0
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Radio: Reconciling Disk I/O Interference in a Para-virtualized Cloud2022 IEEE 15th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD55607.2022.00034(144-156)Online publication date: Jul-2022
  • (2021)Extending Intel PML for hardware-assisted working set size estimation of VMsProceedings of the 17th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3453933.3454018(111-124)Online publication date: 7-Apr-2021
  • (2018)SnapMig: Accelerating VM Live Storage Migration by Leveraging the Existing VM Snapshots in the CloudIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2018.279038929:6(1416-1427)Online publication date: 1-Jun-2018
  • (2018)A Survey on Virtual Machine Migration: Challenges, Techniques, and Open IssuesIEEE Communications Surveys & Tutorials10.1109/COMST.2018.279488120:2(1206-1243)Online publication date: Oct-2019
  • (2018)Local Storage-Based Consolidation With Resource Demand Prediction and Live Migration in CloudsIEEE Access10.1109/ACCESS.2018.28253546(26854-26865)Online publication date: 2018
  • (2018)Consolidation in Cloud Environment Using Optimization TechniquesCloud Computing for Optimization: Foundations, Applications, and Challenges10.1007/978-3-319-73676-1_6(123-151)Online publication date: 27-Feb-2018
  • (2017)Live migration of virtual machines with their local persistent storage in a data intensive cloudInternational Journal of High Performance Computing and Networking10.5555/3070823.307083710:1-2(134-147)Online publication date: 1-Jan-2017
  • (2017)ADE: An ensemble approach for early Anomaly Detection2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM)10.23919/INM.2017.7987310(442-448)Online publication date: May-2017
  • (2017)SupercloudACM Transactions on Computer Systems10.1145/313203835:2(1-33)Online publication date: 4-Oct-2017
  • (2016)Follow the Sun through the CloudsProceedings of the Seventh ACM Symposium on Cloud Computing10.1145/2987550.2987561(141-154)Online publication date: 5-Oct-2016
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media