research-article

Gang migration of virtual machines using cluster-wide deduplication

Authors:

Umesh Deshpande,

Brandon Schlinker,

Kartik GopalanAuthors Info & Claims

CCGRID '13: Proceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

Pages 394 - 401

https://doi.org/10.1109/CCGrid.2013.39

Published: 13 May 2013 Publication History

Abstract

Gang migration refers to the simultaneous live migration of multiple Virtual Machines (VMs) from one set of physical machines to another in response to events such as load spikes and imminent failures. Gang migration generates a large volume of network traffic and can overload the core network links and switches in a datacenter. In this paper, we present an approach to reduce the network overhead of gang migration using global deduplication (GMGD). GMGD identifies and eliminates the retransmission of duplicate memory pages among VMs running on multiple physical machines in the cluster. We describe the design, implementation and evaluation of a GMGD prototype using QEMU/KVM VMs. Evaluations on a 30-node Gigabit Ethernet cluster having 10GigE core links shows that GMGD can reduce the network traffic on core links by up to 65% and the total migration time of VMs by up to 42% when compared to the default migration technique in QEMU/KVM. Furthermore, GMGD has a smaller adverse performance impact on network-bound applications.

References

[1]

A. Arcangeli, I. Eidus, and C. Wright. Increasing memory density by using ksm. In Proc. of Linux Symposium, July 2009.

[2]

Network Performance Benchmark. http://www.netperf.org/netperf.

[3]

E. Bugnion, S. Devine, and M. Rosenblum. Disco: Running commodity operating systems on scalable multiprocessors. In ACM Transactions on Computer Systems, October 1997.

Digital Library

[4]

F. Chabaud and A. Joux. Differential collisions in sha-0. In Proc. of Annual International Cryptology Conference, August 1998.

Digital Library

[5]

C. Clark, K. Fraser, S. Hand, J.G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of Network System Design and Implementation, May 2005.

Digital Library

[6]

Dbench. http://samba.org/ftp/tridge/dbench.

[7]

U. Deshpande, U. Kulkarni, and K. Gopalan. Inter-rack live migration of multiple virtual machines. In Proc. of Virtualization Technologies in Distributed Computing, June 2012.

Digital Library

[8]

U. Deshpande, X. Wang, and K. Gopalan. Live gang migration of virtual machines. In Proc. of High Performance Distributed Computing, June 2010.

Digital Library

[9]

10-Gigabit Ethernet. https://en.wikipedia.org/wiki/10_gigabit_ethernet.

[10]

Gigabit Ethernet. https://en.wikipedia.org/wiki/gigabit_ethernet.

[11]

D. Gupta, S. Lee, M. Vrable, S. Savage, A. C Snoeren, G. Varghese, G. M Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. In Proc. of Operating Systems Design and Implementation, December 2010.

Digital Library

[12]

OpenSSL SHA1 hash. http://www.openssl.org/docs/crypto/sha.html.

[13]

M. Hines, U. Deshpande, and K. Gopalan. Post-copy live migration of virtual machines. In SIGOPS Operating Systems Review, July 2009.

Digital Library

[14]

W. Huang, Q. Gao, J. Liu, and D. K. Panda. High performance virtual machine migration with RDMA over modern interconnects. In Proc. of IEEE International Conference on Cluster Computing, September 2007.

Digital Library

[15]

Infiniband. https://en.wikipedia.org/wiki/infiniband.

[16]

H. Jin, L. Deng, S. Wu, X. Shi, and X. Pan. Live virtual machine migration with adaptive, memory compression. In Proc. of Cluster Computing and Workshops, August 2009.

[17]

S. A. Kiswany, D. Subhraveti, P. Sarkar, and M. Ripeanu. Vmflock: Virtual machine co-migration for the cloud. In Proc. of High Performance Distributed Computing, June 2011.

Digital Library

[18]

A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: The linux virtual machine monitor. In Proc. of Linux Symposium, June 2007.

[19]

G. Milos, D.G. Murray, S. Hand, and M.A. Fetterman. Satori: Enlightened page sharing. In Proc. of USENIX Annual Technical Conference, June 2009.

Digital Library

[20]

M. Nelson, B. H Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proc. of USENIX Annual Technical Conference, April 2005.

Digital Library

[21]

A. Nocentino and P. M. Ruth. Toward dependency-aware live virtual machine migration. In Proc. of Virtualization Technologies in Distributed Computing, June 2009.

Digital Library

[22]

P. Riteau, C. Morin, and T. Priol. Shrinker: Improving live migration of virtual clusters over wans with distributed data deduplication and content-based addressing. In Proc. of EURO-PAR, September 2011.

Digital Library

[23]

C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proc. of Operating Systems Design and Implementation, December 2002.

Digital Library

[24]

Sysbench. http://sysbench.sourceforge.net/index.html.

[25]

Rack Unit. http://en.wikipedia.org/wiki/rack_unit.

[26]

C. A. Waldspurger. Memory resource management in VMware ESX server. In Proc. of Operating Systems Design and Implementation, December 2002.

Digital Library

[27]

J. Wang, K. L Wright, and K. Gopalan. XenLoop: a transparent high performance inter-vm network loopback. In Proc. of High performance distributed computing, June 2008.

Digital Library

[28]

T. Wood, K. K. Ramakrishnan, P. Shenoy, and J. Van Der Merwe. Cloudnet: dynamic pooling of cloud resources by live wan migration of virtual machines. In Proc. of Virtual Execution Environments, March 2011.

Digital Library

[29]

T. Wood, G. Tarasuk-Levin, P. Shenoy, P. Desnoyers, E. Cecchet, and M. D. Corner. Memory buddies: exploiting page sharing for smart colocation in virtualized data centers. In Proc. of Virtual Execution Environments, March 2009.

Digital Library

[30]

L. Xia and P.A. Dinda. A case for tracking and exploiting inter-node and intra-node memory content sharing in virtualized large-scale parallel systems. In Proc. of Virtualization Technologies in Distributed Computing, June 2012.

Digital Library

[31]

X. Zhang, Z. Huo, J. Ma, and D. Meng. Exploiting data deduplication to accelerate live virtual machine migration. In Proc. ofInternational Conference on Cluster Computing, September 2010.

Digital Library

Cited By

He TBuyya R(2023)A Taxonomy of Live Migration Management in Cloud ComputingACM Computing Surveys10.1145/361535356:3(1-33)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3615353
Bagdi HKugve RGopalan K(2017)HyperFreshProceedings of the 8th Asia-Pacific Workshop on Systems10.1145/3124680.3124734(1-8)Online publication date: 2-Sep-2017
https://dl.acm.org/doi/10.1145/3124680.3124734
Zhang FFu XYahyapour R(2017)CBaseProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.26(284-293)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.26
Show More Cited By

Gang migration of virtual machines using cluster-wide deduplication

Recommendations

Live gang migration of virtual machines
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing

This paper addresses the problem of simultaneously migrating a group of co-located and live virtual machines (VMs), i.e, VMs executing on the same physical machine. We refer to such a mass simultaneous migration of active VMs as "live gang migration". ...
Traffic-sensitive live migration of virtual machines
CCGRID '15: Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

In this paper we address the problem of network contention between the migration traffic and the Virtual Machine (VM) application traffic for the live migration of co-located Virtual Machines. When VMs are migrated with pre-copy, they run at the source ...
Inter-rack live migration of multiple virtual machines
VTDC '12: Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date

Within datacenters, often multiple virtual machines (VMs) need to be live migrated simultaneously for various reasons such as maintenance, power savings, and load balancing. Such mass simultaneous live migration of multiple VMs can trigger large data ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CCGRID '13: Proceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

May 2013

710 pages

ISBN:9780768549965

General Chair:
Dick Epema
Delft University of Technology and Eindhoven University of Technology, the Netherlands

Publisher

IEEE Press

Publication History

Published: 13 May 2013

Check for updates

Qualifiers

Research-article

Conference

CCGrid '13

CCGrid '13: 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

May 13 - 16, 2013

Delft, Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
9
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

He TBuyya R(2023)A Taxonomy of Live Migration Management in Cloud ComputingACM Computing Surveys10.1145/361535356:3(1-33)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3615353
Bagdi HKugve RGopalan K(2017)HyperFreshProceedings of the 8th Asia-Pacific Workshop on Systems10.1145/3124680.3124734(1-8)Online publication date: 2-Sep-2017
https://dl.acm.org/doi/10.1145/3124680.3124734
Zhang FFu XYahyapour R(2017)CBaseProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.26(284-293)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.26
Fernando DBagdi HHu YYang PGopalan KKamhoua CKwiat KJiang CRana OAntonopoulos N(2016)Quick eviction of virtual machines through proactive live snapshotsProceedings of the 9th International Conference on Utility and Cloud Computing10.1145/2996890.2996891(99-107)Online publication date: 6-Dec-2016
https://dl.acm.org/doi/10.1145/2996890.2996891
Bruno RFerreira P(2016)ALMAProceedings of the 17th International Middleware Conference10.1145/2988336.2988341(1-14)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/2988336.2988341
Hou KShin KSung JRéveillère LHarris THerlihy M(2015)Application-assisted live migration of virtual machines with Java applicationsProceedings of the Tenth European Conference on Computer Systems10.1145/2741948.2741950(1-15)Online publication date: 17-Apr-2015
https://dl.acm.org/doi/10.1145/2741948.2741950
Shen Svan Beek VIosup ABalaji PXu C(2015)Statistical characterization of business-critical workloads hosted in cloud datacentersProceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2015.60(465-474)Online publication date: 4-May-2015
https://dl.acm.org/doi/10.1109/CCGrid.2015.60
Shen SIosup AIsrael ACirne WRaz DEpema DBalaji PXu C(2015)An availability-on-demand mechanism for datacentersProceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2015.58(495-504)Online publication date: 4-May-2015
https://dl.acm.org/doi/10.1109/CCGrid.2015.58
Zheng QLi RLi XWu JBalaji PXu C(2015)A multi-objective biogeography-based optimization for virtual machine placementProceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2015.25(687-696)Online publication date: 4-May-2015
https://dl.acm.org/doi/10.1109/CCGrid.2015.25
Deshpande UKeahey KBalaji PXu C(2015)Traffic-sensitive live migration of virtual machinesProceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2015.163(51-60)Online publication date: 4-May-2015
https://dl.acm.org/doi/10.1109/CCGrid.2015.163

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents