research-article

Server-storage virtualization: integration and load balancing in data centers

Authors:

Madhukar Korupolu,

Dushmanta MohapatraAuthors Info & Claims

SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing

Article No.: 53, Pages 1 - 12

Published: 15 November 2008 Publication History

Abstract

We describe the design of an agile data center with integrated server and storage virtualization technologies. Such data centers form a key building block for new cloud computing architectures. We also show how to leverage this integrated agility for non-disruptive load balancing in data centers across multiple resource layers - servers, switches, and storage. We propose a novel load balancing algorithm called VectorDot for handling the hierarchical and multi-dimensional resource constraints in such systems. The algorithm, inspired by the successful Toyoda method for multi-dimensional knapsacks, is the first of its kind.

We evaluate our system on a range of synthetic and real data center testbeds comprising of VMware ESX servers, IBM SAN Volume Controller, Cisco and Brocade switches. Experiments under varied conditions demonstrate the end-to-end validity of our system and the ability of VectorDot to efficiently remove overloads on server, switch and storage nodes.

References

[1]

VMware, http://www.vmware.com/.

[2]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization," in Proceedings of Symp. on Operating Systems Principles (SOSP), 2003.

Digital Library

[3]

M. Nelson, B. Lim, and G. Hutchins, "Fast transparent migration for virtual machines," in USENIX Annual Technical Conference, 2005.

Digital Library

[4]

C. Clark, K. Fraser, S. Hand, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live migration of virtual machines," in NSDI, 2005.

Digital Library

[5]

"IBM Storage Virtualization: Value to you," IBM Whitepaper, May 2006.

[6]

EMC Invista, http://www.emc.com/products/software/invista/invista.jsp.

[7]

IDC, "Virtualization across the Enterprise," Nov 2006.

[8]

T. Clark, Designing Storage Area Networks. Addison-Wesley, 1999.

Digital Library

[9]

R. Goldberg, "Survey of virtual machine research," IEEE Computer, vol. 7, no. 6, pp. 34--45, June 1974.

Digital Library

[10]

Hewlett Packard Systems Insight Manager, http://h18002.www1.hp.com/products/servers/management/hpsim/index.html.

[11]

IBM TotalStorage Productivity Center, http://www-306.ibm.com/software/tivoli/products/totalstorage-data/.

[12]

DMTF Common Information Model Standards, http://www.dmtf.org/standards/cim.

[13]

Aperi Storage Management Project, http://www.eclipse.org/aperi.

[14]

VMWare Virtual Center, http://www.vmware.com/products/vi/vc/.

[15]

T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif, "Black-box and Gray-box Strategies for Virtual Machine Migration," in Proceedings of Symp. on Networked Systems Design and Implementation (NSDI), 2007.

Digital Library

[16]

VMWare Infrastructure SDK, http://www.vmware.com/support/developer/vc-sdk/.

[17]

J. Katcher, "PostMark: A New File System Benchmark," Network Appliance Technical Report TR3022, 1997.

[18]

Y. Toyoda, "A simplified algorithm for obtaining approximate solutions to zero-one programming problems," Management Science, vol. 21, no. 12, pp. 1417--1427, 1975.

Digital Library

[19]

A. Freville, "The multidimensional 0--1 knapsack problem: An overview," European Journal of Operational Research, vol. 155, no. 1, pp. 1--21, 2004.

[20]

Devin Carraway, "lookbusy - A Synthetic Load Generator," http://devin.com/lookbusy.

[21]

lometer, http://www.iometer.org.

[22]

Microsoft Virtual Server, http://www.microsoft.com/windowsserversystem/virtualserver.

[23]

"VMware Infrastructure: Resource management with VMware DRS," VMware Whitepaper, 2006.

[24]

L. Grit, D. Irwin, A. Yumerefendi, and J. Chase, "Virtual machine hosting for networked clusters: Building the foundations for "autonomic" orchestration," vol. 0, p. 7, 2006.

[25]

N. Bobroff, A. Kochut, and K. Beaty, "Dynamic Placement of Virtual Machines for Managing SLA Violations," in Proceedings of the 10th IEEE Symposium on Integrated Management (IM), 2007.

[26]

A. Brinkmann, M. Heidebuer, F. M. auf der Heide, U. Rckert, K. Salzwedel, and M. Vodisek, "V:drive - costs and benefits of an out-of-band storage virtualization system," in Proceedings of the 12th NASA Goddard, 21st IEEE Conference on Mass Storage Systems and Technologies (MSST), pp. 153--157.

[27]

C. R. Lumb, A. Merchant, and G. A. Alvarez, "Facade: Virtual storage devices with performance guarantees," in FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies, 2003.

Digital Library

[28]

L. Huang, G. Peng, and T. cker Chiueh, "Multi-dimensional storage virtualization," in SIGMETRICS '04/Performance '04: Proceedings of International Conference on Measurement and Modeling of Computer Systems, 2004.

Digital Library

[29]

E. Anderson, J. Hall, J. Hartline, M. Hobbs, A. Karlin, J. Saia, R. Swaminathan, and J. Wilkes, "An experimental study of data migration algorithms," in Proceedings of International Workshop on Algorithm Engineering, 2001, pp. 28--31.

Digital Library

[30]

C. Lu, G. Alvarez, and J. Wilkes, "Aqueduct: Online Data Migration with Performance Guarantees," in Proceedings of USENIX Conference on File and Storage Technologies, 2002.

Digital Library

[31]

M. Kallahalla, M. Uysal, R. Swaminathan, D. E. Lowell, M. Wray, T. Christian, N. Edwards, C. I. Dalton, and F. Gittler, "SoftUDC: A software based data center for utility computing," IEEE Computer, 2004.

Digital Library

[32]

A. Warfield, R. Ross, K. Fraser, C. Limpach, and S. Hand, "Parallax: managing storage for a million machines," in HOTOS '05: Proceedings of the 10th Conference on Hot Topics in Operating Systems, 2005.

Digital Library

[33]

Cisco, "Data Center Virtualization and Orchestration: Business and Financial Justification," July 2007.

[34]

S. Martello and P. Toth, Knapsack Problems: Algorithms and Computer Implementations. John Wiley, 1990.

Digital Library

[35]

"Knapsack problem: Wikipedia," http://en.wikipedia.org/wiki/Knapsack_problem.

[36]

R. A. Golding and T. M. Wong, "Walking toward moving goalpost: agile management for evolving systems," in First Workshop on Hot Topics in Autonomic Computing, 2006.

Digital Library

[37]

M. Wang, K. Au, A. Ailamaki, A. Brockwell, C. Faloutsos, and G. R. Ganger, "Storage device performance prediction with CART models," SIGMETRICS Perform. Eval. Rev., vol. 32, no. 1, pp. 412--113, 2004.

Digital Library

Cited By

(2019)Virtual cluster optimisation for MapReduce-like applicationsInternational Journal of High Performance Computing and Networking10.5555/3337625.333762813:4(378-388)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.5555/3337625.3337628
Nagendra VBhattacharya AGandhi ADas S(2019)MMLiteProceedings of the 2019 ACM Symposium on SDN Research10.1145/3314148.3314345(69-83)Online publication date: 3-Apr-2019
https://dl.acm.org/doi/10.1145/3314148.3314345
Kanniga Devi RMurugaboopathi GMuthukannan M(2018)Load monitoring and system-traffic-aware live VM migration-based load balancing in cloud data center using graph theoretic solutionsCluster Computing10.5555/3287988.328800921:3(1623-1638)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.5555/3287988.3288009
Show More Cited By

Recommendations

The Best Damn Server Virtualization Book Period: Including Vmware, Xen, and Microsoft Virtual Server
Improving machine virtualisation with 'hotplug memory'

Machine virtualisation is a key technology for server consolidation and on-demand server provisioning. To support this trend, it is essential to improve the performance of virtualisation software and enable the efficient running of many virtual ...
Server virtualization

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing

November 2008

739 pages

ISBN:9781424428359

Conference Chair:
Patricia Teller

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

IEEE Press

Publication History

Published: 15 November 2008

Check for updates

Qualifiers

Research-article

Conference

SC '08

Sponsor:

SIGARCH
IEEE-CS

SC '08: International Conference for High Performance Computing, Networking, Storage and Analysis

November 15 - 21, 2008

Texas, Austin

Acceptance Rates

SC '08 Paper Acceptance Rate 59 of 277 submissions, 21%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
3,560
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

(2019)Virtual cluster optimisation for MapReduce-like applicationsInternational Journal of High Performance Computing and Networking10.5555/3337625.333762813:4(378-388)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.5555/3337625.3337628
Nagendra VBhattacharya AGandhi ADas S(2019)MMLiteProceedings of the 2019 ACM Symposium on SDN Research10.1145/3314148.3314345(69-83)Online publication date: 3-Apr-2019
https://dl.acm.org/doi/10.1145/3314148.3314345
Kanniga Devi RMurugaboopathi GMuthukannan M(2018)Load monitoring and system-traffic-aware live VM migration-based load balancing in cloud data center using graph theoretic solutionsCluster Computing10.5555/3287988.328800921:3(1623-1638)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.5555/3287988.3288009
Huang PChang YChen TTu CChen CWei HShih WHaddad HWainwright RChbeir R(2018)Performance optimization of heterogeneous cloud storage with bandwidth & capacity considerationsProceedings of the 33rd Annual ACM Symposium on Applied Computing10.1145/3167132.3167373(210-213)Online publication date: 9-Apr-2018
https://dl.acm.org/doi/10.1145/3167132.3167373
Liu ZLi CWu WJia R(2018)A hierarchical approach for resource allocation in hybrid cloud environmentsWireless Networks10.1007/s11276-016-1416-724:5(1491-1508)Online publication date: 1-Jul-2018
https://dl.acm.org/doi/10.1007/s11276-016-1416-7
Huang JBadam ACaulfield LNath SSengupta SSharma BQureshi MKuenning GWaldspurger C(2017)FlashBloxProceedings of the 15th Usenix Conference on File and Storage Technologies10.5555/3129633.3129667(375-390)Online publication date: 27-Feb-2017
https://dl.acm.org/doi/10.5555/3129633.3129667
(2017)eduCloudInternational Journal of Communication Networks and Distributed Systems10.5555/3086592.308659918:3-4(329-352)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3086592.3086599
Bolodurina IParfenov D(2017)Development and Research of Models of Organization Distributed Cloud Computing Based on the Software-defined InfrastructureProcedia Computer Science10.1016/j.procs.2017.01.064103:C(569-576)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1016/j.procs.2017.01.064
Bruno RFerreira P(2016)ALMAProceedings of the Posters and Demos Session of the 17th International Middleware Conference10.1145/3007592.3007603(19-20)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3007592.3007603
Bruno RFerreira P(2016)ALMAProceedings of the 17th International Middleware Conference10.1145/2988336.2988341(1-14)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/2988336.2988341
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents