Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1109/CCGRID.2017.128acmconferencesArticle/Chapter ViewAbstractPublication PagesccgridConference Proceedingsconference-collections
tutorial

Automatic Consolidation of Virtual Machines in On-Premises Cloud Platforms

Published: 14 May 2017 Publication History

Abstract

After a sequence of creation and destruction of virtual machines (VMs) in an on-premises Cloud computing platform, the scheduling decisions to host the VMs are far from being optimal and the fragmentation of the physical resources may impede the platform to host some VMs despite the free available virtualization resources. This paper describes a Virtual Machine Consolidation Agent that addresses this problem by analyzing the distribution of the VMs in the virtualization platform to migrate some of them among hosts, in order to defragment the physical resources and to enhance the efficiency on their usage. The agent has been validated in a production platform, where it is capable of minimizing the number of servers needed to host the VMs. The algorithms achieve near-optimal values at a very reduced computational cost, thus making it suitable for production platforms.

References

[1]
Yasuhiro Ajiro and Atsuhiro Tanaka. Improving packing algorithms for server consolidation. In Int. CMG Conference, pages 399--406. Computer Measurement Group, 2007.
[2]
Anton Beloglazov, Jemal Abawajy, and Rajkumar Buyya. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener. Comput. Syst., 28(5):755--768, May 2012.
[3]
Anton Beloglazov and Rajkumar Buyya. Energy efficient resource management in virtualized cloud data centers. In Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGRID'10, pages 826--831, Washington, DC, USA, 2010. IEEE Computer Society.
[4]
Josep Ll. Berral, Íñigo Goiri, Ramón Nou, Ferran Julià, Jordi Guitart, Ricard Gavaldà, and Jordi Torres. Towards energy-aware scheduling in data centers using machine learning. In Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking, e-Energy '10, pages 215--224, New York, NY, USA, 2010. ACM.
[5]
Alberto Caprara and Paolo Toth. Lower bounds and algorithms for the 2-dimensional vector packing problem. Discrete Applied Mathematics, 111(3):231 - 262, 2001.
[6]
C. Chu and R. La. Variable-sized bin packing: Tight absolute worst-case performance ratios for four approximation algorithms. SIAM Journal on Computing, 30(6):2069--2083, 2001.
[7]
T. Cioara, I. Anghel, I. Salomie, G. Copil, D. Moldovan, and A. Kipp. Energy aware dynamic resource consolidation algorithm for virtualized service centers based on reinforcement learning. In Parallel and Distributed Computing (ISPDC), 2011 10th International Symposium on, pages 163--169, 2011.
[8]
Carlos de Alfonso, Miguel Caballer, Fernando Alvarruiz, and Vicente Hernndez. An energy management system for cluster infrastructures. Computers & Electrical Engineering, (0):-, 2013.
[9]
E. Falkenauer and A. Delchambre. A genetic algorithm for bin packing and line balancing. In Robotics and Automation, 1992. Proceedings., 1992 IEEE International Conference on, pages 1186--1192 vol.2, May 1992.
[10]
F. Farahnakian, P. Liljeberg, and J. Plosila. Energy-efficient virtual machines consolidation in cloud data centers using reinforcement learning. In Parallel, Distributed and Network-Based Processing (PDP), 2014 22nd Euromicro International Conference on, pages 500--507, Feb 2014.
[11]
E. Feller, C. Morin, and A. Esnault. A case for fully decentralized dynamic vm consolidation in clouds. In Cloud Computing Technology and Science (CloudCom), 2012 IEEE 4th International Conference on, pages 26--33, 2012.
[12]
E. Feller, L. Rilling, and C. Morin. Energy-aware ant colony based workload placement in clouds. In Grid Computing (GRID), 2011 12th IEEE/ACM International Conference on, pages 26--33, 2011.
[13]
W. Forrest. How to cut data centre carbon emissions?, Diciembre 2008.
[14]
Lakshmi Ganesh. Data Center Energy Management. PhD thesis, Faculty of the Graduate School of Cornell University, 2012.
[15]
S.M. Ghafari, M. Fazeli, A. Patooghy, and L. Rikhtechi. Beemmt: A load balancing method for power consumption management in cloud computing. In Contemporary Computing (IC3), 2013 Sixth International Conference on, pages 76--80, Aug 2013.
[16]
Fabien Hermenier, Xavier Lorca, Jean-Marc Menaud, Gilles Muller, and Julia Lawall. Entropy: A consolidation manager for clusters. In Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE'09, pages 41--50, New York, NY, USA, 2009. ACM.
[17]
Chris Hyser, Bret McKee, Rob Gardner, and Brian J. Watson. Autonomic virtual machine placement in the data center. Technical Report HPL-2007-189, HP Laboratories, February 2008.
[18]
Jangha Kang and Sungsoo Park. Algorithms for the variable sized bin packing problem. European Journal of Operational Research, 147(2):365 - 372, 2003. Fuzzy Sets in Scheduling and Planning.
[19]
G. Keller, M. Tighe, H. Lutfiyya, and M. Bauer. An analysis of first fit heuristics for the virtual machine relocation problem. In Network and service management (cnsm), 2012 8th international conference and 2012 workshop on systems virtualiztion management (svm), pages 406--413, Oct 2012.
[20]
Xueping Li, Zhao Zhaoxia, and Zhang Kaike. A genetic algorithm for the three-dimensional bin packing problem with heterogeneous bins. In Y. Guan and H. Liao, editors, Proceedings of the 2014 Industrial and Systems Engineering Research Conference, 2014.
[21]
S.S. Masoumzadeh and H. Hlavacs. Integrating vm selection criteria in distributed dynamic vm consolidation using fuzzy q-learning. In Network and Service Management (CNSM), 2013 9th International Conference on, pages 332--338, Oct 2013.
[22]
Peter Mell and Tim Grance. The NIST Definition of Cloud Computing. NIST Special Publication 800-145 (Final). Technical report, 2011.
[23]
Cristina Bianca Pop, Ionut Anghel, Tudor Cioara, Ioan Salomie, and Iulia Vartic. A swarm-inspired data center consolidation methodology. In Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics, WIMS'12, pages 41:1--41:7, New York, NY, USA, 2012. ACM.
[24]
M.M. Rafique, N. Ravi, S. Cadambi, A.R. Butt, and S. Chakradhar. Power management for heterogeneous clusters: An experimental study. In Green Computing Conference and Workshops (IGCC), 2011 International, pages 1--8, 2011.
[25]
Lei Shi, J. Furlong, and Runxin Wang. Empirical evaluation of vector bin packing algorithms for energy efficient data centers. In Computers and Communications (ISCC), 2013 IEEE Symposium on, pages 000009--000015, July 2013.
[26]
A. Strunk. Costs of virtual machine live migration: A survey. In Services (SERVICES), 2012 IEEE Eighth World Congress on, pages 323--329, June 2012.
[27]
GiorgioLuigi Valentini, Walter Lassonde, SameeUllah Khan, Nasro Min-Allah, SajjadA. Madani, Juan Li, Limin Zhang, Lizhe Wang, Nasir Ghani, Joanna Kolodziej, Hongxiang Li, AlbertY. Zomaya, Cheng-Zhong Xu, Pavan Balaji, Abhinav Vishnu, Fredric Pinel, JohnatanE. Pecero, Dzmitry Kliazovich, and Pascal Bouvry. An overview of energy efficiency techniques in cluster computing systems. Cluster Computing, 16(1):3--15, 2013.
[28]
Akshat Verma, Puneet Ahuja, and Anindya Neogi. pmapper: power and migration cost aware application placement in virtualized systems. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware, Middleware'08, pages 243--264, New York, NY, USA, 2008. Springer-Verlag New York, Inc.
[29]
Yongqiang Wu, Maolin Tang, and W. Fraser. A simulated annealing algorithm for energy efficient virtual machine placement. In Systems, Man, and Cybernetics (SMC), 2012 IEEE International Conference on, pages 1245--1250, Oct 2012.
[30]
Gerhard Wscher, Heike Hauner, and Holger Schumann. An improved typology of cutting and packing problems. European Journal of Operational Research, 183(3):1109--1130, 2007.
[31]
Minyi Yue. A simple proof of the inequality ffd (l) 11/9 opt (l) + 1, l for the ffd bin-packing algorithm. Acta Mathematicae Applicatae Sinica, 7(4):321--331, 1991.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CCGrid '17: Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
May 2017
1167 pages
ISBN:9781509066100

Sponsors

Publisher

IEEE Press

Publication History

Published: 14 May 2017

Check for updates

Author Tags

  1. Cloud Computing
  2. Facilitate power management
  3. Server consolidation
  4. Virtual Machine Migration

Qualifiers

  • Tutorial
  • Research
  • Refereed limited

Conference

CCGrid '17
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media