Abstract
We consider the problem of jointly allocating compute and network resources in a large Infrastructure-as-a-service cloud. We formulate the problem of optimally allocating resources to virtual data centers (VDCs) for four well-known management objectives: balanced load, energy efficiency, fair allocation, and service differentiation. Then, we outline an architecture for resource allocation, which centers around a set of cooperating controllers, each solving a problem related to the chosen management objective. We illustrate how a global management objective is mapped onto objectives that govern the execution of these controllers. For a key controller, the Dynamic Placement Controller, we give a detailed distributed design, which is based on a gossip protocol that can switch between management objectives. The design is applicable to a broad class of management objectives, which we characterize through a property of the objective function. The property ensures the applicability of an iterative descent method that the gossip protocol implements. We evaluate, through simulation, the dynamic placement of VDCs for a large cloud under changing load and VDC churn. Simulation results show that this controller is effective and highly scalable, up to 100’000 nodes, for the management objectives considered.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Gulati, A., Shanmuganathan, G., Holler, A., Ahmad, I.: In: Proceedings of the 3rd USENIX conference on Hot topics in cloud computing, pp. 3–3. USENIX Association, Berkeley (2011), HotCloud’11, http://dl.acm.org/citation.cfm?id=2170444.2170447
Wuhib, F., Stadler, R., Spreitzer, M.: Network and service management. IEEE Transactions on (2012)
Wuhib, F., Stadler, R., Spreitzer, M.: In international conference on network and service management (2010)
Yanggratoke, R., Wuhib, F., Stadler, R.: In International conference on network and service management (2011)
Wuhib, F., Stadler, R., Lindgren, H.: In Proceedings of the 7th international conference on network and services management CNSM ’12 (2012)
Netcraft: http://news.netcraft.com/archives/2013/01/07/ (2013)
MapReduce: http://www.mapreduce.org (2012)
Dryad: http://research.microsoft.com/en-us/projects/dryad/ (2012)
Amazon Web Services: http://aws.amazon.com/ec2/ (2012)
Popa, L., Ratnasamy, S., Iannaccone, G., Krishnamurthy, A., Stoica, I.: In Proceedings of the 6th international conference (ACM, New York, NY, USA, 2010), Co-NEXT ’10, pp. 16:1–16:12. doi:10.1145/1921168.1921189
Raiciu, C., Ionescu, M., Niculescu, D.: In Proceedings of the 4th USENIX conference on hot topics in cloud computing (USENIX Association, Berkeley, CA, USA, 2012), HotCloud’12, pp. 6–6
Verma, A., Ahuja, P., Neogi, A.: In Proceedings of the 9th ACM/IFIP/USENIX international conference on middleware Springer, New York, Inc., New York, (2008) Middleware ’08, pp. 243–264
Verma, A., Kumar, G., Koller, R.: In Proceedings of the 11th international middleware conference industrial track (ACM, New York, 2010), Middleware Industrial Track ’10, pp. 11–16
Mitzenmacher, M.: IEEE Trans. Parallel Distrib. Syst. 12(10), 1094 (2001). doi:10.1109/71.963420
Voulgaris, S., Gavidia, D., van Steen, M.: J. Netw. Syst. Manag. 13(2), 197 (2005)
Allavena, A., Demers, A., Hopcroft, J.E.: In Proceedings of the twenty-fourth annual ACM symposium on principles of distributed computing pp. 292–301, ACM, New York (2005), PODC ’05. DOI 10.1145/1073814.1073871
Montresor, A., Jelasity, M.: In Peer-to-Peer Computing, 2009. P2P ’09. IEEE ninth international conference on. pp. 99–100. doi:10.1109/P2P.2009.5284506 (2009)
Reiss, C., Tumanov, A., Ganger, G.R., Katz, R.H., Kozuch, M.A.: In ACM symposium on cloud computing (SoCC) San Jose, (2012)
Shrivastava, V., Zerfos, P., Lee, K.W., Jamjoom, H., Liu, Y.H., Banerjee, S.: In INFOCOM, 2011 Proceedings IEEE (2011), pp. 66–70. doi:10.1109/INFCOM.2011.5935247
Guo, C., Lu, G., Wang, H.J., Yang, S., Kong, C., Sun, P., Wu, W., Zhang, Y.: In Proceedings of the 6th international conference, pp. 15:1–15:12. ACM, New York (2010), Co-NEXT ’10. doi:10.1145/1921168.1921188
Ballani, H., Costa, P., Karagiannis, T., Rowstron, A.: In Proceedings of the ACM SIGCOMM 2011 conference, pp. 242–253. ACM, New York (2011), SIGCOMM ’11. doi:10.1145/2018436.2018465
Wang, M., Meng, X., Zhang, L.: In INFOCOM, 2011 Proceedings IEEE, pp. 71–75. doi:10.1109/INFCOM.2011.5935254 (2011)
Breitgand, D., Epstein, A.: In INFOCOM, 2012 Proceedings IEEE, pp. 2861–2865. doi:10.1109/INFCOM.2012.6195716 (2012)
Meng, X., Pappas, V., Zhang, L.: In INFOCOM, 2010 Proceedings IEEE, pp. 1–9. doi:10.1109/INFCOM.2010.5461930 (2010)
Lee, G., Tolia, N., Ranganathan, P., Katz, R.H.: SIGCOMM Comput. Commun. Rev. 41(1), 120 (2010). doi:10.1145/1925861.1925881
Jiang, J., Lan, T., Ha, S., Chen, M., Chiang, M.: In INFOCOM, 2012 Proceedings IEEE, pp. 2876–2880. doi:10.1109/INFCOM.2012.6195719 (2012)
Biran, O., Corradi, A., Fanelli, M., Foschini, L., Nus, A., Raz, D., Silvera, E.: In Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM international symposium on, pp. 498–506. doi:10.1109/CCGrid.2012.119 (2012)
Jayasinghe, D., Pu, C., Eilam, T., Steinder, M., Whally, I., Snible, E.: In services computing (SCC), 2011 IEEE international conference on, pp. 72–79. doi:10.1109/SCC.2011.28 (2011)
Yazir, Y., Matthews, C., Farahbod, R., Neville, S., Guitouni, A., Ganti, S., Coady, Y.: In IEEE international conference on cloud computing, pp. 91–98. doi:10.1109/CLOUD.2010.66 (2010)
Younge, A.J., von Laszewski, G., Wang, L., Lopez-Alarcon, S., Carithers, W.: In Proceedings of the international conference on green computing. IEEE, Chicago (2010). doi:10.1109/GREENCOMP.2010.5598294
Wei, G., Vasilakos, A.V., Zheng, Y., Xiong, N.J.: Supercomput. 54(2), 252 (2010). doi:10.1007/s11227-009-0318-1
Rao, J., Wei, Y., Gong, J., Xu, C.Z.: In Proceedings of the nineteenth international workshop on quality of service. IEEE Press, Piscataway (2011), IWQoS ’11, pp. 31:1–31:9
Li, J.Z., Woodside, M., Chinneck, J., Litoiu, M.: In Proceedings of the 7th international conference on network and services management (2011), CNSM ’11, pp. 162–170
Mudigonda, J., Yalagandula, P., Al-Fares, M., Mogul, J.C.: In Proceedings of the 7th USENIX conference on Networked systems design and implementation. USENIX Association, Berkeley, NSDI’10, pp. 18–18 (2010)
Raiciu, C., Barre, S., Pluntke, C., Greenhalgh, A., Wischik, D., Handley, M.: In Proceedings of the ACM SIGCOMM 2011 conference. ACM, New York (2011), SIGCOMM ’11, pp. 266–277. doi:10.1145/2018436.2018467
Mudigonda, J., Yalagandula, P., Mogul, J., Stiekes, B., Pouffary, Y.: SIGCOMM Comput. Commun. Rev. 41(4), 62 (2011). doi:10.1145/2043164.2018444
Koslovski, G., Soudan, S., Goncalves, P., Vicat-Blanc, P.: In integrated network management (IM), 2011 IFIP/IEEE international symposium on (2011), pp. 153–160. doi:10.1109/INM.2011.5990686
Author information
Authors and Affiliations
Corresponding author
Additional information
Work done while Dr. Fetahi Wuhib was with KTH Royal Institute of Technology.
Rights and permissions
About this article
Cite this article
Wuhib, F., Yanggratoke, R. & Stadler, R. Allocating Compute and Network Resources Under Management Objectives in Large-Scale Clouds. J Netw Syst Manage 23, 111–136 (2015). https://doi.org/10.1007/s10922-013-9280-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10922-013-9280-6