article

A coordinator for scaling elastic applications across multiple clouds

Authors:

Rodrigo N. Calheiros,

Adel Nadjaran Toosi,

Christian Vecchiola,

Rajkumar BuyyaAuthors Info & Claims

Future Generation Computer Systems, Volume 28, Issue 8

Pages 1350 - 1362

https://doi.org/10.1016/j.future.2012.03.010

Published: 01 October 2012 Publication History

Abstract

Cloud computing allows customers to dynamically scale their applications, software platforms, and hardware infrastructures according to negotiated Service Level Agreements (SLAs). However, resources available in a single Cloud data center are limited, thus if a large demand for an elastic application is observed in a given time, a Cloud provider will not be able to deliver uniform Quality of Service (QoS) to handle such a demand and SLAs may be violated. One approach that can be taken to avoid such a scenario is enabling further growing of the application by scaling it across multiple, independent Cloud data centers, following market-based trading and negotiation of resources. This approach, as envisioned in the InterCloud project, is realized by agents called Cloud Coordinators and allows for an increase in performance, reliability, and scalability of elastic applications. In this paper, we propose both an architecture for such Cloud Coordinator and an extensible design that allows its adoption in different public and private Clouds. An evaluation of the Cloud Coordinator prototype running in a small-scale scenario shows the effectiveness of the proposed approach and its impact on elastic applications.

References

[1]

Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J. and Brandic, I., Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems. v25 i6. 599-616.

[2]

Ostermann, S., Iosup, A., Yigitbasi, N., Prodan, R., Fahringer, T. and Epema, D., A performance analysis of EC2 cloud computing services for scientific computing. In: Proceedings of the 1st International Conference on Cloud Computing, Springer, Munich, Germany. pp. 115-131.

[3]

J. Dejun, G. Pierre, C.-H. Chi, Resource provisioning of web applications in heterogeneous clouds, in: Proceedings of the 2nd USENIX Conference on Web Application Development, WebApps'11, USENIX, Portland, USA, 2011.

Digital Library

[4]

Buyya, R., Ranjan, R. and Calheiros, R.N., InterCloud: utility-oriented federation of cloud computing environments for scaling of application services. In: Proceedings of the 10th International Conference on Algorithms and Architectures for Parallel Processing, Springer, Busan, South Korea. pp. 13-31.

[5]

Garg, S.K., Vecchiola, C. and Buyya, R., Mandi: a market exchange for trading utility and cloud computing services. The Journal of Supercomputing.

[6]

Venugopal, S., Chu, X. and Buyya, R., A negotiation mechanism for advance resource reservations using the alternate offers protocol. In: Proceedings of the 16th International Workshop on Quality of Service, IEEE Computer Society, Enschede, Netherlands. pp. 40-49.

[7]

Toosi, A.N., Calheiros, R.N., Thulasiram, R.K. and Buyya, R., Resource provisioning policies to increase IaaS provider's profit in a federated cloud environment. In: Proceedings of the 13th IEEE International Conference on High Performance Computing and Communications, IEEE Computer Society, Banff, Canada.

Digital Library

[8]

Sim, K.M., Agent-based cloud commerce. In: Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management, IEEE, Hong Kong. pp. 717-721.

[9]

. In: Foster, I., Kesselman, C. (Eds.), The Grid 2: Blueprint for a New Computing Infrastructure, Morgan Kaufmann.

[10]

di Costanzo, A., de Assunção, M.D. and Buyya, R., Harnessing cloud technologies for a virtualized distributed computing infrastructure. IEEE Internet Computing. v13 i5. 24-33.

[11]

Rochwerger, B., Reservoir-when one cloud is not enough. Computer. v44 i3. 44-51.

[12]

Rodero-Merino, L., Vaquero, L.M., Gil, V., Galán, F., Fontán, J., Montero, R.S. and Llorente, I.M., From infrastructure delivery to service management in clouds. Future Generation Computer Systems. v26 i8. 1226-1240.

[13]

Avetisyan, A.I., Open Cirrus: a global cloud computing testbed. Computer. v43 i4. 35-43.

[14]

Keahey, K., Tsugawa, M., Matsunaga, A. and Fortes, J.A.B., Sky computing. IEEE Internet Computing. v13 i5. 43-51.

[15]

Ferrer, A.J., Optimis: a holistic approach to cloud service provisioning. Future Generation Computer Systems. v28 i1. 66-77.

[16]

D. Bernstein, E. Ludvigson, K. Sankar, S. Diamond, M. Morrow, Blueprint for the InterCloud-protocols and formats for cloud computing interoperability, in: Proceedings of the 4th International Conference on Internet and Web Applications and Services, ICIW'09, IARIA, Venice, Italy, 2009, pp. 328-336.

[17]

Celesti, A., Tusa, F., Villari, M. and Puliafito, A., How to enhance cloud architectures to enable cross-federation. In: Proceedings of the 3rd International Conference on Cloud Computing, IEEE Computer Society, Miami, USA. pp. 337-345.

Digital Library

[18]

Altmann, J., Courcoubetis, C. and Risch, M., A marketplace and its market mechanism for trading commoditized computing resources. Annals of Telecommunications. v65 i11. 653-667.

[19]

Macías, M., Rana, O., Smith, G., Guitart, J. and Torres, J., Maximizing revenue in grid markets using an economically enhanced resource manager. Concurrency and Computation: Practice and Experience. v22 i14. 1990-2011.

[20]

Song, B., Hassan, M.M. and Huh, E.-N., A novel cloud market infrastructure for trading service. In: Proceedings of the 9th International Conference on ComputationalScience and its Applications, IEEE Computer Society, Suwon, South Korea. pp. 44-50.

Digital Library

[21]

Mihailescu, M. and Teo, Y.M., Strategy-proof dynamic resource pricing of multiple resource types on federated clouds. In: Proceedings of the 10th International Conference on Algorithms and Architectures for Parallel Processing, Springer, Busan, South Korea. pp. 337-350.

[22]

Gomes, E.R., Vo, Q.B. and Kowalczyk, R., Pure exchange markets for resource sharing in federated clouds. Concurrency and Computation: Practice and Experience.

[23]

Vanmechelen, K., Depoorter, W. and Broeckhove, J., Combining futures and spot markets: a hybrid market approach to economic grid resource management. Journal of Grid Computing. v9 i1. 81-94.

[24]

Kim, H., el Khamra, Y., Jha, S. and Parashar, M., Exploring application and infrastructure adaptation on hybrid grid-cloudinfrastructure. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, ACM, Chicago, USA. pp. 402-412.

[25]

Ostermann, S., Prodan, R. and Fahringer, T., Extending grids with cloud resource management for scientific computing. In: Proceedings of the 10th IEEE/ACM International Conference on Grid Computing, IEEE Computer Society, Banff, Canada. pp. 42-49.

[26]

Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters. In: Proceedings of the 18th International Symposium on High Performance Distributed Computing, ACM, Munich, Germany. pp. 141-150.

[27]

Tordsson, J., Montero, R.S., Moreno-Vozmediano, R. and Llorente, I.M., Cloud brokering mechanisms for optimized placement of virtual machines across multiple providers. Future Generation Computer Systems. v28 i2. 358-367.

[28]

den Bossche, R.V., Vanmechelen, K. and Broeckhove, J., Cost-optimal scheduling in hybrid iaas clouds for deadline constrained workloads. In: Proceedings of the 3rd International Conference on Cloud Computing, IEEE Computer Society, Miami, USA. pp. 228-235.

Digital Library

[29]

Fitó, J.O., Goiri, í. and Guitart, J., SLA-driven elastic cloud hosting provider. In: Proceedings of the 18th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, IEEE Computer Society, Pisa, Italy. pp. 111-118.

[30]

Lee, Y.C., Wang, C., Zomaya, A.Y. and Zhou, B.B., Profit-driven service request scheduling in clouds. In: Proceedings of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, IEEE Computer Society, Melbourne, Australia. pp. 15-24.

Digital Library

[31]

Goiri, í., Guitart, J. and Torres, J., Characterizing cloud federation for enhancing providers' profit. In: Proceedings of the 3rd International Conference on Cloud Computing, IEEE Computer Society, Miami, USA. pp. 123-130.

Digital Library

[32]

Varia, J., Best practices in architecting cloud applications in the AWS cloud. In: Buyya, R., Broberg, J., Goscinski, A. (Eds.), Cloud Computing: Principles and Paradigms, Wiley Press, New Jersey, USA. pp. 459-490.

[33]

DMTF, Open virtualization format specification version 1.1.0, DMTF Standard, 2010. URL: http://www.dmtf.org/standards/ovf.

[34]

Nurmi, D., The Eucalyptus open-source cloud computing system. In: Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, IEEE Computer Society, Shanghai, China. pp. 124-131.

Digital Library

[35]

Sotomayor, B., Montero, R.S., Llorente, I.M. and Foster, I., Virtual infrastructure management in private and hybrid clouds. IEEE Internet Computing. v13 i5. 14-22.

[36]

Vecchiola, C., Chu, X. and Buyya, R., Aneka: a software platform for.NET-based cloud computing. In: Gentzsch, W., Grandinetti, L., Joubert, G. (Eds.), High Performance and Large Scale Scientific Computing, IOS Press, Amsterdam, Netherlands.

[37]

Deb, K., Thiele, L., Laumanns, M. and Zitzler, E., Scalable test problems for evolutionary multiobjective optimization. In: Abraham, A., Jain, L., Goldberg, R. (Eds.), Evolutionary Multiobjective Optimization: Theoretical Advances and Applications, Springer, London, UK.

[38]

C. Vecchiola, M. Kirley, R. Buyya, Multi-objective problem solving with offspring on enterprise clouds, in: Proceedings of the 10th International Conference on High-Performance Computing in Asia-Pacific Region, HPCAsia'09, NCHC, Kaohsiung, Taiwan, 2009, pp. 132-139.

Cited By

Sun HYu HFan G(2020)Contract-Based Resource Sharing for Time Effective Task Scheduling in Fog-Cloud EnvironmentIEEE Transactions on Network and Service Management10.1109/TNSM.2020.297784317:2(1040-1053)Online publication date: 10-Jun-2020
https://dl.acm.org/doi/10.1109/TNSM.2020.2977843
Elhabbash ASamreen FHadley JElkhatib Y(2019)Cloud BrokerageACM Computing Surveys10.1145/327465751:6(1-28)Online publication date: 28-Jan-2019
https://dl.acm.org/doi/10.1145/3274657
(2018)Systematic survey on evolution of cloud architecturesInternational Journal of Autonomous and Adaptive Communications Systems10.1504/IJAACS.2018.09066111:1(14-38)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJAACS.2018.090661
Show More Cited By

A coordinator for scaling elastic applications across multiple clouds
1. Computer systems organization
  1. Architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures

Recommendations

Monitoring-based auto-scalability across hybrid clouds
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Cloud computing is a relatively new type of Internet-based computing that becomes more and more popular. Using methods like virtualization, adopting architectures based on microservices, automation of building and deployment processes, Cloud could ...
A flexible elastic control plane for private clouds
CAC '13: Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference

While public cloud computing platforms have become popular in recent years, private clouds---operated by enterprises for their internal use---have also begun gaining traction. The configuration and continuous tuning of a private cloud to meet user ...
Converting a High Performance Application to an Elastic Cloud Application
CLOUDCOM '11: Proceedings of the 2011 IEEE Third International Conference on Cloud Computing Technology and Science

Over the past decade, high performance applications have embraced parallel programming and computing models. While parallel computing offers advantages such as good utilization of dedicated hardware resources, it also has several drawbacks such as poor ...

Comments

Information & Contributors

Information

Published In

cover image Future Generation Computer Systems

Future Generation Computer Systems Volume 28, Issue 8

October, 2012

211 pages

ISSN:0167-739X

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2012.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 October 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun HYu HFan G(2020)Contract-Based Resource Sharing for Time Effective Task Scheduling in Fog-Cloud EnvironmentIEEE Transactions on Network and Service Management10.1109/TNSM.2020.297784317:2(1040-1053)Online publication date: 10-Jun-2020
https://dl.acm.org/doi/10.1109/TNSM.2020.2977843
Elhabbash ASamreen FHadley JElkhatib Y(2019)Cloud BrokerageACM Computing Surveys10.1145/327465751:6(1-28)Online publication date: 28-Jan-2019
https://dl.acm.org/doi/10.1145/3274657
(2018)Systematic survey on evolution of cloud architecturesInternational Journal of Autonomous and Adaptive Communications Systems10.1504/IJAACS.2018.09066111:1(14-38)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJAACS.2018.090661
ZarAfshan Goher SBloodsworth PUr Rasool RMcClatchey R(2018)Cloud provider capacity augmentation through automated resource barteringFuture Generation Computer Systems10.1016/j.future.2017.09.08081:C(203-218)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1016/j.future.2017.09.080
(2017)Workload consolidation techniques to optimise energy in cloudInternational Journal of Internet Protocol Technology10.1504/IJIPT.2017.08519010:2(115-125)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1504/IJIPT.2017.085190
(2017)Diverse approaches to cloud brokeringInternational Journal of Communication Networks and Distributed Systems10.1504/IJCNDS.2017.08544119:1(99-120)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1504/IJCNDS.2017.085441
Premarathne U(2017)Reliability analysis of trust based federated identity management in InterCloud: A graph coloring approach2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC)10.1109/CCNC.2017.7983131(345-348)Online publication date: 8-Jan-2017
https://dl.acm.org/doi/10.1109/CCNC.2017.7983131
(2017)CITJournal of Network and Computer Applications10.1016/j.jnca.2016.12.00985:C(32-46)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.jnca.2016.12.009
Lee YHuang KShieh MLai K(2017)Distributed resource allocation in federated cloudsThe Journal of Supercomputing10.1007/s11227-016-1918-173:7(3196-3211)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1007/s11227-016-1918-1
Pietri ISakellariou R(2016)Mapping Virtual Machines onto Physical Machines in Cloud ComputingACM Computing Surveys10.1145/298357549:3(1-30)Online publication date: 12-Oct-2016
https://dl.acm.org/doi/10.1145/2983575
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents