Article

Free access

Elastic Scalable Cloud Computing Using Application-Level Migration

Authors:

Thomas Chestna,

Carlos A. VarelaAuthors Info & Claims

UCC '12: Proceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing

Pages 91 - 98

https://doi.org/10.1109/UCC.2012.53

Published: 05 November 2012 Publication History

Abstract

We present the Cloud Operating System (COS), a middleware framework to support autonomous workload elasticity and scalability based on application-level migration as a reconfiguration strategy. While other scalable frameworks (e.g., MapReduce or Google App Engine) force application developers to write programs following specific APIs, COS provides scalability in a general-purpose programming framework based on an actor-oriented programming language. When all executing VMs are highly utilized, COS scales a workload up by migrating mobile actors over to newly dynamically created VMs. When VM utilization drops, COS scales the workload down by consolidating actors and terminating idle VMs. Application-level migration is advantageous compared to VM migration especially in hybrid clouds in which migration costs over the Internet are critical to scale out the workloads. We demonstrate the general purpose programming approach using a tightly-coupled computation. We compare the performance of autonomous (i.e., COS-driven) versus ideal reconfiguration, as well as the impact of granularity of reconfiguration, i.e., VM migration versus application-level migration. Our results show promise for future fully automated cloud computing resource management systems that efficiently enable truly elastic and scalable general-purpose workloads.

References

[1]

M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "Above the clouds: A Berkeley view of cloud computing," EECS Department, University of California, Berkeley, Tech. Rep., vol. UCB/EECS- 2009-28, Feb 2009.

[2]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. L. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization." in SOSP'03, 2003, pp. 164-177.

Digital Library

[3]

E. L. Haletky, VMware ESX Server in the Enterprise: Planning and Securing Virtualization Servers, 1st ed. Upper Saddle River, NJ, USA: Prentice Hall, 2008.

Digital Library

[4]

K. H. Kim, A. Beloglazov, and R. Buyya, "Power-aware provisioning of cloud resources for real-time services," in Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science, ser. MGC '09. New York, NY, USA: ACM, 2009, pp. 1:1-1:6.

Digital Library

[5]

C.-C. Lin, P. Liu, and J.-J. Wu, "Energy-efficient virtual machine provision algorithms for cloud systems," in Proceedings of the 2011 Fourth IEEE International Conference on Utility and Cloud Computing, ser. UCC '11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 81-88.

Digital Library

[6]

Rightscale, "Cloud Computing Management Platform by RightScale," http://www.rightscale.com/.

[7]

Amazon Web Services, "Auto Scaling - Amazon Web Services," http://aws.amazon.com/autoscaling/.

[8]

C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum, "Optimizing the migration of virtual computers," SIGOPS Oper. Syst. Rev., vol. 36, pp. 377-390, December 2002.

Digital Library

[9]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live migration of virtual machines." in NSDI'05, 2005, pp. 273-286.

Digital Library

[10]

Hansen, J. Gorm, and E. Jul, "Self-migration of operating systems," in Proceedings of the 11th workshop on ACM SIGOPS European workshop, ser. EW 11. New York, NY, USA: ACM, 2004.

Digital Library

[11]

M. Nelson, B.-H. Lim, and G. Hutchins, "Fast transparent migration for virtual machines," in Proceedings of the annual conference on USENIX Annual Technical Conference, ser. ATEC '05. Berkeley, CA, USA: USENIX Association, 2005, pp. 25-25.

Digital Library

[12]

T. Wood, P. J. Shenoy, A. Venkataramani, and M. S. Yousif, "Sandpiper: Black-box and gray-box resource management for virtual machines." Computer Networks, pp. 2923-2938, 2009.

Digital Library

[13]

K. E. Maghraoui, T. Desell, B. K. Szymanski, and C. A. Varela, "Malleable iterative MPI applications," Concurrency and Computation: Practice and Experience, vol. 21, no. 3, pp. 393-413, March 2009.

Digital Library

[14]

C. A. Varela and G. Agha, "Programming dynamically reconfigurable open systems with SALSA," ACM SIGPLAN Notices. OOPSLA'2001 Intriguing Technology Track Proceedings, vol. 36, no. 12, pp. 20-34, Dec. 2001.

Digital Library

[15]

C. Varela, "Worldwide Computing with Universal Actors: Linguistic Abstractions for Naming, Migration, and Coordination," Ph.D. dissertation, U. of Illinois at Urbana-Champaign, 2001.

Digital Library

[16]

P. Wang, W. Huang, and C. A. Varela, "Impact of virtual machine granularity on cloud computing workloads performance," in Workshop on Autonomic Computational Science (ACS'2010), Brussels, Belgium, October 2010, pp. 393-400.

[17]

K. E. Maghraoui, T. Desell, B. K. Szymanski, and C. A. Varela, "The Internet Operating System: Middleware for adaptive distributed computing," International Journal of High Performance Computing Applications (IJHPCA), Special Issue on Scheduling Techniques for Large-Scale Distributed Platforms, vol. 20, no. 4, pp. 467-480, 2006.

Digital Library

[18]

G. Agha, Actors: a model of concurrent computation in distributed systems. Cambridge, MA, USA: MIT Press, 1986.

Digital Library

[19]

K. E. Maghraoui, "A framework for the dynamic reconfiguration of scientific applications in grid environments," Ph.D. dissertation, Rensselaer Polytechnic Institute, 2007.

[20]

T. Desell, K. E. Maghraoui, and C. A. Varela, "Malleable applications for scalable high performance computing," Cluster Computing, pp. 323-337, June 2007.

Digital Library

[21]

L. V. Kalé, S. Kumar, and J. Desouza, "A malleable-job system for timeshared parallel machines," in Proceedings of the 2nd International Symposium on Cluster Computing and the Grid (CCGrid 2002, 2002, pp. 230-237.

Digital Library

[22]

Q. Wang and C. A. Varela, "Impact of cloud computing virtualization strategies on workloads' performance," in 4th IEEE/ACM International Conference on Utility and Cloud Computing(UCC 2011), Melbourne, Australia, December 2011.

Digital Library

[23]

J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters." in OSDI'04, 2004, pp. 137-150.

Digital Library

[24]

Google, "Google App Engine," https://developers.google.com/appengine/.

[25]

R. N. Calheiros, C. Vecchiola, D. Karunamoorthy, and R. Buyya, "The aneka platform and qos-driven resource provisioning for elastic applications on hybrid clouds," Future Generation Comp. Syst., pp. 861-870, 2012.

Digital Library

[26]

S. Imai and C. A. Varela, "Light-weight adaptive task offloading from smartphones to nearby computational resources," in Research in Applied Computation Symposium (RACS 2011), Miami, Florida, November 2011.

Digital Library

Cited By

Leite AAlves VRodrigues GTadonki CEisenbeis CMelo A(2017)DohkoCluster Computing10.1007/s10586-017-0897-120:3(1951-1976)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1007/s10586-017-0897-1
Rosa Righi RCosta CRodrigues VRostirolla G(2016)Joint-analysis of performance and energy consumption when enabling cloud elasticity for synchronous HPC applicationsConcurrency and Computation: Practice & Experience10.1002/cpe.371028:5(1548-1571)Online publication date: 10-Apr-2016
https://dl.acm.org/doi/10.1002/cpe.3710
Prata PAlves S(2015)CSCLabInternational Journal of Cloud Applications and Computing10.4018/IJCAC.20151001035:4(36-55)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.4018/IJCAC.2015100103
Show More Cited By

Index Terms

Elastic Scalable Cloud Computing Using Application-Level Migration

Recommendations

A parallel migration scheme for fast virtual machine relocation on a cloud cluster

The paper proposes a method for parallelizing migrations to reduce the time required for virtual machine (VM) relocation. During VM relocation, VMs need to wait for their migrations in a chain due to the limited resource of the physical machines (PMs), ...
Power efficient virtual machine migration in a scientific federated cloud

Virtualization technology enables cloud computing to provide virtual infrastructure. This virtual infrastructure is managed by centralized entity which is responsible for creation, deletion and migration of the virtual machine. Migration module helps to ...
A Service Sustainable Live Migration Strategy for Multiple Virtual Machines in Cloud Data Centers
Abstract
Virtual machine (VM) migration is an indispensable aspect of a virtualized cloud environment. It assists in resource management by dynamically relocating VMs from one physical machine to another. This is an essential aspect especially ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

UCC '12: Proceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing

November 2012

357 pages

ISBN:9780769548623

Publisher

IEEE Computer Society

United States

Publication History

Published: 05 November 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
119
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)4

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Leite AAlves VRodrigues GTadonki CEisenbeis CMelo A(2017)DohkoCluster Computing10.1007/s10586-017-0897-120:3(1951-1976)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1007/s10586-017-0897-1
Rosa Righi RCosta CRodrigues VRostirolla G(2016)Joint-analysis of performance and energy consumption when enabling cloud elasticity for synchronous HPC applicationsConcurrency and Computation: Practice & Experience10.1002/cpe.371028:5(1548-1571)Online publication date: 10-Apr-2016
https://dl.acm.org/doi/10.1002/cpe.3710
Prata PAlves S(2015)CSCLabInternational Journal of Cloud Applications and Computing10.4018/IJCAC.20151001035:4(36-55)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.4018/IJCAC.2015100103
Imai SGalli AVarela C(2015)Dynamic Data-driven Avionics SystemsProcedia Computer Science10.1016/j.procs.2015.05.30151:C(1665-1674)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1016/j.procs.2015.05.301
Toosi ACalheiros RBuyya R(2014)Interconnected Cloud Computing EnvironmentsACM Computing Surveys10.1145/259351247:1(1-47)Online publication date: 1-May-2014
https://dl.acm.org/doi/10.1145/2593512
Imai SChestna TVarela C(2013)Accurate Resource Prediction for Hybrid IaaS Clouds Using Workload-Tailored Elastic Compute UnitsProceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing10.1109/UCC.2013.40(171-178)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/UCC.2013.40
Leitner PRostyslav ZGambi ADustdar S(2013)A Framework and Middleware for Application-Level Cloud Bursting on Top of Infrastructure-as-a-Service CloudsProceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing10.1109/UCC.2013.39(163-170)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/UCC.2013.39

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents