Article

A computational field framework for collaborative task execution in volunteer clouds

Authors:

Stefano Sebastio,

Michele Amoretti,

Alberto Lluch LafuenteAuthors Info & Claims

SEAMS 2014: Proceedings of the 9th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

Pages 105 - 114

https://doi.org/10.1145/2593929.2593943

Published: 02 June 2014 Publication History

Abstract

The increasing diffusion of cloud technologies offers new opportunities for distributed and collaborative computing. Volunteer clouds are a prominent example, where participants join and leave the platform and collaborate by sharing computational resources. The high complexity, dynamism and unpredictability of such scenarios call for decentralized self-* approaches. We present in this paper a framework for the design and evaluation of self-adaptive collaborative task execution strategies in volunteer clouds. As a byproduct, we propose a novel strategy based on the Ant Colony Optimization paradigm, that we validate through simulation-based statistical analysis over Google cluster data.

References

[1]

The grid workloads archive. http: //gwa.ewi.tudelft.nl/pmwiki/pmwiki.php.

[2]

The internet traffic archive. http://ita.ee.lbl.gov/.

[3]

Logs of real parallel workloads from production systems. http://www.cs.huji.ac.il/labs/parallel/ workload/logs.html.

[4]

Parallel workloads archive. http://www.cs.huji.ac. il/labs/parallel/workload/.

[5]

A.-D. Ali and M. A. Belal. Multiple ant colonies optimization for load balancing in distributed systems. In ICTA, 2007.

[6]

M. Amoretti, A. Lluch-Lafuente, and S. Sebastio. A Cooperative Approach for Distributed Task Execution in Autonomic Clouds. In PDP, 2013.

Digital Library

[7]

M. Amoretti, M. Picone, F. Zanichelli, and G. Ferrari. Simulating Mobile and Distributed Systems with DEUS and ns-3. In HPCS, 2013.

[8]

D. P. Anderson. Boinc: A system for public-resource computing and storage. In GRID, 2004.

Digital Library

[9]

D. P. Anderson, J. Cobb, E. Korpela, M. Lebofsky, and D. Werthimer. SETI@home: an experiment in public-resource computing. Commun. ACM, 45(11):56–61, Nov. 2002.

Digital Library

[10]

F. V. Brasileiro, E. Araújo, W. Voorsluys, M. Oliveira, and F. de Figueiredo. Bridging the high performance computing gap: the OurGrid experience. In CCGRID, 2007.

Digital Library

[11]

R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. De Rose, and R. Buyya. CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exper., 41(1):23–50, Jan. 2011.

Digital Library

[12]

J. Cappos, I. Beschastnikh, A. Krishnamurthy, and T. Anderson. Seattle: a platform for educational cloud computing. In SIGCSE, 2009.

Digital Library

[13]

G. D. Caro and M. Dorigo. Antnet: A mobile agents approach to adaptive routing. Technical report, IRIDIA, 1997.

[14]

A. Celestini, A. Lluch Lafuente, P. Mayer, S. Sebastio, and F. Tiezzi. Reputation-based cooperation in the clouds, 2014. Manuscript available at eprints.imtlucca.it/2181.

[15]

V. D. Cunsolo, S. Distefano, A. Puliafito, and M. Scarpa. Volunteer computing and desktop cloud: The Cloud@Home paradigm. In NCA, 2009.

Digital Library

[16]

R. De Nicola, M. Loreti, R. Pugliese, and F. Tiezzi. A formal approach to autonomic systems programming: the SCEL Language. ACM Transactions on Autonomous and Adaptive Systems, 2014. To appear, available as Technical Report from http://eprints.imtlucca.it/2117/.

Digital Library

[17]

Distributed Systems Group, DEUS. http://code.google.com/p/deus/.

[18]

E. Di Nitto, D. Dubois, and R. Mirandola. On exploiting decentralized bio-inspired self-organization algorithms to develop real systems. In SEAMS, 2009.

Digital Library

[19]

A. Di Stefano and C. Santoro. A peer-to-peer decentralized strategy for resource management in computational grids: Research articles. Concurr. Comput. : Pract. Exper., 19(9):1271–1286, 2007.

Digital Library

[20]

M. Dorigo and L. M. Gambardella. Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans. Evol. Comp., 1(1):53–66, 1997.

Digital Library

[21]

I. Foster, Y. Zhao, I. Raicu, and S. Lu. Cloud computing and grid computing 360-degree compared. In GCE, 2008.

[22]

J. L. Hellerstein. Google cluster data. Google research blog, Jan. 2010. http://googleresearch.blogspot. com/2010/01/google-cluster-data.html.

[23]

D. Holten and J. J. van Wijk. A user study on visualizing directed edges in graphs. In CHI, 2009.

Digital Library

[24]

W. Kim, A. Roopakalu, K. Y. Li, and V. S. Pai. Understanding and characterizing planetlab resource usage for federated network testbeds. In IMC, 2011.

Digital Library

[25]

K. Li, G. Xu, G. Zhao, Y. Dong, and D. Wang. Cloud task scheduling based on load balancing ant colony optimization. In ChinaGrid, 2011.

Digital Library

[26]

P. Mayer, A. Klarl, R. Hennicker, M. Puviani, F. Tiezzi, R. Pugliese, J. Keznikl, and T. Bureš. The Autonomic Cloud: A Vision of Voluntary, Peer-2-Peer Cloud Computing. In AWARENESS@SASO, 2013.

Digital Library

[27]

A. Mishra, J. Hellerstein, W. Cirne, and C. Das. Towards Characterizing Cloud Backend Workloads: Insights from Google Compute Clusters. ACM SIGMETRICS Performance Evaluation Review, 37(4):34–41, 2010.

Digital Library

[28]

R. Mishra and A. Jaiswal. Ant colony optimization: A solution of load balancing in cloud. International Journal of Web & Semantic Technology (IJWesT), 3(2):33––50, 2012.

[29]

MultiVeStA website. http://code.google.com/p/multivesta/.

[30]

S. J. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Pearson Education, 2nd edition, 2003.

Digital Library

[31]

L. Saino, C. Cocora, and G. Pavlou. A toolchain for simplifying network simulation setup. In SIMUTOOLS, 2013.

Digital Library

[32]

S. Sebastio and A. Vandin. MultiVeStA: Statistical Model Checking for Discrete Event Simulators. In VALUETOOLS, 2013.

[33]

K. M. Sim and W. H. Sun. Ant colony optimization for routing and load-balancing: survey and new directions. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 33(5):560–572, 2003.

Digital Library

[34]

D. Stutzbach and R. Rejaie. Understanding churn in peer-to-peer networks. In IMC, 2006.

Digital Library

[35]

D. Talia. Cloud computing and software agents: Towards cloud intelligent services. In WOA, 2011.

[36]

D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the condor experience. Concurrency - Practice and Experience, 17(2-4):323–356, 2005.

Digital Library

[37]

L. M. Vaquero, L. Rodero-Merino, J. Caceres, and M. Lindner. A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev., 39:50–55, December 2008.

Digital Library

[38]

F. Zambonelli and M. Mamei. Spatial computing: An emerging paradigm for autonomic computing and communication. In WAC, 2004.

Digital Library

Cited By

Sajal SZhu TUrgaonkar BSen S(2024)TraceUpscaler: Upscaling Traces to Evaluate Systems at High LoadProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629581(942-961)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629581
Sajal SHasan RZhu TUrgaonkar BSen SBarbalace ABhatotia PAlvisi LCadar C(2021)TraceSplitterProceedings of the Sixteenth European Conference on Computer Systems10.1145/3447786.3456262(606-619)Online publication date: 21-Apr-2021
https://dl.acm.org/doi/10.1145/3447786.3456262
Ter Beek MLegay ALafuente AVandin A(2020)A Framework for Quantitative Modeling and Analysis of Highly (Re)configurable SystemsIEEE Transactions on Software Engineering10.1109/TSE.2018.285372646:3(321-345)Online publication date: 1-Mar-2020
https://doi.org/10.1109/TSE.2018.2853726
Show More Cited By

Index Terms

A computational field framework for collaborative task execution in volunteer clouds

Recommendations

A Holistic Approach for Collaborative Workload Execution in Volunteer Clouds
Special Issue on FORECAST

The demand for provisioning, using, and maintaining distributed computational resources is growing hand in hand with the quest for ubiquitous services. Centralized infrastructures such as cloud computing systems provide suitable solutions for many ...
A Cooperative Approach for Distributed Task Execution in Autonomic Clouds
PDP '13: Proceedings of the 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing

Virtualization and distributed computing are two key pillars that guarantee scalability of applications deployed in the Cloud. In Autonomous Cooperative Cloud-based Platforms, autonomous computing nodes cooperate to offer a PaaS Cloud for the deployment ...
From volunteer to cloud computing: cloud@home
CF '10: Proceedings of the 7th ACM international conference on Computing frontiers

Even though mainly commercial Cloud solutions have been implemented so far, the Cloud computing approach is quickly and widely spreading in open contexts such as scientific and academic communities. Two main research directions can be identified in such ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SEAMS 2014: Proceedings of the 9th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

June 2014

174 pages

ISBN:9781450328647

DOI:10.1145/2593929

General Chair:
Gregor Engels
University of Paderborn, Germany
,
Program Chair:
Nelly Bencomo
Aston University, UK

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICSE '14

Sponsor:

SIGSOFT

ICSE '14: 36th International Conference on Software Engineering

June 2 - 3, 2014

Hyderabad, India

Acceptance Rates

Overall Acceptance Rate 17 of 31 submissions, 55%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
234
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sajal SZhu TUrgaonkar BSen S(2024)TraceUpscaler: Upscaling Traces to Evaluate Systems at High LoadProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629581(942-961)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629581
Sajal SHasan RZhu TUrgaonkar BSen SBarbalace ABhatotia PAlvisi LCadar C(2021)TraceSplitterProceedings of the Sixteenth European Conference on Computer Systems10.1145/3447786.3456262(606-619)Online publication date: 21-Apr-2021
https://dl.acm.org/doi/10.1145/3447786.3456262
Ter Beek MLegay ALafuente AVandin A(2020)A Framework for Quantitative Modeling and Analysis of Highly (Re)configurable SystemsIEEE Transactions on Software Engineering10.1109/TSE.2018.285372646:3(321-345)Online publication date: 1-Mar-2020
https://doi.org/10.1109/TSE.2018.2853726
Oparin GBogdanova VPashinin AGorsky S(2018)Distributed solvers of applied problems based on microservices and agent networks2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)10.23919/MIPRO.2018.8400255(1415-1420)Online publication date: May-2018
https://doi.org/10.23919/MIPRO.2018.8400255
D'Angelo MAndersson JWeyns D(2018)Decentralized self-adaptive computing at the edgeProceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems10.1145/3194133.3194160(144-148)Online publication date: 28-May-2018
https://dl.acm.org/doi/10.1145/3194133.3194160
Vandin A(2018)Replicated Computations Results (RCR) Report for “A Holistic Approach for Collaborative Workload Execution in Volunteer Clouds”ACM Transactions on Modeling and Computer Simulation10.1145/318216728:2(1-3)Online publication date: 22-Feb-2018
https://dl.acm.org/doi/10.1145/3182167
Sebastio SAmoretti MLafuente AScala A(2018)A Holistic Approach for Collaborative Workload Execution in Volunteer CloudsACM Transactions on Modeling and Computer Simulation10.1145/315533628:2(1-27)Online publication date: 9-Mar-2018
https://dl.acm.org/doi/10.1145/3155336
Sebastio SGnecco GBemporad A(2017)Optimal distributed task scheduling in volunteer cloudsComputers and Operations Research10.1016/j.cor.2016.11.00481:C(231-246)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.cor.2016.11.004
Sebastio SGnecco G(2017)A green policy to schedule tasks in a distributed cloudOptimization Letters10.1007/s11590-017-1208-812:7(1535-1551)Online publication date: 29-Oct-2017
https://doi.org/10.1007/s11590-017-1208-8
Gilmore SReijsbergen DVandin A(2017)Transient and Steady-State Statistical Analysis for Discrete Event SimulatorsIntegrated Formal Methods10.1007/978-3-319-66845-1_10(145-160)Online publication date: 27-Aug-2017
https://doi.org/10.1007/978-3-319-66845-1_10
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten