Article

On the Use of Cloud Computing for Scientific Workflows

Authors:

John GoodAuthors Info & Claims

ESCIENCE '08: Proceedings of the 2008 Fourth IEEE International Conference on eScience

Pages 640 - 645

https://doi.org/10.1109/eScience.2008.167

Published: 07 December 2008 Publication History

Publisher Site

Abstract

This paper explores the use of cloud computing for scientific workflows, focusing on a widely used astronomy application-Montage. The approach is to evaluate from the point of view of a scientific workflow the tradeoffs between running in a local environment, if such is available, and running in a virtual environment via remote, wide-area network resource access. Our results show that for Montage, a workflow with short job runtimes, the virtual environment can provide good compute time performance but it can suffer from resource scheduling delays and widearea communications.

Cited By

View all

Yadav MMishra A(2023)An enhanced ordinal optimization with lower scheduling overhead based novel approach for task scheduling in cloud computing environmentJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-023-00392-z12:1Online publication date: 17-Jan-2023
https://dl.acm.org/doi/10.1186/s13677-023-00392-z
Yang XSong CGu JLi KLi H(2023)A distributed streaming framework for edge–cloud triangle counting in graph streamsKnowledge-Based Systems10.1016/j.knosys.2023.110878278:COnline publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1016/j.knosys.2023.110878
Wang ZZheng WChen PMa YXia YLiu WLi XGuo K(2020)A Novel Coevolutionary Approach to Reliability Guaranteed Multi-Workflow Scheduling upon Edge Computing InfrastructuresSecurity and Communication Networks10.1155/2020/66976402020Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1155/2020/6697640
Show More Cited By

On the Use of Cloud Computing for Scientific Workflows

Recommendations

Deploying High Throughput Scientific Workflows on Container Schedulers with Makeflow and Mesos
CCGrid '17: Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

Workflows are a widely used abstraction for describing large scientific applications and running them on distributed systems. However, most workflow systems have been silent on the question of what execution environment each task in the workflow is ...
Experiences using cloud computing for a scientific workflow application
ScienceCloud '11: Proceedings of the 2nd international workshop on Scientific cloud computing

Clouds are rapidly becoming an important platform for scientific applications. In this paper we describe our experiences running a scientific workflow application in the cloud. The application was developed to process astronomy data released by the ...
An adaptive parallel execution strategy for cloud-based scientific workflows

Many of the existing large-scale scientific experiments modeled as scientific workflows are compute-intensive. Some scientific workflow management systems already explore parallel techniques, such as parameter sweep and data fragmentation, to improve ...

Comments

Information & Contributors

Information

Published In

ESCIENCE '08: Proceedings of the 2008 Fourth IEEE International Conference on eScience

December 2008

792 pages

ISBN:9780769535357

Publisher

IEEE Computer Society

United States

Publication History

Published: 07 December 2008

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

70
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yadav MMishra A(2023)An enhanced ordinal optimization with lower scheduling overhead based novel approach for task scheduling in cloud computing environmentJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-023-00392-z12:1Online publication date: 17-Jan-2023
https://dl.acm.org/doi/10.1186/s13677-023-00392-z
Yang XSong CGu JLi KLi H(2023)A distributed streaming framework for edge–cloud triangle counting in graph streamsKnowledge-Based Systems10.1016/j.knosys.2023.110878278:COnline publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1016/j.knosys.2023.110878
Wang ZZheng WChen PMa YXia YLiu WLi XGuo K(2020)A Novel Coevolutionary Approach to Reliability Guaranteed Multi-Workflow Scheduling upon Edge Computing InfrastructuresSecurity and Communication Networks10.1155/2020/66976402020Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1155/2020/6697640
López García ÁFernández del Castillo ECampos Plasencia I(2019)An efficient cloud scheduler design supporting preemptible instancesFuture Generation Computer Systems10.1016/j.future.2018.12.05795:C(68-78)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1016/j.future.2018.12.057
Koulouzis SMousa RKarakannas Ade Laat CZhao ZEl-Araby EEl-Ghazawi TPanda D(2018)Information centric networking for sharing and accessing digital objects with persistent identifiers on data infrastructuresProceedings of the 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2018.00098(661-668)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1109/CCGRID.2018.00098
Cao HWu CEl-Araby EEl-Ghazawi TPanda D(2018)Performance optimization of budget-constrained mapreduce workflows in multi-cloudsProceedings of the 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2018.00039(243-252)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1109/CCGRID.2018.00039
Ghafouri RMovaghar AMohsenzadeh M(2018)Time-Cost Efficient Scheduling Algorithms for Executing Workflow in Infrastructure as a Service CloudsWireless Personal Communications: An International Journal10.1007/s11277-018-5895-y103:3(2035-2070)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s11277-018-5895-y
Haidri RKatti CSaxena P(2017)Receiver Initiated Deadline Aware Load Balancing Strategy RDLBS for Cloud EnvironmentInternational Journal of Applied Evolutionary Computation10.4018/IJAEC.20170701038:3(53-73)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.4018/IJAEC.2017070103
(2017)Managing workflows on top of a cloud computing orchestrator for using heterogeneous environments on e-ScienceInternational Journal of Web and Grid Services10.1504/IJWGS.2017.08732613:4(375-402)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1504/IJWGS.2017.087326
Judson BMcGrath GPeuchen EChampion MBrenner PChard KNicolae BCostan AZhao D(2017)Cloud IaaS for Mass Spectrometry and ProteomicsProceedings of the 8th Workshop on Scientific Cloud Computing10.1145/3086567.3086571(17-24)Online publication date: 27-Jun-2017
https://dl.acm.org/doi/10.1145/3086567.3086571
Show More Cited By

Abstract

Cited By

Recommendations

Deploying High Throughput Scientific Workflows on Container Schedulers with Makeflow and Mesos

Experiences using cloud computing for a scientific workflow application

An adaptive parallel execution strategy for cloud-based scientific workflows

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations