research-article

Defining future platform requirements for e-Science clouds

Authors:

Lavanya Ramakrishnan,

Keith R. Jackson,

Shane Canon,

Shreyas Cholia,

John ShalfAuthors Info & Claims

SoCC '10: Proceedings of the 1st ACM symposium on Cloud computing

Pages 101 - 106

https://doi.org/10.1145/1807128.1807145

Published: 10 June 2010 Publication History

Get Access

Abstract

Cloud computing has evolved in the commercial space to support highly asynchronous web 2.0 applications. Scientific computing has traditionally been supported by centralized federally funded supercomputing centers and grid resources with a focus on bulk-synchronous compute and data-intensive applications. The scientific computing community has shown increasing interest in exploring cloud computing to serve e-Science applications, with the idea of taking advantage of some of its features such as customizable environments and on-demand resources. Magellan, a recently funded cloud computing project is investigating how cloud computing can serve the needs of mid-range computing and future data-intensive scientific workloads. This paper summarizes the application requirements and business model needed to support the requirements of both existing and emerging science applications, as learned from the early experiences on Magellan and commercial cloud environments. We provide an overview of the capabilities of leading cloud offerings and identify the existent gaps and challenges. Finally, we discuss how the existing cloud software stack may be evolved to better meet e-Science needs, along with the implications for resource providers and middleware developers.

References

[1]

M. Armbrust and et al. Above the Clouds: A Berkeley View of Cloud Computing. Technical Report UCB/EECS-2009-28, EECS Department, University of California, Berkeley, Feb 2009.

Google Scholar

[2]

S. Canon, S. Cholia, J. Shalf, K. Jackson, L. Ramakrishnan, and V. Markowitz. A performance comparison of massively parallel sequence matching computations on cloud computing platforms and hpc clusters using hadoop. 2009.

Google Scholar

[3]

Cern Virtual Machines. http://rbuilder.cern.ch/project/cernvm/releases.

Google Scholar

[4]

J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. pages 137--150.

Google Scholar

[5]

E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The Cost of Doing Science on the Cloud: The Montage Example. In Proceedings of SC'08, Austin, TX, 2008. IEEE.

Digital Library

Google Scholar

[6]

R. T. Fielding and R. N. Taylor. Principled Design of the Modern Web Architecture. ACM Transactions on Internet Technology (TOIT), 2(2):115--150, 2002.

Digital Library

Google Scholar

[7]

I. Foster, Y. Zhao, I. Raicu, and S. Lu. Cloud Computing and Grid Computing 360-Degree Compared. Grid Computing Environments Workshop, 2008. GCE '08, pages 1--10, Nov. 2008.

Crossref

Google Scholar

[8]

J. S. Katie Antypas and H. Wasserman. Nersc-6 workload analysis and benchmark selection process. Technical Report LBNL-1014, Berkeley, CA, 2008.

Crossref

Google Scholar

[9]

K. Keahey and T. Freeman. Science Clouds: Early Experiences in Cloud Computing for Scientific Applications. In Cloud Computing and its Applications (CCA), 2008.

Google Scholar

[10]

J. Li, D. Agarwal, M. Humphrey, C. van Ingen, K. Jackson, and Y. Ryu. eScience in the Cloud: A MODIS Satellite Data Reprojection and Reduction Pipeline in the Windows Azure Platform.

Google Scholar

[11]

D. Nurmi and et al. Eucalyptus:A Technical Report on an Elastic Utility Computing Archietcture Linking Your Programs to Useful Systems. Technical Report 2008-10, University of California, Santa Barbara, California, August 2008.

Google Scholar

[12]

K. K. Ramakrishnan, P. Shenoy, and J. Van der Merwe. Live data center migration across wans: a robust cooperative context aware approach. In INM '07: Proceedings of the 2007 SIGCOMM workshop on Internet network management, pages 262--267, New York, NY, USA, 2007. ACM.

Digital Library

Google Scholar

[13]

M. C. Schatz. CloudBurst: highly sensitive read mapping with MapReduce. Bioinformatics, pages 1363--1369, June 2009.

Digital Library

Google Scholar

Cited By

View all

Saad AEl-Mahdy A(2020)HPCCloud Seer: A Performance Model Based Predictor for Parallel Applications on the CloudIEEE Access10.1109/ACCESS.2020.29928808(87978-87993)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2992880
Saad AEl-Mahdy AEl-Shishiny HChillet D(2019)Performance Modeling of MPI-based Applications on Cloud Multicore ServersProceedings of the Rapid Simulation and Performance Evaluation: Methods and Tools10.1145/3300189.3300194(1-6)Online publication date: 21-Jan-2019
https://dl.acm.org/doi/10.1145/3300189.3300194
Chandra SVarde AWang J(2019)A Hive and SQL Case Study in Cloud Data Analytics2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON47517.2019.8992925(0112-0118)Online publication date: Oct-2019
https://doi.org/10.1109/UEMCON47517.2019.8992925
Show More Cited By

Index Terms

Defining future platform requirements for e-Science clouds

Recommendations

e-Clouds: Scientific Computing as a Service
CISIS '13: Proceedings of the 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive Systems

We present the e-Clouds project aimed at allowing researchers to easily execute many applications on public Infrastructure as a Service (IaaS) solutions. Designed for being a Software as a Service (SaaS) marketplace for scientific applications, e-Clouds ...
Comparing FutureGrid, Amazon EC2, and Open Science Grid for Scientific Workflows

Scientists have many computing infrastructures available to conduct their research, including grids and public or private clouds. This article explores the use of these cyberinfrastructures to execute scientific workflows, an important class of ...
MapReduce in the Clouds for Science
CLOUDCOM '10: Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science

The utility computing model introduced by cloud computing combined with the rich set of cloud infrastructure services offers a very viable alternative to traditional servers and computing clusters. MapReduce distributed data processing architecture has ...

Comments

Information & Contributors

Information

Published In

SoCC '10: Proceedings of the 1st ACM symposium on Cloud computing

June 2010

264 pages

ISBN:9781450300360

DOI:10.1145/1807128

General Chair:
Joseph M. Hellerstein
University of California, Berkeley, USA
,
Program Chairs:
Surajit Chaudhuri
Microsoft Research, USA
,
Mendel Rosenblum
Stanford University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SOCC '10

Sponsor:

SOCC '10: ACM SIGMOD-SIGOPS Workshop on Cloud Computing in conjunction with SIGMOD 2010

June 10 - 11, 2010

Indiana, Indianapolis, USA

Acceptance Rates

Overall Acceptance Rate 169 of 722 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
1,309
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Saad AEl-Mahdy A(2020)HPCCloud Seer: A Performance Model Based Predictor for Parallel Applications on the CloudIEEE Access10.1109/ACCESS.2020.29928808(87978-87993)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2992880
Saad AEl-Mahdy AEl-Shishiny HChillet D(2019)Performance Modeling of MPI-based Applications on Cloud Multicore ServersProceedings of the Rapid Simulation and Performance Evaluation: Methods and Tools10.1145/3300189.3300194(1-6)Online publication date: 21-Jan-2019
https://dl.acm.org/doi/10.1145/3300189.3300194
Chandra SVarde AWang J(2019)A Hive and SQL Case Study in Cloud Data Analytics2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON47517.2019.8992925(0112-0118)Online publication date: Oct-2019
https://doi.org/10.1109/UEMCON47517.2019.8992925
Mohammadi MBazhirov TGuan S(2018)Comparative benchmarking of cloud computing vendors with high performance linpackProceedings of the 2nd International Conference on High Performance Compilation, Computing and Communications10.1145/3195612.3195613(1-5)Online publication date: 15-Mar-2018
https://dl.acm.org/doi/10.1145/3195612.3195613
Caballer MZala SGarcía ÁMoltó GFernández PVelten M(2018)Orchestrating Complex Application Architectures in Heterogeneous CloudsJournal of Grid Computing10.1007/s10723-017-9418-y16:1(3-18)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s10723-017-9418-y
González PPenas DPardo XBanga JDoallo R(2018)Multimethod optimization in the cloud: A case‐study in systems biology modellingConcurrency and Computation: Practice and Experience10.1002/cpe.448830:12Online publication date: 30-Mar-2018
https://doi.org/10.1002/cpe.4488
González PPardo XPenas DTeijeiro DBanga JDoallo R(2017)Using the Cloud for parameter estimation problemsProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.58(797-806)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.58
Galante Gda Rosa Righi R(2017)Exploring Cloud Elasticity in Scientific ApplicationsCloud Computing10.1007/978-3-319-54645-2_4(101-125)Online publication date: 3-Jun-2017
https://doi.org/10.1007/978-3-319-54645-2_4
Moldovan DTruong HDustdar S(2016)Cost-Aware Scalability of Applications in Public Clouds2016 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E.2016.23(79-88)Online publication date: Apr-2016
https://doi.org/10.1109/IC2E.2016.23
Atif MKobayashi RMenadue BLin CSanderson MWilliams A(2016)Breaking HPC Barriers with the 56GbE CloudProcedia Computer Science10.1016/j.procs.2016.07.17493(3-11)Online publication date: 2016
https://doi.org/10.1016/j.procs.2016.07.174
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

e-Clouds: Scientific Computing as a Service

Comparing FutureGrid, Amazon EC2, and Open Science Grid for Scientific Workflows

MapReduce in the Clouds for Science