research-article

Case study for running HPC applications in public clouds

Authors:

Tom McGlynnAuthors Info & Claims

HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Pages 395 - 401

https://doi.org/10.1145/1851476.1851535

Published: 21 June 2010 Publication History

Abstract

Cloud computing is emerging as an alternative computing platform to bridge the gap between scientists' growing computational demands and their computing capabilities. A scientist who wants to run HPC applications can obtain massive computing resources 'in the cloud' quickly (in minutes), as opposed to days or weeks it normally takes under traditional business processes. Due to the popularity of Amazon EC2, most HPC-in-the-cloud research has been conducted using EC2 as a target platform. Previous work has not investigated how results might depend upon the cloud platform used. In this paper, we extend previous research to three public cloud computing platforms. In addition to running classical benchmarks, we also port a 'full-size' NASA climate prediction application into the cloud, and compare our results with that from dedicated HPC systems. Our results show that 1) virtualization technology, which is widely used by cloud computing, adds little performance overhead; 2) most current public clouds are not designed for running scientific applications primarily due to their poor networking capabilities. However, a cloud with moderately better network (vs. EC2) will deliver a significant performance improvement. Our observations will help to quantify the improvement of using fast networks for running HPC-in-the-cloud, and indicate a promising trend of HPC capability in future private science clouds. We also discuss techniques that will help scientists to best utilize public cloud platforms despite current deficiencies.

References

[1]

}}M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, and M. Zaharia. Above the clouds: A berkeley view of cloud computing. Technical report, UC Berkeley, 2009.

[2]

}}Cubed-sphere finite-volume dynamic core(fvcore). http://sivo.gsfc.nasa.gov/cubedsphere.html.

[3]

}}J. B. Daniel Nurmi and R. Wolski. QBETS: Queue bounds estimation from time series. In JSSPP, pages 76--101, 2007.

Digital Library

[4]

}}J. J. Dongarra, P. Luszczek, and A. Petitet. The LINPACK benchmark: past, present and future. Concurrency and Computation Practice and Experience, 15(9):803.820, 2003.

[5]

}}Amazon EC2 cloud. http://aws.amazon.com/ec2.

[6]

}}C. Evangelinos and C. N. Hill. Cloud computing for parallel scientific hpc applications: Feasibility of running coupled atmosphere-ocean climate models on amazon's ec2. In Cloud Computing and Its Applications, October 2008.

[7]

}}M. Feldman. HPCwire: DOE labs to build science clouds. http://www.hpcwire.com/specialfeatures/cloud\_computing/news/DOE-Labs-to-Build-Science-Clouds-64189872.html.

[8]

}}Flexiscale cloud. http://www.flexiscale.com.

[9]

}}Gogrid cloud. http://www.gogrid.com.

[10]

}}Gotoblas. http://www.tacc.utexas.edu/tacc-projects.

[11]

}}T. S. E. N. Guohui Wang. The impact of virtualization on network performance of amazon ec2 data center. In INFOCOM, 2010.

Digital Library

[12]

}}Hpc as-a-service. http://www.penguincomputing.com/POD/HPC_as_a_service.

[13]

}}High-performance LINPACK. http://www.netlib.org/benchmark/hpl.

[14]

}}Hpl-caculator. http://hpl-calculator.sourceforge.net.

[15]

}}IBM cloud. https://www-949.ibm.com/cloud/developer/login.jsp.

[16]

}}IBM MPI benchmark. http://www.intel.com/software/imb.

[17]

}}iperf. http://sourceforge.net/projects/iperf.

[18]

}}H. Jin, M. Frumkin, and J. Yan. The OpenMP implementation of NAS parallel benchmarks and its performance. NASA Ames Research Center,. Technical Report NAS-99-011, 1999.

[19]

}}E. L. Lusk and A. Chan. Early experiments with the openmp/mpi hybrid programming model. In IWOMP, pages 36--47, 2008.

Digital Library

[20]

}}mpptest. http://www.mcs.anl.gov/research/projects/mpi/mpptest/.

[21]

}}J. Napper and P. Bientinesi. Can cloud computing reach the top500? In UCHPC-MAW '09: Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop, pages 17--20. ACM, 2009.

Digital Library

[22]

}}NASA NEBULA. http://nebula.nasa.gov.

[23]

}}NIST definition of cloud computing. http://csrc.nist.gov/groups/SNS/cloud-computing/index.html.

[24]

}}Rackspace cloud. http://www.rackspacecloud.com.

[25]

}}J. Rehr, F. Vila, J. Gardner, L. Svec, and M. Prange. Scientific computing in the cloud. Computing in Science and Engineering, 99(1), 5555.

Digital Library

[26]

}}A. Snavely, G. Chun, H. Casanova, R. F. V. der Wijngaart, and M. A. Frumkin. Benchmarks for grid computing: a review of ongoing efforts and future directions. SIGMETRICS Perform. Eval. Rev., 30(4):27--32, 2003.

Digital Library

[27]

}}V. Stantchev. Performance evaluation of cloud computing offerings. In 2009 Third International Conference on Advanced Engineering Computing and Applications in Sciences, page 187.192, 2009.

Digital Library

[28]

}}E. Walker. Benchmarking amazon ec2 for high-performance scientific computing. ;LOGIN:, 33(5), 2008.

[29]

}}L. Youseff and et. al. Evaluating the performance impact of xen on mpi and process execution for hpc systems. In VTDC '06: Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, 2006.

Digital Library

Cited By

de Melo MSouto RDrummond L(2025)Optimized Execution of a Numerical Weather Forecast Model in a Cloud ClusterConcurrency and Computation: Practice and Experience10.1002/cpe.837437:3Online publication date: 16-Jan-2025
https://doi.org/10.1002/cpe.8374
Logan LKougkas ASun X(2024)MegaMmap: Blurring the Boundary Between Memory and Storage for Data-Intensive WorkloadsSC24: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41406.2024.00114(1-18)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SC41406.2024.00114
Dancheva TAlonso UBarton M(2023)Cloud benchmarking and performance analysis of an HPC application in Amazon EC2Cluster Computing10.1007/s10586-023-04060-427:2(2273-2290)Online publication date: 28-Jun-2023
https://dl.acm.org/doi/10.1007/s10586-023-04060-4
Show More Cited By

Index Terms

Case study for running HPC applications in public clouds
1. Information systems
  1. Information retrieval
  2. Information storage systems

Recommendations

Simplifying the Use of Clouds for Scientific Computing with Everest

Cloud computing has emerged as a new paradigm for on-demand access to a wast pool of computing resources that provides an alternative to using on-premises resources. This paper discusses the challenges related to using the cloud computing ...
Execution of Compute Intensive Applications on Hybrid Clouds (Case Study with mpiBLAST)
CISIS '12: Proceedings of the 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)

Cloud computing is the most recent realisation of computing as a utility. Recently, fields with substantial computational requirements, e.g., biology, are turning to clouds for cheap, on-demand provisioning of resources. Of interest to this paper is the ...
Monitoring-based auto-scalability across hybrid clouds
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Cloud computing is a relatively new type of Internet-based computing that becomes more and more popular. Using methods like virtualization, adopting architectures based on microservices, automation of building and deployment processes, Cloud could ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

June 2010

911 pages

ISBN:9781605589428

DOI:10.1145/1851476

General Chairs:
Salim Hariri
University of Arizona
,
Kate Keahey
University of Chicago

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Aeronautics and Space Administration

Conference

HPDC '10

Sponsor:

University of Arizona
SIGARCH

HPDC '10: The 19th International Symposium on High Performance Distributed Computing

June 21 - 25, 2010

Illinois, Chicago

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

129
Total Citations
View Citations
1,606
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)3

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

de Melo MSouto RDrummond L(2025)Optimized Execution of a Numerical Weather Forecast Model in a Cloud ClusterConcurrency and Computation: Practice and Experience10.1002/cpe.837437:3Online publication date: 16-Jan-2025
https://doi.org/10.1002/cpe.8374
Logan LKougkas ASun X(2024)MegaMmap: Blurring the Boundary Between Memory and Storage for Data-Intensive WorkloadsSC24: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41406.2024.00114(1-18)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SC41406.2024.00114
Dancheva TAlonso UBarton M(2023)Cloud benchmarking and performance analysis of an HPC application in Amazon EC2Cluster Computing10.1007/s10586-023-04060-427:2(2273-2290)Online publication date: 28-Jun-2023
https://dl.acm.org/doi/10.1007/s10586-023-04060-4
Whitcomb TArevalo DMoskaitis JKomaromi WDoyle JHuang AWodka JNoon FMay MWilliamson FReinecke P(2022)Real-Time Probabilistic Tropical Cyclone Forecasting in the CloudBulletin of the American Meteorological Society10.1175/BAMS-D-21-0164.1103:8(E1930-E1946)Online publication date: Aug-2022
https://doi.org/10.1175/BAMS-D-21-0164.1
Fan YLan ZRich PAllcock WPapka M(2022)Hybrid Workload Scheduling on HPC Systems2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS53621.2022.00052(470-480)Online publication date: May-2022
https://doi.org/10.1109/IPDPS53621.2022.00052
Kutzner CKniep CCherian ANordstrom LGrubmüller Hde Groot BGapsys V(2022)GROMACS in the Cloud: A Global Supercomputer to Speed Up Alchemical Drug DesignJournal of Chemical Information and Modeling10.1021/acs.jcim.2c0004462:7(1691-1711)Online publication date: 30-Mar-2022
https://doi.org/10.1021/acs.jcim.2c00044
Vivas ACastro H(2022)Quantitative Characterization of Scientific Computing ClustersHigh Performance Computing10.1007/978-3-031-23821-5_4(47-62)Online publication date: 21-Dec-2022
https://doi.org/10.1007/978-3-031-23821-5_4
Guidi GEllis MBuluç AYelick KCuller DBourcier JJiang ZBezemer CCortellessa V(2021)10 Years Later: Cloud Computing is Closing the Performance GapCompanion of the ACM/SPEC International Conference on Performance Engineering10.1145/3447545.3451183(41-48)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3447545.3451183
Hsu KChou J(2021)Performance benchmarking and auto-tuning for scientific applications on virtual clusterThe Journal of Supercomputing10.1007/s11227-021-04103-w78:5(6174-6206)Online publication date: 11-Oct-2021
https://doi.org/10.1007/s11227-021-04103-w
Chitre VShah D(2021)Novel Approach for Task Scheduling of HPC Applications Using SDNProceeding of First Doctoral Symposium on Natural Computing Research10.1007/978-981-33-4073-2_33(355-365)Online publication date: 19-Mar-2021
https://doi.org/10.1007/978-981-33-4073-2_33
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten