research-article

Public Access

Virtual Clusters in the Jetstream Cloud: A story of elasticized HPC

Authors:

J. Eric Coulter,

Eroma Abeysinghe,

Sudhakar Pamidighantam,

Marlon PierceAuthors Info & Claims

HARC '19: Proceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing

Article No.: 8, Pages 1 - 6

https://doi.org/10.1145/3355738.3355752

Published: 29 July 2019 Publication History

Abstract

We discuss our work providing resources for batch computing via the Jetstream cloud, in the form of SLURM clusters. While these are mainly used by science gateways, there have been a few used in the more traditional commandline manner. The flexible nature of these has also lent itself well to educational work, and has provided the basis for a very successful series of tutorials and workshops. This paper discusses the technical evolution of the Virtual Cluster product, and gives an overview of the science enabled. We discuss the challenges in supporting an ecosystem of these virtual clusters, and in supporting research on cloud resources in general.

References

[1]

[n. d.]. NSF Campus Cyberinfrastructure Solicitation 19-533. https://www.nsf.gov/pubs/2019/nsf19533/nsf19533.htm

[2]

2019. Distant Reader Gateway. https://distantreader.org/

[3]

2019. Jetstream User Wiki. https://wiki.jetstream-cloud.org/

[4]

2019. Openstack Heat Project. https://wiki.openstack.org/wiki/Heat

[5]

2019. Torque Resource Manager. http://www.adaptivecomputing.com/products/torque/

[6]

Enis Afgan, Dannon Baker, BÃl'rÃl'nice Batut, Marius vanÂădenÂăBeek, Dave Bouvier, Martin Ä&Ncaron;ech, John Chilton, Dave Clements, Nate Coraor, BjÃűrn A GrÃijning, Aysam Guerler, Jennifer Hillman-Jackson, Saskia Hiltemann, Vahid Jalili, Helena Rasche, Nicola Soranzo, Jeremy Goecks, James Taylor, Anton Nekrutenko, and Daniel Blankenberg. 2018. The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update. Nucleic Acids Research 46, W1 (05 2018), W537--W544. https://doi.org/10.1093/nar/gky379 arXiv:http://oup.prod.sis.lan/nar/article-pdf/46/W1/W537/25110642/gky379.pdf

[7]

Enis Afgan, Andrew Lonie, James Taylor, and Nuwan Goonasekera. 2019. Cloud-Launch: Discover and deploy cloud applications. Future Generation Computer Systems 94 (2019), 802--810. https://doi.org/10.1016/j.future.2018.04.037

[8]

Ansible Configuration Management Software 2018. Ansible Configuration Management Software. http://www.ansible.com/. [Online; accessed 17-August-2018; Red Hat Inc.].

[9]

Meghna Babbar-Sebens, Snehasis Mukhopadhyay, Ganti Murthy, Jeff Reimer, Arjan Durresi Jenna H. Tilt, and Samuel J Rivera. 2019. InterACTWEL. http://interactwel.oregonstate.edu/

[10]

Evan F. Bollig and James C. Wilgenbusch. 2018. From Bare Metal to Virtual: Lessons Learned when a Supercomputing Institute Deploys Its First Cloud. In Proceedings of the Practice and Experience on Advanced Research Computing (PEARC '18). ACM, New York, NY, USA, Article 13, 8 pages. https://doi.org/10.1145/3219104.3219164

[11]

Eric Coulter, Jeremy Fischer, Barbara Hallock, Richard Knepper, and Craig Stewart. 2016. Implementation of Simple XSEDE-Like Clusters: Science Enabled and Lessons Learned. In Proceedings of the XSEDE16 Conference on Diversity, Big Data, and Science at Scale (XSEDE16). ACM, New York, NY, USA, Article 10, 8 pages. https://doi.org/10.1145/2949550.2949570

Digital Library

[12]

B Demeler. 2005. UltraScan A comprehensive data analysis software package for analytical ultracentrifugation experiments. Modern Analytical Ultracentrifugation: Techniques and Methods (01 2005), 210--229.

[13]

Rion Dooley, Kent Milfeld, Chona Guiang, Sudhakar Pamidighantam, and Gabrielle Allen. 2006. From proposal to production: Lessons learned developing the computational chemistry grid cyberinfrastructure. Journal of Grid Computing 4, 2 (2006), 195--208.

[14]

Sudhakar Pamidighantam Eric Coulter, Richard Knepper. 2017. Using the Jetstream Research Cloud to provide Science Gateway resources. CCGrid.

[15]

Jeremy Fischer, Richard Knepper, Matthew Standish, Craig A. Stewart, Resa Alvord, David Lifka, Barbara Hallock, and Victor Hazlewood. 2014. Methods For Creating XSEDE Compatible Clusters. In Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment (XSEDE '14). ACM, New York, NY, USA, Article 74, 5 pages. https://doi.org/10.1145/2616498.2616578

Digital Library

[16]

Kate Keahey, Pierre Riteau, Dan Stanzione, Tim Cockerill, Joe Mambretti, Paul Rad, and Paul Ruth. 2019. Chameleon: a Scalable Production Testbed for Computer Science Research. In Contemporary High Performance Computing: From Petascale toward Exascale (1 ed.), Jeffrey Vetter (Ed.). Chapman & Hall/CRC Computational Science, Vol. 3. CRC Press, Boca Raton, FL, Chapter 5, 123--148.

[17]

Steven Lee. 2017. Cornell Red Cloud: Campus-based Hybrid Cloud. http://hdl.handle.net/2022/21730

[18]

Murat Maga. 2018. 3-Dimensional Quantitative Phenotyping Gateway. http://faculty.washington.edu/maga/

[19]

Suresh Marru, Lahiru Gunathilake, Chathura Herath, Patanachai Tangchaisin, Marlon Pierce, Chris Mattmann, Raminder Singh, Thilina Gunarathne, Eran Chinthaka, Ross Gardler, Aleksander Slominski, Ate Douma, Srinath Perera, and Sanjiva Weerawarana. 2011. Apache Airavata: A Framework for Distributed Applications and Computational Workflows. In Proceedings of the 2011 ACM Workshop on Gateway Computing Environments (GCE '11). ACM, New York, NY, USA, 21--28. https://doi.org/10.1145/2110486.2110490

Digital Library

[20]

Craig Stewart. 2017. Big Data, Big Red II, Data Capacitor II, Wrangler, Jetstream, and Globus Online: A national science & engineering cloud. http://hdl.handle.net/2022/19680

[21]

Craig A. Stewart, Timothy M. Cockerill, Ian Foster, David Hancock, Nirav Merchant, Edwin Skidmore, Daniel Stanzione, James Taylor, Steven Tuecke, George Turner, Matthew Vaughn, and Niall I. Gaffney. 2015. Jetstream: A Self-provisioned, Scalable Science and Engineering Cloud Environment. In Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure (XSEDE '15). ACM, New York, NY, USA, Article 29, 8 pages. https://doi.org/10.1145/2792745.2792774

[22]

Craig A. Stewart, Richard Knepper, James Ferguson, Felix Bachmann, Ian Foster, Andrew Grimshaw, Victor Hazlewood, and David Lifka. 2012. What is Campus Bridging and What is XSEDE Doing About It?. In Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the Campus and Beyond (XSEDE '12). ACM, New York, NY, USA, Article 47, 8 pages. https://doi.org/10.1145/2335755.2335844

Digital Library

[23]

Kenneth Yoshimoto Vadim Astakhov Anita Bandrowski Mary Ann Martone Nicholas T. Carnevale Subhashini Sivagnanam, Amit Majumdar. 2013. Introducing The Neuroscience Gateway. In Proceedings of the 5th International Workshop on Science Gateways, Vol. 003. CEUR-WS. http://ceur-ws.org/Vol-993/

[24]

J. Towns, T. Cockerill, M. Dahan, I. Foster, K. Gaither, A. Grimshaw, V. Hazlewood, S. Lathrop, D. Lifka, G. D. Peterson, R. Roskies, J. R. Scott, and N. Wilkins-Diehr. 2014. XSEDE: Accelerating Scientific Discovery. Computing in Science & Engineering 16, 5 (Sept.-Oct. 2014), 62--74. https://doi.org/10.1109/MCSE.2014.80

[25]

Andy B. Yoo, Morris A. Jette, and Mark Grondona. 2003. SLURM: Simple Linux Utility for Resource Management. In Job Scheduling Strategies for Parallel Processing, Dror Feitelson, Larry Rudolph, and Uwe Schwiegelshohn (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 44--60.

Cited By

Jayawardana YWannipurage DAbeysinghe EMarru S(2024)Enhancing Research Productivity: Seamless Integration of Personal Devices and HPC Resources with the Cybershuttle Notebook GatewayPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670623(1-5)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670623
Coulter EKnepper RReynolds RBird SSamuel TSnapp-Childs W(2023)Campus Bridging in the Age of COVID-19Practice and Experience in Advanced Research Computing 2023: Computing for the Common Good10.1145/3569951.3597604(355-358)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3569951.3597604
Ranawaka IAbeysinghe EWannipurage DDe Silva DBrookes EMarru SChristie MPamidighantam SPierce M(2023)Airavata Metascheduler: A Reliable, Fault Tolerant, and Resource-Aware Job Scheduling ServicePractice and Experience in Advanced Research Computing 2023: Computing for the Common Good10.1145/3569951.3593605(35-42)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3569951.3593605
Show More Cited By

Index Terms

Virtual Clusters in the Jetstream Cloud: A story of elasticized HPC

Recommendations

Jetstream: Early Operations Performance, Adoption, and Impacts
UCC '17: Proceedings of the10th International Conference on Utility and Cloud Computing

Jetstream, built with OpenStack, is the first production cloud funded by the NSF for conducting general-purpose science and engineering research as well as an easy-to-use platform for education activities. Unlike many high-performance computing systems, ...
N3phele: Open Science-as-a-Service Workbench for Cloud-based Scientific Computing
OCS '12: Proceedings of the 2012 7th Open Cirrus Summit

Abstract --Because of inexpensive, on-demand resources, Cloud computing is a promising platform for scientific HPC applications, such as gene sequencing. However, it also poses challenges to users and developers in terms of running and maintaining HPC ...
Community Clusters or the Cloud: Continuing cost assessment of on-premises and cloud HPC in Higher Education
PEARC '19: Practice and Experience in Advanced Research Computing 2019: Rise of the Machines (learning)

Understanding total cost of ownership (TCO) for HPC systems on a site-specific range of applications is a critical component of any RFP or capacity plan at research computing centers. With the increasing industry use of the HPC in the cloud, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

HARC '19: Proceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing

July 2019

62 pages

ISBN:9781450372794

DOI:10.1145/3355738

Program Chair:
Craig A. Stewart
Pervasive Technology Institute, Indiana University

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

ACM: Association for Computing Machinery
Indiana University: Indiana University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

NSF

Conference

HARC '19

HARC '19: Enabling and Facilitating Research on Cloud Computing

July 29, 2019

IL, Chicago, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
300
Total Downloads

Downloads (Last 12 months)89
Downloads (Last 6 weeks)8

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jayawardana YWannipurage DAbeysinghe EMarru S(2024)Enhancing Research Productivity: Seamless Integration of Personal Devices and HPC Resources with the Cybershuttle Notebook GatewayPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670623(1-5)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670623
Coulter EKnepper RReynolds RBird SSamuel TSnapp-Childs W(2023)Campus Bridging in the Age of COVID-19Practice and Experience in Advanced Research Computing 2023: Computing for the Common Good10.1145/3569951.3597604(355-358)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3569951.3597604
Ranawaka IAbeysinghe EWannipurage DDe Silva DBrookes EMarru SChristie MPamidighantam SPierce M(2023)Airavata Metascheduler: A Reliable, Fault Tolerant, and Resource-Aware Job Scheduling ServicePractice and Experience in Advanced Research Computing 2023: Computing for the Common Good10.1145/3569951.3593605(35-42)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3569951.3593605
Javornik BSantiago III HDeHart J(2021)The LROSE Science Gateway: One-Stop Shop for Weather Data, Analysis, and Expert AdvicePractice and Experience in Advanced Research Computing 2021: Evolution Across All Dimensions10.1145/3437359.3465595(1-6)Online publication date: 17-Jul-2021
https://dl.acm.org/doi/10.1145/3437359.3465595
Hancock DFischer JLowe JSnapp-Childs WPierce MMarru SCoulter JVaughn MBeck BMerchant NSkidmore EJacobs G(2021)Jetstream2: Accelerating cloud computing via JetstreamPractice and Experience in Advanced Research Computing 2021: Evolution Across All Dimensions10.1145/3437359.3465565(1-8)Online publication date: 17-Jul-2021
https://dl.acm.org/doi/10.1145/3437359.3465565
Caballer MAntonacci MŠustr ZPerniola MMoltó G(2021)Deployment of Elastic Virtual Hybrid Clusters Across Cloud SitesJournal of Grid Computing10.1007/s10723-021-09543-519:1Online publication date: 15-Feb-2021
https://doi.org/10.1007/s10723-021-09543-5
Choi IAbeysinghe ECoulter EMarru SPierce MLiu X(2020)TopPIC Gateway: A Web Gateway for Top-Down Mass Spectrometry Data InterpretationPractice and Experience in Advanced Research Computing 2020: Catch the Wave10.1145/3311790.3400853(461-464)Online publication date: 26-Jul-2020
https://dl.acm.org/doi/10.1145/3311790.3400853
Vaillancourt PCoulter JKnepper RBarker B(2020)Self-Scaling Clusters and Reproducible Containers to Enable Scientific Computing2020 IEEE High Performance Extreme Computing Conference (HPEC)10.1109/HPEC43674.2020.9286208(1-8)Online publication date: 22-Sep-2020
https://doi.org/10.1109/HPEC43674.2020.9286208
Voss BStewart C(2019)HumanwareProceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing10.1145/3355738.3357001(1-6)Online publication date: 29-Jul-2019
https://dl.acm.org/doi/10.1145/3355738.3357001

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents