research-article

Methods For Creating XSEDE Compatible Clusters

Authors:

Jeremy Fischer,

Richard Knepper,

Matthew Standish,

Craig A. Stewart,

Barbara Hallock,

Victor HazlewoodAuthors Info & Claims

XSEDE '14: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment

Article No.: 74, Pages 1 - 5

https://doi.org/10.1145/2616498.2616578

Published: 13 July 2014 Publication History

Abstract

The Extreme Science and Engineering Discovery Environment has created a suite of software that is collectively known as the basic XSEDE-compatible cluster build. It has been distributed as a Rocks roll for some time. It is now available as individual RPM packages, so that it can be downloaded and installed in portions as appropriate on existing and working clusters. In this paper, we explain the concept of the XSEDE-compatible cluster and explain how to install individual components as RPMs through use of Puppet and the XSEDE compatible cluster YUM repository.

References

[1]

Stewart, C.A., R. Knepper, J.W. Ferguson, F. Bachmann, I. Foster, A. Grimshaw, V. Hazlewood and D. Lifka. What is campus bridging and what is XSEDE doing about it? 2012. Presentation. Presented at: XSEDE12 (Chicago, IL, 16-20 Jul 2012). http://hdl.handle.net/2022/14599

Digital Library

[2]

XSEDE Software Repository. http://software.xsede.org/cb/centos6/x86_64/

[3]

Rocks -- Open Source Toolkit for Real and Virtual Servers. http://www.rocksclusters.org/wordpress/

[4]

Fischer, Jeremy L. and Brown, Paul. 2013. What software is installed on a "bare-bones" XSEDE-compatible Rocks cluster? Indiana University Knowledge Base https://kb.iu.edu/data/bdww.html

[5]

Fischer, Jeremy L. and Brown, Paul. 2013. What is the XSEDE Yum Repository and how do I use it? Indiana University Knowledge Base https://kb.iu.edu/data/bdwx.html.

[6]

Stewart, Craig A.; Knepper, Richard; Grimshaw, Andrew; Foster, Ian; Bachmann, Felix; Lifka, David; Riedel, Morris; Tueke, Steven. 2012. XSEDE Campus Bridging Use Cases.

[7]

Hazlewood, Victor, Knepper, Richard, Lee, Steven, Lifka, David, Navarro, JP, Stewart, Craig A. 2013. XSEDE Campus Bridging -- Cluster software distribution strategy and tactics. http://hdl.handle.net/2022/15459

[8]

Fischer, Jeremy L. and Brown, Paul. 2013. What is the XSEDE Rocks roll, and how do I use it? Indiana University Knowledge Base https://kb.iu.edu/data/bdwx.html.

[9]

About Rocks. http://www.rocksclusters.org/wordpress/?page_id=57

[10]

The Rocks Group. Base User Guide Rocks 6.1. Chapter 8: Advanced Tasks -- 8.10 System Updates. http://central6.rocksclusters.org/roll-documentation/base/6.1/update.html

[11]

RedHat Knowledge Base. "What is yum and how to use it?" https://access.redhat.com/site/solutions/9934

[12]

Howard University. "Brief History of Howard University." http://www.howard.edu/explore/history.htm

[13]

DAUIN Department of Control and Computer Engineering. "General Information." http://www.dauin.polito.it/it/informazioni_generali

[14]

Croce, F. Della, Nepote, N., Piccolo, E. "A Terascale Cost-Effective Open Solution for Academic Computing: Early Experience of the Dauin HPC Initiative." http://www.dauin-hpc.polito.it/papers/aica2011.pdf

[15]

Hendrix, Val, Benjamin, Doug, Yao, Yushu. "Scientific Cluster Deployment and Recovery -- Using puppet to simplify cluster management." 2012 J. Phys.: Conf. Ser. 396 042027

[16]

XSEDE. "Campus Bridging." https://www.xsede.org/campus-bridging

Cited By

Vaillancourt PCoulter JKnepper RBarker B(2020)Self-Scaling Clusters and Reproducible Containers to Enable Scientific Computing2020 IEEE High Performance Extreme Computing Conference (HPEC)10.1109/HPEC43674.2020.9286208(1-8)Online publication date: 22-Sep-2020
https://doi.org/10.1109/HPEC43674.2020.9286208
Coulter JAbeysinghe EPamidighantam SPierce MStewart C(2019)Virtual Clusters in the Jetstream CloudProceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing10.1145/3355738.3355752(1-6)Online publication date: 29-Jul-2019
https://dl.acm.org/doi/10.1145/3355738.3355752
Langin CHart D(2017)We Have an HPC SystemPractice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact10.1145/3093338.3093341(1-8)Online publication date: 9-Jul-2017
https://dl.acm.org/doi/10.1145/3093338.3093341
Show More Cited By

Index Terms

Methods For Creating XSEDE Compatible Clusters

Recommendations

XCBC and XNIT - Tools for Cluster Implementation and Management in Research and Training
CLUSTER '15: Proceedings of the 2015 IEEE International Conference on Cluster Computing

The Extreme Science and Engineering Discovery Environment has created a suite of software collectively known as the XSEDE-compatible basic cluster (XCBC). It has been distributed as a Rocks Roll for some time. The same scientific and supporting packages ...
A tool for converting Linux device drivers into Solaris compatible binaries
Research Articles

The Linux operating system is quickly becoming a standard, attracting a wide user community and supporting a broad variety of applications and devices. Other vendors, such as Sun, have provided Linux-compatible system call interfaces to their kernels, ...
Configuring Large High-Performance Clusters at Lightspeed: A Case Study

Over a decade ago, the TOP500 list was started as a way to measure supercomputers by their sustained performance on a particular linear algebra benchmark. Once reserved for the exotic machines and extremely well-funded centers and laboratories, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

XSEDE '14: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment

July 2014

445 pages

ISBN:9781450328937

DOI:10.1145/2616498

General Chair:
Scott Lathrop
National Center for Supercomputing Applications
,
Program Chair:
Jay Alameda
National Center for Supercomputing Applications

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

NSF: National Science Foundation
Drexel University
Indiana University: Indiana University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 July 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

XSEDE '14

XSEDE '14: Annual Conference of the Extreme Science and Engineering Discovery Environment

July 13 - 18, 2014

GA, Atlanta, USA

Acceptance Rates

XSEDE '14 Paper Acceptance Rate 80 of 120 submissions, 67%;

Overall Acceptance Rate 129 of 190 submissions, 68%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
88
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vaillancourt PCoulter JKnepper RBarker B(2020)Self-Scaling Clusters and Reproducible Containers to Enable Scientific Computing2020 IEEE High Performance Extreme Computing Conference (HPEC)10.1109/HPEC43674.2020.9286208(1-8)Online publication date: 22-Sep-2020
https://doi.org/10.1109/HPEC43674.2020.9286208
Coulter JAbeysinghe EPamidighantam SPierce MStewart C(2019)Virtual Clusters in the Jetstream CloudProceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing10.1145/3355738.3355752(1-6)Online publication date: 29-Jul-2019
https://dl.acm.org/doi/10.1145/3355738.3355752
Langin CHart D(2017)We Have an HPC SystemPractice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact10.1145/3093338.3093341(1-8)Online publication date: 9-Jul-2017
https://dl.acm.org/doi/10.1145/3093338.3093341
Knepper RCoulter EPierce MMarru SPamidighantam S(2017)Using the Jetstream Research Cloud to provide Science Gateway resourcesProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.121(753-757)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.121
Stewart CCockerill TFoster IHancock DMerchant NSkidmore EStanzione DTaylor JTuecke STurner GVaughn MGaffney NPeterson G(2015)JetstreamProceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure10.1145/2792745.2792774(1-8)Online publication date: 26-Jul-2015
https://dl.acm.org/doi/10.1145/2792745.2792774
Wu LGanote CDoak TBarnett WMockaitis KStewart CPeterson G(2015)Cyberinfrastructure resources enabling creation of the loblolly pine reference transcriptomeProceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure10.1145/2792745.2792748(1-6)Online publication date: 26-Jul-2015
https://dl.acm.org/doi/10.1145/2792745.2792748
Hintsch JGörling CTurowski K(2015)Modularization of Software as a Service ProductsProceedings of the 2015 International Conference on Enterprise Systems10.1109/ES.2015.25(184-191)Online publication date: 14-Oct-2015
https://dl.acm.org/doi/10.1109/ES.2015.25
Geimer MHoste KMcLay RBording CGeorges A(2014)Modern scientific software management using EasyBuild and LmodProceedings of the First International Workshop on HPC User Support Tools10.1109/HUST.2014.8(41-51)Online publication date: 16-Nov-2014
https://dl.acm.org/doi/10.1109/HUST.2014.8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten