research-article

Public Access

CHI-in-a-Box: Reducing Operational Costs of Research Testbeds

Authors:

Jason Anderson,

Michael Sherman,

Jenett Tillotson,

Taimoor Ul Islam,

François HalbachAuthors Info & Claims

PEARC '22: Practice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You

Article No.: 14, Pages 1 - 8

https://doi.org/10.1145/3491418.3530768

Published: 08 July 2022 Publication History

All formats PDF

Abstract

Making scientific instruments for computer science research available and open to all is more important than ever given the constantly increasing pace of opportunity and innovation – yet, such instruments are expensive to build and operate given their complexity and need for rapid evolution to keep pace with the advancing frontier of science. This paper describes how we can lower the cost of computer science testbeds by making them easier to deploy and operate. We present CHI-in-a-Box, a packaging of CHameleon Infrastructure (CHI) underlying the Chameleon testbed, describe the practices that went into its design and implementation, and present three case studies of its use.

References

[1]

Jason Anderson and Kate Keahey. 2019. A Case for Integrating Experimental Containers with Notebooks. In 2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, Sydney, NSW, Australia, 151–158. https://doi.org/10.1109/CloudCom.2019.00032

[2]

Jason Anderson and Kate Keahey. 2022. Migrating towards Single Sign-On and Federated Identity. In Proceedings of the Practice and Experience in Advanced Research Computing (Boston, MA, USA) (PEARC ’22). Association for Computing Machinery.

Digital Library

[3]

Ilya Baldin, Anita Nikolich, James Griffioen, Indermohan Inder S. Monga, Kuang Ching Wang, Tom Lehman, Paul Ruth, and Ewa Deelman. 2019. FABRIC: A National-Scale Programmable Experimental Network Infrastructure. IEEE Internet Computing 23 (2019), 38–47. Issue 6. https://doi.org/10.1109/MIC.2019.2958545

Digital Library

[4]

Ilia Baldine, Yufeng Xin, Anirban Mandal, Paul Ruth, Chris Heerman, and Jeff Chase. 2012. ExoGENI: A multi-domain infrastructure-as-a-service testbed. Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering 44 LNICST (2012), 97–113. https://doi.org/10.1007/978-3-642-35576-9_12

[5]

Daniel Balouek, Alexandra Carpen Amarie, Ghislain Charrier, Frédéric Desprez, Emmanuel Jeannot, Emmanuel Jeanvoine, Adrien Lèbre, David Margery, Nicolas Niclausse, Lucas Nussbaum, Olivier Richard, Christian Perez, Flavien Quesnel, Cyril Rohr, and Luc Sarzyniec. 2012. Adding Virtualization Capabilities to the Grid’5000 Testbed. Communications in Computer and Information Science 367 CCIS (2012), 3–20. https://doi.org/10.1007/978-3-319-04519-1_1

[6]

Mark Berman, Jeffrey S. Chase, Lawrence Landweber, Akihiro Nakao, Max Ott, Dipankar Raychaudhuri, Robert Ricci, and Ivan Seskar. 2014. GENI: A federated testbed for innovative network experiments. Computer Networks 61 (3 2014), 5–23. https://doi.org/10.1016/J.BJP.2013.12.037

Digital Library

[7]

Maxine Brown, Luc Renambot, Lance Long, Timothy Bargo, and Andrew E. Johnson. 2019. COMPaaS DLV: Composable Infrastructure for Deep Learning in an Academic Research Environment. In 2019 IEEE 27th International Conference on Network Protocols (ICNP). IEEE, Chicago, IL, USA, 1–2. https://doi.org/10.1109/ICNP.2019.8888070

[8]

Mert Cevik, Paul Ruth, Kate Keahey, and Pierre Riteau. 2019. Wide-area Software Defined Networking Experiments using Chameleon. In IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, Paris, France, 811–816. https://doi.org/10.1109/INFCOMW.2019.8845093

[9]

Chameleon. 2022. Chameleon main page. Retrieved Feb 16, 2022 from https://chameleoncloud.org/

[10]

Chameleon. 2022. CHI-in-a-Box source repository. https://github.com/ChameleonCloud/chi-in-a-box

[11]

Chameleon. 2022. Doni: OpenStack Inventory Service. https://github.com/ChameleonCloud/doni

[12]

Peter Couvares, Kate Keahey, and Frédérique Marion. 2021. Finding the Gravitational Wave: A History of Discovery Written in Software. SoftwareX 15(2021), 100715. https://doi.org/10.1016/j.softx.2021.100715

[13]

Dmitry Duplyakin, Robert Ricci, Aleksander Maricq, Gary Wong, Jonathon Duerig, Eric Eide, Leigh Stoller, Mike Hibler, David Johnson, Kirk Webb, Aditya Akella, Kuangching Wang, Glenn Ricart, Larry Landweber, Chip Elliott, Michael Zink, Emmanuel Cecchet, Snigdhaswin Kar, and Prabodh Mishra. 2019. The Design and Operation of CloudLab. In Proceedings of the USENIX Annual Technical Conference (ATC). USENIX Association, Renton, WA, 1–14. https://www.flux.utah.edu/paper/duplyakin-atc19

[14]

OpenInfra Foundation. 2022. OpenStack Components. https://www.openstack.org/software/project-navigator

[15]

OpenInfra Foundation. 2022. Stackalytics. https://www.stackalytics.io/?release=all&company=universityofchicago&metric=person-day

[16]

Abhimanyu Gosain and Ivan Seskar. 2017. GENI wireless testbed: An open edge ecosystem for ubiquitous computing applications. In 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, Kona, HI, USA, 54–56. https://doi.org/10.1109/PERCOMW.2017.7917520

[17]

Hongwei Zhang et al.2021. ARA: A Wireless Living Lab Vision for Smart and Connected Rural Communities. In WiNTECH. ACM, New Orleans, LA, USA, 9–16.

[18]

Kate Keahey. 2020. The Silver Lining. IEEE Internet Computing 24, 4 (2020), 55–59. https://doi.org/10.1109/MIC.2020.3013361

[19]

Kate Keahey, Jason Anderson, Michael Sherman, Zhuo Zhen, Mark Powers, Isabel Brunkan, and Adam Cooper. 2021. Chameleon@Edge Community Workshop Report. https://doi.org/10.5281/zenodo.5777344

[20]

Kate Keahey, Jason Anderson, Zhuo Zhen, Pierre Riteau, Paul Ruth, Dan Stanzione, Mert Cevik, Jacob Colleran, Haryadi S. Gunawi, Cody Hammock, Joe Mambretti, Alexander Barnes, François Halbah, Alex Rocha, and Joe Stubbs. 2020. Lessons Learned from the Chameleon Testbed. In 2020 USENIX Annual Technical Conference (USENIX ATC 20). USENIX Association, online, 219–233. https://www.usenix.org/conference/atc20/presentation/keahey

[21]

Kate Keahey, Pierre Riteau, Jason Anderson, and Zhuo Zhen. 2019. Managing Allocatable Resources. In 2019 IEEE 12th International Conference on Cloud Computing (CLOUD). IEEE, Milan, Italy, 41–49. https://doi.org/10.1109/CLOUD.2019.00019

[22]

Kate Keahey, Pierre Riteau, Dan Stanzione, Tim Cockerill, Joe Mambretti, Paul Rad, and Paul Ruth. 2019. Chameleon: A Scalable Production Testbed for Computer Science Research. In Contemporary High Performance Computing. CRC, Boca Raton, 123–148. https://doi.org/10.1201/9781351036863-5

[23]

Lance Long, Tim Bargo, Luc Renambot, Maxine Brown, and Andrew Johnson. 2022. Composable Infrastructures for an Academic Research Environment: Lessons Learned. (3 June 2022). submitted.

[24]

David Margery, Emile Morel, Lucas Nussbaum, Olivier Richard, and Cyril Rohr. 2014. Resources Description, Selection, Reservation and Verification on a Large-Scale Testbed. In Testbeds and Research Infrastructure: Development of Networks and Communities, Victor C.M. Leung, Min Chen, Jiafu Wan, and Yin Zhang (Eds.). Springer International Publishing, Cham, 239–247.

[25]

MOC. 2022. Mass Open Cloud – An Open Cloud Exchange Public Cloud. https://massopen.cloud/

[26]

Mark Powers. 2022. Interactive Science Made Easy with Chameleon Daypass. https://www.chameleoncloud.org/blog/2022/01/24/interactive-science-made-easy-with-chameleon-daypass/

[27]

Paul Ruth, Kate Keahey, Mert Cevik, Zhuo Zhen, Cong Wang, and Jason Anderson. 2021. Overcast: Running Controlled Experiments Spanning Research and Commercial Clouds. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE.

[28]

StackHPC. 2022. Kayobe: An Introduction. https://www.stackhpc.com/pages/kayobe.html

[29]

Craig A. Stewart, Timothy M. Cockerill, Ian Foster, David Hancock, Nirav Merchant, Edwin Skidmore, Daniel Stanzione, James Taylor, Steven Tuecke, George Turner, Matthew Vaughn, and Niall I. Gaffney. 2015. Jetstream: a self-provisioned, scalable science and engineering cloud environment. In Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure(XSEDE ’15). ACM, New York, NY, USA, 1–8. https://doi.org/10.1145/2792745.2792774

Digital Library

[30]

Chameleon Team. 2022. Chameleon Cloud Python API. https://python-chi.readthedocs.io/en/latest/

[31]

Chameleon Team. 2022. Hammers: Percussive Maintenance. https://chameleoncloud.gitbook.io/chi-in-a-box/operations/chameleon-tools/hammers

[32]

Chameleon Team. 2022. Trovi: Practical Open Reproducibility. https://chameleoncloud.gitbook.io/trovi/

[33]

Steven Tuecke, Rachana Ananthakrishnan, Kyle Chard, Mattias Lidman, Brendan McCollam, Stephen Rosen, and Ian Foster. 2016. Globus auth: A research identity and access management platform. In 2016 IEEE 12th International Conference on e-Science (e-Science). IEEE, Baltimore, MD, USA, 203–212. https://doi.org/10.1109/eScience.2016.7870901

[34]

Brian White, Jay Lepreau, Leigh Stoller, Robert Ricci, Shashi Guruprasad, Mac Newbold, Mike Hibler, Chad Barb, and Abhijeet Joglekar. 2002. An Integrated Experimental Environment for Distributed Systems and Networks. In Proc. of the Fifth Symposium on Operating Systems Design and Implementation. USENIX Association, ACM, Boston, MA, 255–270.

Cited By

Rakshit AReddy SRamnath RArora ABoubin J(2024)Righteous: Automatic Right-Sizing for Complex Edge Deployments2024 IEEE/ACM Symposium on Edge Computing (SEC)10.1109/SEC62691.2024.00010(15-28)Online publication date: 4-Dec-2024
https://doi.org/10.1109/SEC62691.2024.00010
Islam TBoateng JNadim MZu GShahid MLi XZhang TReddy SXu WAtalar ALee VGossling EPermatasari EMeng ZBabu SSoliman MHussain AQiao DZheng MBoyraz OGuan YArora ASelim MAhmad ACohen MZhang H(2024)Demo: Ara Pawr Wireless Living Lab for Smart and Connected Rural Communities2024 IEEE 32nd International Conference on Network Protocols (ICNP)10.1109/ICNP61940.2024.10858584(1-3)Online publication date: 28-Oct-2024
https://doi.org/10.1109/ICNP61940.2024.10858584
Esquivel Morel AFowler WKeahey KZheng KSherman MAnderson R(2023)AutoLearn: Learning in the Edge to Cloud ContinuumProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624101(350-356)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624101
Show More Cited By

Recommendations

On the impact of research network based testbeds on wide-area experiments
IMC '06: Proceedings of the 6th ACM SIGCOMM conference on Internet measurement

An important stage of wide-area systems and networking research is to prototype a system to understand its performance when deployed in the real Internet. A key requirement of prototyping is that results obtained from the prototype experiments be ...
Testbeds Support for Reproducible Research
Reproducibility '17: Proceedings of the Reproducibility Workshop

In the context of experimental research, testbeds play an important role in enabling reproducibility of experiments, by providing a set of services that help experiments with setting up the experimental environment, and collecting data about it. This ...
Analysis and Research of Cloud Computing System Instance
ICFN '10: Proceedings of the 2010 Second International Conference on Future Networks

As a kind of emerging business computational model, Cloud Computing distribute computation task on the resource pool which consists of massive computers, accordingly ,the application systems can gain the computation strength, the storage space and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PEARC '22: Practice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You

July 2022

455 pages

ISBN:9781450391610

DOI:10.1145/3491418

Editors:
Julie Wernert
Indiana University
,
Alan Chalker
Ohio Supercomputer Center
,
Shava Smallen
San Diego Supercomputer Center, University of California, San Diego
,
Tabitha Samuel
University of Tennessee, Knoxville
,
JP Navarro
Argonne National Laboratory

Copyright © 2022 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

PEARC '22

Sponsor:

PEARC '22: Practice and Experience in Advanced Research Computing

July 10 - 14, 2022

MA, Boston, USA

Acceptance Rates

Overall Acceptance Rate 133 of 202 submissions, 66%

Upcoming Conference

PEARC '25

Sponsor:
sighpc
sighpc

Practice and Experience in Advanced Research Computing

July 20 - 24, 2025

Columbus , OH , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
361
Total Downloads

Downloads (Last 12 months)148
Downloads (Last 6 weeks)28

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rakshit AReddy SRamnath RArora ABoubin J(2024)Righteous: Automatic Right-Sizing for Complex Edge Deployments2024 IEEE/ACM Symposium on Edge Computing (SEC)10.1109/SEC62691.2024.00010(15-28)Online publication date: 4-Dec-2024
https://doi.org/10.1109/SEC62691.2024.00010
Islam TBoateng JNadim MZu GShahid MLi XZhang TReddy SXu WAtalar ALee VGossling EPermatasari EMeng ZBabu SSoliman MHussain AQiao DZheng MBoyraz OGuan YArora ASelim MAhmad ACohen MZhang H(2024)Demo: Ara Pawr Wireless Living Lab for Smart and Connected Rural Communities2024 IEEE 32nd International Conference on Network Protocols (ICNP)10.1109/ICNP61940.2024.10858584(1-3)Online publication date: 28-Oct-2024
https://doi.org/10.1109/ICNP61940.2024.10858584
Esquivel Morel AFowler WKeahey KZheng KSherman MAnderson R(2023)AutoLearn: Learning in the Edge to Cloud ContinuumProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624101(350-356)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624101
Mostafavi SMoothedath VRonngren SRoy NSharma GSeo SMunoz MGross JSha KBanerjee SChen J(2023)ExPECA: An Experimental Platform for Trustworthy Edge Computing ApplicationsProceedings of the Eighth ACM/IEEE Symposium on Edge Computing10.1145/3583740.3626819(294-299)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3583740.3626819
Rakshit ABoubin J(2023)Poster Abstract: Automatic Deployment Right-Sizing Through Hyperparameter OptimizationProceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation10.1145/3576842.3589157(438-439)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3576842.3589157
Hakiri AYahia SGokhale Aniruddha S(2023)Hyper-5G: A Cross-Atlantic Digital Twin Testbed for Next Generation 5G IoT Networks and Beyond2023 IEEE 26th International Symposium on Real-Time Distributed Computing (ISORC)10.1109/ISORC58943.2023.00041(230-235)Online publication date: May-2023
https://doi.org/10.1109/ISORC58943.2023.00041
Zu GNadim MReddy SIslam TBabu SZhang TOiao DZhang HArora A(2023)AraHaul: Multi-Modal Wireless X-Haul Living Lab for Long-Distance, High-Capacity Communications2023 IEEE Future Networks World Forum (FNWF)10.1109/FNWF58287.2023.10520543(1-6)Online publication date: 13-Nov-2023
https://doi.org/10.1109/FNWF58287.2023.10520543
Anderson JKeahey K(2022)Migrating towards Single Sign-On and Federated IdentityPractice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You10.1145/3491418.3530770(1-8)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.1145/3491418.3530770

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten