research-article

Containers in HPC: a survey

Authors:

Rafael Keller Tesser,

Edson BorinAuthors Info & Claims

The Journal of Supercomputing, Volume 79, Issue 5

Pages 5759 - 5827

https://doi.org/10.1007/s11227-022-04848-y

Published: 27 October 2022 Publication History

Abstract

OS-level virtualization (containers) has become a popular alternative to hypervisor-based virtualization. From a system-administration point-of-view, containers enable support for user-defined software stacks, thus freeing users of restrictions imposed by the host’s pre-configured software environment. In high performance computing (HPC), containers inspire special interest due to their potentially low overheads on performance. Moreover, they also bring benefits in portability and scientific reproducibility. Despite the potential advantages, the adoption of containers in HPC has been relatively slow, mainly due to specific requirements of the field. These requirements gave rise to various HPC-focused container implementations. Besides unprivileged container execution, they offer different degrees of automation of system-specific optimizations, which are necessary for optimal performance. When we looked into the scientific literature on containers applied to HPC, we were unable to find an up-to-date overview of the state-of-the-art. For this reason, we developed this extensive survey, including 93 carefully selected works. Overall, based on our survey, we argue that issues related to performance overhead are mostly solved. There is, however, a clear trade-off between performance and portability, since optimal performance often depends on host-specific optimizations. A few works propose solutions to mitigate this issue, but there is still room for improvement. Besides, we found surprisingly few works that deal with portability between dedicated HPC systems and public cloud platforms.

References

[1]

Abraham S, Paul AK, Khan RIS, Butt AR (2020) On the use of containers in high performance computing environments. In: IEEE 13th International Conference on Cloud Computing (CLOUD). IEEE, Beijing, China, pp 284–293.

[2]

Aoyama K, Watanabe H, Ohue M, Akiyama Y (2020) Multiple HPC environments-aware container image configuration workflow for large-scale all-to-all protein–protein docking calculations. In: Supercomputing Frontiers. Springer, Cham, pp 23–39.

[3]

Arango C, Dernat R, Sanabria J (2017) Performance evaluation of container-based virtualization for high performance computing environments. arXiv:1709.10140. Accessed 13 Sept 2022

[4]

Azab A (2017) Enabling Docker containers for high-performance and many-task computing. In: IEEE International Conference on Cloud Engineering, pp 279–285. IEEE, Vancouver, Canada.

[5]

Bachiega NG, Souza PSL, Bruschi SM, de Souza SRS (2018) Container-based performance evaluation: a survey and challenges. In: IEEE International Conference on Cloud Engineering (IC2E). IEEE, Vancouver, Canada, pp 398–403.

[6]

Bahls D (2016) Evaluating shifter for HPC applications. In: Cray User Group. CUG, London, UK. https://cug.org/proceedings/cug2016_proceedings/includes/files/pap135s2-file1.pdf. Accessed 13 Sept 2022

[7]

Belkin M, Haas R, Arnold GW, Leong HW, Huerta EA, Lesny D, Neubauer M (2018) Container solutions for HPC systems. In: Proceedings of the Practice and Experience on Advanced Research Computing. ACM, New York, NY, USA.

[8]

Beltre AM, Saha P, Govindaraju M, Younge A, Grant RE (2019) Enabling HPC workloads on cloud infrastructure using kubernetes container orchestration mechanisms. In: IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC). IEEE, Denver, CO, USA, pp 11–20.

[9]

Benedicic L, Cruz FA, Madonna A, Mariotti K (2019) Sarus: highly scalable Docker containers for HPC systems. In: International Conference on High Performance Computing. LNCS—ISC-HPC. Springer, Cham, pp 46–60.

[10]

Bentaleb O, Belloum AS, Sebaa A, and El-Maouhab A Containerization technologies: taxonomies, applications and challenges J Supercomput 2022 78 1 1144-1181

[11]

Beserra D, Moreno ED, Endo PT, Barreto J (2016) Performance evaluation of a lightweight virtualization solution for HPC I/O scenarios. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, Melbourne, Australia, pp 004681–004686.

[12]

Brayford D, Vallecorsa S, Atanasov A, Baruffa F, Riviera W (2019) Deploying AI frameworks on secure HPC systems with containers. In: IEEE High Performance Extreme Computing Conference (HPEC). IEEE, Waltham, MA, USA, pp 1–6.

[13]

Brayford D, Allalen M, Iapichino L, Brennan J, Moran N, Q’Riordan LJ, Hanley K (2021) Deploying containerized QuanEX quantum simulation software on HPC systems. In: 3rd International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC), pp 1–9.

[14]

Canon RS, Younge A (2019) A case for portability and reproducibility of HPC containers. In: IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC). IEEE, Denver, CO, USA, pp 49–54.

[15]

Casalicchio E and Iannucci S The state-of-the-art in container technologies: application, orchestration and security Concurr Comput 2020 32 17 5668

[16]

Cavet C, Souchal M, Gadrat S, Grasseau G, Satirana A, Bailly-Reyre A, Dadoun O, Mendoza V, Chamont D, Marchal-Duval G, Medernach E, and Pansanel J ComputeOps: container for high performance computing EPJ Web Conf 2020 245 07006

[17]

Cerin C, Greneche N, Menouer T (2020) Towards pervasive containerization of HPC job schedulers. In: International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD). IEEE, Porto, Portugal, pp 281–288.

[18]

Chang Y-TS, Heistand S, Hood R, Jin H (2021) Feasibility of running singularity containers with hybrid MPI on NASA high-end computing resources. In: 3rd International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC), pp 17–28.

[19]

Chen J, Guan Q, Liang X, Bryant P, Grubel P, McPherson A, Lo L-T, Randles T, Chen Z, Ahrens JP (2018) Build and execution environment (BEE): an encapsulated environment enabling HPC applications running everywhere. In: IEEE International Conference on Big Data (Big Data). IEEE, Seattle, WA, USA, pp 1737–1746.

[20]

Chung MT, Le A, Quang-Hung N, Nguyen D-D, Thoai N (2016) Provision of Docker and InfiniBand in high performance computing. In: International Conference on Advanced Computing and Applications (ACOMP). IEEE, Can Tho City, Vietnam, pp 127–134.

[21]

Chung MT, Quang-Hung N, Nguyen M-T, Thoai N (2016) Using Docker in high performance computing applications. In: IEEE Sixth International Conference on Communications and Electronics (ICCE). IEEE, Ha Long Bay, Vietnan, pp 52–57.

[22]

de Bayser M, Cerqueira R (2017) Integrating MPI with Docker for HPC. In: IEEE International Conference on Cloud Engineering (IC2E). IEEE, Vancouver, BC, Canada, pp 259–265.

[23]

Freyermuth O, Wienemann P, Bechtle P, and Desch K Operating an HPC/HTC cluster with fully containerized jobs using HTCondor, Singularity, CephFS and CVMFS Comput Softw Big Sci 2021 5 1 1-20

[24]

Gantikow H, Walter S, Reich C (2020) Rootless containers with Podman for HPC. In: International Conference on High Performance Computing. LNCS—ISC-HPC. Springer, Cham, pp 343–354.

[25]

Gerhardt L, Bhimji W, Canon S, Fasel M, Jacobsen D, Mustafa M, Porter J, and Tsulaia V Shifter: containers for HPC J Phys Conf Ser 2017 898

[26]

Gomes J, Bagnaschi E, Campos I, David M, Alves L, Martins JA, Pina JA, López-García A, and Orviz P Enabling rootless Linux containers in multi-user environments. The udocker tool Comput Phys Commun 2018 232 84-97

[27]

Grupp A, Kozlov V, Campos I, David M, Gomes J, López García Á (2019) Benchmarking deep learning infrastructures by means of TensorFlow and containers. In: International Conference on High Performance Computing. LNCS—ISC-HPC, pp. 478–489. Springer, Cham.

[28]

Hale JS, Li L, Richardson CN, and Wells GN Containers for portable, productive, and performant scientific computing Comput Sci Eng 2017 19 6 40-50

[29]

Heinonen N (2019) ALCF research benefits from singularity. https://www.hpcwire.com/off-the-wire/alcf-research-benefits-from-singularity/. Accessed 13 Feb 2022

[30]

Herbein S, Dusia A, Landwehr A, McDaniel S, Monsalve J, Yang Y, Seelam SR, Taufer M (2016) Resource management for running HPC applications in container clouds. In: International Conference on High Performance Computing. LNCS—ISC-HPC, vol. 9697, pp. 261–278. Springer, Frankfurt, Germany.

[31]

Higgins J, Holmes V, and Venters C Autonomous discovery and management in virtual container clusters Comput J 2016 60 2 240-252

[32]

Higgins J, Holmes V, Venters C (2016) Securing user defined containers for scientific computing. In: International Conference on High Performance Computing and Simulation (HPCS). IEEE, Innsbruck, Austria, pp 449–453.

[33]

Hisle MS, Meier MS, Toth DM (2018) Accelerating AutoDock vina with containerization. In: Proceedings of the Practice and Experience on Advanced Research Computing. ACM, New York, NY, USA.

[34]

Höb M, Kranzlmüller D (2020) Enabling EASEY deployment of containerized applications for future HPC systems. In: 20th International Conference on Computational Science (ICCS). Springer, Cham, pp 206–219.

[35]

Hu G, Zhang Y, Chen W (2019) Exploring the performance of singularity for high performance computing scenarios. In: IEEE 5th International Conference on Data Science and Systems (DSS). IEEE, Zhangjiajie, China, pp 2587–2593.

[36]

Huang L, Wang Y, Lu C-Y, Liu S (2021) Best practice of IO workload management in containerized environments on supercomputers. In: Proceedings of Practice and Experience in Advanced Research Computing (PEARC). ACM, New York, NY, USA.

[37]

Hursey J (2020) Design considerations for building and running containerized MPI applications. In: IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC). IEEE, Atlanta, GA, USA, pp 35–44.

[38]

Jacobsen DM, Canon RS (2015) Contain this: unleashing Docker for HPC. https://cug.org/proceedings/cug2015_proceedings/includes/files/pap157-file2.pdf. Accessed 13 Sept 2022

[39]

Jung K, Cho Y-K, and Tak Y-J Containers and orchestration of numerical ocean model for computational reproducibility and portability in public and private clouds: application of ROMS 3.6 Simul Model Pract Theory 2021 109

[40]

Kadri S, Sboner A, Sigaras A, and Roy S Containers in bioinformatics: applications, practical considerations, and best practices in molecular pathology J Molec Diag 2022 24 5 442-454

[41]

Khan M, Becker T, Kuppuudaiyar P, Elster AC (2018) Container-based virtualization for heterogeneous HPC clouds: insights from the EU h2020 CloudLightning project. In: 2018 IEEE International Conference on Cloud Engineering (IC2E). IEEE, Orlando, FL, USA, pp 392–397.

[42]

Kovacs A (2017) Comparison of different Linux containers. In: 40th International Conference on Telecommunications and Signal Processing (TSP). IEEE, Barcelona, Spain, pp 47–51.

[43]

Kuity A, Peddoju SK (2017) Performance evaluation of container-based high performance computing ecosystem using OpenPOWER. In: International Conference on High Performance Computing. LNCS—ISC-HPC. Springer, Cham, pp 290–308.

[44]

Kumar M, Kaur G (2022) Containerized MPI application on Infiniband based HPC: an empirical study. In: 3rd International Conference for Emerging Technology (INCET), pp 1–6.

[45]

Kumar Abhishek M High performance computing using containers in cloud Int J Adv Trends Comput Sci Eng 2020 9 4 5686-5690

[46]

Kurtzer GM, Sochat V, and Bauer MW Singularity: scientific containers for mobility of compute PLoS One 2017 12 5 1-20

[47]

Lahiff A, de Witt S, Caballer M, La Rocca G, Pamela S, and Coster D Running HTC and HPC applications opportunistically across private, academic and public clouds EPJ Web Conf 2020 245 07032

[48]

Le E, Paz D (2017) Performance analysis of applications using singularity container on SDSC Comet. In: Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact (PEARC). ACM, New York, NY, USA.

[49]

Lee M, Ahn H, Hong C-H, and Nikolopoulos DS gShare: a centralized GPU memory management framework to enable GPU memory sharing for containers Future Gener Comput Sys 2022 130 181-192

[50]

Lim SB, Woo J, and Li G Performance analysis of container-based networking solutions for high-performance computing cloud Int J Electr Comput Eng 2020 10 2 1507

[51]

Liu P and Guitart J Performance comparison of multi-container deployment schemes for HPC workloads: an empirical study J Supercomput 2020 77 6 6273-6312

[52]

Liu P and Guitart J Performance characterization of containerization for HPC workloads on Infiniband clusters: an empirical study Clust Comput 2022 25 2 847-868

[53]

Ma H, Wang L, Tak BC, Wang L, Tang C (2016) Auto-tuning performance of MPI parallel programs using resource management in container-based virtual cloud. In: IEEE 9th International Conference on Cloud Computing (CLOUD). IEEE, San Francisco, CA, USA, pp 545–552.

[54]

Maliszewski AM, Vogel A, Griebler D, Roloff E, Fernandes LG, Navaux Philippe OA (2019) Minimizing communication overheads in container-based clouds for HPC applications. In: IEEE Symposium on Computers and Communications (ISCC). IEEE, Barcelona, Spain, pp 1–6.

[55]

Maliszewski AM, Roloff E, Griebler D, Gaspary LP, Navaux POA (2020) Performance impact of IEEE 802.3ad in container-based clouds for HPC applications. In: International Conference on Computational Science and Its Applications (ICCSA). Springer, Cham, pp 158–167.

[56]

Manalo K, Baber L, Bradley R, You Z-Q, Zhang N (2019) Community collections. In: Proceedings of Practice and Experience in Advanced Research Computing (PEARC) Rise of the Machines (Learning). ACM, New York, NY, USA.

[57]

Martinasso M, Gila M, Sawyer W, Sarmiento R, Peretti-Pezzi G, and Karakasis V Cray programming environments within containers on cray XC systems Concurr Comput 2019 32 20 5543

[58]

Medrano-Jaimes F, Lozano-Rizk JE, Castañeda-Avila S, Rivera-Rodriguez R (2019) Use of containers for high-performance computing. In: International Conference on Supercomputing in Mexico. CCIS—ISUM. Springer, Cham, pp 24–32.

[59]

Merkel D (2014) Docker: lightweight Linux containers for consistent development and deployment. https://www.linuxjournal.com/content/docker-lightweight-linux-containers-consistent-development-and-deployment. Accessed 13 Sept 2022

[60]

Michel M, Burnett N (2019) Enabling GPU-enhanced computer vision and machine learning research using containers. In: International Conference on High Performance Computing. LNCS—ISC-HPC. Springer, Cham, pp 80–87.

[61]

Muhtaroglu N, Ari I, and Kolcu B Democratization of HPC cloud services with automated parallel solvers and application containers Concurr Comput 2018 30 21 4782

[62]

Muscianisi G, Fiameni G, Azab A (2019) Singularity GPU containers execution on HPC cluster. In: Weiland M, Juckeland G, Alam S, Jagode H (eds) International conference on high performance computing. LNCS—ISC-HPC. Springer, Cham, pp 61–68.

[63]

Newlin M, Smathers K, DeYoung ME (2019) ARC containers for AI workloads. In: Proceedings of Practice and Experience in Advanced Research Computing (PEARC) Rise of the Machines (Learning). ACM, New York, NY, USA.

[64]

Nguyen N, Bein D (2017) Distributed MPI cluster with docker swarm mode. In: IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC). IEEE, Las Vegas, NV, USA, pp 1–7.

[65]

Okuno S, Hirai A, Fukumoto N (2022) Performance analysis of multi-containerized MD simulations for low-level resource allocation. In: IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), pp 1014–1017.

[66]

Pahl C, Brogi A, Soldani J, and Jamshidi P Cloud container technologies: a state-of-the-art review IEEE Trans Cloud Comput 2019 7 3 677-692

[67]

Peiro Conde K (2020) Containers in HPC: is it worth it? Master’s thesis. http://hdl.handle.net/2117/335295. Accessed 13 Sept 2022

[68]

Piras ME, Pireddu L, Moro M, Zanetti G (2019) Container orchestration on HPC clusters. In: International Conference on High Performance Computing. LNCS—ISC-HPC. Springer, Cham, pp 25–35.

[69]

Priedhorsky R, Randles T (2017) Charliecloud. In: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis, SC ’17. ACM, New York, NY, USA.

[70]

Priedhorsky R, Canon RS, Randles T, Younge AJ (2021) Minimizing privilege for building HPC containers. In: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis, SC, pp 1–14

[71]

Ramon-Cortes C, Serven A, Ejarque J, Lezzi D, and Badia RM Transparent orchestration of task-based parallel applications in containers platforms J Grid Comput 2018 16 1 137-160

[72]

Rudyy O, Garcia-Gasulla M, Mantovani F, Santiago A, Sirvent R, Vazquez M (2019) Containers in HPC: a scalability and portability study in production biological simulations. In: IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, Rio de Janeiro, RJ, Brazil, pp. 567–577.

[73]

Ruhela A, Vaughn M, Harrell SL, Zynda GJ, Fonner J, Evans RT, Minyard T (2020) Containerization on petascale HPC clusters. In: Supercomp State Pract Arch. SC—SOTP. https://sc20.supercomputing.org/proceedings/sotp/sotp_files/sotp120s2-file1.pdf

[74]

Ruhela A, Harrell SL, Evans RT, Zynda GJ, Fonner J, Vaughn M, Minyard T, Cazes J (2021) Characterizing containerized HPC applications performance at petascale on CPU and GPU architectures. In: International Conference on High Performance Computing. LNCS—ISC-HPC. Springer, Cham, pp 411–430.

[75]

Saha P, Beltre A, Uminski P, Govindaraju M (2018) Evaluation of docker containers for scientific workloads in the Cloud. In: Proceedings of the Practice and Experience on Advanced Research Computing. ACM, New York, NY, USA.

[76]

Sampedro Z, Holt A, Hauser T (2018) Continuous integration and delivery for HPC. In: Proceedings of the Practice and Experience on Advanced Research Computing (PEARC). ACM, New York, NY, USA.

[77]

Sande Veiga V, Simon M, Azab A, Fernandez C, Muscianisi G, Fiameni G, Marocchi S (2019) Evaluation and benchmarking of Singularity MPI containers on EU research e-infrastructure. In: IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC). IEEE, Denver, CO, USA, pp 1–10.

[78]

Simchev T, Atanassov E (2020) Performance effects of running container-based Open-MPI cluster in public cloud. In: International Conference on Large-Scale Scientific Computing (LSSC). Springer, Cham, pp 254–262.

[79]

Sochat VV, Prybol CJ, and Kurtzer GM Enhancing reproducibility in scientific computing: metrics and registry for Singularity containers PLoS One 2017 12 11 0188511

[80]

Sparks J (2017) HPC containers in use. In: Proceedings of the Cray User Group (CUG). https://cug.org/proceedings/cug2017_proceedings/includes/files/pap164s2-file1.pdf. Accessed 13 Sept 2022

[81]

Sparks J Enabling docker for HPC Concurr Comput 2018 31 16 5018

[82]

Steffenel LA, Charão AS, Alves B, de Araujo LR, da Silva LF (2020) MPI to Go: container clusters for MPI applications. In: International Conference on Cloud Computing and Services Science. Springer, Cham, pp 199–222.

[83]

Tippit J, Hodson DD, Grimaila MR (2021) Julia and singularity for high performance computing. In: Advances in Parallel and Distributed Processing, and Applications, pp 3–15. Springer, Cham.

[84]

Torrez A, Randles T, Priedhorsky R (2019) HPC container runtimes have minimal or no performance impact. In: IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC). IEEE, Denver, CO, USA, pp 37–42.

[85]

Tronge J, Chen J, Grubel P, Randles T, Davis R, Wofford Q, Anaya S, Guan Q (2021) BeeSwarm: enabling parallel scaling performance measurement in continuous integration for HPC applications. In: 36th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp 1136–1140.

[86]

Vaillancourt PZ, Coulter JE, Knepper R, Barker B (2020) Self-scaling clusters and reproducible containers to enable scientific computing. In: IEEE High Performance Extreme Computing Conference (HPEC). IEEE, Boston, MA, USA, pp 1–8.

[87]

Vaillancourt P, Wineholt B, Barker B, Deliyannis P, Zheng J, Suresh A, Brazier A, Knepper R, Wolski R (2020) Reproducible and portable workflows for scientific computing and HPC in the cloud. In: Practice and Experience in Advanced Research Computing (PEARC). ACM, Portland, OR, USA, pp 311–320.

[88]

Vallee G, Gutierrez CEA, Clerget C (2019) On-node resource manager for containerized HPC workloads. In: IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC). IEEE, Denver, CO, USA, pp 43–48.

[89]

Wang Y, Evans RT, Huang L (2019) Performant container support for HPC applications. In: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) (PEARC). ACM, Chicago, IL, USA.

[90]

Weidner O, Atkinson M, Barker A, Filgueira Vicente R (2016) Rethinking high performance computing platforms. In: ACM International Workshop on Data-Intensive Distributed Computing. ACM, Kyoto, Japan, pp 19–26.

[91]

Yang X and Kasahara M LPMX: a pure rootless composable container system BMC Bioinf 2022 23 1 1-13

[92]

Youn C, Das AK, Yang S, Kim J (2019) Developing a meta framework for key-value memory networks on HPC clusters. In: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (Learning) (PEARC). ACM, New York, NY, USA.

[93]

Younge AJ, Pedretti K, Grant RE, Brightwell R (2017) A tale of two systems: Using containers to deploy HPC applications on supercomputers and clouds. In: IEEE International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, Hong Kong, pp 74–81.

[94]

Yuan S, Brandt SR, Chen Q, Zhu L, Salatin R, and Dooley R A sustainable collaboratory for coastal resilience research Future Gener Comput Syst 2020 111 786-792

[95]

Zhang J, Lu X, Panda DK (2016) High performance MPI library for container-based HPC cloud on InfiniBand clusters. In: 45th international conference on parallel processing (ICPP). IEEE, Philadelphia, PA, USA, pp 268–277.

[96]

Zhang J, Lu X, Panda DK (2016) Performance characterization of hypervisor-and container-based virtualization for HPC on SR-IOV enabled InfiniBand clusters. In: IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). IEEE, Chicago, IL, USA, pp 1777–1784.

[97]

Zhang J, Lu X, Panda DK (2017) Is singularity-based container technology ready for running MPI applications on HPC clouds? In: Proceedings of the10th International Conference on Utility and Cloud Computing (UCC ’17). ACM, New York, NY, USA, pp 151–160.

[98]

Zhou N, Georgiou Y, Pospieszny M, Zhong L, Zhou H, Niethammer C, Pejak B, Marko O, and Hoppe D Container orchestration on HPC systems through Kubernetes J Cloud Comput 2021 10 1 1-14

Cited By

Lawrence RChakravorty DPerez LBrashear WHe ZWinchell JLiu H(2024)Container Adoption in Campus High Performance Computing at Texas A&M UniversityPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670550(1-7)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670550
Lin ZLi JLi Y(2024)A cloud computing approach to superscale colored traveling salesman problemsThe Journal of Supercomputing10.1007/s11227-024-06433-x80:19(27340-27369)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s11227-024-06433-x
Mujkanovic NDurillo JHammer NMüller T(2023)Survey of adaptive containerization architectures for HPCProceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624588(165-176)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624588
Show More Cited By

Index Terms

Containers in HPC: a survey
1. General and reference
2. Software and its engineering
  1. Software notations and tools
  2. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Index terms have been assigned to the content through auto-classification.

Recommendations

Survey of adaptive containerization architectures for HPC
SC-W '23: Proceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis

Containers offer an array of advantages that benefit research reproducibility and portability. As container tools mature, container security improves, and high-performance computing (HPC) and cloud system tools converge, supercomputing centers are ...
Exploring the support for high performance applications in the container runtime environment

Cloud computing is the driving power behind the current technological era. Virtualization is rightly referred to as the backbone of cloud computing. Impacts of virtualization employed in high performance computing (HPC) has been much reviewed by ...
Reproducible Distributed Clusters with Mutable Containers: To Minimize Cost and Provisioning Time
HotConNet '17: Proceedings of the Workshop on Hot Topics in Container Networking and Networked Systems

Reproducible and repeatable provisioning of large-scale distributed systems is laborious. The cost of virtual infrastructure and the provisioning complexity are two of the main concerns. The trade-offs between virtual machines (VMs) and containers, the ...

Comments

Information & Contributors

Information

Published In

cover image The Journal of Supercomputing

The Journal of Supercomputing Volume 79, Issue 5

Mar 2023

1164 pages

ISSN:0920-8542

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022. Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 27 October 2022

Accepted: 21 September 2022

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lawrence RChakravorty DPerez LBrashear WHe ZWinchell JLiu H(2024)Container Adoption in Campus High Performance Computing at Texas A&M UniversityPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670550(1-7)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670550
Lin ZLi JLi Y(2024)A cloud computing approach to superscale colored traveling salesman problemsThe Journal of Supercomputing10.1007/s11227-024-06433-x80:19(27340-27369)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s11227-024-06433-x
Mujkanovic NDurillo JHammer NMüller T(2023)Survey of adaptive containerization architectures for HPCProceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624588(165-176)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624588
Medeiros DSchieffer GWahlgren JPeng I(2023)Understanding Layered Portability from HPC to Cloud in Containerized EnvironmentsHigh Performance Computing. ISC High Performance 2024 International Workshops10.1007/978-3-031-73716-9_31(439-452)Online publication date: 12-May-2023
https://dl.acm.org/doi/10.1007/978-3-031-73716-9_31

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents