Extending the Open Community Runtime with External Application Support
Article No.: 7, Pages 1 - 7
Abstract
The Open Community Runtime specification prescribes the way a task-parallel application has to be written, in order to give the runtime system the ability to automatically migrate work and data, provide fault tolerance, improve portability, etc. These constraints prevent an application from efficiently starting a new process to run another external program. We have designed an extension of the specification which provides exactly this functionality in a way that fits the task-based model. The bulk of our work is devoted to exploring the way the task-parallel application can interact with an external application without having to resort to using files on a physical drive for data exchange. To eliminate the need to make changes to the external application, the data is exposed via a virtual file system using the filesystem-in-userspace architecture.
References
[1]
Cédric Augonnet, Samuel Thibault, Raymond Namyst, and Pierre-André Wacrenier. 2011. StarPU: A Unified Platform for Task Scheduling on Heterogeneous Multicore Architectures. Concurrency and Computation: Practice and Experience; Euro-Par 2009 23 (2011), 187--198. Issue 2.
[2]
J. Bueno, J. Planas, A. Duran, R.M. Badia, X. Martorell, E. Ayguade, and J. Labarta. 2012. Productive Programming of GPU Clusters with OmpSs. In IPDPS 2012 Parallel Distributed Processing Symposium. https://doi.org/10.1109/IPDPS.2012.58
[3]
Jiri Dokulil, Martin Sandrieser, and Siegfried Benkner. 2015. OCR-Vx - An Alternative Implementation of the Open Community Runtime. In International Workshop on Runtime Systems for Extreme Scale Programming Models and Architectures, in conjunction with SC15. Austin, Texas.
[4]
J. Dokulil, M. Sandrieser, and S. Benkner. 2016. Implementing the Open Community Runtime for Shared-Memory and Distributed-Memory Systems. In 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP). 364--368. https://doi.org/10.1109/PDP.2016.81
[5]
Hartmut Kaiser, Thomas Heller, Bryce Adelstein-Lelbach, Adrian Serio, and Dietmar Fey. 2014. HPX - A Task Based Programming Model in a Global Address Space. In The 8th International Conference on Partitioned Global Address Space Programming Models (PGAS).
[6]
Alexey Kukanov and Michael J. Voss. 2007. The Foundations for Scalable Multi-Core Software in Intel Threading Building Blocks. Intel Technology Journal 11, 04 (2007), 309--322.
[7]
Joshua Landwehr, Joshua Suetterlein, Andrés Márquez, Joseph Manzano, and Guang R. Gao. 2016. Application Characterization at Scale: Lessons Learned from Developing a Distributed Open Community Runtime System for High Performance Computing. In Proceedings of the ACM International Conference on Computing Frontiers (CF '16). ACM, New York, NY, USA, 164--171. https://doi.org/10.1145/2903150.2903166
[8]
Tim Mattson and Romain Cledat (Eds.). 2016. The Open Community Runtime Interface. https://xstack.exascale-tech.com/git/public?p=ocr.git;a=blob;f=ocr/spec/ocr-1.1.0.pdf.
[9]
T. G. Mattson et al. 2016. The Open Community Runtime: A runtime system for extreme scale computing. In 2016 IEEE High Performance Extreme Computing Conference (HPEC). 1--7. https://doi.org/10.1109/HPEC.2016.7761580
Index Terms
- Extending the Open Community Runtime with External Application Support
Recommendations
Chapel-on-X: Exploring Tasking Runtimes for PGAS Languages
ESPM2'17: Proceedings of the Third International Workshop on Extreme Scale Programming Models and MiddlewareWith the shift to exascale computer systems, the importance of productive programming models for distributed systems is increasing. Partitioned Global Address Space (PGAS) programming models aim to reduce the complexity of writing distributed-memory ...
Consistency model for runtime objects in the Open Community Runtime
Task-based runtime systems are seen as a way to deal with increasing heterogeneity and performance variability in modern high performance computing systems. The Open Community Runtime is an example of such runtime system, with the benefit of having an ...
Retargeting of the Open Community Runtime to Intel Xeon Phi
The Open Community Runtime (OCR) is a recent effort in the search for a runtime for extreme scale parallel systems. OCR relies on the concept of a dynamically generated task graph to ex- press the parallelism of a program. Rather than being directly ...
Comments
Information & Contributors
Information
Published In
November 2017
61 pages
ISBN:9781450351331
DOI:10.1145/3152041
Copyright © 2017 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 November 2017
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
SC '17
Sponsor:
SC '17: The International Conference for High Performance Computing, Networking, Storage and Analysis
November 12 - 17, 2017
CO, Denver, USA
Acceptance Rates
Overall Acceptance Rate 5 of 10 submissions, 50%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 71Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 08 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in