survey

Partitioned Global Address Space Languages

Authors:

Mattias De Wael,

Bruno De Fraine,

Tom Van Cutsem,

Wolfgang De MeuterAuthors Info & Claims

ACM Computing Surveys (CSUR), Volume 47, Issue 4

Article No.: 62, Pages 1 - 27

https://doi.org/10.1145/2716320

Published: 26 May 2015 Publication History

Abstract

The Partitioned Global Address Space (PGAS) model is a parallel programming model that aims to improve programmer productivity while at the same time aiming for high performance. The main premise of PGAS is that a globally shared address space improves productivity, but that a distinction between local and remote data accesses is required to allow performance optimizations and to support scalability on large-scale parallel architectures. To this end, PGAS preserves the global address space while embracing awareness of nonuniform communication costs.

Today, about a dozen languages exist that adhere to the PGAS model. This survey proposes a definition and a taxonomy along four axes: how parallelism is introduced, how the address space is partitioned, how data is distributed among the partitions, and finally, how data is accessed across partitions. Our taxonomy reveals that today’s PGAS languages focus on distributing regular data and distinguish only between local and remote data access cost, whereas the distribution of irregular data and the adoption of richer data access cost models remain open challenges.

References

[1]

Eric Allen, David Chase, Joe Hallett, Victor Luchangco, Jan-Willem Maessen, Sukyoung Ryu, Guy L. Steele, and Sam Tobin-Hochstadt. 2008. The Fortress Language Specification, version 1.0. Technical Report. Sun Microsystems, Inc. 262 pages.

[2]

Dan Bonachea. 2002. GASNet Specification, v1.1. Technical Report. University of California at Berkeley, Berkeley, CA.

Digital Library

[3]

Dan Bonachea and Jason Duell. 2004. Problems with using MPI 1.1 and 2.0 as compilation targets for parallel language implementations. Int. J. High Perform. Comput. Netw. 1, 1--3 (Aug. 2004), 91--99.

Digital Library

[4]

Eugene D. Brooks III, Brent C. Gorda, and Karen H. Warren. 1992. The parallel C preprocessor. Scientific Programming 1, 1 (Jan. 1992), 79--89.

Digital Library

[5]

David Callahan and Ken Kennedy. 1988. Compiling programs for distributed memory multiprocessors. The Journal of Supercomputing 2, 2 (1988), 151--169.

[6]

William W. Carlson and Jesse M. Draper. 1995. Distributed data access in AC. In Proceedings of the 5th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPOPP’95). ACM, New York, NY, 39--47.

Digital Library

[7]

Bradford L. Chamberlain, David Callahan, and Hans P. Zima. 2007. Parallel programmability and the chapel language. International Journal of High Performance Computing Applications 21, 3 (2007), 291--312.

Digital Library

[8]

Barbara Chapman, Tony Curtis, Swaroop Pophale, Stephen Poole, Jeff Kuehn, Chuck Koelbel, and Lauren Smith. 2010. Introducing OpenSHMEM: SHMEM for the PGAS community. In Proceedings of the 4th Conference on Partitioned Global Address Space Programming Model (PGAS’10). ACM, Article 2, 3 pages.

Digital Library

[9]

Philippe Charles, Christian Grothoff, Vijay Saraswat, Christopher Donawa, Allan Kielstra, Kemal Ebcioğlu, Christoph von Praun, and Vivek Sarkar. 2005. X10: An object-oriented approach to non-uniform cluster computing. In Proceedings of the 20th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA’05). ACM, New York, NY, 519--538.

Digital Library

[10]

Sébastien Chauvin, Proshanta Saha, François Cantonnet, Smita Annareddy, and Tarek El-Ghazawi. 2005. UPC Manual (v1.2 ed.). The George Washington University.

[11]

Cray Inc. 1999. Cray T3E C and C++ Optimization Guide. Technical Report 0042178002. http://docs.cray.com/books/004-2178-002/004-2178-002-manual.pdf.

[12]

David E. Culler, Andrea Dusseau, Seth Copen Goldstein, Arvind Krishnamurthy, Steven Lumetta, Thorsten von Eicken, and Katherine Yelick. 1993. Parallel programming in Split-C. In Proceedings of the Supercomputing’93 Conference. ACM, 262--273.

Digital Library

[13]

Steven J. Deitz. 2005. High-Level Programming Language Abstractions for Advanced and Dynamic Parallel Computations. Dissertation. University of Washington.

Digital Library

[14]

Tarek El-Ghazawi, William Carlson, Thomas Sterling, and Katherine Yelick. 2005. UPC: Distributed Shared Memory Programming. Wiley, Hoboken, NJ. 252 pages.

Digital Library

[15]

Al Geist, William Gropp, Steven H. Lederman, Andrew Lumsdaine, Ewing L. Lusk, William Saphir, Tony Skjellum, and Marc Snir. 1996. MPI-2: Extending the message-passing interface. In Euro-Par’96: Proceedings of the 2nd International Euro-Par Conference on Parallel Processing. Springer-Verlag, 128--135.

Digital Library

[16]

High Performance Fortran Forum. 1993. High Performance Fortran Language Specification, version 1.0. Technical Report CRPC-TR92225. Center for Research on Parallel Computation, Rice University, Houston, Texas.

[17]

Ken Kennedy, Charles Koelbel, and Hans Zima. 2007. The rise and fall of high performance Fortran: An historical object lesson. In Proceedings of the 3rd ACM SIGPLAN Conference on History of Programming Languages (HOPL III). ACM, New York, NY, 7--1--7--22.

Digital Library

[18]

Charles H. Koelbel, David B. Loveman, Robert S. Schreiber, Guy L. Steele, Jr., and Mary E. Zosel. 1994. The High Performance Fortran Handbook. MIT Press, Cambridge, MA.

Digital Library

[19]

Jinpil Lee and Mitsuhisa Sato. 2010. Implementation and performance evaluation of XcalableMP: A parallel programming language for distributed memory systems. In Proceedings of the 2010 39th International Conference on Parallel Processing Workshops (ICPPW’10). IEEE Computer Society 413--420.

Digital Library

[20]

Calvin Lin and Lawrence Snyder. 1994. ZPL: An array sublanguage. In Proceedings of the 6th International Workshop on Languages and Compilers for Parallel Computing, Lecture Notes in Computer Science, Utpal Banerjee, David Gelernter, Alex Nicolau, and David Padua (Eds.), Vol. 768. Springer, 96--114.

Digital Library

[21]

Ewing L. Lusk and Katherine A. Yelick. 2007. Languages for high-productivity computing: The DARPA HPCS language project. Parallel Processing Letters 17, 1 (2007), 89--102.

[22]

Jarek Nieplocha and Bryan Carpenter. 1999. ARMCI: A portable remote memory copy library for distributed array libraries and compiler run-time systems. In Lecture Notes in Computer Science. Springer-Verlag, 533--546.

Digital Library

[23]

Jaroslaw Nieplocha, Robert J. Harrison, and Richard J. Littlefield. 1994. Global arrays: A portable “shared-memory” programming model for distributed memory computers. In Proceedings Supercomputing’94. 340--349.

Digital Library

[24]

Robert W. Numrich and John Reid. 1998. Co-Array Fortran for parallel programming. ACM Fortran Forum 17, 2 (1998), 1--31.

Digital Library

[25]

Robert W. Numrich and John Reid. 2005. Co-arrays in the next Fortran Standard. SIGPLAN Fortran Forum 24, 2 (Aug. 2005), 4--17.

Digital Library

[26]

Franz-Josef Pfreundt. 2010. The Building Blocks for HPC: GPI and MCTP. Technical Report. Fraunhofer Institut für Techno-und-Wirtschaftsmathematik (ITWM). Retrieved from http://www.gpi-site.com/cms/sites/default/files/GPI_Whitepaper.pdf.

[27]

John T. Richards, Jonathan Brezin, Calvin B. Swart, and Christine A. Halverson. 2014. A decade of progress in parallel programming productivity. Commun. ACM 57, 11 (October 2014), 60--66.

Digital Library

[28]

Lawrence Snyder. 2007. The design and development of ZPL. In Proceedings of the 3rd ACM SIGPLAN Conference on History of Programming Languages (HOPL III). ACM, 8--1--8--37.

Digital Library

[29]

Herb Sutter. 2005. The free lunch is over: A fundamental turn toward concurrency in software. Dr. Dobb’s Journal 30, 3 (March 2005), 1--1.

[30]

Thinking Machines Corporation. 1991. CM Fortran Reference Manual, Version 1.0. Cambridge, Massachusetts.

[31]

UPC Consortium. 2005. UPC Language Specification, v1.2. Technical Report LBNL-59208. Lawrence Berkeley National Laboratory.

[32]

Yonghong Yan, Jisheng Zhao, Yi Guo, and Vivek Sarkar. 2009. Hierarchical place trees: A portable abstraction for task parallelism and data movement. In Languages and Compilers for Parallel Computing. 172--187.

Digital Library

[33]

Katherine A. Yelick, Luigi Semenzato, Geoff Pike, Carleton Miyamoto, Ben Liblit, Arvind Krishnamurthy, Paul N. Hilfinger, Susan L. Graham, David Gay, Phillip Colella, and Alexander Aiken. 1998. Titanium: A high-performance java dialect. Concurrency: Practice and Experience 10, 11--13 (1998), 825--836.

[34]

Hans P. Zima, Heinz-J. Bast, and Michael Gerndt. 1988. SUPERB: A tool for semiautomatic MIMD/SIMD parallelization. Parallel Comput. 6, 1 (1988), 1--18.

[35]

ZPL Research Group. 2003. A Comic Book Introduction to ZPL. Department of Computer Science, University of Washington Seattle, WA. Retrieved from http://www.cs.washington.edu/research/zpl/comicbook/comicbook.html.

Cited By

Rolinger TSussman A(2024)Adaptive Prefetching for Fine-grain Communication in PGAS Programs2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS57955.2024.00071(740-751)Online publication date: 27-May-2024
https://doi.org/10.1109/IPDPS57955.2024.00071
Finnerty PPosner JBürger JTakaoka LKanzaki T(2024)On the Performance of Malleable APGAS Programs and Batch Job SchedulersSN Computer Science10.1007/s42979-024-02641-75:4Online publication date: 27-Mar-2024
https://dl.acm.org/doi/10.1007/s42979-024-02641-7
Salvaneschi GWeisenburger P(2024)Bridging Between Active Objects: Multitier Programming for Distributed, Concurrent SystemsActive Object Languages: Current Research Trends10.1007/978-3-031-51060-1_4(92-122)Online publication date: 29-Jan-2024
https://doi.org/10.1007/978-3-031-51060-1_4
Show More Cited By

Index Terms

Partitioned Global Address Space Languages
1. Software and its engineering
  1. Software notations and tools
    1. General programming languages
      1. Language features
      2. Language types

Recommendations

Productivity and performance using partitioned global address space languages
PASCO '07: Proceedings of the 2007 international workshop on Parallel symbolic computation

Partitioned Global Address Space (PGAS) languages combine the programming convenience of shared memory with the locality and performance control of message passing. One such language, Unified Parallel C (UPC) is an extension of ISO C defined by a ...
Tuning collective communication for Partitioned Global Address Space programming models

Partitioned Global Address Space (PGAS) languages offer programmers the convenience of a shared memory programming style combined with locality control necessary to run on large-scale distributed memory systems. Even within a PGAS language programmers ...
Asynchronous PGAS runtime for Myrinet networks
PGAS '10: Proceedings of the Fourth Conference on Partitioned Global Address Space Programming Model

PGAS languages aim to enhance productivity for large scale systems. The IBM Asynchronous PGAS runtime (APGAS) supports various high productivity programming languages including UPC, X10 and CAF. The runtime has been designed for scalability and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys

ACM Computing Surveys Volume 47, Issue 4

July 2015

573 pages

ISSN:0360-0300

EISSN:1557-7341

DOI:10.1145/2775083

Editor:
Sartaj Sahni
Department of Computer and Information Science and Engineering/University of Florida/Gainesville, FL

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 May 2015

Accepted: 01 January 2015

Revised: 01 November 2014

Received: 01 June 2013

Published in CSUR Volume 47, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey
Research
Refereed

Funding Sources

Agentschap voor Innovatie door Wetenschap en Technologie

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

50
Total Citations
View Citations
974
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)3

Reflects downloads up to 30 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rolinger TSussman A(2024)Adaptive Prefetching for Fine-grain Communication in PGAS Programs2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS57955.2024.00071(740-751)Online publication date: 27-May-2024
https://doi.org/10.1109/IPDPS57955.2024.00071
Finnerty PPosner JBürger JTakaoka LKanzaki T(2024)On the Performance of Malleable APGAS Programs and Batch Job SchedulersSN Computer Science10.1007/s42979-024-02641-75:4Online publication date: 27-Mar-2024
https://dl.acm.org/doi/10.1007/s42979-024-02641-7
Salvaneschi GWeisenburger P(2024)Bridging Between Active Objects: Multitier Programming for Distributed, Concurrent SystemsActive Object Languages: Current Research Trends10.1007/978-3-031-51060-1_4(92-122)Online publication date: 29-Jan-2024
https://doi.org/10.1007/978-3-031-51060-1_4
De Carvalho Junior FCarneiro T(2023)A Component Model for Multilevel Parallel ProgrammingProceedings of the XXVII Brazilian Symposium on Programming Languages10.1145/3624309.3624318(25-32)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3624309.3624318
Lu HSao PMatheson MKannan RWang FPotok T(2023)Optimizing Communication in 2D Grid-Based MPI Applications at ExascaleProceedings of the 30th European MPI Users' Group Meeting10.1145/3615318.3615327(1-11)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3615318.3615327
Casadei R(2023)Macroprogramming: Concepts, State of the Art, and Opportunities of Macroscopic Behaviour ModellingACM Computing Surveys10.1145/357935355:13s(1-37)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3579353
Zhong KCui WChen XLi QYang ZLu YYan XLuo SYuan QHuang K(2023)Revisiting Swapping in User-Space With Lightweight ThreadingIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.327495342:11(4205-4218)Online publication date: Nov-2023
https://doi.org/10.1109/TCAD.2023.3274953
Bartelheimer NNeuwirth S(2023)Toward Reproducible Benchmarking of PGAS and MPI Communication Schemes2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS60453.2023.00268(1959-1967)Online publication date: 17-Dec-2023
https://doi.org/10.1109/ICPADS60453.2023.00268
Asgari MYang WLindsay JShao HLiu YDe Queiroga Miranda RDehnavi M(2023)Development of a knowledge-sharing parallel computing approach for calibrating distributed watershed hydrologic modelsEnvironmental Modelling & Software10.1016/j.envsoft.2023.105708164(105708)Online publication date: Jun-2023
https://doi.org/10.1016/j.envsoft.2023.105708
Finnerty PTakaoka LKanzaki TPosner J(2023)Malleable APGAS Programs and Their Support in Batch Job SchedulersEuro-Par 2023: Parallel Processing Workshops10.1007/978-3-031-48803-0_8(89-101)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-48803-0_8
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents