research-article

Public Access

Exposition, clarification, and expansion of MPI semantic terms and conventions: is a nonblocking MPI function permitted to block?

Authors:

Purushotham V. Bangalore,

Rolf Rabenseifner,

Daniel J. Holmes,

Guillaume Mercier,

Claudia Blaas-Schenner,

Anthony SkjellumAuthors Info & Claims

EuroMPI '19: Proceedings of the 26th European MPI Users' Group Meeting

Article No.: 2, Pages 1 - 10

https://doi.org/10.1145/3343211.3343213

Published: 11 September 2019 Publication History

Abstract

This paper offers a timely study and proposed clarifications, revisions, and enhancements to the Message Passing Interface's (MPI's) Semantic Terms and Conventions. To enhance MPI, a clearer understanding of the meaning of the key terminology has proven essential, and, surprisingly, important concepts remain underspecified, ambiguous and, in some cases, inconsistent and/or conflicting despite 26 years of standardization. This work addresses these concerns comprehensively and usefully informs MPI developers, implementors, those teaching and learning MPI, and power users alike about key aspects of existing conventions, syntax, and semantics. This paper will also be a useful driver for great clarity in current and future standardization and implementation efforts for MPI.

References

[1]

Barbara Chapman, Tony Curtis, Swaroop Pophale, Stephen Poole, Jeff Kuehn, Chuck Koelbel, and Lauren Smith. 2010. Introducing OpenSHMEM: SHMEM for the PGAS Community. In Proceedings of the Fourth Conference on Partitioned Global Address Space Programming Model (PGAS '10). ACM, New York, NY, USA, Article 2, 3 pages.

Digital Library

[2]

Leonardo Dagum and Ramesh Menon. 1998. OpenMP: An Industry-Standard API for Shared-Memory Programming. IEEE Comput. Sci. Eng. 5, 1 (Jan. 1998), 46--55.

Digital Library

[3]

Message Passing Interface Forum. 1994. MPI: A Message-Passing Interface Standard. Version 1.0. Technical Report. Univ. of Tennessee, Knoxville, TN, USA.

Digital Library

[4]

Message Passing Interface Forum. 1997. MPI: A Message-Passing Interface Standard. Version 2.0. Technical Report. Univ. of Tennessee, Knoxville, TN, USA.

[5]

Message Passing Interface Forum. 2008. MPI: A Message-Passing Interface Standard. Version 2.1. Technical Report. Univ. of Tennessee, Knoxville, TN, USA.

[6]

Message Passing Interface Forum. 2015. MPI: A Message-Passing Interface Standard. Version 3.1. Technical Report. Univ. of Tennessee, Knoxville, TN, USA.

[7]

Message Passing Interface Forum. 2018. MPI: A Message-Passing Interface Standard. 2018 Draft Specification. Technical Report. Univ. of Tennessee, Knoxville, TN, USA. Note: This is the first MPI-4 Draft Specification.

[8]

Ganesh Gopalakrishnan, Robert M. Kirby, Stephen F. Siegel, Rajeev Thakur, William Gropp, Ewing L. Lusk, Bronis R. de Supinski, Martin Schulz, and Greg Bronevetsky. 2011. Formal analysis of MPI-based parallel programs. Commun. ACM 54, 12 (2011), 82--91.

Digital Library

[9]

Guodong Li, Michael Delisi, Ganesh Gopalakrishnan, and Robert M. Kirby. 2008. Formal Specification of the MPI-2.0 Standard in TLA+. In Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP '08). ACM, New York, NY, USA, 283--284.

Digital Library

[10]

Guodong Li, Robert Palmer, Michael DeLisi, Ganesh Gopalakrishnan, and Robert M. Kirby. 2011. Formal specification of MPI 2.0: Case study in specifying a practical concurrent programming API. Science of Computer Programming 76, 2 (2011), 65 -- 81.

Digital Library

[11]

Robert Palmer, Michael DeLisi, Ganesh Gopalakrishnan, and Robert M. Kirby. 2008. An Approach to Formalization and Analysis of Message Passing Libraries. In Formal Methods for Industrial Critical Systems, Stefan Leue and Pedro Merino (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 164--181.

Digital Library

[12]

Stephen F. Siegel. 2007. Model Checking Nonblocking MPI Programs. In Verification, Model Checking, and Abstract Interpretation, Byron Cook and Andreas Podelski (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 44--58.

Digital Library

[13]

Stephen F. Siegel and George S. Avrunin. 2004. Verification of MPI-Based Software for Scientific Computation. In Model Checking Software, Susanne Graf and Laurent Mounier (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 286--303.

[14]

Sarvani Vakkalanka, Anh Vo, Ganesh Gopalakrishnan, and Robert M. Kirby. 2009. Reduced Execution Semantics of MPI: From Theory to Practice. In FM 2009: Formal Methods, Ana Cavalcanti and Dennis R. Dams (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 724--740.

Digital Library

[15]

Stephen R. Walli. 1995. The POSIX Family of Standards. StandardView 3, 1 (March 1995), 11--17.

Digital Library

Cited By

Loubach D(2021)An Overview of Cyber-Physical Systems’ Hardware Architecture Concerning Machine Learning2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC)10.1109/DASC52595.2021.9594429(1-6)Online publication date: 3-Oct-2021
https://doi.org/10.1109/DASC52595.2021.9594429
Schuchart JNiethammer CGracia J(2020)Fibers are not (P)ThreadsProceedings of the 27th European MPI Users' Group Meeting10.1145/3416315.3416320(39-50)Online publication date: 21-Sep-2020
https://dl.acm.org/doi/10.1145/3416315.3416320
Holmes DSkjellum ASchafer D(2020)Why is MPI (perceived to be) so complex?Proceedings of the 27th European MPI Users' Group Meeting10.1145/3416315.3416318(21-30)Online publication date: 21-Sep-2020
https://dl.acm.org/doi/10.1145/3416315.3416318
Show More Cited By

Index Terms

Exposition, clarification, and expansion of MPI semantic terms and conventions: is a nonblocking MPI function permitted to block?
1. Computing methodologies
  1. Parallel computing methodologies

Recommendations

Performance Evaluation of MPI Implementations and MPI-Based Parallel ELLPACK Solvers
MPIDC '96: Proceedings of the Second MPI Developers Conference

Abstract: We are concerned with the parallelization of finite element mesh generation and its decomposition, and the parallel solution of sparse algebraic equations which are obtained from the parallel discretization of second order elliptic partial ...
MPICH on the T3D: A Case Study of High-Performance Message Passing
MPIDC '96: Proceedings of the Second MPI Developers Conference

This paper describes the design, implementation and performance of a port of the Argonne National Laboratory/Mississippi State University MPICH implementation of the Message Passing Interface standard to the Cray T3D massively parallel processing ...
MT-MPI: multithreaded MPI for many-core environments
ICS '14: Proceedings of the 28th ACM international conference on Supercomputing

Many-core architectures, such as the Intel Xeon Phi, provide dozens of cores and hundreds of hardware threads. To utilize such architectures, application programmers are increasingly looking at hybrid programming models, where multiple threads interact ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EuroMPI '19: Proceedings of the 26th European MPI Users' Group Meeting

September 2019

134 pages

ISBN:9781450371759

DOI:10.1145/3343211

Editors:
Torsten Hoefler
ETH, Zürich
,
Jesper Larsson Träff
TU Wien, Austria

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

EuroMPI 2019

EuroMPI 2019: 26th European MPI Users' Group Meeting

September 11 - 13, 2019

Zürich, Switzerland

Acceptance Rates

EuroMPI '19 Paper Acceptance Rate 13 of 26 submissions, 50%;

Overall Acceptance Rate 66 of 139 submissions, 47%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
301
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)11

Reflects downloads up to 01 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Loubach D(2021)An Overview of Cyber-Physical Systems’ Hardware Architecture Concerning Machine Learning2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC)10.1109/DASC52595.2021.9594429(1-6)Online publication date: 3-Oct-2021
https://doi.org/10.1109/DASC52595.2021.9594429
Schuchart JNiethammer CGracia J(2020)Fibers are not (P)ThreadsProceedings of the 27th European MPI Users' Group Meeting10.1145/3416315.3416320(39-50)Online publication date: 21-Sep-2020
https://dl.acm.org/doi/10.1145/3416315.3416320
Holmes DSkjellum ASchafer D(2020)Why is MPI (perceived to be) so complex?Proceedings of the 27th European MPI Users' Group Meeting10.1145/3416315.3416318(21-30)Online publication date: 21-Sep-2020
https://dl.acm.org/doi/10.1145/3416315.3416318
Barbosa CLemarinier PSergent MPapaure GPerache M(2020)Overlapping MPI communications with Intel TBB computation2020 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW50202.2020.00159(958-966)Online publication date: May-2020
https://doi.org/10.1109/IPDPSW50202.2020.00159
Schafer DGhafoor SHolmes DRuefenacht MSkjellum A(2019)User-Level Scheduled Communications for MPI2019 IEEE 26th International Conference on High Performance Computing, Data, and Analytics (HiPC)10.1109/HiPC.2019.00043(290-300)Online publication date: Dec-2019
https://doi.org/10.1109/HiPC.2019.00043

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents