Article

Open MPI: a flexible high performance MPI

Authors:

Richard L. Graham,

Timothy S. Woodall,

Jeffrey M. SquyresAuthors Info & Claims

PPAM'05: Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics

Pages 228 - 239

https://doi.org/10.1007/11752578_29

Published: 11 September 2005 Publication History

Publisher Site

Abstract

A large number of MPI implementations are currently available, each of which emphasize different aspects of high-performance computing or are intended to solve a specific research problem. The result is a myriad of incompatible MPI implementations, all of which require separate installation, and the combination of which present significant logistical challenges for end users. Building upon prior research, and influenced by experience gained from the code bases of the LAM/MPI, LA-MPI, FT-MPI, and PACX-MPI projects, Open MPI is an all-new, production-quality MPI-2 implementation that is fundamentally centered around component concepts. Open MPI provides a unique combination of novel features previously unavailable in an open-source, production-quality implementation of MPI. Its component architecture provides both a stable platform for third-party research as well as enabling the run-time composition of independent software add-ons. This paper presents a high-level overview the goals, design, and implementation of Open MPI, as well as performance results for it's point-to-point implementation.

References

[1]

G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Fedak, C. Germain, T. Herault, P. Lemarinier, O. Lodygensky, F. Magniette, V. Neri, and A. Selikhov. MPICH-V: Toward a scalable fault tolerant MPI for volatile nodes. In SC'2002 Conference CD, Baltimore, MD, 2002. IEEE/ACM SIGARCH. pap298, LRI.

Digital Library

Google Scholar

[2]

D. E. Bernholdt et. all. A component architecture for high-performance scientific computing. Intl. J. High-Performance Computing Applications, 2004.

Google Scholar

[3]

G. E. Fagg, E. Gabriel, Z. Chen, T. Angskun, G. Bosilca, A. Bukovski, and J. J. Dongarra. Fault tolerant communication library and applications for high perofrmance. In Los Alamos Computer Science Institute Symposium, Santa Fee, NM, October 27-29 2003.

Google Scholar

[4]

R. L. Graham, S.-E. Choi, D. J. Daniel, N. N. Desai, R. G. Minnich, C. E. Rasmussen, L. D. Risinger, and M. W. Sukalksi. A network-failure-tolerant message-passing system for terascale clusters. International Journal of Parallel Programming, 31(4):285-303, August 2003.

Digital Library

Google Scholar

[5]

Rainer Keller, Edgar Gabriel, Bettina Krammer, Matthias S. Mueller, and Michael M. Resch. Towards efficient execution of parallel applications on the grid: porting and optimization issues. International Journal of Grid Computing, 1(2):133-149, 2003.

Crossref

Google Scholar

[6]

Jiuxing Liu, Jiesheng Wu, Sushmitha P. Kini, Pete Wyckoff, and Dhabaleswar K. Panda. High performance RDMA-based MPI implementation over infiniband. In ICS '03: Proceedings of the 17th annual international conference on Supercomputing, pages 295-304, New York, NY, USA, 2003. ACM Press.

Digital Library

Google Scholar

[7]

Message Passing Interface Forum. MPI: A Message Passing Interface Standard, June 1995. http://www.mpi-forum.org/.

Google Scholar

[8]

Message Passing Interface Forum. MPI-2: Extensions to the Message Passing Interface, July 1997. http://www.mpi-forum.org/.

Google Scholar

[9]

MPICH2. http://www.mcs.anl.gov/mpi/mpich2/.

Google Scholar

[10]

Sriram Sankaran, Jeffrey M. Squyres, Brian Barrett, Andrew Lumsdaine, Jason Duell, Paul Hargrove, and Eric Roman. The LAM/MPI checkpoint/restart framework: System-initiated checkpointing. International Journal of High Performance Computing Applications, To appear, 2004.

Google Scholar

[11]

Galen M. Shipman. Infiniband scalability in Open MPI. Master's thesis, University of New Mexico, December 2005.

Google Scholar

[12]

Q. O. Snell, A. R. Mikler, and J. L. Gustafson. NetPIPE: A Network Protocol Independent Performace Evaluator. In IASTED International Conference on Intelligent Information Management and Systems, June 1996.

Google Scholar

[13]

J. M. Squyres and A. Lumsdaine. A Component Architecture for LAM/MPI. In Proceedings, 10th European PVM/MPI Users' Group Meeting, number 2840 in Lecture Notes in Computer Science, Venice, Italy, Sept. 2003. Springer.

Google Scholar

[14]

Rajeev Thakur, William Gropp, and Ewing Lusk. Data sieving and collective I/O in ROMIO. In Proceedings of the 7th Symposium on the Frontiers of Massively Parallel Computation, pages 182-189. IEEE Computer Society Press, Feb 1999.

Digital Library

Google Scholar

Cited By

View all

De Vita CCaramiello DMellone GSánchez-Gallegos GSánchez-Gallegos DMele VCavallo SDi Luccio DColonnelli ICasanova HMontella R(2024)An ad-hoc file system accelerated workflow application for accidental fire fast responseProceedings of the 2nd Workshop on Workflows in Distributed Environments10.1145/3642978.3652836(21-27)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642978.3652836
Xu YBelyaev LJain TSchafer DSkjellum ACooperman G(2023)Implementation-Oblivious Transparent Checkpoint-Restart for MPIProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624255(1738-1747)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624255
Nived MEswaran V(2023)A massively parallel implicit 3D unstructured grid solver for computing turbulent flows on latest distributed memory computational architecturesJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104750182:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.jpdc.2023.104750
Show More Cited By

Open MPI: a flexible high performance MPI
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures

Recommendations

Open issues in MPI implementation
ACSAC'07: Proceedings of the 12th Asia-Pacific conference on Advances in Computer Systems Architecture

MPI (the Message Passing Interface) continues to be the dominant programming model for parallel machines of all sizes, from small Linux clusters to the largest parallel supercomputers such as IBM Blue Gene/L and Cray XT3. Although the MPI standard was ...
MPI + MPI: a new hybrid approach to parallel programming with MPI plus shared memory

Hybrid parallel programming with the message passing interface (MPI) for internode communication in conjunction with a shared-memory programming model to manage intranode parallelism has become a dominant approach to scalable parallel programming. While ...
Performance Evaluation of Open MPI on Cray XE/XK Systems
HOTI '12: Proceedings of the 2012 IEEE 20th Annual Symposium on High-Performance Interconnects

Open MPI is a widely used open-source implementation of the MPI-2 standard that supports a variety of platforms and interconnects. Current versions of Open MPI, however, lack support for the Cray XE6 and XK6 architectures -- both of which use the Gemini ...

Comments

Information & Contributors

Information

Published In

PPAM'05: Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics

September 2005

1121 pages

ISBN:3540341412

Editors:
Roman Wyrzykowski
Institute of Computational and Information Sciences, Czestochowa University of Technology
,
Jack Dongarra
Computer Science Department, University of Tennessee, Knoxville, TN
,
Norbert Meyer
Computer Science Department, Poznan Supercomputing and Networking Center, Knoxville, TN, Poland
,
Jerzy Waśniewski
Informatics & Mathematical Modeling, Technical University of Denmark, Lyngby, DK, Denmark

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 11 September 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

De Vita CCaramiello DMellone GSánchez-Gallegos GSánchez-Gallegos DMele VCavallo SDi Luccio DColonnelli ICasanova HMontella R(2024)An ad-hoc file system accelerated workflow application for accidental fire fast responseProceedings of the 2nd Workshop on Workflows in Distributed Environments10.1145/3642978.3652836(21-27)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642978.3652836
Xu YBelyaev LJain TSchafer DSkjellum ACooperman G(2023)Implementation-Oblivious Transparent Checkpoint-Restart for MPIProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624255(1738-1747)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624255
Nived MEswaran V(2023)A massively parallel implicit 3D unstructured grid solver for computing turbulent flows on latest distributed memory computational architecturesJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104750182:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.jpdc.2023.104750
Huber DSchreiber MSchulz M(2023)A Case Study on PMIx-Usage for Dynamic Resource ManagementHigh Performance Computing10.1007/978-3-031-40843-4_4(42-55)Online publication date: 21-May-2023
https://dl.acm.org/doi/10.1007/978-3-031-40843-4_4
Elfarouk HKent QChandra CKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)Faster and scalable algorithms for densest subgraph and decompositionProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602225(26966-26979)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602225
Sumimoto SArakawa TSakaguchi YMatsuba HYashiro HHanawa TNakajima K(2022)A System-Wide Communication to Couple Multiple MPI Programs for Heterogeneous ComputingParallel and Distributed Computing, Applications and Technologies10.1007/978-3-031-29927-8_25(314-327)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1007/978-3-031-29927-8_25
Khalilov MTimofeev APolyakov D(2022)Towards OpenUCX and GPUDirect Technology Support for the Angara InterconnectSupercomputing10.1007/978-3-031-22941-1_43(591-603)Online publication date: 26-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-22941-1_43
Smith ARiley JSyed MKupcevic MEdmon PYockel SFurlani T(2019)Exploring Untrusted Distributed Storage for High Performance ComputingPractice and Experience in Advanced Research Computing 2019: Rise of the Machines (learning)10.1145/3332186.3332224(1-6)Online publication date: 28-Jul-2019
https://dl.acm.org/doi/10.1145/3332186.3332224
Alsmadi IKhreishah AXu D(2018)Network slicing to improve multicasting in HPC clustersCluster Computing10.5555/3287988.328800121:3(1493-1506)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.5555/3287988.3288001
Hjelm NDosanjh MGrant RGroves TBridges PArnold D(2018)Improving MPI Multi-threaded RMA Communication PerformanceProceedings of the 47th International Conference on Parallel Processing10.1145/3225058.3225114(1-11)Online publication date: 13-Aug-2018
https://dl.acm.org/doi/10.1145/3225058.3225114
Show More Cited By

Abstract

References

Cited By

Recommendations

Open issues in MPI implementation

MPI + MPI: a new hybrid approach to parallel programming with MPI plus shared memory

Performance Evaluation of Open MPI on Cray XE/XK Systems

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations