poster

POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures

Authors:

Shigang Li,

Yunquan Zhang,

Torsten HoeflerAuthors Info & Claims

PPoPP '17: Proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

Pages 445 - 446

https://doi.org/10.1145/3018743.3019025

Published: 26 January 2017 Publication History

Get Access

Abstract

In the many-core era, the performance of MPI collectives is more dependent on the intra-node communication component. However, the communication algorithms generally inherit from the inter-node version and ignore the cache complexity. We propose cache-oblivious algorithms for MPI all-to-all operations, in which data blocks are copied into the receive buffers in Morton order to exploit data locality. Experimental results on different many-core architectures show that our cache-oblivious implementations significantly outperform the naive implementations based on shared heap and the highly optimized MPI libraries.

References

[1]

M. Frigo, C. E. Leiserson, H. Prokop, and S. Ramachandran. Cache-oblivious algorithms. ACM Transactions on Algorithms (TALG), 8 (1): 4, 2012.

Digital Library

Google Scholar

[2]

S. Li, T. Hoefler, and M. Snir. NUMA-aware shared-memory collective communication for MPI. In Proceedings of the 22nd international symposium on High-performance parallel and distributed computing, pages 85--96. ACM, 2013.

Digital Library

Google Scholar

[3]

S. Li, T. Hoefler, C. Hu, and M. Snir. Improved MPI collectives for MPI processes in shared address spaces. Cluster Computing, 17 (4): 1139--1155, 2014.

Digital Library

Google Scholar

[4]

G. M. Morton. A computer oriented geodetic data base and a new technique in file sequencing. International Business Machines Company New York, 1966.

Google Scholar

[5]

012)]MPIMPI Forum. MPI: A Message-Passing Interface standard. Version 3.0, September 2012.

Google Scholar

[6]

R. Thakur, R. Rabenseifner, and W. Gropp. Optimization of collective communication operations in MPICH. International Journal of High Performance Computing Applications, 19 (1): 49--66, 2005.

Digital Library

Google Scholar

Cited By

View all

Sabrigiriraj MManoharan K(2019)Wavelength Allotment for All-to-All Broadcast in WDM Optical Modified Linear Array for Reliable CommunicationMobile Networks and Applications10.1007/s11036-017-0908-824:2(350-356)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s11036-017-0908-8
Salmankurt BGürel H(2019)Computational aspects of nanostructures: PW vs AO calculations10.1063/1.5091118(020001)Online publication date: 2019
https://doi.org/10.1063/1.5091118
Chen LLi SZhou CLiu FXu RLi SWang JZhang B(2019)Diverse Demands Estimation and Ranking Based on User BehaviorsHigh-Performance Computing Applications in Numerical Simulation and Edge Computing10.1007/978-981-32-9987-0_7(69-78)Online publication date: 29-Aug-2019
https://doi.org/10.1007/978-981-32-9987-0_7
Show More Cited By

Index Terms

POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures

Recommendations

POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures
PPoPP '17

In the many-core era, the performance of MPI collectives is more dependent on the intra-node communication component. However, the communication algorithms generally inherit from the inter-node version and ignore the cache complexity. We propose cache-...
Poster: An MPI Library implementing Direct Communication for Many-Core Based Accelerators
SCC '12: Proceedings of the 2012 SC Companion: High Performance Computing, Networking Storage and Analysis

DCFA-MPI is an MPI library implementation for manycore-based clusters, whose compute node consists of Intel MIC (Many Integrated Core) connected to the host via PCI Express with InfiniBand. DCFA-MPI enables direct data transfer between MIC units without ...
A Synergetic Approach to Throughput Computing on x86-Based Multicore Desktops

In the era of multicores, many applications that require substantial computing power and data crunching can now run on desktop PCs. However, to achieve the best possible performance, developers must write applications in a way that exploits both ...

Comments

Information & Contributors

Information

Published In

PPoPP '17: Proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

January 2017

476 pages

ISBN:9781450344937

DOI:10.1145/3018743

General Chair:
Vivek Sarkar
Rice University, USA
,
Program Chair:
Lawrence Rauchwerger
Texas A&M University, USA

ACM SIGPLAN Notices Volume 52, Issue 8
PPoPP '17
August 2017
442 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/3155284
Editor:
Matthew Fluet
Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 January 2017

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

National Natural Science Foundation of China
National Key Research and Development Program of China

Conference

PPoPP '17

Sponsor:

SIGPLAN

PPoPP '17: 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

February 4 - 8, 2017

Texas, Austin, USA

Acceptance Rates

PPoPP '17 Paper Acceptance Rate 29 of 132 submissions, 22%;

Overall Acceptance Rate 230 of 1,014 submissions, 23%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
261
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sabrigiriraj MManoharan K(2019)Wavelength Allotment for All-to-All Broadcast in WDM Optical Modified Linear Array for Reliable CommunicationMobile Networks and Applications10.1007/s11036-017-0908-824:2(350-356)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s11036-017-0908-8
Salmankurt BGürel H(2019)Computational aspects of nanostructures: PW vs AO calculations10.1063/1.5091118(020001)Online publication date: 2019
https://doi.org/10.1063/1.5091118
Chen LLi SZhou CLiu FXu RLi SWang JZhang B(2019)Diverse Demands Estimation and Ranking Based on User BehaviorsHigh-Performance Computing Applications in Numerical Simulation and Edge Computing10.1007/978-981-32-9987-0_7(69-78)Online publication date: 29-Aug-2019
https://doi.org/10.1007/978-981-32-9987-0_7
Chen LZhang BLiu FLi JSun C(2019)Topology Layout Technology of Energy InternetHigh-Performance Computing Applications in Numerical Simulation and Edge Computing10.1007/978-981-32-9987-0_20(235-245)Online publication date: 29-Aug-2019
https://doi.org/10.1007/978-981-32-9987-0_20

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures

Poster: An MPI Library implementing Direct Communication for Many-Core Based Accelerators

A Synergetic Approach to Throughput Computing on x86-Based Multicore Desktops