article

Optimizing noncontiguous accesses in MPI – IO

Authors:

Rajeev Thakur,

William Gropp, and

Ewing LuskAuthors Info & Claims

Parallel Computing, Volume 28, Issue 1

Pages 83 - 105

https://doi.org/10.1016/S0167-8191(01)00129-6

Published: 07 January 2002 Publication History

Abstract

No abstract available.

Cited By

View all

Weiß RLesnik SGaleazzo FRuopp ARusche H(2024)Coherent mesh representation for parallel I/O of unstructured polyhedral meshesThe Journal of Supercomputing10.1007/s11227-024-06051-780:11(16112-16132)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s11227-024-06051-7
Bez JByna SIbrahim S(2023)I/O Access Patterns in HPC Applications: A 360-Degree SurveyACM Computing Surveys10.1145/361100756:2(1-41)Online publication date: 15-Sep-2023
https://dl.acm.org/doi/10.1145/3611007
Yang YKwon YKim JCho I(2023)Ultra Data-Oriented Parallel Fractional Hot-Deck Imputation With Efficient Linearized Variance EstimationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.324956735:9(9754-9768)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1109/TKDE.2023.3249567
Show More Cited By

Index Terms

Optimizing noncontiguous accesses in MPI – IO
1. Computer systems organization
  1. Architectures
    1. Parallel architectures
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Communications management
        Input / output

Recommendations

MPI windows on storage for HPC applications
EuroMPI '17: Proceedings of the 24th European MPI Users' Group Meeting

Upcoming HPC clusters will feature hybrid memories and storage devices per compute node. In this work, we propose to use the MPI one-sided communication model and MPI windows as unique interface for programming memory and storage. We describe the design ...
Read More
MPI-IO/Gfarm: An Optimized Implementation of MPI-IO for the Gfarm File System
CCGRID '11: Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

This paper proposes a design and implementation of an MPI-IO implementation of the Gfarm file system, called MPI-IO/Gfarm. The Gfarm file system is a global file system that federates the local storage of compute nodes among several clusters. It has a ...
Read More
Integrating collective I/O and cooperative caching into the "clusterfile" parallel file system
ICS '04: Proceedings of the 18th annual international conference on Supercomputing

This paper presents the integration of two collective I/O techniques into the Clusterfile parallel file system: disk-directed I/O and two-phase I/O. We show that global cooperative cache management improves the collective I/O performance. The solution ...
Read More

Comments

Information & Contributors

Information

Published In

Parallel Computing Volume 28, Issue 1

January, 2002

145 pages

ISSN:0167-8191

Issue’s Table of Contents

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 07 January 2002

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

View all

Weiß RLesnik SGaleazzo FRuopp ARusche H(2024)Coherent mesh representation for parallel I/O of unstructured polyhedral meshesThe Journal of Supercomputing10.1007/s11227-024-06051-780:11(16112-16132)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s11227-024-06051-7
Bez JByna SIbrahim S(2023)I/O Access Patterns in HPC Applications: A 360-Degree SurveyACM Computing Surveys10.1145/361100756:2(1-41)Online publication date: 15-Sep-2023
https://dl.acm.org/doi/10.1145/3611007
Yang YKwon YKim JCho I(2023)Ultra Data-Oriented Parallel Fractional Hot-Deck Imputation With Efficient Linearized Variance EstimationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.324956735:9(9754-9768)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1109/TKDE.2023.3249567
Seiz MOffenhäuser PAndersson SHötzer JHierl HNestler BResch M(2021)Lustre I/O performance investigations on Hazel Hen: experiments and heuristicsThe Journal of Supercomputing10.1007/s11227-021-03730-777:11(12508-12536)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1007/s11227-021-03730-7
Tessier FGressier PVishwanath V(2018)Optimizing Data Aggregation by Leveraging the Deep Memory Hierarchy on Large-scale SystemsProceedings of the 2018 International Conference on Supercomputing10.1145/3205289.3205316(229-239)Online publication date: 12-Jun-2018
https://dl.acm.org/doi/10.1145/3205289.3205316
Tsujita YHori AKameyama TUno AShoji FIshikawa Y(2018)Improving Collective MPI-IO Using Topology-Aware Stepwise Data Aggregation with I/O ThrottlingProceedings of the International Conference on High Performance Computing in Asia-Pacific Region10.1145/3149457.3149464(12-23)Online publication date: 28-Jan-2018
https://dl.acm.org/doi/10.1145/3149457.3149464
Malakar PVishwanath V(2017)Hierarchical Read---Write Optimizations for Scientific Applications with Multi-variable Structured DatasetsInternational Journal of Parallel Programming10.1007/s10766-015-0388-z45:1(94-108)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s10766-015-0388-z
Tessier FMalakar PVishwanath VJeannot EIsaila F(2016)Topology-aware data aggregation for intensive I/O on large-scale supercomputersProceedings of the First Workshop on Optimization of Communication in HPC10.5555/3018058.3018066(73-81)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3018058.3018066
Kunkel JAguilera AHübbe NWiedemann MZimmer M(2015)Monitoring energy consumption with SIOXComputer Science - Research and Development10.1007/s00450-014-0271-y30:2(125-133)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1007/s00450-014-0271-y
Kunkel JZimmer MHübbe NAguilera AMickler HWang XChut ABönisch TLüttgau JMichel RWeging J(2014)The SIOX Architecture --- Coupling Automatic Monitoring and Optimization of Parallel I/OProceedings of the 29th International Conference on Supercomputing - Volume 848810.1007/978-3-319-07518-1_16(245-260)Online publication date: 22-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-07518-1_16
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Cited By

Index Terms

Recommendations

MPI windows on storage for HPC applications

MPI-IO/Gfarm: An Optimized Implementation of MPI-IO for the Gfarm File System

Integrating collective I/O and cooperative caching into the "clusterfile" parallel file system

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations