Article

I/O Requirements of Scientific Applications: An Evolutionary View

Authors:

Evgenia Smirni,

Ruth A. Aydt,

Andrew A. Chien,

Daniel A. ReedAuthors Info & Claims

HPDC '96: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing

Page 30

Published: 06 August 1996 Publication History

Publisher Site

Abstract

The modest I/O configurations and file system limitations of many current high-performance systems preclude solution of problems with large I/O needs. I/O hardware and file system parallelism is the key to achieve high performance. We analyze the I/O behavior of several versions of two scientific applications on the Intel Paragon XP/S. The versions involve incremental application code enhancements across multiple releases of the operating system. Studying the evolution of I/O access patterns underscores the interplay between application access patterns and file system features. Our results show that both small and large request sizes are common, that at present application developers must manually aggregate small requests to obtain high disk transfer rates, that concurrent file accesses are frequent, and that appropriate matching of the application access pattern and the file system access mode can significantly increase application I/O performance. Based on these results, we describe a set of file system design principles.

References

[1]

H. Berryman, J. Saltz, and J. Scroggs, "Execution Time Support for Adaptive Scientific Algorithms on Distributed Memory Machines," Concurrency: Practice and Experience, vol. 3, pp. 159-178, June 1991.

Digital Library

Google Scholar

[2]

A. Choudhary, G. Fox, S. Hiranandani, K. Kennedy, C. Koelbel, S. Ranka, and J. Saltz, "Software Support for Irregular and Loosely Synchronous Problems," Proceedings of the Conference on High-Performance Computing for Flight Vehicles, 1992.

Google Scholar

[3]

S.E. Deering and D.R. Cheriton, "Multicast routing in datagram internetwork and extended LANs," ACM Transactions on Computer Systems, vol. 8, pp. 85-110, May 1990.

Digital Library

Google Scholar

[4]

High-Performance Fortran Forum, "High Performance Fortran Language Specification," January 1993.

Google Scholar

[5]

HPF-2 Scope of Activities and Motivating Applications, "High Performance Fortran Forum," November 13, 1994.

Google Scholar

[6]

C. Huang, and P. Mckinley, "Communication Issues in Parallel Computing Across ATM Networks," IEEE Parallel & Distributed Technology, pp. 73-86, Winter 1994.

Digital Library

Google Scholar

[7]

M. Kaddoura, and S. Ranka, "STANCE: Software Techniques for Adaptive and Nonuniform Computational Environments," technical report, Syracuse University, 1995, inpreparation.

Google Scholar

[8]

M. Kaddoura, C. Ou, and S. Ranka, "Mapping Unstructured Computational Graphs for Adaptive and Nonuniform Computational Environments," IEEE Parallel & Distributed Technology, pp. 63-69, Fall 1995.

Digital Library

Google Scholar

[9]

J.D. Keyser, K. Lust, and D. Roose, "Run-Time Load Balancing Support for Parallel Multiblock Euler/Navier-Stokes Code with Adaptive Refinement on Distributed Memory Computers," Parallel Computing, vol. 20, pp. 1069-1088, September 1994.

Digital Library

Google Scholar

[10]

N. Nedeljkovic and M. J. Quinn, "Data-Parallel Programming on a Network of Heterogeneous Workstations," Proceedings of the First International Symposium on High-Performance Distributed Computing, pp. 28-36, September 1992.

Crossref

Google Scholar

[11]

C. Ou, M. Gunwani, and S. Ranka, "Architecture Independent Locality Improving Transformations of Computational Graphs Embedded in K-Dimensions," technical report, Syracuse University, January 1995.

Google Scholar

[12]

B.S. Siegell and P. Steenkiste, "Automatic Generation of Parallel Programs with Dynamic Load Balancing," Proceedings of the Third International Symposium on High-Performance Distributed Computing, pp. 166-175, August 1994.

Crossref

Google Scholar

Cited By

View all

Lin HBalaji PPoole RSosa CMa XFeng WTeller P(2008)Massively parallel genomic sequence search on the Blue Gene/P architectureProceedings of the 2008 ACM/IEEE conference on Supercomputing10.5555/1413370.1413404(1-11)Online publication date: 15-Nov-2008
https://dl.acm.org/doi/10.5555/1413370.1413404
Hildebrand DWard LHoneyman PEgan GMuraoka Y(2006)Large files, small writes, and pNFSProceedings of the 20th annual international conference on Supercomputing10.1145/1183401.1183419(116-124)Online publication date: 28-Jun-2006
https://dl.acm.org/doi/10.1145/1183401.1183419
Rosti ESerazzi GSmirni ESquillante M(2002)Models of Parallel Applications with Large Computation and I/O RequirementsIEEE Transactions on Software Engineering10.1109/32.99132128:3(286-307)Online publication date: 1-Mar-2002
https://dl.acm.org/doi/10.1109/32.991321

I/O Requirements of Scientific Applications: An Evolutionary View
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

I/O Requirements of Scientific Applications: An Evolutionary View
HPDC '96: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing

The modest NO configurations and file system limitations of many current high-performance systems preclude solution of problems with large II0 needs. II0 hardware and file sys-tem parallelism is the key to achieve high performance. We analyze the II0 ...
Exploiting parallel processing in large scientific applications
Parallel I/O Requirements of Four Oceanography Applications

Comments

Information & Contributors

Information

Published In

HPDC '96: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing

August 1996

ISBN:0818675829

Publisher

IEEE Computer Society

United States

Publication History

Published: 06 August 1996

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lin HBalaji PPoole RSosa CMa XFeng WTeller P(2008)Massively parallel genomic sequence search on the Blue Gene/P architectureProceedings of the 2008 ACM/IEEE conference on Supercomputing10.5555/1413370.1413404(1-11)Online publication date: 15-Nov-2008
https://dl.acm.org/doi/10.5555/1413370.1413404
Hildebrand DWard LHoneyman PEgan GMuraoka Y(2006)Large files, small writes, and pNFSProceedings of the 20th annual international conference on Supercomputing10.1145/1183401.1183419(116-124)Online publication date: 28-Jun-2006
https://dl.acm.org/doi/10.1145/1183401.1183419
Rosti ESerazzi GSmirni ESquillante M(2002)Models of Parallel Applications with Large Computation and I/O RequirementsIEEE Transactions on Software Engineering10.1109/32.99132128:3(286-307)Online publication date: 1-Mar-2002
https://dl.acm.org/doi/10.1109/32.991321

Abstract

References

Cited By

Recommendations