Abstract
This paper examines the communication patterns of parallel scientific programs, including some of the NAS benchmarks and the Miami Isopycnic Coordinate Ocean Model (MICOM), that use explicit message-passing. Communication locality, including communication event locality, message destination locality, and message size locality, is proposed and studied in addition to the widely accepted metrics of message size, destination, and generation distributions. We find that the locality metrics are relatively insensitive to system and problem size variations making them robust metrics for characterizing the communication patterns of parallel applications. We observe that the communication patterns of the benchmark programs are consistent with those of the actual application. The results of this study will be useful for understanding parallel applications' communication behavior and for designing more realistic synthetic benchmarks.
Preview
Unable to display preview. Download preview PDF.
References
Bailey, D., Barszcz, E., Barton, J., Browning, D., Carter, Ft., Darum, L., Fatoohi, R., Fineberg, S., Frederickson, P., Lasinski, T., Schreiber, R., Simon, H., Venkatakrishnan, V., Weeratunga, S.: The NAS Parallel Benchmarks. NAS Report RNR-94-007. (March 1994)
Chodnekar, S., Srinivasan, V., Vaidya, A., Sivasubramaniam, A., Das, C: Towards a Communication Characterization Methodology for Parallel Applications. High-Performance Computer Architecture. (1997)
R. Cypher, A. Ho, S. Konstantinidou, and P. Messina, Architectural Requirements of Parallel Scientific Applications with Explicit Communication. International Symposium on Computer Architecture. (1993) 2–13.
Hsieh, J., Du, D., Troullier, N., Lin, M.: Enhanced PVM Communications over a HIPPI Networks. Proceedings of the Second International Workshop on High-Speed Network Computing. (April 1996)
Fatoohi, R., Weeratunga, S.: Performance Evaluation of Three Distributed Computing Environments for Scientific Applications. Supercomputing'94. (1994) 400–409
Frymoyer, E.: Fibre Channel Fusion: Low Latency, High Speed. Data Communications Magazine. (February 1995)
Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Manchek, R., Sunderam, V.: PVM: Parallel Virtual Machine — A Users' Guide and Tutorial for Networked Parallel Computing. The MIT Press. (1994)
Hsu, J., Banerjee, P.: Performance Measurement and Trace Driven Simulation of Parallel CAD and Numeric Applications on a Hypercube Multicomputer. International Symposium on Computer Architecture. (1990) 260–269
Kim, J., Lilja, D.: Exploiting Multiple Heterogeneous Networks to Reduce Communication Costs in Parallel Programs. Heterogeneous Computing Workshop, International Parallel Processing Symposium. (April 1997) 83–95
Kim, J., Lilja, D.: Utilizing Heterogeneous Networks in Distributed Parallel Computing Systems. International Symposium on High Performance Distributed Computing. (August 1997) 336–345
Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. Version 1.1 (June 1995)
Sawdey, A.: Using the Parallel MICOM on SGI Multiprocessors and the Cray T3D. The MICOM User's Group Meeting. (February 1995)
Tolmie, D., Flanagan, D.: HIPPI: It's Not Just for Supercomputers Anymore. Data Communications Magazine. (May 1995)
VanderWiel, S., Nathanson, D., Lilja, D.: Complexity and Performance in Parallel Programming Languages. International Workshop on High-Level Parallel Programming Models and Supportive Environments, International Parallel Processing Symposium. (April 1997) 3–12
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, J., Lilja, D.J. (1998). Characterization of communication patterns in message-passing parallel scientific application programs. In: Panda, D.K., Stunkel, C.B. (eds) Network-Based Parallel Computing Communication, Architecture, and Applications. CANPC 1998. Lecture Notes in Computer Science, vol 1362. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052218
Download citation
DOI: https://doi.org/10.1007/BFb0052218
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64140-7
Online ISBN: 978-3-540-69693-3
eBook Packages: Springer Book Archive