Article

Free access

Automatic performance prediction to support parallelization of Fortran programs for massively parallel systems

Authors:

Thomas Fahringer,

Hans P. ZimaAuthors Info & Claims

ICS '92: Proceedings of the 6th international conference on Supercomputing

Pages 347 - 356

https://doi.org/10.1145/143369.143431

Published: 01 August 1992 Publication History

Abstract

In order to take on the challenge of fully automatic program parallelizing, one of the last and probably the most decisive missing tool is a performance estimation system. In this paper a new performance prediction tool is introduced, which automatically derives performance estimates for single program multiple data (SPMD) parallel Fortran 77 programs based on distributed memory systems (DMS). The underlying methodology is based on static and dynamic techniques. This paper discusses in particular a high level abstract description of the parallel program, which is utilized to derive performance estimates. The salient features of the overall design of this tool and its components are described.

References

[1]

Walid Abu-Sufah, Alex Y.Kwok: "Performance Prediction Tools for Cedar: A Multiprocessor Supercomputer", Proc. of the 12th Int'l Sympl. on Computer Architecture, 1985, pp. 406-413

Digital Library

[2]

A.Aho, R.Sethi, j. Ullman: "Compilers, Principles, Techniques, and Tools", Addison-Wesley Series in Computer Science, 1988

Digital Library

[3]

D.Atapattu, D.Gannon: "Building Analytical Models into an Interactive Performance Prediction Tool", ACM Press, Proc. Supercomputing 89, Reno, Nevada, pp. 521 - 530

Digital Library

[4]

R. Blasko: "Simulation of Parallel Asynchronous Systems Described by B-nets", Preprints of IMACS European Simulation Meeting on Simulation in Research and Development, Eger, Aug. 1984, pp. 59- 68

[5]

R. Blasko: "Modeling of Interprocess Communications", University of Vienna, Institute of Statistics and Computer Science, in preparation

[6]

V.Balasundaram, G.Fox, K.Kennedy, U.Kremer: "A Static Performance Estimator to Guide Data Partitioning Decisions", 3rd ACM Sigplan Symposium on Principles and Practice of Parallel Programming (PPoPP) April 21-44, 1991, Williamsburg, VA

Digital Library

[7]

B.M. Chapman, H. Herbeck, H.P. Zima: "Automatic Support for Data Distribution", Proc. of the Sixth Distributed Memory Conference, Portland OR, May 1991, pp. 51 - 58

[8]

B.M. Chapman, P. Mehrotra, H.P. Zima: "Vienna Fortran- A Fortran Language Extension for Distributed Memory Multiprocessors", ICASE Report No. 91-72, Contract No. NAS1-18605, NASA, Langley Research Center, Hampton, VA, 1991

[9]

T. Fahringer: "DYNAMITE- Dynamic/Static Performance Prediction to Support Parallelizing Fortran77 programs", Technical Report, Austrian Center for Parallel Computation, in preparation

[10]

T.Fahringer: "The Weight Finder- A Fortran Profiler", Technical Report, Austrian Center for Parallel Computation, in preparation

[11]

G.Fox,S.Hiranandani, K.Kennedy, C.Koelbel, U.Kremer, C.Tseng, M.Wu: "Fortran D language specification. Technical Report TR90-141, Dept. of Computer Science, Rice University, December 1990

[12]

Domenico Ferrari: "Computer Systems Performance Evaluation", Prentice Hall, 1978 pp. 100- 160

[13]

G.Fox, M.Johnson, G.Lyzenga, S.Otto, J.Salmon, D.Walker "Solving Problems on Concurrent Processors", Vols 1. and 2. Prentice Hall, Englewood Cliffs, NY, 1988

Digital Library

[14]

K. Gallivan, W. Jalby, A. Malony, H. Wijshoff: "Performance Prediction of Loop Constructs on Multiprocessor Hierarchical- Memory Systems", ACM International Conference on Supercomputing, 1989

Digital Library

[15]

H.M.Gerndt: "Parallelization for Distributed-Memory Multiprocessing Systems", Ph.D. Dissertation, University of Bonn, Technical Report Series ACPC/TR90-1, Austrian Center for Parallel Computation, Vienna 1990

[16]

H.M.Gerndt, H.P.Zima "Optimizing Communication in SUPERB", Proc. CONPAR 90-VAPP IV, Lecture Notes in Computer Science, LNCS 457, 300- 311, Ziirich, Sep. 1990,

Digital Library

[17]

Charles Koelbel: "Compiling Programs for Non-Shared Memory Machines", Ph.D. Thesis, Purdue University, W.Lafayette, IN, 1990

Digital Library

[18]

H. Mierendorf, R. Schwarzwald: "LAPAS: A Performance evaluation tool for large parallel systems", Tagungsband, 11. ITG/GI Fachtagung, Miinchen, M~rz 1990

Digital Library

[19]

Pacific Sierra Research: "MIMDizer User's Guide, Pacific Sierra Research Corporation, Los Angeles CA, 1990

[20]

Vivek Sarkar: "Determining Average Program Execution Times", ACM International Conference on Supercomputing, 1989

[21]

F. SStz: "A method for performance prediction of parallel programs", University of Erlangen- Niirnberg, FRG

[22]

K.Wang, D.Gannon: "Applying AI Techniques to Program Optimizations for Parallel Computers", In: K.Hwang and D.DeGroot (Eds.): Parallel Processing for Supercomputers and Artificial Intelligence, McGraw-Hill, 1989, pp. 441- 485

[23]

M.Weiser: "Program Slicing", IEEE Transactions on Software Engineering, Vol. SE 10, NO. 4, July 1984

[24]

H.P.Zima, H.-J. Bast, tt.M.Gerndt "SUPERB: A tool for semi-automatic MIMD/SIMD parallelization", Parallel Computing 6, 1988, 1-18

[25]

H.P.Zima, B.M.Chapman "Automatic Restructuring for Parallel and Vector Computers", Adeli, H. (Ed.); Supercomputing in Engineering Analysis, Chapter 5, 135- 167, Marcel Dekker, Inc., New York and Basel, 1991

[26]

H.P.Zima, B.M.Chapman: "Supercompilers for Parallel and Vector Computers", ACM Press, Frontier Series, Addison-Wesley 1990

Cited By

Chatzopoulos GKourtis KKoziris NGoumas G(2013)Towards a compiler/runtime synergy to predict the scalability of parallel loops2013 IEEE 6th International Workshop on Multi-/Many-core Computing Systems (MuCoCoS)10.1109/MuCoCoS.2013.6633605(1-10)Online publication date: Sep-2013
https://doi.org/10.1109/MuCoCoS.2013.6633605
Nguyen TEisenhauer GSchwan KWolf MAbbasi HKlasky SPodhorszki N(2013)Resource Provisioning for Staging ComponentsProceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and PhD Forum10.1109/IPDPSW.2013.152(1947-1953)Online publication date: 20-May-2013
https://dl.acm.org/doi/10.1109/IPDPSW.2013.152
Decker KDvorak JRehmann RRühl R(2006)Satisfying application user requirements: A next-generation tool environment for parallel systemsHigh-Performance Computing and Networking10.1007/BFb0046631(206-228)Online publication date: 2-Feb-2006
https://doi.org/10.1007/BFb0046631
Show More Cited By

Index Terms

Recommendations

Hybrid parallelization and flat parallelization in HPF (high performance Fortran)
ISHPC'05/ALPS'06: Proceedings of the 6th international symposium on high-performance computing and 1st international conference on Advanced low power systems

We have developed the HPF (High Performance Fortran) compiler HPF/SX V2 as an interface for distributed memory parallel programming. HPF is a de facto standard language for parallel programs. It is possible to write parallel programs just by inserting ...
Automatic Performance Prediction of Parallel Programs
A Comparison of 12 Parallel FORTRAN Dialects

A simple program that approximates pi by numerical quadrature is rewritten to run on nine commercially available processors to illustrate the compilations that arise in parallel programming in FORTRAN. The machines used are the Alliant FX/8, BBN ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICS '92: Proceedings of the 6th international conference on Supercomputing

August 1992

495 pages

ISBN:0897914856

DOI:10.1145/143369

Chairmen:
Ken Kennedy
Rice University, Houston, TX
,
Constantine D. Polychronopoulos
Kubota Pacific Computers and CSRD

Copyright © 1992 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 1992

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

ICS92

Sponsor:

SIGARCH

ICS92: ACM SIGARCH International Conference on Supercomputing

July 19 - 24, 1992

D. C., Washington, USA

Acceptance Rates

Overall Acceptance Rate 629 of 2,180 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
276
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)5

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chatzopoulos GKourtis KKoziris NGoumas G(2013)Towards a compiler/runtime synergy to predict the scalability of parallel loops2013 IEEE 6th International Workshop on Multi-/Many-core Computing Systems (MuCoCoS)10.1109/MuCoCoS.2013.6633605(1-10)Online publication date: Sep-2013
https://doi.org/10.1109/MuCoCoS.2013.6633605
Nguyen TEisenhauer GSchwan KWolf MAbbasi HKlasky SPodhorszki N(2013)Resource Provisioning for Staging ComponentsProceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and PhD Forum10.1109/IPDPSW.2013.152(1947-1953)Online publication date: 20-May-2013
https://dl.acm.org/doi/10.1109/IPDPSW.2013.152
Decker KDvorak JRehmann RRühl R(2006)Satisfying application user requirements: A next-generation tool environment for parallel systemsHigh-Performance Computing and Networking10.1007/BFb0046631(206-228)Online publication date: 2-Feb-2006
https://doi.org/10.1007/BFb0046631
Bareau CCaillaud BJard CThoraval R(2005)Measuring concurrency of regular distributed computationsTAPSOFT '95: Theory and Practice of Software Development10.1007/3-540-59293-8_230(711-725)Online publication date: 1-Jun-2005
https://doi.org/10.1007/3-540-59293-8_230
Keßler CPaul W(2005)Automatic parallelization by pattern-matchingParallel Computation10.1007/3-540-57314-3_14(166-181)Online publication date: 29-May-2005
https://doi.org/10.1007/3-540-57314-3_14
Subhlok JVenkataramaiah S(2003)Performance Estimation for Scheduling on Shared NetworksJob Scheduling Strategies for Parallel Processing10.1007/10968987_8(148-165)Online publication date: 2003
https://doi.org/10.1007/10968987_8
Subhlok JVenkataramaiah SSingh A(2002)Characterizing NAS Benchmark Performance on Shared Heterogeneous NetworksProceedings of the 16th International Parallel and Distributed Processing Symposium10.5555/645610.661710Online publication date: 15-Apr-2002
https://dl.acm.org/doi/10.5555/645610.661710
Subhlok JVenkataramaiah SSingh A(2002)Characterizing NAS benchmark performance on shared heterogeneous networksProceedings 16th International Parallel and Distributed Processing Symposium10.1109/IPDPS.2002.1015659(9 pp)Online publication date: 2002
https://doi.org/10.1109/IPDPS.2002.1015659
Subhlok JLieu PLowekamp B(1999)Automatic node selection for high performance applications on networksACM SIGPLAN Notices10.1145/329366.30111934:8(163-172)Online publication date: 1-May-1999
https://dl.acm.org/doi/10.1145/329366.301119
Subhlok JLieu PLowekamp BSnir MChien A(1999)Automatic node selection for high performance applications on networksProceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming10.1145/301104.301119(163-172)Online publication date: 1-May-1999
https://dl.acm.org/doi/10.1145/301104.301119
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents