Article

Free access

A comparative study of the NAS MG benchmark across parallel languages and architectures

Authors:

Bradford L. Chamberlain,

Steven J. Deitz,

Lawrence SnyderAuthors Info & Claims

SC '00: Proceedings of the 2000 ACM/IEEE conference on Supercomputing

Pages 46 - es

Published: 01 November 2000 Publication History

Abstract

Hierarchical algorithms such as multigrid applications form an important cornerstone for scientific computing. In this study, we take a first step toward evaluating parallel language support for hierarchical applications by comparing implementations of the NAS MG benchmark in several parallel programming languages: Co-Array Fortran, High Performance Fortran, Single Assignment C, and ZPL. We evaluate each language in terms of its portability, its performance, and its ability to express the algorithm clearly and concisely. Experimental platforms include the Cray T3E, IBM SP, SGI Origin, Sun Enterprise 5500 and a high-performance Linux cluster. Our findings indicate that while it is possible to achieve good portability, performance, and expressiveness, most languages currently fall short in at least one of these areas. We find a strong correlation between expressiveness and a language's support for a global view of computation, and we identify key factors for achieving portable performance in multigrid applications.

References

[1]

David Bailey, Tim Harris, William Saphir, Rob van der Wijngaart, Alex Woo, and Maurice Yarrow. The NAS parallel benchmarks 2.0. Technical Report NAS-95-020, Nasa Ames Research Center, Moffet Field, CA, December 1995.]]

[2]

P. Banerjee, J. A. Chandy, M. Gupta, E. W. Hodges IV, J. G. Holm, A. Lain, D. J. Palermo, S. Ramaswamy, and E. Su. The PARADIGM compiler for distributed-memory multicomputers. IEEE Computer, 28(10):37-47, October 1995.]]

Digital Library

[3]

Eric Barszcz and Paul Frederickson. NAS MG 2.3 release notes. December 1995.]]

[4]

A. Brandt. Multi-level adaptive solutions to boundary value problems. Mathematics of Computation, 31(138):333-390, 1977.]]

[5]

W. L. Briggs. A Multigrid Tutorial. SIAM, 1987.]]

[6]

Bradford Chamberlain, Sung-Eun Choi, E Christopher Lewis, Calvin Lin, Lawrence Snyder, and W. Derrick Weathersby. The case for high level parallel programming in zpl. IEEE Computational Science and Engineering, 5(3):76-86, July-September 1998.]]

Digital Library

[7]

Bradford L. Chamberlain, Sung-Eun Choi, E Christopher Lewis, Calvin Lin, Lawrence Snyder, and W. Derrick Weathersby. ZPL's WYSIWYG performance model. In Third International Workshop on High-Level Parallel Programming Models and Supportive Environments, pages 50-61. IEEE Computer Society Press, March 1998.]]

Digital Library

[8]

Bradford L. Chamberlain, Sung-Eun Choi, and Lawrence Snyder. A compiler abstraction for machine independent communication generation. In Languages and Compilers for Parallel Computing, pages 261-76. Springer-Verlag, August 1997.]]

Digital Library

[9]

Bradford L. Chamberlain, Steven Deitz, and Lawrence Snyder. Parallel language support for multigrid algorithms. Technical Report UW-CSE 99-11-03, University of Washington, Seattle, WA USA, November 1999.]]

[10]

Bradford L. Chamberlain, E Christopher Lewis, and Lawrence Snyder. A region-based approach for sparse parallel computing. Technical Report UW-CSE-98-11-01, University of Washington, November 1998.]]

[11]

Sung-Eun Choi. Machine Independent Communication Optimization. PhD thesis, University of Washington, Department of Computer Science and Engineering, March 1999.]]

Digital Library

[12]

Sung-Eun Choi and Lawrence Snyder. Quantifying the effect of communication optimizations. In Proceedings of the International Conference on Parallel Processing, pages 218-222, August 1997.]]

Digital Library

[13]

Leonardo Dagum and Ramesh Menon. OpenMP: An industry-standard API for shared-memory programming. IEEE Computational Science and Engineering, 5(1), January/March 1998.]]

Digital Library

[14]

W. Davids and G. Turkiyyah. Multigrid preconditioners for unstructured nonlinear 3D finite element models. Journal of Engineering Mechanics, 125(2):186-196, 1999.]]

[15]

Steven J. Deitz. On eliminating redundant computation from high-level array statements. Technical Report UW-CSE 2000- 04-02, University of Washington, Seattle, WA USA, April 2000.]]

[16]

M. A. Epton and B. Dembart. Multipole translation theory for the three-dimensional laplace and helmholtz equations. SIAM- Journal-on-Scientific-Computing, 16(4):865-97, July 1995.]]

Digital Library

[17]

S. J. Fink, S. R. Kohn, and S. B. Baden. Efficient run-time support for irregular block-structured applications. Journal of Parallel and Distributed Computing, 50:61-82, May 1998.]]

Digital Library

[18]

Michael Frumkin, Haoqiang Jin, and Jerry Yan. Implementation of NAS parallel benchmarks in high performance fortran. Technical Report NAS-98-009, Nasa Ames Research Center, Moffet Field, CA, September 1998.]]

[19]

Michael A. Frumkin. Personal communication. NASA Ames Research Center, April 2000.]]

[20]

M. Gupta, S. Midkiff, E. Schonberg, V. Seshadri, D. Shields, K. Y. Wang, W. M. Ching, and T. Ngo. An HPF compiler for the IBM SP-2. In Proceedings of Supercomputing '95, December 1995.]]

Digital Library

[21]

High Performance Fortran Forum. High Performance Fortran Specification Version 1.1. November 1994.]]

[22]

High Performance Fortran Forum. High Performance Fortran Specification Version 2.0. January 1997.]]

[23]

Dixie Hisley, Gagan Agrawal, Punyam Satya-narayana, and Lori Pollock. Porting and performance evaluation of irregular codes using OpenMP. In Proceedings of the First European Workshop on OpenMP, September/October 1999.]]

[24]

Steve Karmesin, James Crotinger, Julian Cummings, Scott Haney, William Humphrey, John Reynders, Stephen Smith, and Timothy J. Williams. Array Design and Expression Evaluation in POOMA II. In D. Caromel, R.R. Oldehoeft, and M. Tholburn, editors, Computing in Object-Oriented Parallel Environments, volume 1505 of Lecture Notes in Computer Science, pages 231-238. Springer-Verlag, 1998.]]

Digital Library

[25]

R. Leveque and M. Merger. Adaptive mesh refinement for hyperbolic partial differential equations. In Proceedings of the 3rd International Conference on Hyperbolic Problems, Uppsala, Sweden, 1990.]]

[26]

Message Passing Interface Forum. MPI: A message passing interface standard. International Journal of Supercomputing Applications, 8(3/4):169-416, 1994.]]

[27]

Ton A. Ngo, Lawrence Snyder, and Bradford L. Chamberlain. Portable performance of data parallel languages. In SC97: High Performance Networking and Computing, November 1997.]]

Digital Library

[28]

R. W. Numrich and J. K. Reid. Co-array fortran for parallel programming. Technical Report RAL-TR-1998-060, Rutherford Appleton Laboratory, Oxon, UK, August 1998.]]

Digital Library

[29]

Robert W. Numrich, John Reid, and Kieun Kim. Writing a multigrid solver using co-array fortran. In Proceedings of the Fourth International Workshop on Applied Parallel Computing, Umea, Sweden, June 1998.]]

Digital Library

[30]

Portland Group technical reporting service. Personal communication. October 1999.]]

[31]

S. B. Scholz. Single assignment C - functional programming using imperative style. In Proceedings of IFL '94, Norwich, UK, 1994.]]

[32]

S. B. Scholz. A case study: Effects of WITH-loop-folding on the NAS benchmark MG in SAC. In Proceedings of IFL '98, London, 1998. Springer-Verlag.]]

Digital Library

[33]

Lawrence Snyder. The ZPL Programmer's Guide. MIT Press, 1999.]]

[34]

T. Stricker, J. Subhlok, D. O'Hallaron, S. Hinrichsand, and T. Gross. Decoupling synchronization and data transfer in message passsing systems of parallel computers. In 9./ International Conference on Supercomputing, July 1995.]]

Digital Library

[35]

Manuel Ujaldon, Emilio L. Zapata, Barbara M. Chapman, and Hans P. Zima. Vienna-fortran/HPF extensions for sparse and irregular problems and their compilation. IEEE Transactions on Parallel and Distributed Systems, 8(10), October 1997.]]

Digital Library

[36]

University of Kiel. SAC website. http://www.informatik.uni-kiel.de/sacbase/ (Current December 11, 1999).]]

[37]

Rob Van der Wijngaart. Personal communication. MRJ Technology Solutions, April 2000.]]

[38]

H. Zima, P. Brezany, B. Chapman, P. Mehrotra, and A. Schwald. Vienna fortran - a language specification version 1.1. Technical Report ACPC/TR 92-4, Austrian Center for Parallel Computation, March 1992.]]

Cited By

Wienke SMiller JSchulz MMüller MWest J(2016)Development effort estimation in HPCProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.5555/3014904.3014918(1-12)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3014904.3014918
Wang LHuang MNarayana VEl-Ghazawi TCascaval CTrancoso PPrasanna V(2011)Scaling scientific applications on clusters of hybrid multicore/GPU nodesProceedings of the 8th ACM International Conference on Computing Frontiers10.1145/2016604.2016612(1-10)Online publication date: 3-May-2011
https://dl.acm.org/doi/10.1145/2016604.2016612
Rolls DJoslin CKudryavtsev AScholz SShafarenko A(2009)Numerical Simulations of Unsteady Shock Wave Interactions Using SaC and Fortran-90Proceedings of the 10th International Conference on Parallel Computing Technologies10.1007/978-3-642-03275-2_44(445-456)Online publication date: 3-Sep-2009
https://dl.acm.org/doi/10.1007/978-3-642-03275-2_44
Show More Cited By

Index Terms

A comparative study of the NAS MG benchmark across parallel languages and architectures

Recommendations

NAS Parallel Benchmark Results

Benchmark results for the Numerical Aerodynamic Simulation (NAS) Program at NASA Ames Research Center, which is dedicated to advancing the science of computational aerodynamics are presented. The benchmark performance results are for the Y-MP, Y-MO EL, ...
Performance portability on EARTH: a case study across several parallel architectures
Abstract
Due to the increase of the diversity of parallel architectures, and the increasing development time for parallel applications, performance portability has become one of the major considerations when designing the next generation of parallel ...
Benchmark Evaluation of the IBM SP2 for Parallel Signal Processing

This paper evaluates the IBM SP2 architecture, the AIX parallel programming environment, and the IBM message-passing library (MPL) through STAP (Space-Time Adaptive Processing) benchmark experiments. Only coarse-grain parallelism was exploited on the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '00: Proceedings of the 2000 ACM/IEEE conference on Supercomputing

November 2000

889 pages

ISBN:0780398025

Conference Chair:
Louis Turcotte
Rose-Hulman Institute of Technology

Copyright © Copyright (c) 2000 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

In-Cooperation

SIAM: Society for Industrial and Applied Mathematics

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 November 2000

Check for updates

Qualifiers

Article

Conference

SC '00

Sponsor:

SIGARCH
IEEE-CS

SC '00: International Conference for High Performance Computing, Networking, Storage and Analysis

November 4 - 10, 2000

Texas, Dallas, USA

Acceptance Rates

SC '00 Paper Acceptance Rate 62 of 179 submissions, 35%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
493
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)5

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wienke SMiller JSchulz MMüller MWest J(2016)Development effort estimation in HPCProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.5555/3014904.3014918(1-12)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3014904.3014918
Wang LHuang MNarayana VEl-Ghazawi TCascaval CTrancoso PPrasanna V(2011)Scaling scientific applications on clusters of hybrid multicore/GPU nodesProceedings of the 8th ACM International Conference on Computing Frontiers10.1145/2016604.2016612(1-10)Online publication date: 3-May-2011
https://dl.acm.org/doi/10.1145/2016604.2016612
Rolls DJoslin CKudryavtsev AScholz SShafarenko A(2009)Numerical Simulations of Unsteady Shock Wave Interactions Using SaC and Fortran-90Proceedings of the 10th International Conference on Parallel Computing Technologies10.1007/978-3-642-03275-2_44(445-456)Online publication date: 3-Sep-2009
https://dl.acm.org/doi/10.1007/978-3-642-03275-2_44
Yelick KHilfinger PGraham SBonachea DSu JKamil ADatta KColella PWen T(2007)Parallel Languages and CompilersInternational Journal of High Performance Computing Applications10.1177/109434200707844921:3(266-290)Online publication date: 1-Aug-2007
https://dl.acm.org/doi/10.1177/1094342007078449
Snyder LRyder BHailpern B(2007)The design and development of ZPLProceedings of the third ACM SIGPLAN conference on History of programming languages10.1145/1238844.1238852(8-1-8-37)Online publication date: 9-Jun-2007
https://dl.acm.org/doi/10.1145/1238844.1238852
Loh EVan De Vanter MVotta LJohnson P(2005)Can software engineering solve the HPCS problem?Proceedings of the second international workshop on Software engineering for high performance computing system applications10.1145/1145319.1145328(27-31)Online publication date: 15-May-2005
https://dl.acm.org/doi/10.1145/1145319.1145328
Hochstein LCarver JShull FAsgari SBasili VHollingsworth JZelkowitz MKramer W(2005)Parallel Programmer ProductivityProceedings of the 2005 ACM/IEEE conference on Supercomputing10.1109/SC.2005.53Online publication date: 12-Nov-2005
https://dl.acm.org/doi/10.1109/SC.2005.53
Datta KBonachea DYelick K(2005)Titanium performance and potentialProceedings of the 18th international conference on Languages and Compilers for Parallel Computing10.1007/978-3-540-69330-7_14(200-214)Online publication date: 20-Oct-2005
https://dl.acm.org/doi/10.1007/978-3-540-69330-7_14
Grelck C(2002)Implementing the NAS Benchmark MG in SACProceedings of the 16th International Parallel and Distributed Processing Symposium10.5555/645610.660911Online publication date: 15-Apr-2002
https://dl.acm.org/doi/10.5555/645610.660911
Deitz SChamberlain BSnyder L(2002)High-level Language Support for User-defined ReductionsThe Journal of Supercomputing10.1023/A:101578101844923:1(23-37)Online publication date: 1-Aug-2002
https://dl.acm.org/doi/10.1023/A%3A1015781018449
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents