Performance Prediction with Benchmaps
Abstract
Benchmapping is a performance prediction method for data-parallel programs that is based on modeling the performance of runtime systems. This paper describes a benchmapping system, called BenchCvl, that predicts the running time of data-parallel programs written in the NESL language on several computer systems. BenchCvl predicts performance using a set of more than 200 parameterized models. The models quantify the cost of moving data between processors, as well as the cost of moving data within the local memory hierarchy of each processor. The parameters for the models are automatically estimated from measurements of the execution time of runtime system calls on each computer system.
References
[1]
E. Anderson, Z. Bai, C. Bischof, J. Demmel, J. Dongarra, J. Du Croz, A. Greenbaum, S. Hammarling, A. McKenney, S. Ostrouchov, and D. Sorensen. LAPACK User's Guide. SIAM, Philadelphia, PA, 2nd edition, 1994.
[2]
Daya Atapattu and Dennis Gannon. Building analytical models into an interactive performance prediction tool. In Proceedings of Supercomputing '89, pages 521-530, 1989.
[3]
Vasanth Balasundaram, Geoffrey Fox, Ken Kennedy, and Ulrich Kremer. A static performance estimator to guide partitioning decisions. In Proceedings of the 3rd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pages 213-223, 1991.
[4]
John Louis Bentley. Writing Efficient Programs. Prentice-Hall, Englewood Cliffs, NJ, 1982.
[5]
Guy E. Blelloch. NESL: A nested data-parallel language (version 2.6). Technical Report CMU-CS-93-129, School of Computer Science, Carnegie Mellon University, April 1993.
[6]
Guy E. Blelloch, Siddhartha Chatterjee, Jonathan C. Hardwick, Margaret Reid-Miller, Jay Sipelstein, and Marco Zagha. CVL: A C vector library. Technical Report CMU-CS-93-114, School of Computer Science, Carnegie Mellon University, February 1993.
[7]
Eric A. Brewer. Portable High-Performance Superconducting: High-Level Platform-Dependent Optimization. PhD thesis, Massachusetts Institute of Technology, 1994.
[8]
Eric A. Brewer. High-level optimization via automated statistical modeling. In Proceedings of the 5th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pages 80-91, 1995.
[9]
J. Choi, J. Dongarra, R. Pozo, and D. Walker. ScaLAPACK: A scalable linear algebra for distributed memory concurrent computers. In Proceedings of the 4th Symposium on the Frontiers of Massively Parallel Computation, pages 120-127, 1992. Also available as University of Tennessee Technical Report CS-92- 181.
[10]
Mark E. Crovella and Thomas J. LeBlanc. Parallel performance prediction using lost cycles analysis. In Proceedings of Supercomputing '94, pages 600-609, Washington, D.C., November 1994.
[11]
Thomas Fahringer and Hans P. Zima. A static parameter based performance prediction tool for parallel programs. In Proceedings of the 7th ACM International Conference on Supercomputing, July 1993.
[12]
Charles H. Koelbel, David B. Loveman, Robert S. Schreiber, Guy L. Steele Jr., and Mary E. Zosel. The High Performance Fortran Handbook. MIT Press, Cambridge, MA, 1994.
[13]
Neil B. MacDonald. Predicting execution times of sequential scientific kernels. In Christoph W. Kessler, editor, Automatic Parallelization, pages 32-44. Vieweg, 1994.
[14]
Sivan Toledo. PerfSim: A tool for automatic performance analysis of data parallel Fortran programs. In 5th Symposium on the Frontiers of Massively Parallel Computation, McLean, VA, February 1995.
[15]
Sivan A. Toledo. Quantitative Performance Modeling of Scientific Computations and Creating Locality in Numerical Algorithms. PhD thesis, Massachusetts Institute of Technology, 1995. Also available as Technical Report MIT-LCS-TR-656.
Index Terms
- Performance Prediction with Benchmaps
Index terms have been assigned to the content through auto-classification.
Recommendations
Learning-aided predictor integration for system performance prediction
The integration of multiple predictors promises higher prediction accuracy than the accuracy that can be obtained with a single predictor. The challenge is how to select the best predictor at any given moment. Traditionally, multiple predictors are run ...
Query Performance Prediction using Passage Information
SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information RetrievalWe focus on the post-retrieval query performance prediction (QPP) task. Specifically, we make a new use of passage information for this task. Using such information we derive a new mean score calibration predictor that provides a more accurate ...
Analysing performance in a word prediction system with multiple prediction methods
In this article, we investigate the performance of a hybrid prediction system with a phrase prediction utility in English word prediction from two viewpoints. From the application user's point of view, measures of effort savings are important in word ...
Comments
Information & Contributors
Information
Published In
April 1996
851 pages
ISBN:0818672552
Copyright © Copyright (c) 1996 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.
Publisher
IEEE Computer Society
United States
Publication History
Published: 15 April 1996
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Aug 2024