article

Free access

Benchmark semantics

Author:

Carl G. PonderAuthors Info & Claims

ACM SIGPLAN Notices, Volume 23, Issue 6

Pages 157 - 161

https://doi.org/10.1145/44546.44563

Published: 01 June 1988 Publication History

PDF eReader

Abstract

Be careful when interpreting benchmark measurements that compare two languages or two implementations of the same language. A program expressed in two different languages rarely computes the exact same function in both cases. The same goes for a program run on two different implementations of the same language. The implementation details ultimately affect the language semantics as well as the benchmark performance. Here are some simple examples of this effect.

References

[1]

[1] D. B. Cooper, Standard Pascal User Reference Manual, W. W. Norton & Co., New York 1983.

Digital Library

Google Scholar

[2]

[2] G. Birtwistle, L. Enderin, M. Ohlin, and J. Palme, DECSYSTEM-10 SIMULA Language Handbook, 1977 Swedish National Defense Institute.

Google Scholar

[3]

[3] C. W. Gear, PL/I and PL/C Language Manual Science Research Assoc, Inc. 1978.

Google Scholar

[4]

[4] G. L. Steele, Common LISP: the Language, Digital Press, 1984.

Digital Library

Google Scholar

[5]

[5] A. Goldberg & D. Robson, Smalltalk-80: the Language and its Implementation, Addison-Wesley, Reading, Mass. 1983.

Digital Library

Google Scholar

[6]

[6] R. P. Gabriel, Performance and Evaluation of Lisp Systems MIT Press, Cambridge, Mass. 1985.

Digital Library

Google Scholar

[7]

[7] R. A. O'Keffe, Prolog Compared with Lisp? SIGPLAN Notices, vol. 18 #5 (May 1983).

Digital Library

Google Scholar

Index Terms

Benchmark semantics

Recommendations

Benchmark semantics

Be careful when interpreting benchmark measurements that compare two languages or two implementations of the same language. A program expressed in two different languages rarely computes the exact same function in both cases. The same goes for a program ...
Read More
Benchmark semantics

Be careful when interpreting benchmark measurements that compare two languages or two implementations of the same language. A program expressed in two different languages rarely computes the exact same function in both cases. The same goes for a program ...
Read More
Subsetting the SPEC CPU2006 benchmark suite

On August 24, 2006, the Standard Performance Evaluation Corporation (SPEC) announced CPU2006 -- the next generation of industry-standardized CPU-intensive benchmark suite. The SPEC CPU benchmark suite has become the most frequently used suite for ...
Read More

Comments

Information & Contributors

Information

Published In

ACM SIGPLAN Notices Volume 23, Issue 6

June, 1988

139 pages

ISSN:0362-1340

EISSN:1558-1160

DOI:10.1145/44546

Editor:
Richard L. Wexelblat

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1988

Published in SIGPLAN Volume 23, Issue 6

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
102
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)1

Other Metrics

View Author Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Index Terms

Recommendations