article

A dynamic optimization framework for a Java just-in-time compiler

Authors:

Toshio Suganuma,

Toshiaki Yasue,

Motohiro Kawahito,

Hideaki Komatsu,

Toshio NakataniAuthors Info & Claims

ACM SIGPLAN Notices, Volume 36, Issue 11

Pages 180 - 195

https://doi.org/10.1145/504311.504296

Published: 01 October 2001 Publication History

Abstract

The high performance implementation of Java Virtual Machines (JVM) and just-in-time (JIT) compilers is directed toward adaptive compilation optimizations on the basis of online runtime profile information. This paper describes the design and implementation of a dynamic optimization framework in a production-level Java JIT compiler. Our approach is to employ a mixed mode interpreter and a three level optimizing compiler, supporting quick, full, and special optimization, each of which has a different set of tradeoffs between compilation overhead and execution speed. a lightweight sampling profiler operates continuously during the entire program's exectuion. When necessary, detailed information on runtime behavior is collected by dynmiacally generating instrumentation code which can be installed to and uninstalled from the specified recompilation target code. Value profiling with this instrumentation mechanism allows fully automatic code specialization to be performed on the basis of specific parameter values or global data at the highest optimization level. The experimental results show that our approach offers high performance and a low code expansion ratio in both program startup and steady state measurements in comparison to the compile-only approach, and that the code specialization can also contribute modest performance improvement

References

[1]

A.R. Adl-Tabatabai, M. Ciemiak, C.Y. Lueh, V.M. Parikh, and J.M. Stichnoth. Fast, Effective Code Generation in a Just-in- Time Java Compiler. In Proceedings of the ACM SIGPLAN '98 Conference on Programming Language Design and Implementation, pp. 280-290, Jun. 1998.]]

Digital Library

[2]

O. Agesen and D. Detlefs. Mixed-mode Byteeode Execution. Technical Report SMLI TR-2000-87, Sun Microsystems, 2000.]]

Digital Library

[3]

M. Arnold, S. Fink, D. Grove, M. Hind, and P.F. Sweeney. Adaptive Optimizations in the Jalapefio JVM. In Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages & Applications, OOPSLA '00, Oct. 2000.]]

Digital Library

[4]

M. Arnold, S. Fink, D. Grove, M. Hind, and P.F. Sweeney. Adaptive Optimizations in the Jalapefio JVM: The Controller's Analytical Model. In Proceedings of the ACM SIGPLAN Workshop on Feedback-Directed and Dynamic Optimization, FDDO-3, Dec. 2000.]]

Digital Library

[5]

M. Arnold, B.G. Ryder. A Framework for Reducing the Cost of Instrumented Code. In Proceedings of the A CM SIGPLAN '01 Conference on Program Language Design and Implementation, pp. 168-179, Jun. 2001.]]

Digital Library

[6]

J. Auslander, M. Philipose, C. Chambers, S.J. Eggers, and B.N. Bershad. Fast, Effective Dynamic Compilation. In Proceedings of the ACM SIGPLAN '96 Conference on Programming Language Design andlmplementation, pp. 149-158, May 1996.]]

Digital Library

[7]

T. Autrey and M. Wolfe. Initial Results for Glacial Variable Analysis. In Proceedings of the 9th International Workshop on Languages and Compilers for Parallel Computing, Aug. 1996.]]

Digital Library

[8]

V. Bala, E. Duesterwald, and S. Banerjia. Dynamo: A Transparent Dynamic Optimization System. In Proceedings of the ACM SIGPLAN '00 Conference on Programming Language Design andlmplementation, pp. 1-12, Jun. 2000.]]

Digital Library

[9]

R.G. Burger and R.K. Dybvig. An infrastructure for Profile- Driven Dynamic Recompilation, In ICCL '98, the IEEE Computer Society International Conference on Computer Languages, May 1998.]]

Digital Library

[10]

M.G. Burke, J.D. Choi, S. Fink, D. Grove, M. Hind, V. Sarkar, M. Serrano, V.C. Sreedhar, H. Srinivasan, and J. Whaley. The Jalapefio Dynamic Optimizing Compiler for Java, In Proceedings' of the ACM SIGPLAN Java Grande Conference, pp. 129- 141, Jun. 1999]]

Digital Library

[11]

B. Calder, P. Feller, and A. Eustace. Value Profiling. In 30th International Conference on Microarchitecture, pp. 259-269, Dec. 1997.]]

Digital Library

[12]

C. Chambers and D. Ungar. Customization: Optimizing Compiler Technology for SELF, a Dynamically-Typed Object- Oriented Programming Languages. In Proceedings of the A CM SIGPLAN '89 Conference on Programming Language Design andlmplementation, pp. 146-160, Jul. 1989.]]

Digital Library

[13]

M. Ciemiak, G.Y. Lueh, and J.M. Stiehnoth. Practicing JUDO: Java Under Dynamic Optim/zations. In Proceedings of the ACM SIGPLAN '00 Conference on Programming Language Design andlmplementation, pp. 13-26, Jun. 2000.]]

Digital Library

[14]

C. Consel and F. Noel. A General Approach for Run-Time Specialization and its Application to C. In Conference Record of the 23rd ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, pp. 145-156, Jan. 1996]]

Digital Library

[15]

J. Dean, C. Chambers, and D. Grove. Selective Specialization for Object-Oriented Languages. In Proceedings of the ACM SIGPLAN '95 Conference on Programming Language Design andlmplementation, pp. 93-102, Jun. 1995.]]

Digital Library

[16]

J. Dean and C. Chambers. Towards Better Inlining Decisions Using Inlining Trials. In Proceedings of the ACM SIGPLAN '94 Conference on LISP and Functional Programming, pp. 273-282, Jun. 1994.]]

Digital Library

[17]

D. Detlefs and O. Agesen. Inlining of Virtual Methods. In the 13th European Conference on Object-Oriented Programming, 1999.]]

Digital Library

[18]

J. Gosling, B. Joy, and G. Steele. The Java Language Specification. Addison-Wesley, 1996.]]

Digital Library

[19]

B. Grant, M. Philipose, M. Mock, C. Chambers,and S.J. Eggers. An Evaluation of Staged Run-Time Optimizations in DyC. In Proceedings of the A CM SIGPLAN '99 Conference on Programming Language Design and Implementation, pp. 293- 304, May 1999.]]

Digital Library

[20]

U. Holzle. Adaptive Optimization for SELF: Reconciling High Performance with Exploratory Programming. Ph.D. Thesis, Stanford University, CS-TR-94-1520, Aug. 1994.]]

Digital Library

[21]

U, Holzle and D. Ungar. Reconciling responsiveness with performanee in pure object-oriented languages. ACM Transactions on Programming Languages and estems, 18(4):355-400, Jul. 1996.]]

Digital Library

[22]

IBM Corporation Inc. "WebSphere Software Platform", documentation available at http://www.ibn~eom/websphere 2000.]]

[23]

K. Ishizaki, M. Kawahito, T. Yasue, M. Takeuehi, Y. Ogasawara, T. Suganuma, T. Onodera, H. Komatsu, and T. Nakatani. Design, Implementation, and Evaluation of Optimizations in a Just-In-Time Compiler. In Proceedings of ACM SIGPLAN Java Grande Conference, pp. 119-128, Jun. 1999.]]

Digital Library

[24]

K. Ishizaki, M. Kawahito, T. Yasue, H. Komatsu, and T. Nakatani. A Study of Devirtualization Techniques for a Java Just-In- Time Compiler. In Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages & Applications, OOPSLA '00, pp. 294-310, Oct. 2000.]]

Digital Library

[25]

Just System Corp. "IchitaroArk for Java", available at http://www.justsystem.corn/arldindex.html 1998.]]

[26]

M. Kawahito, H. Komatsu, and T. Nakatani. Effective Null Pointer Check Elimination Utilizing Hardware Trap. In Proceedings of the 9th International Conference on Architectural Support on Programming Languages and Operating Systems, Nov. 2000.]]

Digital Library

[27]

A. Krall. Efficient JavaVM Just-in-Time Compilation. In Proceedings of International Conference on Parallel Architecture and Compilation Technique, Oct. 1998.]]

Digital Library

[28]

R. Marlet, C. Consel, and P. Boinot. Efficient Incremental Run-Time Specialization for Free. In Proceedings of the ACM SIGPLAN '99 Conference on Programming Language Design and Implementation, pp. 281-292, Jun. 1999.]]

Digital Library

[29]

T. Ogasawara, H. Komatsu, and T. Nakatani. A Study of Exception Handling and its Dynamic Optimization for Java. In Proceedings of the ACM SIGPLAN Conference on Object- Oriented Programming, Systems, Languages & Applications, OOPSLA '01, Oct. 2001.]]

Digital Library

[30]

M. Paleezny, C. Viek, and C. Click. The Java HotSpot Server Compiler. In Proceedings of the Java Virtual Machine Research and Technology Symposium (JVM '01), pp. 1-12, Apr. 2001.]]

Digital Library

[31]

M.P. Plezbert and R.K. Cytron. Does "Just in Time" = "Better Late than Never"?. In Conference Record of the 24th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, pp. 120-131, Jan. 1997.]]

Digital Library

[32]

M. Poletto, D. Engler, and M.F. Kaashoek. tee: A System for Fast, Flexible, and High-Level Dynamic Code Generation. In Proceedings of the ACM SIGPLAN'97 Conference on Programming Language Design and Implementation, pp. 109-121, Jun. 1997.]]

Digital Library

[33]

V.C. Sreedhar, M. Burke, and J.D. Choi. A Framework for In. terprocedural Optimization in the Presence of Dynamic Class Loading. In Proceedings of the ACM SIGPLAN '00 Conference of Program Language Design and Implementation, pp. 196-207, Jun. 2000.]]

Digital Library

[34]

M.D. Smith. Overcoming the Challenges to Feedback-Directed Optimization. In Proceedings of the ACM SIGPLAN Workshop on Dynamic and Adaptive Compilation and Optimization (Dynamo '00), pp. 1-11, Jan. 2000.]]

Digital Library

[35]

Standard Performance Evaluation Corporation. SPECjvm98 Benchmarks, available at http://www.spec.org/osg/jvrn98 and SPECjbb-2000 available at http://www.spec.org/osg/jbb2000.]]

[36]

T. Suganuma, T. Ogasawara, M. Takeuchi, T. Yasue, M. Kawahito, K. Ishizaki, H. Komatsd, and T. Nakatani. Overview of the IBM Java Just-in-Time Compiler, IBM Systems Journal, 39(1), 2000.]]

Digital Library

[37]

Sun Microsysterus. The Java Hotspot Performance Engine Architecture. White paper available at http://java.sun.com/products/hotspot/index.html, May. 2001.]]

[38]

Sun Microsystems. Hot Java TM Browser available at http://java.sun.eorn/products/hotj ava/index.html 1997.]]

[39]

O. Traub, S. Schechter, and M.D. Smith. Ephemeral Instrumentation for Lightweight Program Profiling. Technical Report, Harvard University, 1999.]]

[40]

J. Whaley. A Portable Sampling-Based Profiler for Java Virtual Machines. In Proceedings of the ACM SIGPLAN Java Grande Conference, Jun. 2000.]]

Digital Library

[41]

J. Whaley. Dynamic Optimization through the Use of Automatie Runtime Specialization. Master's thesis, Massachusetts Institute of Technology, May 1999.]]

[42]

Wind River Systems Inc. "IceStorm Browser 5", available at http://www.iceso ft.no/ieebrowser5/index.htm12000.]]

[43]

B.S. Yang, S.M. Moon, S. Park, J. Lee, S. Lee, J. Park, Y.C. Chung, S. Kim, K. Ebeioglu, and E. Altman. LaTTe: A Java VM Just-in-Time Compiler with Fast and Efficient Register Allocation. In Proceedings of International Conference on Parallel Architecture and Compilation Technique, Oct. 1999.]]

Digital Library

Cited By

Gazis AKatsiri E(2024)Streamline Intelligent Crowd Monitoring with IoT Cloud Computing MiddlewareSensors10.3390/s2411364324:11(3643)Online publication date: 4-Jun-2024
https://doi.org/10.3390/s24113643
Nakamura HSonoyama AKamiyama TOguchi MYamaguchi S(2024)Performance Study of Kotlin and Java Programs with Bytecode AnalysisJournal of Information Processing10.2197/ipsjjip.32.38032(380-395)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.380
Makor LRajan H(2021)Run-time data analysis in dynamic runtimesCompanion Proceedings of the 2021 ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity10.1145/3484271.3484973(6-8)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3484271.3484973
Show More Cited By

Index Terms

A dynamic optimization framework for a Java just-in-time compiler
1. Software and its engineering
  1. Software notations and tools
    1. Compilers
    2. General programming languages
      1. Language types
        Functional languages

Recommendations

Design and evaluation of dynamic optimizations for a Java just-in-time compiler

The high performance implementation of Java Virtual Machines (JVM) and Just-In-Time (JIT) compilers is directed toward employing a dynamic compilation system on the basis of online runtime profile information. The trade-off between the compilation ...
A dynamic optimization framework for a Java just-in-time compiler
OOPSLA '01: Proceedings of the 16th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications

The high performance implementation of Java Virtual Machines (JVM) and just-in-time (JIT) compilers is directed toward adaptive compilation optimizations on the basis of online runtime profile information. This paper describes the design and ...
The jastadd extensible java compiler
Proceedings of the 2007 OOPSLA conference

The JastAdd Extensible Java Compiler is a high quality Java compiler that is easy to extend in order to build static analysis tools for Java, and to extend Java with new language constructs. It is built modularly, with a Java 1.4 compiler that is ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGPLAN Notices

ACM SIGPLAN Notices Volume 36, Issue 11

11/01/2001

380 pages

ISSN:0362-1340

EISSN:1558-1160

DOI:10.1145/504311

Issue’s Table of Contents

OOPSLA '01: Proceedings of the 16th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications
October 2001
382 pages
ISBN:1581133359
DOI:10.1145/504282
Conference Chair:
Linda Northrop
Software Engineering Institute
,
Program Chair:
John Vlissides
IBM T.J. Watson Research Center

Copyright © 2001 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2001

Published in SIGPLAN Volume 36, Issue 11

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

124
Total Citations
View Citations
2,245
Total Downloads

Downloads (Last 12 months)60
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gazis AKatsiri E(2024)Streamline Intelligent Crowd Monitoring with IoT Cloud Computing MiddlewareSensors10.3390/s2411364324:11(3643)Online publication date: 4-Jun-2024
https://doi.org/10.3390/s24113643
Nakamura HSonoyama AKamiyama TOguchi MYamaguchi S(2024)Performance Study of Kotlin and Java Programs with Bytecode AnalysisJournal of Information Processing10.2197/ipsjjip.32.38032(380-395)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.380
Makor LRajan H(2021)Run-time data analysis in dynamic runtimesCompanion Proceedings of the 2021 ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity10.1145/3484271.3484973(6-8)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3484271.3484973
Mohammadi MHan SAtoofian EBaniasadi AAamodt TDally W(2020)Energy Efficient On-Demand Dynamic Branch Prediction ModelsIEEE Transactions on Computers10.1109/TC.2019.295671069:3(453-465)Online publication date: 1-Mar-2020
https://dl.acm.org/doi/10.1109/TC.2019.2956710
Fu JJin GZhang LWang JPalermo GFeo JTumeo AFranke H(2016)CAOSProceedings of the ACM International Conference on Computing Frontiers10.1145/2903150.2903151(110-118)Online publication date: 16-May-2016
https://dl.acm.org/doi/10.1145/2903150.2903151
Vandercammen MNicolay JMarr SDe Koster JD'Hondt TDe Roover CXu HBinder W(2015)A formal foundation for trace-based JIT compilersProceedings of the 13th International Workshop on Dynamic Analysis10.1145/2823363.2823369(25-30)Online publication date: 26-Oct-2015
https://dl.acm.org/doi/10.1145/2823363.2823369
Sandoval JCooper KBadia RWang N(2009)Dynamic compilation for component-based high performance computingProceedings of the 2009 Workshop on Component-Based High Performance Computing10.1145/1687774.1687778(1-4)Online publication date: 15-Nov-2009
https://dl.acm.org/doi/10.1145/1687774.1687778
Mytkowicz TCoughlin DDiwan AArora SLeavens G(2009)Inferred call path profilingProceedings of the 24th ACM SIGPLAN conference on Object oriented programming systems languages and applications10.1145/1640089.1640102(175-190)Online publication date: 26-Oct-2009
https://dl.acm.org/doi/10.1145/1640089.1640102
Mytkowicz TCoughlin DDiwan A(2009)Inferred call path profilingACM SIGPLAN Notices10.1145/1639949.164010244:10(175-190)Online publication date: 25-Oct-2009
https://dl.acm.org/doi/10.1145/1639949.1640102
Shankar AArnold MBodik R(2008)JoltACM SIGPLAN Notices10.1145/1449955.144977543:10(127-142)Online publication date: 19-Oct-2008
https://dl.acm.org/doi/10.1145/1449955.1449775
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents