research-article

Speculation without regret: reducing deoptimization meta-data in the Graal compiler

Authors:

Gilles Duboscq,

Thomas Würthinger, and

Hanspeter MössenböckAuthors Info & Claims

PPPJ '14: Proceedings of the 2014 International Conference on Principles and Practices of Programming on the Java platform: Virtual machines, Languages, and Tools

September 2014

Pages 187 - 193

https://doi.org/10.1145/2647508.2647521

Published: 23 September 2014 Publication History

Abstract

Speculative optimizations are used in most Just In Time (JIT) compilers in order to take advantage of dynamic runtime feedback. These speculative optimizations usually require the compiler to produce meta-data that the Virtual Machine (VM) can use as fallback when a speculation fails. This meta-data can be large and incurs a significant memory overhead since it needs to be stored alongside the machine code for as long as the machine code lives. The design of the Graal compiler leads to many speculations falling back to a similar state and location. In this paper we present deoptimization grouping, an optimization using this property of the Graal compiler to reduce the amount of meta-data that must be stored by the VM without having to modify the VM. We compare our technique with existing meta-data compression techniques from the HotSpot Virtual Machine and study how well they combine. In order to make informed decisions about speculation meta-data, we present an empirical analysis of the origin, impact and usages of this meta-data.

References

[1]

src/share/vm/code/debugInfoRec.cpp. URL http://hg.openjdk.java.net/jdk8/jdk8/hotspot.

[2]

S. M. Blackburn, R. Garner, C. Hoffman, A. M. Khan, K. S. McKinley, R. Bentzur, A. Diwan, D. Feinberg, D. Frampton, S. Z. Guyer, M. Hirzel, A. Hosking, M. Jump, H. Lee, J. E. B. Moss, A. Phansalkar, D. Stefanović, T. VanDrunen, D. von Dincklage, and B. Wiedermann. The DaCapo benchmarks: Java benchmarking development and analysis. In Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications, pages 169--190. ACM Press, Oct. 2006.

Digital Library

[3]

DaCapo Project. The DaCapo Benchmark Suite, 2012. URL http://dacapobench.org/.

[4]

G. Duboscq, L. Stadler, T. Würthinger, D. Simon, C. Wimmer, and H. Mössenböck. Graal IR: An extensible declarative intermediate representation. In Proceedings of the Asia-Pacific Programming Languages and Compilers Workshop, 2013.

[5]

G. Duboscq, T. Würthinger, L. Stadler, C. Wimmer, D. Simon, and H. Mössenböck. An intermediate representation for speculative optimizations in a dynamic compiler. In Proceedings of the ACM workshop on Virtual Machines and Intermediate Languages, 2013.

Digital Library

[6]

S. J. Fink and F. Qian. Design, implementation and evaluation of adaptive recompilation with on-stack replacement. In Proceedings of the International Symposium on Code Generation and Optimization, pages 241--252. IEEE Computer Society, 2003. ISBN 0-7695-1913-X.

Digital Library

[7]

A. Gal, C. W. Probst, and M. Franz. HotpathVM: An effective JIT compiler for resource-constrained devices. pages 144--153. ACM Press, 2006. ISBN 1-59593-332-8.

Digital Library

[8]

U. Hölzle, C. Chambers, and D. Ungar. Debugging optimized code with dynamic deoptimization. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation, pages 32--43. ACM Press, 1992. ISBN 0-89791-475-9.

Digital Library

[9]

T. Kotzmann, C. Wimmer, H. Mössenböck, T. Rodriguez, K. Russell, and D. Cox. Design of the Java HotSpot^#8482; client compiler for Java 6. ACM Transactions on Architecture and Code Optimization, 5(1), May 2008. ISSN 1544-3566.

Digital Library

[10]

OpenJDK Community. Graal Project, 2012. URL http://openjdk.java.net/projects/graal/.

[11]

M. Paleczny, C. Vick, and C. Click. The Java HotSpot^#8482; server compiler. In Proceedings of the Symposium on Java Virtual Machine Research and Technology, pages 1--12. USENIX, 2001.

Digital Library

[12]

M. Pall. LuaJIT 2.0 intellectual property disclosure and research opportunities, 2009. URL http://lua-users.org/lists/lua-l/2009-11/msg00089.html.

[13]

M. Pall. src/lj_snap.c, 2009. URL http://luajit.org/git/luajit-2.0.git.

[14]

D. Schneider and C. F. Bolz. The efficient handling of guards in the design of RPython's tracing JIT. In Proceedings of the ACM workshop on Virtual Machines and Intermediate Languages, pages 3--12. ACM Press, 2012. ISBN 978-1-4503-1633-0.

Digital Library

[15]

A. Sewe, M. Mezini, A. Sarimbekov, and W. Binder. Da Capo con Scala: design and analysis of a Scala benchmark suite for the Java virtual machine. In Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications, pages 657--676. ACM Press, 2011.

Digital Library

[16]

L. Stadler, T. Würthinger, and H. Mössenböck. Partial escape analysis and scalar replacement for Java. In Proceedings of the International Symposium on Code Generation and Optimization, pages 165--174. ACM Press, 2014. ISBN 978-1-4503-2670-4.

Digital Library

[17]

Standard Performance Evaluation Corporation. SPECjbb2005,. URL http://www.spec.org/jbb2005/.

[18]

Standard Performance Evaluation Corporation. SPECjvm2008,. URL http://www.spec.org/jvm2008/.

[19]

D. Ungar and R. B. Smith. Self: The power of simplicity. In Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications, pages 227--242. ACM Press, 1987. ISBN 0-89791-247-0.

Digital Library

[20]

C. Wimmer, M. Haupt, M. L. Van De Vanter, M. Jordan, L. Daynès, and D. Simon. Maxine: An approachable virtual machine for, and in, java. ACM Transactions on Architecture and Code Optimization, 9(4): 30:1--30:24, Jan. 2013. ISSN 1544-3566.

Digital Library

Cited By

Vukasovic MProkopec A(2023)Exploiting Partially Context-sensitive Profiles to Improve Performance of Hot CodeACM Transactions on Programming Languages and Systems10.1145/361293745:4(1-64)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3612937
Mosaner RBarany GLeopoldseder DMössenböck HKotselidis CProkopec A(2022)Improving Vectorization Heuristics in a Dynamic Compiler with Machine Learning ModelsProceedings of the 14th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3563838.3567679(36-47)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3563838.3567679
Weingarten MTheodoridis TProkopec AKotselidis CProkopec A(2022)Inlining-Benefit Prediction with Interprocedural Partial Escape AnalysisProceedings of the 14th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3563838.3567677(13-24)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3563838.3567677
Show More Cited By

Index Terms

Speculation without regret: reducing deoptimization meta-data in the Graal compiler
1. Software and its engineering
  1. Software notations and tools
    1. Compilers
      1. Runtime environments

Recommendations

An intermediate representation for speculative optimizations in a dynamic compiler
VMIL '13: Proceedings of the 7th ACM workshop on Virtual machines and intermediate languages

We present a compiler intermediate representation (IR) that allows dynamic speculative optimizations for high-level languages. The IR is graph-based and contains nodes fixed to control flow as well as floating nodes. Side-effecting nodes include a ...
Read More
Formally verified speculation and deoptimization in a JIT compiler

Just-in-time compilers for dynamic languages routinely generate code under assumptions that may be invalidated at run-time, this allows for specialization of program code to the common case in order to avoid unnecessary overheads due to uncommon cases. ...
Read More
Partial Escape Analysis and Scalar Replacement for Java
CGO '14: Proceedings of Annual IEEE/ACM International Symposium on Code Generation and Optimization

Escape Analysis allows a compiler to determine whether an object is accessible outside the allocating method or thread. This information is used to perform optimizations such as Scalar Replacement, Stack Allocation and Lock Elision, allowing modern ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PPPJ '14: Proceedings of the 2014 International Conference on Principles and Practices of Programming on the Java platform: Virtual machines, Languages, and Tools

September 2014

214 pages

ISBN:9781450329262

DOI:10.1145/2647508

General Chair:
Joanna Kolodziej
Cracow University of Technology, Poland
,
Program Chair:
Bruce Childers
University of Pittsburgh

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing
SIGPLAN: ACM Special Interest Group on Programming Languages
Sabre: Sabre
PK: Cracow University of Technology

In-Cooperation

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 September 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PPPJ '14

Sponsor:

SIGAPP
SIGPLAN
Sabre
PK

PPPJ '14: 2014 INTERNATIONAL CONFERENCE ON PRINCIPLES AND PRACTICES OF PROGRAMMING ON THE JAVA PLATFORM VIRTUAL MACHINES, LANGUAGES AND TOOLS

September 23 - 26, 2014

Cracow, Poland

Acceptance Rates

Overall Acceptance Rate 15 of 27 submissions, 56%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Vukasovic MProkopec A(2023)Exploiting Partially Context-sensitive Profiles to Improve Performance of Hot CodeACM Transactions on Programming Languages and Systems10.1145/361293745:4(1-64)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3612937
Mosaner RBarany GLeopoldseder DMössenböck HKotselidis CProkopec A(2022)Improving Vectorization Heuristics in a Dynamic Compiler with Machine Learning ModelsProceedings of the 14th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3563838.3567679(36-47)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3563838.3567679
Weingarten MTheodoridis TProkopec AKotselidis CProkopec A(2022)Inlining-Benefit Prediction with Interprocedural Partial Escape AnalysisProceedings of the 14th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3563838.3567677(13-24)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3563838.3567677
Mosaner RLeopoldseder DKisling WStadler LMössenböck H(2022)Machine-Learning-Based Self-Optimizing Compiler Heuristics✱Proceedings of the 19th International Conference on Managed Programming Languages and Runtimes10.1145/3546918.3546921(98-111)Online publication date: 14-Sep-2022
https://dl.acm.org/doi/10.1145/3546918.3546921
Makor LKloibhofer SLeopoldseder DBonetta DStadler LMössenböck H(2022)Automatic Array Transformation to Columnar Storage at Run TimeProceedings of the 19th International Conference on Managed Programming Languages and Runtimes10.1145/3546918.3546919(16-28)Online publication date: 14-Sep-2022
https://dl.acm.org/doi/10.1145/3546918.3546919
Flückiger OJečmen JKrynski SVitek JJhala RDillig I(2022)Deoptless: speculation with dispatched on-stack replacement and specialized continuationsProceedings of the 43rd ACM SIGPLAN International Conference on Programming Language Design and Implementation10.1145/3519939.3523729(749-761)Online publication date: 9-Jun-2022
https://dl.acm.org/doi/10.1145/3519939.3523729
D'Souza MDuboscq GRichards GRigger M(2021)Lightweight on-stack replacement in languages with unstructured loopsProceedings of the 13th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3486606.3486782(4-13)Online publication date: 19-Oct-2021
https://dl.acm.org/doi/10.1145/3486606.3486782
Festa MGervasoni NCherubin SAgosta G(2019)Continuous Program Optimization via Advanced Dynamic Compilation TechniquesProceedings of the 10th and 8th Workshop on Parallel Programming and Run-Time Management Techniques for Many-core Architectures and Design Tools and Architectures for Multicore Embedded Computing Platforms10.1145/3310411.3310415(1-6)Online publication date: 21-Jan-2019
https://dl.acm.org/doi/10.1145/3310411.3310415
Leopoldseder DStadler LRigger MWürthinger TMössenböck HKell SMarr S(2018)A cost model for a graph-based intermediate-representation in a dynamic compilerProceedings of the 10th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3281287.3281290(26-35)Online publication date: 4-Nov-2018
https://dl.acm.org/doi/10.1145/3281287.3281290
Grimmer MSchatz RSeaton CWürthinger TLuján MMössenböck H(2018)Cross-Language Interoperability in a Multi-Language RuntimeACM Transactions on Programming Languages and Systems10.1145/320189840:2(1-43)Online publication date: 28-May-2018
https://dl.acm.org/doi/10.1145/3201898
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents