research-article

Continuously measuring critical section pressure with the free-lunch profiler

Authors:

Gilles MullerAuthors Info & Claims

OOPSLA '14: Proceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications

Pages 291 - 307

https://doi.org/10.1145/2660193.2660210

Published: 15 October 2014 Publication History

Abstract

Today, Java is regularly used to implement large multi-threaded server-class applications that use locks to protect access to shared data. However, understanding the impact of locks on the performance of a system is complex, and thus the use of locks can impede the progress of threads on configurations that were not anticipated by the developer, during specific phases of the execution.

In this paper, we propose Free Lunch, a new lock profiler for Java application servers, specifically designed to identify, in-vivo, phases where the progress of the threads is impeded by a lock. Free Lunch is designed around a new metric, critical section pressure (CSP), which directly correlates the progress of the threads to each of the locks. Using Free Lunch, we have identified phases of high CSP, which were hidden with other lock profilers, in the distributed Cassandra NoSQL database and in several applications from the DaCapo 9.12, the SPECjvm2008 and the SPECjbb2005 benchmark suites. Our evaluation of Free Lunch shows that its overhead is never greater than 6%, making it suitable for in-vivo use.

References

[1]

B. Alpern, S. Augart, S. M. Blackburn, M. Butrico, A. Cocchi, P. Cheng, J. Dolby, S. Fink, D. Grove, M. Hind, K. S. McKinley, M. Mergen, J. E. B. Moss, T. Ngo, V. Sarkar, and M. Trapp. The Jikes Research Virtual Machine project: Building an open source research community. IBM System Journal, 2005.

Digital Library

[2]

E. Altman, M. Arnold, S. Fink, and N. Mitchell. Performance analysis of idle programs. In OOPSLA, pages 739--753, 2010.

Digital Library

[3]

Apache Tomcat web page. http://tomcat.apache.org/, 2014.

[4]

D. F. Bacon, R. Konuru, C. Murthy, and M. Serrano. Thin locks: featherweight synchronization for Java. In PLDI, pages 258--268, 1998.

Digital Library

[5]

VanDrunen, von Dincklage, and Wiedermann}oopsla/06/blackburn/dacapoS. M. Blackburn, R. Garner, C. Hoffmann, A. M. Khang, K. S. McKinley, R. Bentzur, A. Diwan, D. Feinberg, D. Frampton, S. Z. Guyer, M. Hirzel, A. Hosking, M. Jump, H. Lee, J. E. B. Moss, A. Phansalkar, D. Stefanović, T. VanDrunen, D. von Dincklage, and B. Wiedermann. The DaCapo benchmarks: Java benchmarking development and analysis. In OOPSLA, pages 169--190, 2006.

Digital Library

[6]

R. Bryant and J. Hawkes. Lockmeter: Highly-informative instrumentation for spin locks in the Linux kernel. In 4th Annual Linux Showcase & Conference, pages 271--282, 2000.

Digital Library

[7]

F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. In OSDI, pages 205--218, 2006.

Digital Library

[8]

G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In SOSP, pages 205--220, 2007.

Digital Library

[9]

J. Demme and S. Sethumadhavan. Rapid identification of architectural bottlenecks via precise event counting. In ISCA, 2011.

Digital Library

[10]

J. Dongarra, K. London, S. Moore, P. Mucci, D. Terpstra, H. You, and M. Zhou. Experiences and lessons learned with a portable interface to hardware performance counters. In IPDPS. IEEE, 2003.

Digital Library

[11]

t al.(2013)Du Bois, Sartor, Eyerman, and Eeckhout}oopsla/13/DuBois/bottle-graphsK. Du Bois, J. B. Sartor, S. Eyerman, and L. Eeckhout. Bottle graphs: visualizing scalability bottlenecks in multi-threaded applications. In OOPSLA, pages 355--372, 2013.

Digital Library

[12]

N. Geoffray, G. Thomas, J. Lawall, G. Muller, and B. Folliot. VMKit: A substrate for managed runtime environments. In VEE, pages 51--62, 2010.

Digital Library

[13]

K. Glerum, K. Kinshumann, S. Greenberg, G. Aul, V. Orgovan, G. Nichols, D. Grant, G. Loihle, and G. Hunt. Debugging in the (very) large: ten years of implementation and experience. In SOSP, pages 103--116, 2009.

Digital Library

[14]

J. Gosling, B. Joy, G. Steele, and G. Bracha. The Java#8482; language specification. Addison-Wesley, 3rd edition, 2005.

Digital Library

[15]

H2 web page. http://www.h2database.com/, 2014.

[16]

Healthcenter. IBM Health Center. http://www.ibm.com/developerworks/java/jdk/tools/healthcenter/, 2014.

[17]

rofiling tool()}url/hprofHPROF: A heap/CPU profiling tool. http://docs.oracle.com/javase/7/docs/technotes/samples/hprof.html, 2014.

[18]

Y. Huang, Z. Cui, L. Chen, W. Zhang, Y. Bao, and M. Chen. HaLock: hardware-assisted lock contention detection in multithreaded applications. In PACT, pages 253--262, 2012.

Digital Library

[19]

H. Inoue and T. Nakatani. How a Java VM can get more from a hardware performance monitor. In OOPSLA, pages 137--154, 2009.

Digital Library

[20]

Java Lock Analyzer. JLA homepage. http://publib.boulder.ibm.com/infocenter/javasdk/tools/index.jsp?topic=%2Fcom.ibm.java.doc.igaa%2F_1vg0001143f2181--11a9b04924e-7ff9_1001.html, 2014.

[21]

JBoss web page. https://www.jboss.org/overview/, 2014.

[22]

R. Jones, A. Hosking, and E. Moss. The garbage collection handbook: the art of automatic memory management. Chapman & Hall/CRC, 1st edition, 2011.

Digital Library

[23]

JProfiler home page. http://www.ej-technologies.com/products/jprofiler/overview.html, 2014.

[24]

JVMTI. Java#8482; Virtual Machine Tool Interface.newlinehttp://docs.oracle.com/javase/6/docs/technotes/guides/jvmti/, 2014.

[25]

T. Kalibera, M. Mole, R. Jones, and J. Vitek. A black-box approach to understanding concurrency in DaCapo. In OOPSLA, pages 335--354, 2012.

Digital Library

[26]

A. Lakshman and P. Malik. Cassandra: Structured storage system on a P2P network. In PODC, 2009.

Digital Library

[27]

D. Lea. The java.util.concurrent synchronizer framework. Sci. Comput. Program., pages 293--309, 2005.

Digital Library

[28]

J.-P. Lozi, F. David, G. Thomas, J. Lawall, and G. Muller. Remote Core Locking: migrating critical-section execution to improve the performance of multithreaded applications. In ATC, pages 65--76. USENIX, 2012.

Digital Library

[29]

J. Manson, W. Pugh, and S. V. Adve. The Java memory model. In POPL, pages 378--391, 2005.

Digital Library

[30]

M. Milenkovic, S. Jones, F. Levine, and E. Pineda. Performance inspector tools with instruction tracing and per-thread / function profiling. In Linux Symposium, 2008.

[31]

N. Mitchell and P. F. Sweeney. On-the-fly capacity planning. In Proceedings of the 2013 ACM SIGPLAN International Conference on Object Oriented Programming Systems Languages & Applications, OOPSLA, pages 849--866, 2013.

Digital Library

[32]

Multicore SDK.newlinehttps://www.ibm.com/developerworks/mydeveloperworks/groups/service/html/communityview?communityUuid=9a29d9f0--11b1--4d29--9359-a6fd9678a2e8, 2014.

[33]

Mutrace. Measuring Lock Contention. http://0pointer.de/blog/projects/mutrace.html, 2014.

[34]

z, Gibson, Fuchs, and Rinaldi}socc/11/patil/ycsbS. Patil, M. Polte, K. Ren, W. Tantisiriroj, L. Xiao, J. López, G. Gibson, A. Fuchs, and B. Rinaldi. YCSB

[35]

: Benchmarking and performance debugging advanced features in scalable table stores. In SoCC. ACM, 2011.

[36]

Safepoints in Hotspot. http://blog.ragozin.info/2012/10/safepoints-in-hotspot, 2014.

[37]

SPECjbb2005. http://www.spec.org/jbb2005/, 2014.

[38]

SPECjvm2008. http://www.spec.org/jvm2008/, 2014.

[39]

N. R. Tallent, J. M. Mellor-Crummey, and A. Porterfield. Analyzing lock contention in multithreaded applications. In PPoPP, pages 269--280, 2010.

Digital Library

[40]

F. Xian, W. Srisa-an, and H. Jiang. Contention-aware scheduler: unlocking execution parallelism in multithreaded Java programs. In OOPSLA, pages 163--180, 2008.

Digital Library

[41]

W. Xiong, S. Park, J. Zhang, Y. Zhou, and Z. Ma. Ad hoc synchronization considered harmful. In OSDI, pages 1--8. USENIX, 2010.

Digital Library

[42]

Yourkit. Yourkit home page. http://www.yourkit.com/, 2014.

[43]

Y. Yu, T. Rodeheffer, and W. Chen. Racetrack: Efficient detection of data race conditions via adaptive tracking. In SOSP, pages 221--234, 2005.

Digital Library

Cited By

Nahian ADemsky BRodríguez GSadayappan PSukumaran-Rajam A(2024)FlowProf: Profiling Multi-threaded Programs using Information-FlowProceedings of the 33rd ACM SIGPLAN International Conference on Compiler Construction10.1145/3640537.3641577(137-149)Online publication date: 17-Feb-2024
https://dl.acm.org/doi/10.1145/3640537.3641577
Li JZhang YLu SGunawi HGu XHuang FLi D(2023)Performance Bug Analysis and Detection for Distributed Storage and Computing SystemsACM Transactions on Storage10.1145/358028119:3(1-33)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3580281
Liscano RAhmed ARobertson JAzim ASundaresan VChan Y(2023)A Lock Contention Classifier Based on Java Lock Contention Anti-Patterns2023 International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA58977.2023.00165(1106-1113)Online publication date: 15-Dec-2023
https://doi.org/10.1109/ICMLA58977.2023.00165
Show More Cited By

Index Terms

Continuously measuring critical section pressure with the free-lunch profiler

Recommendations

Continuously measuring critical section pressure with the free-lunch profiler
OOPSLA '14

Today, Java is regularly used to implement large multi-threaded server-class applications that use locks to protect access to shared data. However, understanding the impact of locks on the performance of a system is complex, and thus the use of locks ...
Fast and Portable Locking for Multicore Architectures

The scalability of multithreaded applications on current multicore systems is hampered by the performance of lock algorithms, due to the costs of access contention and cache misses. The main contribution presented in this article is a new locking ...
Pessimistic software lock-elision
DISC'12: Proceedings of the 26th international conference on Distributed Computing

Read-write locks are one of the most prevalent lock forms in concurrent applications because they allow read accesses to locked code to proceed in parallel. However, they do not offer any parallelism between reads and writes.

This paper introduces ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

OOPSLA '14: Proceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications

October 2014

946 pages

ISBN:9781450325851

DOI:10.1145/2660193

General Chair:
Andrew Black
Portland State University, USA
,
Program Chair:
Todd Millstein
University of California, Los Angeles, USA

ACM SIGPLAN Notices Volume 49, Issue 10
OOPSLA '14
October 2014
907 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/2714064
Editor:
Andy Gill
University of Kansas, Lawrence, KS
Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGPLAN: ACM Special Interest Group on Programming Languages

In-Cooperation

SIGAda: ACM Special Interest Group on Ada Programming Language

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Agence Nationale de la Recherche

Conference

SPLASH '14

Sponsor:

SIGPLAN

SPLASH '14: Conference on Systems, Programming, and Applications: Software for Humanity

October 20 - 24, 2014

Oregon, Portland, USA

Acceptance Rates

OOPSLA '14 Paper Acceptance Rate 52 of 186 submissions, 28%;

Overall Acceptance Rate 268 of 1,244 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
394
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nahian ADemsky BRodríguez GSadayappan PSukumaran-Rajam A(2024)FlowProf: Profiling Multi-threaded Programs using Information-FlowProceedings of the 33rd ACM SIGPLAN International Conference on Compiler Construction10.1145/3640537.3641577(137-149)Online publication date: 17-Feb-2024
https://dl.acm.org/doi/10.1145/3640537.3641577
Li JZhang YLu SGunawi HGu XHuang FLi D(2023)Performance Bug Analysis and Detection for Distributed Storage and Computing SystemsACM Transactions on Storage10.1145/358028119:3(1-33)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3580281
Liscano RAhmed ARobertson JAzim ASundaresan VChan Y(2023)A Lock Contention Classifier Based on Java Lock Contention Anti-Patterns2023 International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA58977.2023.00165(1106-1113)Online publication date: 15-Dec-2023
https://doi.org/10.1109/ICMLA58977.2023.00165
Khan NRobertson JLiscano RAzim ASundaresan VChang Y(2022)Lock Contention Performance Classification for Java Intrinsic LocksRuntime Verification10.1007/978-3-031-17196-3_16(274-282)Online publication date: 28-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-17196-3_16
Nair RField TAmaral JKoziolek ATrubiani CIosup A(2020)GAPP: A Fast Profiler for Detecting Serialization Bottlenecks in Parallel Linux ApplicationsProceedings of the ACM/SPEC International Conference on Performance Engineering10.1145/3358960.3379136(257-264)Online publication date: 20-Apr-2020
https://dl.acm.org/doi/10.1145/3358960.3379136
Rosà ARosales EBinder W(2019)Analysis and Optimization of Task Granularity on the Java Virtual MachineACM Transactions on Programming Languages and Systems10.1145/333849741:3(1-47)Online publication date: 16-Jul-2019
https://dl.acm.org/doi/10.1145/3338497
Khan TZhao YPokam GMozafari BKasikci BMcKinley KFisher K(2019)Huron: hybrid false sharing detection and repairProceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation10.1145/3314221.3314644(453-468)Online publication date: 8-Jun-2019
https://dl.acm.org/doi/10.1145/3314221.3314644
Guerraoui RGuiroux HLachaize RQuéma VTrigonakis V(2019)Lock–UnlockACM Transactions on Computer Systems10.1145/330150136:1(1-149)Online publication date: 14-Mar-2019
https://dl.acm.org/doi/10.1145/3301501
Bouksiaa MTrahay FLescouet AVoron GDulong RGuermouche ABrunet EThomas G(2019)Using Differential Execution Analysis to Identify Thread InterferenceIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2019.292748130:12(2866-2878)Online publication date: 1-Dec-2019
https://doi.org/10.1109/TPDS.2019.2927481
Benavides ZVora KGupta RZhang X(2019)Annotation guided collection of context-sensitive parallel execution profilesFormal Methods in System Design10.1007/s10703-019-00341-054:3(388-415)Online publication date: 9-Oct-2019
https://doi.org/10.1007/s10703-019-00341-0
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents