research-article

Public Access

UniHeap: managing persistent objects across managed runtimes for non-volatile memory

Authors:

Benjamin Reidys,

Josep Torrellas,

Jian HuangAuthors Info & Claims

SYSTOR '21: Proceedings of the 14th ACM International Conference on Systems and Storage

Article No.: 7, Pages 1 - 12

https://doi.org/10.1145/3456727.3463775

Published: 14 June 2021 Publication History

Abstract

Byte-addressable, non-volatile memory (NVM) is emerging as a promising technology. To facilitate its wide adoption, employing NVM in managed runtimes like JVM has proven to be an effective approach (i.e., managed NVM). However, such an approach is runtime specific, it lacks a generic abstraction across different managed languages. Similar to the well-known filesystem primitives that allow diverse programs to access the same file via the block I/O interface, managed NVM deserves the same system-wide property for persistent objects across managed runtimes with low overhead.

In this paper, we present UniHeap, a new NVM framework for managing persistent objects. It proposes a unified persistent object model that supports various managed languages, and manages NVM within a shared heap that enables cross-language persistent object sharing. UniHeap reduces the object persistence overhead by managing the shared heap in a log-structured manner and coalescing object updates during the garbage collection. We implement UniHeap as a generic framework and extend it to different managed runtimes that include HotSpot JVM, cPython, and JavaScript engine SpiderMonkey. We evaluate UniHeap with a variety of applications, such as key-value store and transactional database. Our evaluation shows that UniHeap significantly out-performs state-of-the-art object sharing approaches, while introducing negligible overhead to the managed runtimes.

References

[1]

2015. Intel 64 and IA-32 Architectures Software Developer's Manual. https://www.intel.com/content/dam/www/public/us/en/documents/manuals/64-ia-32-architectures-software-developer-\instruction-set-reference-manual-325383.pdf.

[2]

2019. Apache Thrift vs Protocol Buffers vs Fast Buffers. https://www.eprosima.com/index.php/resources-all/performance/apache-thrift-vs-protocol-buffers-vs-fast-buffers.

[3]

2019. H2 Database Engine. https://www.h2database.com

[4]

2019. NVDIMM. https://en.wikipedia.org/wiki/NVDIMM.

[5]

2019. PCJ. https://github.com/pmem/pcj.

[6]

2019. Protocol buffers are a language-neutral, platform-neutral extensible mechanism for serializing structured data. https://developers.google.com/protocol-buffers/.

[7]

2019. Why are multiple programming languages used in the development of one product or piece of software. https://softwareengineering.stackexchange.com/questions/370135/why-are-multiple-programming-languages-used-in-the-development-of-one-product-or.

[8]

2021. 10 Garbage-First Garbage Collector Tuning. https://stackoverflow.com/questions/61936621/what-is-remembered-set-in-g1-algorithms-used-for.

[9]

2021. Persistent Memory Development Kit. http://pmem.io/pmdk/

[10]

5 Popular Programming Languages and Their Uses. 2017. https://medium.com/@CarolPelu/5-popular-programming-languages-and-their-\uses-22af241de35b.

[11]

H. Akinaga and H. Shima. 2010. Resistive Random Access Memory (ReRAM) Based on Metal Oxides. Proc. IEEE 98, 12 (Dec 2010), 2237--2251.

[12]

Shoaib Akram, Jennifer B. Sartor, Kathryn S. McKinley, and Lieven Eeckhout. 2018. Write-Rationing Garbage Collection for Hybrid Memories. In Proceedings of ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'18). Philadelphia, PA.

Digital Library

[13]

Miao Cai, Chance Coats, and Jian Huang. 2020. Hoop: Efficient Hardware-Assisted Out-of-Place Update for Non-Volatile Memory. In Proceedings of the 47th International Symposium on Computer Architecture (ISCA'20). Virtual Event.

Digital Library

[14]

Dhruva R. Chakrabarti, Hans-J. Boehm, and Kumud Bhandari. 2014. Atlas: Leveraging Locks for Non-volatile Memory Consistency. In Proceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications (Portland, Oregon, USA) (OOPSLA '14). ACM, New York, NY, USA, 433--452.

Digital Library

[15]

Joel Coburn, Adrian M. Caulfield, Ameen Akel, Laura M. Grupp, Rajesh K. Gupta, Ranjit Jhala, and Steven Swanson. 2011. NV-Heaps: Making Persistent Objects Fast and Safe with Next-generation, Non-volatile Memories. In Proceedings of the Sixteenth International Conference on Architectural Support for Programming Languages and Operating Systems (Newport Beach, California, USA) (ASPLOS XVI). ACM, New York, NY, USA, 105--118.

Digital Library

[16]

Nachshon Cohen, David T. Aksun, and James R. Larus. 2018. Object-oriented recovery for non-volatile memory. Proceedings of the ACM on Programming Languages, Vol. 2, OOPSLA (2018), 153:1--153:22.

Digital Library

[17]

Jeremy Condit, Edmund B. Nightingale, Christopher Frost, Engin Ipek, Benjamin Lee, Doug Burger, and Derrick Coetzee. 2009. Better I/O Through Byte-addressable, Persistent Memory. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles (SOSP'09). Big Sky Montana, USA.

Digital Library

[18]

Brian F. Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan, and Russell Sears. [n.d.]. Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing.

[19]

Joel E. Denny, Seyong Lee, and Jeffrey S. Vetter. 2016. NVL-C: Static Analysis Techniques for Efficient, Correct Programming of Non-Volatile Main Memory Systems. In Proceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing (Kyoto, Japan) (HPDC '16). ACM, New York, NY, USA, 125--136.

Digital Library

[20]

Mingkai Dong, Heng Bu, Jifei Yi, Benchao Dong, and Haibo Chen. 2019. Performance and Protection in the ZoFS User-Space NVM File System. In Proceedings of the 27th ACM Symposium on Operating Systems Principles (SOSP'19) (Huntsville, Ontario, Canada).

Digital Library

[21]

K. Doshi, E. Giles, and P. Varman. 2016. Atomic persistence for SCM with a non-intrusive backend controller. In 2016 IEEE International Symposium on High Performance Computer Architecture (HPCA). 77--89.

[22]

Vaibhav Gogte, Stephan Diestelhorst, William Wang, Satish Narayanasamy, Peter M. Chen, and Thomas F. Wenisch. 2018. Persistency for Synchronization-free Regions. In Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation (Philadelphia, PA, USA) (PLDI 2018). ACM, New York, NY, USA, 46--61.

Digital Library

[23]

Matthias Grimmer, Chris Seaton, Roland Schatz, Thomas Würthinger, and Hanspeter Mössenböck. 2015. High-Performance Cross-Language Interoperability in a Multi-Language Runtime. In Proceedings of the 11th Symposium on Dynamic Languages (DLS'15). Pittsburgh, PA, USA.

Digital Library

[24]

Terry Ching-Hsiang Hsu, Helge Brügner, Indrajit Roy, Kimberly Keeton, and Patrick Eugster. 2017. NVthreads: Practical Persistence for Multi-threaded Applications. In Proceedings of the Twelfth European Conference on Computer Systems (Belgrade, Serbia) (EuroSys '17). ACM, New York, NY, USA, 468--482.

Digital Library

[25]

Jian Huang, Karsten Schwan, and Moinuddin K. Qureshi. 2015. NVRAM-Aware Logging in Transaction Systems. In Proceedings of the VLDB Endowment (VLDB'15). Kohala Coast, Hawaii.

[26]

Jian Huang, Xuechen Zhang, and Karsten Schwan. 2015. Understanding Issue Correlations: A Case Study of the Hadoop System. In Proceedings of the Sixth ACM Symposium on Cloud Computing (SoCC'15). Kohala Coast, Hawaii.

Digital Library

[27]

Intel. 2018. 3D XPoint: A Breakthrough in Non-Volatile Memory Technology. https://www.intel.com/content/www/us/en/architecture-and-technology/intel-micron-3d-xpoint-webcast.html.

[28]

Joseph Izraelevitz, Terence Kelly, and Aasheesh Kolli. 2016. Failure-Atomic Persistent Memory Updates via JUSTDO Logging. In Proceedings of 21th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'16). Atlanta, GA.

Digital Library

[29]

Java Data Objects. 2006. https://en.wikipedia.org/wiki/Java_Data_Objects.

[30]

Java Persistence API. 2013. https://en.wikipedia.org/wiki/Java_Persistence_API.

[31]

JetStream2. 2019. https://browserbench.org/JetStream/.

[32]

A. Joshi, V. Nagarajan, S. Viglas, and M. Cintra. 2017. ATOM: Atomic Durability in Non-volatile Memory through Hardware Logging. In 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA). 361--372.

[33]

Rohan Kadekodi, Se Kwon Lee, Sanidhya Kashyap, Taesoo Kim, Aasheesh Kolli, and Vijay Chidambaram. 2019. SplitFS: Reducing Software Overhead in File Systems for Persistent Memory. In Proceedings of the 27th ACM Symposium on Operating Systems Principles (SOSP'19) (Huntsville, Ontario, Canada).

Digital Library

[34]

Aasheesh Kolli, Vaibhav Gogte, Ali Saidi, Stephan Diestelhorst, Peter M. Chen, Satish Narayanasamy, and Thomas F. Wenisch. 2017. Language-level Persistency. In Proceedings of the 44th Annual International Symposium on Computer Architecture (Toronto, ON, Canada) (ISCA '17). ACM, New York, NY, USA, 481--493.

Digital Library

[35]

Se Kwon Lee, Jayashree Mohan, Sanidhya Kashyap, Taesoo Kim, and Vijay Chidambaram. 2019. Recipe: Converting Concurrent DRAM Indexes to Persistent-Memory Indexes. In Proceedings of the 27th ACM Symposium on Operating Systems Principles (SOSP'19) (Huntsville, Ontario, Canada).

Digital Library

[36]

Baptiste Lepers, Oana Balmau, Karan Gupta, and Willy Zwaenepoel. 2019. KVell: The Design and Implementation of a Fast Persistent Key-Value Store. In Proceedings of the 27th ACM Symposium on Operating Systems Principles (SOSP'19) (Huntsville, Ontario, Canada).

Digital Library

[37]

Virendra Marathe, Achin Mishra, Amee Trivedi, Yihe Huang, Faisal Zaghloul, Sanidhya Kashyap, Margo Seltzer, Tim Harris, Steve Byan, Bill Bridge, and Dave Dice. 2018. Persistent Memory Transactions. arXiv:cs.DC/1804.00701

[38]

Mario Wolczko, Non-Volatile Memory and Java. 2019. https://medium.com/@mwolczko/non-volatile-memory-and-java-7ba80f1e730c.

[39]

Mark Slee and Aditya Agarwal and Marc Kwiatkowski. 2007. Thrift: Scalable Cross-Language Services Implementation. White Paper (2007).

[40]

Amirsaman Memaripour, Joseph Izraelevitz, and Steven Swanson. 2020. Pronto: Easy and Fast Persistence for Volatile Data Structures. In Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'20). Lausanne, Switzerland.

Digital Library

[41]

Software Transactional Memory. 2019. https://en.wikipedia.org/wiki/Software_transactional_memory.

[42]

Sanketh Nalli, Swapnil Haria, Mark D. Hill, Michael M. Swift, Haris Volos, and Kimberly Keeton. 2017. An Analysis of Persistent Memory Use with WHISPER. In Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems (Xi'an, China) (ASPLOS '17). ACM, New York, NY, USA, 135--148.

Digital Library

[43]

Khanh Nguyen, Lu Fang, Christian Navasca, Guoqing Xu, Brian Demsky, and Shan Lu. 2018. Skyway: Connecting Managed Heaps in Distributed Big Data Systems. In Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '18). Williamsburg, VA, USA.

Digital Library

[44]

Tri M. Nguyen and David Wentzlaff. 2018. PiCL: a software-transparent, persistent cache log for nonvolatile main memory. In Proceedings of the 51th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'18). Fukuoka, Japan, 178--190.

[45]

Yuanjiang Ni, Jishen Zhao, Heiner Litz, Daniel Bittman, and Ethan L. Miller. 2019. SSP: Eliminating Redundant Writes in Failure-Atomic NVMRAMs via Shadow Sub-Paging. In Proceedings of 52st International Symposium on Microarchitecture (MICRO'19). Columbus, OH.

[46]

Steven Pelley, Peter M. Chen, and Thomas F. Wenisch. 2014. Memory Persistency. In Proceeding of the 41st Annual International Symposium on Computer Architecuture (ISCA'14). Minneapolis, Minnesota, USA.

[47]

QuickCached. 2019. https://github.com/QuickServerLab/QuickCached.

[48]

Dulloor Subramanya Rao, Sanjay Kumar, Anil Keshavamurthy, Philip Lantz, Dheeraj Reddy, Rajesh Sankaran, and Jeff Jackson. 2014. System software for persistent memory. In Ninth Eurosys Conference 2014, EuroSys 2014, Amsterdam, The Netherlands, April 13-16, 2014. 15:1--15:15.

Digital Library

[49]

S. Raoux, G. W. Burr, M. J. Breitwisch, C. T. Rettner, Y. C. Chen, R. M. Shelby, M. Salinga, D. Krebs, S. H. Chen, H. L. Lung, and C. H. Lam. 2008. Phase-change random access memory: A scalable technology. IBM Journal of Research and Development 52, 4.5 (July 2008), 465--479.

Digital Library

[50]

Seunghee Shin, Satish Kumar Tirukkovalluri, James Tuck, and Yan Solihin. 2017. Proteus: A Flexible and Fast Software Supported Hardware Logging Approach for NVM. In Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture (Cambridge, Massachusetts) (MICRO-50 '17). ACM, New York, NY, USA, 178--190.

Digital Library

[51]

Thomas Shull, Jian Huang, and Josep Torrellas. 2018. Defining a High-level Programming Model for Emerging NVRAM Technologies. In Proceedings of the 15th International Conference on Managed Languages & Runtimes (Linz, Austria) (ManLang '18). ACM, New York, NY, USA, Article 11, 7 pages.

Digital Library

[52]

Thomas Shull, Jian Huang, and Josep Torrellas. 2019. AutoPersist: an easy-to-use Java NVM framework based on reachability. In Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'19). Phoenix, AZ.

Digital Library

[53]

Thomas Shull, Jian Huang, and Josep Torrellas. 2019. QuickCheck: Using Speculation to Reduce the Overhead of Checks in NVM Frameworks. In Proceedings of the 15th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE'19). Providence, Rhode Island.

Digital Library

[54]

The Python Performance Benchmark Suite. 2017. https://pyperformance.readthedocs.io/.

[55]

Top 10 Programming Languages of the World - 2019 to Begin with. 2019. https://www.geeksforgeeks.org/top-10-programming-languages-\of-the-world-2019-to-begin-with/.

[56]

Haris Volos, Andres Jaan Tack, and Michael M. Swift. 2011. Mnemosyne: Lightweight Persistent Memory. In Proceedings of the Sixteenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'11) (Newport Beach, California, USA).

[57]

Chenxi Wang, Huimin Cui, Ting Cao, John Zigman, Haris Volos, Onur Multu, Fang Lv, Xiaobing Feng, and Guoqing Harry Xu. 2019. Panthera: Holistic Memory Management for Big Data Processing over Hybrid Memories. In Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'19). Phoenix, AZ.

Digital Library

[58]

Michael Wegiel and Chandra Krintz. 2008. XMem: Type-Safe, Transparent, Shared Memory for Cross-Runtime Communication and Coordination. In Proceedings of ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'08). Tucson, AZ.

Digital Library

[59]

Michal Wegiel and Chandra Krintz. 2010. Cross-language, type-safe, and transparent object sharing for co-located managed runtimes. In Proceedings of the 25th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA'10). Reno/Tahoe, Nevada.

Digital Library

[60]

Mingyu Wu, Ziming Zhao, Haoyu Li, Heting Li, Haibo Chen, Binyu Zang, and Haibing Guan. 2018. Espresso: Brewing Java For More Non-Volatility with Non-volatile Memory. In Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'18). Williamsburg, VA, USA.

Digital Library

[61]

Jian Xu and Steven Swanson. 2016. NOVA: A Log-structured File System for Hybrid Volatile/Non-volatile Main Memories. In 14th USENIX Conference on File and Storage Technologies, FAST 2016, Santa Clara, CA, USA, February 22-25, 2016. 323--338.

Digital Library

[62]

Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2010. Spark: Cluster Computing with Working Sets. In Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud'10). Boston, MA.

Digital Library

Cited By

Wu RShen ZYang ZShu J(2024)Mitigating Write Disturbance in Non-Volatile Memory via Coupling Machine Learning with Out-of-Place Updates2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA)10.1109/HPCA57654.2024.00092(1184-1198)Online publication date: 2-Mar-2024
https://doi.org/10.1109/HPCA57654.2024.00092
KP AMishra DPanda B(2024)Prosper: Program Stack Persistence in Hybrid Memory Systems2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA)10.1109/HPCA57654.2024.00091(1168-1183)Online publication date: 2-Mar-2024
https://doi.org/10.1109/HPCA57654.2024.00091
Wu JDong JFang RZhang WWang WZuo D(2022)WDBTJournal of Systems and Software10.1016/j.jss.2022.111247187:COnline publication date: 1-May-2022
https://dl.acm.org/doi/10.1016/j.jss.2022.111247
Show More Cited By

Index Terms

UniHeap: managing persistent objects across managed runtimes for non-volatile memory
1. Hardware
  1. Emerging technologies
    1. Memory and dense storage
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Software architectures
        Object oriented architectures

Recommendations

Hoop: efficient hardware-assisted out-of-place update for non-volatile memory
ISCA '20: Proceedings of the ACM/IEEE 47th Annual International Symposium on Computer Architecture

Byte-addressable non-volatile memory (NVM) is a promising technology that provides near-DRAM performance with scalable memory capacity. However, it requires atomic data durability to ensure memory persistency. Therefore, many techniques, including ...
High-Performance Transactions for Persistent Memories
ASPLOS '16: Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems

Emerging non-volatile memory (NVRAM) technologies offer the durability of disk with the byte-addressability of DRAM. These devices will allow software to access persistent data structures directly in NVRAM using processor loads and stores, however, ...
High-Performance Transactions for Persistent Memories
ASPLOS '16

Emerging non-volatile memory (NVRAM) technologies offer the durability of disk with the byte-addressability of DRAM. These devices will allow software to access persistent data structures directly in NVRAM using processor loads and stores, however, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SYSTOR '21: Proceedings of the 14th ACM International Conference on Systems and Storage

June 2021

226 pages

ISBN:9781450383981

DOI:10.1145/3456727

General Chairs:
Bruno Wassermann
IBM Research - Haifa, Israel
,
Michal Malka
IBM Research - Haifa, Israel
,
Program Chairs:
Vijay Chidambaram
University of Texas at Austin/VMWare Research
,
Danny Raz
Technion - Israel Institute of Technology, Israel

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

In-Cooperation

Technion: Israel Institute of Technology
USENIX Assoc: USENIX Assoc

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF (National Science Foundation)

Conference

SYSTOR '21

Sponsor:

SIGOPS

SYSTOR '21: The 14th ACM International Systems and Storage Conference

June 14 - 16, 2021

Haifa, Israel

Acceptance Rates

SYSTOR '21 Paper Acceptance Rate 18 of 63 submissions, 29%;

Overall Acceptance Rate 108 of 323 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
364
Total Downloads

Downloads (Last 12 months)104
Downloads (Last 6 weeks)21

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wu RShen ZYang ZShu J(2024)Mitigating Write Disturbance in Non-Volatile Memory via Coupling Machine Learning with Out-of-Place Updates2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA)10.1109/HPCA57654.2024.00092(1184-1198)Online publication date: 2-Mar-2024
https://doi.org/10.1109/HPCA57654.2024.00092
KP AMishra DPanda B(2024)Prosper: Program Stack Persistence in Hybrid Memory Systems2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA)10.1109/HPCA57654.2024.00091(1168-1183)Online publication date: 2-Mar-2024
https://doi.org/10.1109/HPCA57654.2024.00091
Wu JDong JFang RZhang WWang WZuo D(2022)WDBTJournal of Systems and Software10.1016/j.jss.2022.111247187:COnline publication date: 1-May-2022
https://dl.acm.org/doi/10.1016/j.jss.2022.111247
Wu JDong JFang RZhang WWang WZuo D(2021)WDBT: Wear Characterization, Reduction, and Leveling of DBT Systems for Non-Volatile MemoryProceedings of the International Symposium on Memory Systems10.1145/3488423.3519337(1-13)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3488423.3519337

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten