E=MC^2: Efficient Mobility Centric Caching
Authors: 
Chen Ding, Ben Reber, Dorin Patru, Alexander H. Kneipp, Marcus FigoritoAuthors Info & Claims
Chen Ding, Ben Reber, Dorin Patru, Alexander H. Kneipp, Marcus FigoritoAuthors Info & ClaimsArticle No.: 10, Pages 1 - 5
Abstract
Mobility-centric design revolves around the concept of a lease, which is used by hardware to manage the cache memory and by software to program the hardware. This position paper presents a design of collaborative software and hardware programming of a multicore cache hierarchy. This design is the first to allow any mix of software and hardware policies on the same machine. It promises more powerful cache optimization than what is possible with existing cache designs but also introduces the problem of multi-level cache programming.
References
[1]
Amro Awad, Arkaprava Basu, Sergey Blagodurov, Yan Solihin, and Gabriel H. Loh. 2017. Avoiding TLB Shootdowns Through Self-Invalidating TLB Entries. In Proceedings of the International Conference on Parallel Architecture and Compilation Techniques. 273–287. https://doi.org/10.1109/PACT.2017.38
[2]
Nathan Beckmann and Daniel Sanchez. 2015. Talus: A simple way to remove cliffs in cache performance. In Proceedings of the International Symposium on High-Performance Computer Architecture. 64–75. https://doi.org/10.1109/HPCA.2015.7056022
[3]
Kristof Beyls and Erik H. D’Hollander. 2005. Generating cache hints for improved program efficiency. Journal of Systems Architecture 51, 4 (2005), 223–250.
[4]
Sayak Chakraborti, Zhizhou Zhang, Noah Bertram, Chen Ding, and Sandhya Dwarkadas. 2023. Blast from the Past: Least Expected Use (LEU) Cache Replacement with Statistical History. In Proceedings of the International Symposium on Memory Management, Stephen M. Blackburn and Erez Petrank (Eds.). 124–136.
[5]
Dong Chen, Chen Ding, Fangzhou Liu, Benjamin Reber, Wesley Smith, and Pengcheng Li. 2021. Uniform lease vs. LRU cache: analysis and evaluation. In ISMM ’21: 2021 ACM SIGPLAN International Symposium on Memory Management, Virtual Event, Canada, 22 June 2021, Zhenlin Wang and Tobias Wrigstad (Eds.). ACM, 15–27.
[6]
Dong Chen, Fangzhou Liu, Chen Ding, and Sreepathi Pai. 2018. Locality analysis through static parallel sampling. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation. 557–570. https://doi.org/10.1145/3192366.3192402
[7]
Chen Ding, Dong Chen, Fangzhou Liu, Benjamin Reber, and Wesley Smith. 2022. CARL: Compiler Assigned Reference Leasing. ACM Transactions on Architecture and Code Optimization 19, 1 (2022), 15:1–15:28.
[8]
Brad Fitzpatrick. 2004. Distributed caching with Memcached. Linux Journal 2004, 124 (2004), 5.
[9]
Cary G. Gray and David R. Cheriton. 1989. Leases: An Efficient Fault-Tolerant Mechanism for Distributed File Cache Consistency. In Proceedings of the ACM Symposium on Operating System Principles. 202–210. https://doi.org/10.1145/74850.74870
[10]
Xiaoming Gu and Chen Ding. 2011. On the theory and potential of LRU-MRU collaborative cache management. In Proceedings of the International Symposium on Memory Management. 43–54.
[11]
Xiameng Hu, Xiaolin Wang, Lan Zhou, Yingwei Luo, Chen Ding, and Zhenlin Wang. 2016. Kinetic Modeling of Data Eviction in Cache. In Proceedings of USENIX Annual Technical Conference. 351–364. https://www.usenix.org/conference/atc16/technical-sessions/presentation/hu
[12]
Xiameng Hu, Xiaolin Wang, Lan Zhou, Yingwei Luo, Zhenlin Wang, Chen Ding, and Chencheng Ye. 2018. Fast Miss Ratio Curve Modeling for Storage Cache. ACM Transactions on Storage 14, 2 (2018), 12:1–12:34. https://doi.org/10.1145/3185751
[13]
Akanksha Jain and Calvin Lin. 2016. Back to the Future: Leveraging Belady’s Algorithm for Improved Cache Replacement. In Proceedings of the International Symposium on Computer Architecture. 78–89. https://doi.org/10.1109/ISCA.2016.17
[14]
Aamer Jaleel, Kevin B Theobald, Simon C Steely Jr, and Joel Emer. 2010. High performance cache replacement using re-reference interval prediction (RRIP). In ACM SIGARCH Computer Architecture News, Vol. 38. ACM, 60–71.
[15]
Louis-Noël Pouchet. [n. d.]. PolyBench/C 4.0. http://polybench.sourceforge.net.
[16]
Ian Prechtl, Chen Ding, and Dorin Patru. 2020. Design and Evaluation of a Fixed-size Programmable Working-set Cache on FPGAs. preprint online at https://dx.doi.org/10.13140/RG.2.2.24423.60320.
[17]
Ian Prechtl, Ben Reber, Chen Ding, Dorin Patru, and Dong Chen. 2020. CLAM: Compiler Lease of Cache Memory. In MEMSYS 2020: The International Symposium on Memory Systems, Washington, DC, USA, September, 2020. ACM, 281–296.
[18]
Moinuddin K. Qureshi, Aamer Jaleel, Yale N. Patt, Simon C. Steely, and Joel S. Emer. 2007. Adaptive insertion policies for high performance caching. In Proceedings of the International Symposium on Computer Architecture. 381–391.
[19]
Benjamin Reber, Matthew Gould, Alexander H. Kneipp, Fangzhou Liu, Ian Prechtl, Chen Ding, Linlin Chen, and Dorin Patru. 2023. Cache Programming for Scientific Loops Using Leases. ACM Transactions on Architecture and Code Optimization 20, 3, Article 39 (jul 2023), 25 pages.
[20]
Kimming So and Rudolph N. Rechtschaffen. 1988. Cache Operations by MRU Change. IEEE Trans. Comput. 37, 6 (1988), 700–709. https://doi.org/10.1109/12.2208
[21]
Harold S. Stone, John Turek, and Joel L. Wolf. 1992. Optimal Partitioning of Cache Memory. IEEE Trans. Comput. 41, 9 (1992), 1054–1068. https://doi.org/10.1109/12.165388
[22]
Dominique Thiébaut, Joel L. Wolf, and Harold S. Stone. 1992. Synthetic Traces for Trace-Driven Simulation of Cache Memories. IEEE Trans. Comput. 41, 4 (1992), 388–410.
[23]
Carl A. Waldspurger, Trausti Saemundsson, Irfan Ahmad, and Nohhyun Park. 2017. Cache Modeling and Optimization using Miniature Simulations. In Proceedings of USENIX Annual Technical Conference. 487–498. https://www.usenix.org/conference/atc17/technical-sessions/presentation/waldspurger
[24]
Z. Wang, K. S. McKinley, A. L.Rosenberg, and C. C. Weems. 2002. Using the compiler to improve cache replacement decisions. In Proceedings of the International Conference on Parallel Architecture and Compilation Techniques. Charlottesville, Virginia.
[25]
Chencheng Ye, Jacob Brock, Chen Ding, and Hai Jin. 2017. Rochester Elastic Cache Utility (RECU): Unequal Cache Sharing is Good Economics. International Journal of Parallel Programming 45, 1 (2017), 30–44. https://doi.org/10.1007/s10766-015-0384-3
Index Terms
- E=MC^2: Efficient Mobility Centric Caching
Recommendations
Selective Victim Caching: A Method to Improve the Performance of Direct-Mapped Caches
Although direct-mapped caches suffer from higher miss ratios as compared to set-associative caches, they are attractive for today's high-speed pipelined processors that require very low access times. Victim caching was proposed by Jouppi [1] as an ...
User-assisted in-network caching in information-centric networking
In information-centric networking, in-network caching has the potential to improve network efficiency and content distribution performance by satisfying user requests with cached content rather than downloading the requested content from remote sources. ...
Proactive caching with mobility prediction under uncertainty in information-centric networks
ICN '17: Proceedings of the 4th ACM Conference on Information-Centric NetworkingProactive caching can be a key enabler for reducing the latency of retrieving predictable content requests, alleviating backhaul traffic and mitigating latency caused by handovers. In mobile networks, proactive caching relies on mobility prediction to ...
Comments
Information & Contributors
Information
Published In
October 2023
231 pages
ISBN:9798400716447
DOI:10.1145/3631882
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 April 2024
Check for updates
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
Conference
MEMSYS '23
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 144Total Downloads
- Downloads (Last 12 months)144
- Downloads (Last 6 weeks)15
Reflects downloads up to 08 Mar 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in