Cited By
View all- Andreoli RCucinotta TDe Oliveira D(2023)Priority-Driven Differentiated Performance for NoSQL Database-as-a-ServiceIEEE Transactions on Cloud Computing10.1109/TCC.2023.329203111:4(3469-3482)Online publication date: Oct-2023
Zoned FTL: Achieve Resource Isolation via Hardware Virtualization
Authors: 
Luyi Kang, Bruce JacobAuthors Info & Claims
Luyi Kang, Bruce JacobAuthors Info & ClaimsArticle No.: 7, Pages 1 - 8
Abstract
NVMe Solid-State Drives (SSDs) offer unprecedented throughput and response time for data centers. To increase resource utilization and enable necessary isolation, service providers usually accommodate multiple Virtual Machines (VMs) and lightweight containers on the same physical server. Till today, providing predictable storage performance is still challenging as commercial datacenter NVMe SSDs still appear as black-box block devices. This motivates us to re-examine the I/O stack and firmware design, discuss and quantify the root causes of performance interference. We argue that the semantic gap between predictable performance and the underlying device must be bridged to address this challenge. We propose a split-level design, Zoned FTL (), which enables strong physical isolation for multiple virtualized services with minimal changes in existing storage stacks. We implement the prototype on an SSD emulator and evaluate it under a variety of multi-tenant environments. The evaluation results demonstrate that barely impacts the raw performance while delivering up to 1.51x better throughput and reduce the 99th percentile latency by up to 79.4% in a multi-tenancy environment.
References
[1]
2020. Intel® SSD DC P4510 Series. https://ark.intel.com/content/www/us/en/ark/products/series/122570/intel-ssd-dc-p4510-series.html.
[2]
2020. Zoned Namespaces (ZNS) SSDs. https://zonedstorage.io/introduction/zns/.
[3]
2021. NVME Command Set. https://nvmexpress.org/developers/nvme-command-set-specifications/.
[4]
2021. What is a Namespace?https://nvmexpress.org/resources/nvm-express-technology-features/nvme-namespaces/.
[5]
Janki Bhimani, Zhengyu Yang, Ningfang Mi, Jingpei Yang, Qiumin Xu, Manu Awasthi, Rajinikanth Pandurangan, and Vijay Balakrishnan. 2018. Docker container scheduler for I/O intensive applications running on NVMe SSDs. IEEE Transactions on Multi-Scale Computing Systems 4, 3 (2018), 313–326.
[6]
Matias Bjørling. 2019. From open-channel SSDs to zoned namespaces. In Proc. Linux Storage Filesyst. Conf.(Vault). 1.
[7]
Matias Bjørling, Javier Gonzalez, and Philippe Bonnet. 2017. Lightnvm: The linux open-channel {SSD} subsystem. In 15th {USENIX} Conference on File and Storage Technologies ({FAST} 17). 359–374.
[8]
Sergey Blagodurov, Alexandra Fedorova, Sergey Zhuravlev, and Ali Kamali. 2010. A case for NUMA-aware contention management on multicore systems. In 2010 19th International Conference on Parallel Architectures and Compilation Techniques (PACT). IEEE, 557–558.
[9]
Yaozu Dong, Zhao Yu, and Greg Rose. 2008. SR-IOV Networking in Xen: Architecture, Design and Implementation. In Workshop on I/O Virtualization, Vol. 2.
[10]
Aayush Gupta, Youngjae Kim, and Bhuvan Urgaonkar. 2009. DFTL: a flash translation layer employing demand-based selective caching of page-level address mappings. Acm Sigplan Notices 44, 3 (2009), 229–240.
[11]
Yang Hu, Hong Jiang, Dan Feng, Lei Tian, Hao Luo, and Shuping Zhang. 2011. Performance impact and interplay of SSD parallelism through advanced commands, allocation strategy and data granularity. In Proceedings of the international conference on Supercomputing. 96–107.
[12]
Jian Huang, Anirudh Badam, Laura Caulfield, Suman Nath, Sudipta Sengupta, Bikash Sharma, and Moinuddin K Qureshi. 2017. Flashblox: Achieving both performance isolation and uniform lifetime for virtualized ssds. In 15th {USENIX} Conference on File and Storage Technologies ({FAST} 17). 375–390.
[13]
Vimalkumar Jeyakumar, Mohammad Alizadeh, David Mazières, Balaji Prabhakar, Albert Greenberg, and Changhoon Kim. 2013. EyeQ: Practical network performance isolation at the edge. In 10th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13). 297–311.
[14]
Myoungsoo Jung, Jie Zhang, Ahmed Abulila, Miryeong Kwon, Narges Shahidi, John Shalf, Nam Sung Kim, and Mahmut Kandemir. 2017. SimpleSSD: Modeling solid state drives for holistic system simulation. IEEE Computer Architecture Letters 17, 1 (2017), 37–41.
[15]
Jeong-Uk Kang, Jeeseok Hyun, Hyunjoo Maeng, and Sangyeun Cho. 2014. The multi-streamed solid-state drive. In 6th {USENIX} Workshop on Hot Topics in Storage and File Systems (HotStorage 14).
[16]
Jaeho Kim, Donghee Lee, and Sam H Noh. 2015. Towards {SLO} Complying SSDs Through {OPS} Isolation. In 13th {USENIX} Conference on File and Storage Technologies ({FAST} 15). 183–189.
[17]
Miryeong Kwon, Donghyun Gouk, Changrim Lee, Byounggeun Kim, Jooyoung Hwang, and Myoungsoo Jung. 2020. DC-store: eliminating noisy neighbor containers using deterministic I/O performance and resource isolation. In 18th {USENIX} Conference on File and Storage Technologies ({FAST} 20). 183–191.
[18]
Changman Lee, Dongho Sim, Jooyoung Hwang, and Sangyeun Cho. 2015. F2FS: A new file system for flash storage. In 13th {USENIX} Conference on File and Storage Technologies ({FAST} 15). 273–286.
[19]
Ganguk Lee, Yeaseul Park, Jeongseob Ahn, and Youngjin Kwon. 2019. Slicing the io execution with relaytracer. arXiv preprint arXiv:1906.07124(2019).
[20]
Jacob Leverich and Christos Kozyrakis. 2014. Reconciling high server utilization and sub-millisecond quality-of-service. In Proceedings of the Ninth European Conference on Computer Systems. 1–14.
[21]
Huaicheng Li, Mingzhe Hao, Michael Hao Tong, Swaminathan Sundararaman, Matias Bjørling, and Haryadi S Gunawi. 2018. The {CASE} of {FEMU}: Cheap, accurate, scalable and extensible flash emulator. In 16th {USENIX} Conference on File and Storage Technologies ({FAST} 18). 83–90.
[22]
Youhuizi Li, Jiancheng Zhang, Congfeng Jiang, Jian Wan, and Zujie Ren. 2019. PINE: Optimizing performance isolation in container environments. IEEE Access 7(2019), 30410–30422.
[23]
Heerak Lim, Hwajung Kim, Kihyeon Myung, Heon Young, and Yongseok Son. 2019. IsoKV: An Isolation Scheme for Key-Value Stores by Exploiting Internal Parallelism in SSD. In 2019 IEEE 26th International Conference on High Performance Computing, Data, and Analytics (HiPC). IEEE, 247–256.
[24]
Dirk Merkel 2014. Docker: lightweight linux containers for consistent development and deployment. Linux journal 2014, 239 (2014), 2.
[25]
Sai Prashanth Muralidhara, Lavanya Subramanian, Onur Mutlu, Mahmut Kandemir, and Thomas Moscibroda. 2011. Reducing memory interference in multicore systems via application-aware memory channel partitioning. In 2011 44th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 374–385.
[26]
Ivan Luiz Picoli, Niclas Hedam, Philippe Bonnet, and Pinar Tözün. 2020. Open-Channel SSD (What is it Good For). In CIDR.
[27]
Rami Rosen. 2013. Resource management: Linux kernel namespaces and cgroups. Haifux, May 186(2013), 70.
[28]
Rami Rosen. 2014. Linux containers and the future cloud. Linux J 240, 4 (2014), 86–95.
[29]
Gustavo AA Santana. 2013. Data center virtualization fundamentals: understanding techniques and designs for highly efficient data centers with Cisco Nexus, UCS, MDS, and beyond. Cisco Press.
[30]
Theano Stavrinos, Daniel S. Berger, Ethan Katz-Bassett, and Wyatt Lloyd. 2021. Don’t Be a Blockhead: Zoned Namespaces Make Work on Conventional SSDs Obsolete. Association for Computing Machinery, New York, NY, USA, 144–151. https://doi.org/10.1145/3458336.3465300
[31]
Qiumin Xu, Huzefa Siyamwala, Mrinmoy Ghosh, Tameesh Suri, Manu Awasthi, Zvika Guz, Anahita Shayesteh, and Vijay Balakrishnan. 2015. Performance analysis of NVMe SSDs and their implication on real world databases. In Proceedings of the 8th ACM International Systems and Storage Conference. 1–11.
[32]
Shiqin Yan, Huaicheng Li, Mingzhe Hao, Michael Hao Tong, Swaminathan Sundararaman, Andrew A Chien, and Haryadi S Gunawi. 2017. Tiny-tail flash: Near-perfect elimination of garbage collection tail latencies in NAND SSDs. ACM Transactions on Storage (TOS) 13, 3 (2017), 1–26.
Recommendations
Quantifying the performance isolation properties of virtualization systems
ExpCS '07: Proceedings of the 2007 workshop on Experimental computer scienceIn this paper, we present the design of a performance isolation benchmark that quantifies the degree to which a virtualization system limits the impact of a misbehaving virtual machine on other well-behaving virtual machines running on the same physical ...
Quantifying the performance isolation properties of virtualization systems
ecs'07: Experimental computer science on Experimental computer scienceIn recent years, there have been a number of papers comparing the performance of different virtualization environments for x86. These comparisons have typically quantified the overhead of virtualization for one VM compared to a base OS. It has also been ...
Performance comparison of hardware virtualization platforms
NETWORKING'11: Proceedings of the 10th international IFIP TC 6 conference on Networking - Volume Part IHosting virtual servers on a shared physical hardware by means of hardware virtualization is common use at data centers, web hosters, and research facilities. All platforms include isolation techniques that restrict resource consumption of the virtual ...
Comments
Information & Contributors
Information
Published In
September 2021
158 pages
ISBN:9781450385701
DOI:10.1145/3488423
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 May 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
MEMSYS 2021
MEMSYS 2021: The International Symposium on Memory Systems
September 27 - 30, 2021
DC, Washington DC, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 200Total Downloads
- Downloads (Last 12 months)64
- Downloads (Last 6 weeks)8
Reflects downloads up to 11 Aug 2024
Other Metrics
Citations
Cited By
View all- Andreoli RCucinotta TDe Oliveira D(2023)Priority-Driven Differentiated Performance for NoSQL Database-as-a-ServiceIEEE Transactions on Cloud Computing10.1109/TCC.2023.329203111:4(3469-3482)Online publication date: Oct-2023
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format