Efficiently Enlarging RDMA-Attached Memory with SSD
RDMA-based in-memory storage systems offer high performance but are restricted by the capacity of physical memory. In this article, we propose TeRM to extend RDMA-attached memory with SSD. TeRM achieves fast remote access on the SSD-extended memory by ...
Evolving the Cloud Block Store with Performance, Elasticity, Availability, and Hardware Offloading
- Erci Xu,
- Weidong Zhang,
- Qiuping Wang,
- Xiaolu Zhang,
- Yuesheng Gu,
- Zhenwei Lu,
- Tao Ouyang,
- Guanqun Dong,
- Wenwen Peng,
- Zhe Xu,
- Shuo Zhang,
- Dong Wu,
- Yilei Peng,
- Tianyun Wang,
- Haoran Zhang,
- Jiasheng Wang,
- Wenyuan Yan,
- Yuanyuan Dong,
- Wenhui Yao,
- Zhongjie Wu,
- Lingjun Zhu,
- Chao Shi,
- Yinhu Wang,
- Rong Liu,
- Junping Wu,
- Jiaji Zhu,
- Jiesheng Wu
In this paper, we qualitatively and quantitatively discuss the design choices, production experience, and lessons in building the Elastic Block Storage (EBS) at Alibaba Cloud over the past decade. To cope with hardware advancement and users’ demands, we ...
Leveraging On-demand Processing to Co-optimize Scalability and Efficiency for Fully-external Graph Computation
Fully-external graph computation systems exhibit optimal scalability by computing the ever-growing, large-scale graph with a constant amount of memory on a single machine. In particular, they keep the entire massive graph data in storage and iteratively ...
A Portable Linux-based Firmware for NVMe Computational Storage Devices
Over the years, interest in computational storage devices has been growing steadily. This is largely due to the rise of data-intensive applications, such as machine learning, online video distribution, astrophysics, and genomics. Moving compute operations ...
WALSH: Write-Aggregating Log-Structured Hashing for Hybrid Memory
Persistent memory (PM) brings important opportunities for improving data storage including the widely used hash tables. However, PM is not friendly to small writes, which causes existing PM hashes to suffer from high hardware write amplification. Hybrid ...
HLN-Tree: A memory-efficient B+-Tree with huge leaf nodes and locality predictors
Key-value stores in Cloud environments can contain more than 245 unique elements and be larger than 100 PByte. B+-Trees are well suited for these larger-than-memory datasets and seamlessly index data stored on thousands of secondary storage devices. ...
A Dynamic Characteristic Aware Index Structure Optimized for Real-world Datasets
Many datasets in real life are complex and dynamic, that is, their key densities are varied over the whole key space and their key distributions change over time. It is challenging for an index structure to efficiently support all key operations for data ...
Scalable and High-Performance Large-Scale Dynamic Graph Storage and Processing System
Existing in-memory graph storage systems that rely on DRAM have scalability issues because of the limited capacity and volatile nature of DRAM. The emerging persistent memory (PMEM) offers us a chance to solve these issues through its larger capacity and ...
