research-article

SSD bufferpool extensions for database systems

Editors: Elisa Bertino, Paolo Atzeni, Kian Lee Tan, Yi Chen, Y. C. Tay Authors:

George A. Mihaila,

Bishwaranjan Bhattacharjee,

Kenneth A. Ross,

Christian A. LangAuthors Info & Claims

Proceedings of the VLDB Endowment, Volume 3, Issue 1-2

Pages 1435 - 1446

https://doi.org/10.14778/1920841.1921017

Published: 01 September 2010 Publication History

Abstract

High-end solid state disks (SSDs) provide much faster access to data compared to conventional hard disk drives. We present a technique for using solid-state storage as a caching layer between RAM and hard disks in database management systems. By caching data that is accessed frequently, disk I/O is reduced. For random I/O, the potential performance gains are particularly significant. Our system continuously monitors the disk access patterns to identify hot regions of the disk. Temperature statistics are maintained at the granularity of an extent, i.e., 32 pages, and are kept current through an aging mechanism. Unlike prior caching methods, once the SSD is populated with pages from warm regions cold pages are not admitted into the cache, leading to low levels of cache pollution. Simulations based on DB2 I/O traces, and a prototype implementation within DB2 both show substantial performance improvements.

References

[1]

L. Belady. A study of replacement algorithms for virtual storage computers. IBM Systems Journal, 5(2):78--101, 1966.

Digital Library

[2]

M. Canim, G. A. Mihaila, B. Bhattacharjee, K. A. Ross, and C. A. Lang. An object placement advisor for DB2 using solid state storage. Proc. VLDB Endow., 2(2):1318--1329, 2009.

Digital Library

[3]

F. Chen, D. A. Koufaty, and X. Zhang. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In SIGMETRICS '09: Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems, pages 181--192, New York, NY, USA, 2009. ACM.

Digital Library

[4]

Z. Chen, Y. Zhang, Y. Zhou, H. Scott, and B. Schiefer. Empirical evaluation of multi-level buffer cache collaboration for storage systems. SIGMETRICS Perform. Eval. Rev., 33(1):145--156, 2005.

Digital Library

[5]

DB2 for Linux, UNIX and Windows. http://www-01.ibm.com/software/data/db2/linux-unix-windows.

[6]

P. Frazier, P. Andersen, G. Boggs, C. Carrillo, D. Holtzman, J. M. Morris, P. K. Muller, and P. Rubio. Decoupled logical and physical data storage within a database management system. Patent Application no. 20080281939, May 2007.

[7]

P. Gray and H. J. Watson. Present and future directions in data warehousing. SIGMIS Database, 29(3):83--90, 1998.

Digital Library

[8]

B. S. Greenberg and S. H. Webber. The multics multilevel paging hierarchy. In IEEE, editor, Proc 1975 IEEE Intercon, 1975.

[9]

Performance value of solid state drives using IBM i, May 2009. http://www-03.ibm.com/systems/resources/ssd_ibmi.pdf.

[10]

W. H. Inmon. Building the Operational Data Store. John Wiley & Sons, Inc., New York, NY, USA, 1999.

Digital Library

[11]

S. Jiang, K. Davis, and X. Zhang. Coordinated multilevel buffer cache management with consistent access locality quantification. IEEE Trans. Comput., 56(1):95--108, 2007.

Digital Library

[12]

S. Jiang, F. Petrini, X. Ding, and X. Zhang. A locality-aware cooperative cache management protocol to improve network file system performance. In ICDCS '06: Proceedings of the 26th IEEE International Conference on Distributed Computing Systems, page 42, Washington, DC, USA, 2006. IEEE Computer Society.

Digital Library

[13]

T. L. Johnson and W. mei W. Hsu. Run-time adaptive cache hierarchy management via reference analysis. In Proceedings of 24th Annual International Symposium on Computer Architecture, June 1997.

Digital Library

[14]

S.-H. Kim, D. Jung, J.-S. Kim, and S. Maeng. HeteroDrive: Re-shaping the storage access pattern of oltp workload using ssd. In Proceedings of 4th International Workshop on Software Support for Portable Storage (IWSSPS 2009), pages 13--17, October 2009.

[15]

I. Koltsidas and S. Viglas. The case for flash-aware multi level caching. Internet Publication, 2009. http://homepages.inf.ed.ac.uk/s0679010/mfcache-TR.pdf.

[16]

I. Koltsidas and S. Viglas. Utility-aware multi-device caching, 2009.

[17]

C. A. Lang, B. Bhattacharjee, T. Malkemus, S. Padmanabhan, and K. Wong. Increasing buffer-locality for multiple relational table scans through grouping and throttling. Proc. of International Conference on Data Engineering, 0:1136--1145, 2007.

[18]

A. Leventhal. Flash storage memory. Commun. ACM, 51(7):47--51, 2008.

Digital Library

[19]

X. Li, A. Aboulnaga, K. Salem, A. Sachedina, and S. Gao. Second-tier cache management using write hints. In FAST'05: Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies, pages 9--9, Berkeley, CA, USA, 2005. USENIX Association.

Digital Library

[20]

N. Megiddo and D. Modha. ARC: A self-tuning, low overhead replacement cache. In In Proceedings of the 2003 Conference on File and Storage Technologies (FAST, pages 115--130, 2003.

Digital Library

[21]

N. Megiddo and D. S. Modha. Outperforming LRU with an adaptive replacement cache algorithm. Computer, 37(4):58--65, 2004.

Digital Library

[22]

A technical overview of the Sun Oracle Exadata storage server and database machine. Internet Publication, September 2009. http://www.oracle.com/technology/products/bi/db/exadata/pdf/Exadata_Smart_Flash_Cache_TWP_v5.pdf.

[23]

S. Padmanabhan, B. Bhattacharjee, T. Malkemus, L. Cranston, and M. Huras. Multi-dimensional clustering: A new data layout scheme in DB2. In A. Y. Halevy, Z. G. Ives, and A. Doan, editors, SIGMOD Conference, pages 637--641. ACM, 2003.

Digital Library

[24]

R. Ramakrishnan and J. Gehrke. Database Management Systems. McGraw-Hill, 2003.

Digital Library

[25]

J. Samos, F. Saltor, J. Sistac, and A. Bardés. Database architecture for data warehousing: An evolutionary approach. In DEXA '98: Proceedings of the 9th International Conference on Database and Expert Systems Applications, pages 746--756, 1998.

Digital Library

[26]

TPC-C, On-Line Transaction Processing Benchmark. http://www.tpc.org/tpcc/.

[27]

TPC-H, Decision Support Benchmark. http://www.tpc.org/tpch/.

[28]

C. Williamson. On filter effects in web caching hierarchies. ACM Trans. Internet Technol., 2(1):47--77, 2002.

Digital Library

[29]

Y. Zhou, Z. Chen, and K. Li. Second-level buffer cache management. IEEE Transactions on Parallel and Distributed Systems, 15:2004, 2004.

Digital Library

Cited By

Haas GAlhomssi ALeis V(2025)Managing Very Large Datasets on Directly Attached NVMe ArraysScalable Data Management for Future Hardware10.1007/978-3-031-74097-8_9(223-240)Online publication date: 24-Jan-2025
https://doi.org/10.1007/978-3-031-74097-8_9
Yang XZhang YChen HLi FWang BFang JSun CWang YBarcelo PSanchez-Pi NMeliou ASudarshan S(2024)PolarDB-MP: A Multi-Primary Cloud-Native Database via Disaggregated Shared MemoryCompanion of the 2024 International Conference on Management of Data10.1145/3626246.3653377(295-308)Online publication date: 9-Jun-2024
https://dl.acm.org/doi/10.1145/3626246.3653377
Haas GLeis V(2023)What Modern NVMe Storage Can Do, and How to Exploit it: High-Performance I/O for High-Performance Storage EnginesProceedings of the VLDB Endowment10.14778/3598581.359858416:9(2090-2102)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.14778/3598581.3598584
Show More Cited By

SSD bufferpool extensions for database systems
1. Information systems
  1. Data management systems

Recommendations

Early Experience and Evaluation of File Systems on SSD with Database Applications
NAS '10: Proceedings of the 2010 IEEE Fifth International Conference on Networking, Architecture, and Storage

Flash SSDs are being incorporated in many enterprise storage platforms recently. However, the characteristics of the flash SSD are quite different from that of hard disk. The IO strategies in the existing systems should be carefully evaluated. This ...
Evaluation of Exclusive Data Allocation Between SSD Tier and SSD Cache in Storage Systems
ICEIS 2014: Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1

We proposed and evaluated the storage I/O response time with the exclusive allocation method between SSD for tiered volume and SSD for cache in the storage system utilizing SSD and HDD. In the proposed method, the SSD cache function with exclusive ...
Proactive Stripe Reconstruction to Improve Cache Use Efficiency of SSD-Based RAID Systems
Special Issue ESWEEK 2023
Solid-State Drives (SSDs) exhibit different failure characteristics compared to conventional hard disk drives. In particular, the Bit Error Rate (BER) of an SSD increases as it bears more writes. Then, Parity-based Redundant Array of Inexpensive Disks (...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment

Proceedings of the VLDB Endowment Volume 3, Issue 1-2

September 2010

1658 pages

ISSN:2150-8097

Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 September 2010

Published in PVLDB Volume 3, Issue 1-2

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

108
Total Citations
View Citations
1,010
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)12

Reflects downloads up to 22 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Haas GAlhomssi ALeis V(2025)Managing Very Large Datasets on Directly Attached NVMe ArraysScalable Data Management for Future Hardware10.1007/978-3-031-74097-8_9(223-240)Online publication date: 24-Jan-2025
https://doi.org/10.1007/978-3-031-74097-8_9
Yang XZhang YChen HLi FWang BFang JSun CWang YBarcelo PSanchez-Pi NMeliou ASudarshan S(2024)PolarDB-MP: A Multi-Primary Cloud-Native Database via Disaggregated Shared MemoryCompanion of the 2024 International Conference on Management of Data10.1145/3626246.3653377(295-308)Online publication date: 9-Jun-2024
https://dl.acm.org/doi/10.1145/3626246.3653377
Haas GLeis V(2023)What Modern NVMe Storage Can Do, and How to Exploit it: High-Performance I/O for High-Performance Storage EnginesProceedings of the VLDB Endowment10.14778/3598581.359858416:9(2090-2102)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.14778/3598581.3598584
Papon TAthanassoulis M(2023)ACEing the Bufferpool Management Paradigm for Modern Storage Devices2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00106(1326-1339)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00106
Nicholson HChrysogelos PAilamaki A(2023)HPCache: memory-efficient OLAP through proportional caching revisitedThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-023-00828-733:6(1775-1791)Online publication date: 22-Dec-2023
https://dl.acm.org/doi/10.1007/s00778-023-00828-7
Fedorova ASmith KBostic KLoVerso SCahill MGorrod AGavrilovska AAltınbüken DBinnig C(2022)Writes hurtProceedings of the 13th Symposium on Cloud Computing10.1145/3542929.3563461(110-125)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3542929.3563461
Nicholson HChrysogelos PAilamaki A(2022)HPCache: Memory-Efficient OLAP Through Proportional CachingProceedings of the 18th International Workshop on Data Management on New Hardware10.1145/3533737.3535100(1-9)Online publication date: 12-Jun-2022
https://dl.acm.org/doi/10.1145/3533737.3535100
Xu PZhao NWan JLiu WChen SZhou YAlbahar HLiu HTang LTan Z(2022)Building a Fast and Efficient LSM-tree Store by Integrating Local Storage with Cloud StorageACM Transactions on Architecture and Code Optimization10.1145/352745219:3(1-26)Online publication date: 25-May-2022
https://dl.acm.org/doi/10.1145/3527452
Menon PQadah TRabl TSadoghi MJacobsen H(2022)LogStore: A Workload-Aware, Adaptable Key-Value Store on Hybrid Storage SystemsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2020.302719134:8(3867-3882)Online publication date: 1-Aug-2022
https://doi.org/10.1109/TKDE.2020.3027191
Shetti MLi BDu D(2022)Machine Learning-based Adaptive Migration Algorithm for Hybrid Storage Systems2022 IEEE International Conference on Networking, Architecture and Storage (NAS)10.1109/NAS55553.2022.9925545(1-8)Online publication date: Oct-2022
https://doi.org/10.1109/NAS55553.2022.9925545
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents