research-article

Free access

Programmable solid-state storage in future cloud datacenters

Authors:

Jaeyoung Do,

Sudipta Sengupta,

Steven SwansonAuthors Info & Claims

Communications of the ACM, Volume 62, Issue 6

Pages 54 - 62

https://doi.org/10.1145/3286588

Published: 21 May 2019 Publication History

All formats PDF

Abstract

Programmable software-defined solid-state drives can move computing functions closer to storage.

References

[1]

Alves, V. In-situ processing. Flash Memory Summit (Santa Clara, CA, Aug. 8--10), 2017.

Google Scholar

[2]

Bjørling, M., González, J., and Bonnet, P. Lightnvm: The Linux open-channel SSD subsystem. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (Santa Clara, CA, Feb. 27--Mar. 2). USENIX Association, Berkeley, CA, 2017, 359--374.

Digital Library

Google Scholar

[3]

Bonnet, P. What's up with the storage hierarchy? In Proceedings of the 8th Biennial Conference on Innovative Data Systems Research (Chaminade, CA, Jan. 8--11), 2017.

Google Scholar

[4]

Cornwell, M. Anatomy of a solid-state drive. Commun. ACM 55, 12 (Dec. 2012), 59--63.

Digital Library

Google Scholar

[5]

Do, J. Softflash: Programmable storage in future data centers. In Proceedings of the 20th SNIA Storage Developer Conference (Santa Clara, CA, Sep. 11--14), 2017.

Google Scholar

[6]

Do, J., Kee, Y.-S., Patel, J.M., Park, C., Park, K., and DeWitt, D.J. Query processing on smart SSDs: Opportunities and challenges. In Proceedings of the ACM SIGMOD International Conference on Management of Data (New York, NY, Jun. 22--27). ACM Press, New York, 2013, 1221--1230.

Digital Library

Google Scholar

[7]

Gu, B., Yoon, A. S., Bae, D.-H., Jo, I., Lee, J., Yoon, J., Kang, J.-U., Kwon, M., Yoon, C., Cho, S., et al. Biscuit: A framework for near data processing of big data workloads. In Proceedings of the ACM/IEEE 43rd Annual International Symposium on Computer Architecture (Seoul, S. Korea, Jun. 18--22). IEEE, 2016, 153--165.

Digital Library

Google Scholar

[8]

Hady, F. Wicked fast storage and beyond. In Proceedings of the 7th Non Volatile Memory Workshop (San Diego, CA, Mar. 6--8). Keynote, 2016.

Google Scholar

[9]

Han, S., Egi, N., Panda, A., Ratnasamy, S., Shi, G., and Shenker, S. Network support for resource disaggregation in next-generation datacenters. In Proceedings of the 12th ACM Workshop on Hot Topics in Networks (College Park, MD, Nov. 21--22). ACM Press, New York, 2013, 10.

Digital Library

Google Scholar

[10]

Huang, J., Xu, J., Xing, X., Liu, P., and Qureshi, M. K. Flashguard: Leveraging intrinsic flash properties to defend against encryption ransomware. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security (Dallas, TX, Oct. 30--Nov. 3). ACM Press, New York, 2017, 2231--2244.

Digital Library

Google Scholar

[11]

István, Z., Sidler, D., and Alonso, G. Caribou: Intelligent distributed storage. In Proceedings of the VLDB Endowment 10, 11 (Aug. 2017), 1202--1213.

Digital Library

Google Scholar

[12]

Jo, I., Bae, D.-H., Yoon, A.S., Kang, J.-U., Cho, S., Lee, D.D., and Jeong, J. YourSQL: A high-performance database system leveraging in storage computing. In Proceedings of the VLDB Endowment 9, 12 (Aug. 2016), 924--935.

Digital Library

Google Scholar

[13]

Jun, S.-W., Liu, M., Lee, S., Hicks, J., Ankcorn, J., King, M., Xu, S., et al. BlueDBM: An appliance for big data analytics. In Proceedings of the ACM/IEEE 42nd Annual International Symposium on Computer Architecture (Portland, OR, Jun. 13--17). IEEE, 2015, 1--13.

Digital Library

Google Scholar

[14]

Kang, J.-U., Hyun, J., Maeng, H., and Cho, S. The multi-streamed solid-state drive. In Proceedings of the 6th USENIX Workshop on Hot Topics in Storage and File Systems (Philadelphia, PA, Jun. 17--18). USENIX Association, Berkeley, CA, 2014.

Digital Library

Google Scholar

[15]

Klimovic, A., Kozyrakis, C., Thereska, E., John, B., and Kumar, S. Flash storage disaggregation. In Proceedings of the 11th European Conference on Computer Systems (London, U.K., Apr. 18--21). ACM Press, New York, 2016, 29.

Digital Library

Google Scholar

[16]

Ouyang, J., Lin, S., Jiang, S., Hou, Z., Wang, Y., and Wang, Y. SDF: Software-defined flash for web-scale Internet storage systems. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (Salt Lake City, UT, Mar. 1--5). ACM press, New York, 2014, 471--484.

Digital Library

Google Scholar

[17]

Park, K., Kee, Y.-S., Patel, J.M., Do, J., Park, C., and Dewitt, D.J. Query processing on smart SSDs. IEEE Data Engineering Bulletin 37, 2 (Jun. 2014), 19--26.

Google Scholar

[18]

Picoli, I.L., Pasco, C.V., Jónsson, B.Þ., Bouganim, L., and Bonnet, P. uFLIP-OC: Understanding flash I/O patterns on open-channel solid state drives. In Proceedings of the 8th Asia-Pacific Workshop on Systems (Mumbai, India, Sep. 2--3). ACM Press, New York, 2017, 20.

Digital Library

Google Scholar

[19]

Schroeder, B., Lagisetty, R., and Merchant, A. Flash reliability in production: The expected and the unexpected. In Proceedings of the 14th USENIX Conference on File and Storage Technologies (Santa Clara, CA, Feb. 22--25). USENIX Association, Berkeley, CA, 2016, 67--80.

Digital Library

Google Scholar

[20]

Seshadri, S., Gahagan, M., Bhaskaran, S., Bunker, T., De, A., Jin, Y., Liu, Y., and Swanson, S. Willow: A user-programmable SSD. In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (Broomfield, CO, Oct. 6--8). USENIX Association, Berkeley, CA, 2014, 67--80.

Digital Library

Google Scholar

[21]

Woods, L., István, Z., and Alonso, G. Ibex: An intelligent storage engine with support for advanced SQL offloading. In Proceedings of the VLDB Endowment 7, 11 (Jul. 2014), 963--974.

Digital Library

Google Scholar

Cited By

View all

Yu SSha ZTang CCai ZTang PHuang MLi JLiao J(2024)Adaptive DRAM Cache Division for Computational Solid-state Drives2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546745(1-6)Online publication date: 25-Mar-2024
https://doi.org/10.23919/DATE58400.2024.10546745
Tsuji AOguchi M(2024)Comparison of FHE Schemes and Libraries for Efficient Cryptographic Processing2024 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICNC59896.2024.10556382(584-590)Online publication date: 19-Feb-2024
https://doi.org/10.1109/ICNC59896.2024.10556382
Cha HKim IKim T(2024)Using a random forest to predict quantized reuse distance in an SSD write bufferComputing10.1007/s00607-024-01343-5Online publication date: 5-Sep-2024
https://doi.org/10.1007/s00607-024-01343-5
Show More Cited By

Index Terms

Programmable solid-state storage in future cloud datacenters
1. Hardware
  1. Communication hardware, interfaces and storage

Recommendations

Incorporating solid state drives into distributed storage systems
Using Working Set Reorganization to Manage Storage Systems with Hard and Solid State Disks
ICPPW '14: Proceedings of the 2014 43rd International Conference on Parallel Processing Workshops

Scientific applications from many problem domains produce and/or access large volumes of data. To support these applications, designers of high-end computing (HEC) systems have greatly increased the capacity of storage systems in recent years. However, ...
Read-Performance Optimization for Deduplication-Based Storage Systems in the Cloud

Data deduplication has been demonstrated to be an effective technique in reducing the total data transferred over the network and the storage space in cloud backup, archiving, and primary storage systems, such as VM (virtual machine) platforms. However, ...

Comments

Information & Contributors

Information

Published In

Communications of the ACM Volume 62, Issue 6

June 2019

85 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/3336127

Editor:
Andrew A. Chien
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2019

Published in CACM Volume 62, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
3,844
Total Downloads

Downloads (Last 12 months)569
Downloads (Last 6 weeks)43

Reflects downloads up to 01 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yu SSha ZTang CCai ZTang PHuang MLi JLiao J(2024)Adaptive DRAM Cache Division for Computational Solid-state Drives2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546745(1-6)Online publication date: 25-Mar-2024
https://doi.org/10.23919/DATE58400.2024.10546745
Tsuji AOguchi M(2024)Comparison of FHE Schemes and Libraries for Efficient Cryptographic Processing2024 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICNC59896.2024.10556382(584-590)Online publication date: 19-Feb-2024
https://doi.org/10.1109/ICNC59896.2024.10556382
Cha HKim IKim T(2024)Using a random forest to predict quantized reuse distance in an SSD write bufferComputing10.1007/s00607-024-01343-5Online publication date: 5-Sep-2024
https://doi.org/10.1007/s00607-024-01343-5
Li JChen XLiu DRen AZeng ZTan Y(2023)RadarSSD: A Computational Storage for Radar Signal ProcessingProceedings of the 52nd International Conference on Parallel Processing10.1145/3605573.3605628(244-253)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3605573.3605628
Papon THyoung Mun JRoozkhosh SHoornaert DSanaullah ADrepper UMancuso RAthanassoulis M(2023)Relational Fabric: Transparent Data Transformation2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00297(3688-3698)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00297
Liu YHsu KTseng H(2023)Rethinking Programming Frameworks for In-Storage Processing2023 60th ACM/IEEE Design Automation Conference (DAC)10.1109/DAC56929.2023.10247919(1-6)Online publication date: 9-Jul-2023
https://doi.org/10.1109/DAC56929.2023.10247919
Unnibhavi HCerdeira DBarbalace ASantos NBhatotia PIves ZBonifati AEl Abbadi A(2022)Secure and Policy-Compliant Query Processing on Heterogeneous Computational Storage ArchitecturesProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3517913(1462-1477)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3517913
Weiner JAgarwal NSchatzberg DYang LWang HSanouillet BSharma BHeo TJain MTang CSkarlatos DFalsafi BFerdman MLu SWenisch T(2022)TMO: transparent memory offloading in datacentersProceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3503222.3507731(609-621)Online publication date: 28-Feb-2022
https://dl.acm.org/doi/10.1145/3503222.3507731
Li JChen XLiu DLi LWang JZeng ZTan YQiao L(2022)Horae: A Hybrid I/O Request Scheduling Technique for Near-Data Processing-Based SSDIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2022.319751841:11(3803-3813)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1109/TCAD.2022.3197518
Zou CChien AHardavellas NCampanoni SGrot BKarpuzcu U(2022)ASSASIN: Architecture Support for Stream Computing to Accelerate Computational StorageProceedings of the 55th Annual IEEE/ACM International Symposium on Microarchitecture10.1109/MICRO56248.2022.00035(354-368)Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1109/MICRO56248.2022.00035
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Incorporating solid state drives into distributed storage systems

Using Working Set Reorganization to Manage Storage Systems with Hard and Solid State Disks

Read-Performance Optimization for Deduplication-Based Storage Systems in the Cloud

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations