Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3404397.3404460acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicppConference Proceedingsconference-collections
research-article

SkyChain: A Deep Reinforcement Learning-Empowered Dynamic Blockchain Sharding System

Published: 17 August 2020 Publication History

Abstract

To overcome the limitations on the scalability of current blockchain systems, sharding is widely considered as a promising solution that divides the network into multiple disjoint groups processing transactions in parallel to improve throughput while decreasing the overhead of communication, computation, and storage. However, most existing blockchain sharding systems adopt a static sharding policy that cannot efficiently deal with the dynamic environment in the blockchain system, i.e., joining and leaving of nodes, and malicious attack. This paper presents SkyChain, a novel dynamic sharding-based blockchain framework to achieve a good balance between performance and security without compromising scalability under the dynamic environment. We first propose an adaptive ledger protocol to guarantee that the ledgers can merge or split efficiently based on the dynamic sharding policy. Then, to optimize the sharding policy under dynamic environment with high dimensional system states, a deep reinforcement learning-based sharding approach has been proposed, the goals of which include: 1) building a framework to evaluate the blockchain sharding systems from the aspects of performance and security; 2) adjusting the re-sharding interval, shard number and block size to maintain a long-term balance of the system’s performance and security. Experimental results show that SkyChain can effectively improve the performance and security of the sharding system without compromising scalability under the dynamic environment in the blockchain system.

References

[1]
Elli Androulaki, Artem Barger, Vita Bortnikov, Christian Cachin, Konstantinos Christidis, Angelo De Caro, David Enyeart, Christopher Ferris, Gennady Laventman, Yacov Manevich, 2018. Hyperledger fabric: a distributed operating system for permissioned blockchains. In Proceedings of the Thirteenth EuroSys Conference. ACM, 30.
[2]
Miguel Castro and Barbara Liskov. 1999. Practical Byzantine fault tolerance. In Proceedings of the Third Symposium on Operating Systems Design and Implementation (New Orleans, Louisiana, USA) (OSDI ’99). USENIX Association, USA, 173–186.
[3]
Miguel Castro and Barbara Liskov. 2002. Practical Byzantine fault tolerance and proactive recovery. ACM Transactions on Computer Systems (TOCS) 20, 4 (2002), 398–461.
[4]
Hung Dang, Tien Tuan Anh Dinh, Dumitrel Loghin, Ee-Chien Chang, Qian Lin, and Beng Chin Ooi. 2019. Towards scaling blockchain systems via sharding. In Proceedings of the 2019 International Conference on Management of Data. ACM, 123–140.
[5]
John R Douceur. 2002. The sybil attack. In International workshop on peer-to-peer systems. Springer, 251–260.
[6]
Ittay Eyal and Emin Gün Sirer. 2014. Majority Is Not Enough: Bitcoin Mining Is Vulnerable. In Financial Cryptography and Data Security, Nicolas Christin and Reihaneh Safavi-Naini (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 436–454.
[7]
Eleftherios Kokoris Kogias, Philipp Jovanovic, Nicolas Gailly, Ismail Khoffi, Linus Gasser, and Bryan Ford. 2016. Enhancing Bitcoin Security and Performance with Strong Consistency via Collective Signing. In 25th USENIX Security Symposium (USENIX Security 16). USENIX Association, Austin, TX, 279–296.
[8]
E. Kokoris-Kogias, P. Jovanovic, L. Gasser, N. Gailly, E. Syta, and B. Ford. 2018. OmniLedger: A Secure, Scale-Out, Decentralized Ledger via Sharding. In 2018 IEEE Symposium on Security and Privacy (SP). 583–598. https://doi.org/10.1109/SP.2018.000-5
[9]
Daniel Kraft. 2016. Difficulty control for blockchain-based consensus systems. Peer-to-Peer Networking and Applications 9, 2 (2016), 397–413.
[10]
Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971(2015).
[11]
Loi Luu, Viswesh Narayanan, Chaodong Zheng, Kunal Baweja, Seth Gilbert, and Prateek Saxena. 2016. A Secure Sharding Protocol For Open Blockchains. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security (Vienna, Austria) (CCS ’16). ACM, New York, NY, USA, 17–30. https://doi.org/10.1145/2976749.2978389
[12]
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529.
[13]
Satoshi Nakamoto 2008. Bitcoin: A peer-to-peer electronic cash system. (2008).
[14]
J. Newsome, E. Shi, D. Song, and A. Perrig. 2004. The Sybil attack in sensor networks: analysis defenses. In Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004. 259–268. https://doi.org/10.1109/IPSN.2004.239019
[15]
Lan N Nguyen, Truc DT Nguyen, Thang N Dinh, and My T Thai. 2019. OptChain: Optimal Transactions Placement for Scalable Blockchain Sharding. In 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS). IEEE, 525–535.
[16]
Rafael Pass and Elaine Shi. 2017. Hybrid consensus: Efficient consensus in the permissionless model. In 31st International Symposium on Distributed Computing (DISC 2017). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.
[17]
Siddhartha Sen and Michael J. Freedman. 2012. Commensal Cuckoo: Secure Group Partitioning for Large-scale Services. SIGOPS Oper. Syst. Rev. 46, 1 (Feb. 2012), 33–39. https://doi.org/10.1145/2146382.2146389
[18]
Gang Wang, Zhijie Jerry Shi, Mark Nixon, and Song Han. 2019. SoK: Sharding on Blockchain. In Proceedings of the 1st ACM Conference on Advances in Financial Technologies. ACM, 41–61.
[19]
Jiaping Wang and Hao Wang. 2019. Monoxide: Scale out Blockchains with Asynchronous Consensus Zones. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19). USENIX Association, Boston, MA, 95–112.
[20]
Gavin Wood 2014. Ethereum: A secure decentralised generalised transaction ledger. Ethereum project yellow paper 151, 2014 (2014), 1–32.
[21]
Mahdi Zamani, Mahnush Movahedi, and Mariana Raykova. 2018. RapidChain: Scaling Blockchain via Full Sharding. In Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security (Toronto, Canada) (CCS ’18). ACM, New York, NY, USA, 931–948. https://doi.org/10.1145/3243734.3243853

Cited By

View all
  • (2024)Scalability of Blockchain Using ShardingEnsuring Security and End-to-End Visibility Through Blockchain and Digital Twins10.4018/979-8-3693-3494-2.ch018(326-349)Online publication date: 28-Jun-2024
  • (2024)SPRING: Improving the Throughput of Sharding Blockchain via Deep Reinforcement Learning Based State PlacementProceedings of the ACM Web Conference 202410.1145/3589334.3645386(2836-2846)Online publication date: 13-May-2024
  • (2024)SmartChain: A Dynamic and Self-Adaptive Sharding Framework for IoT BlockchainIEEE Transactions on Services Computing10.1109/TSC.2024.337624217:2(674-688)Online publication date: Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICPP '20: Proceedings of the 49th International Conference on Parallel Processing
August 2020
844 pages
ISBN:9781450388160
DOI:10.1145/3404397
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Blockchain
  2. deep reinforcement learning
  3. performance
  4. scalability
  5. security
  6. sharding

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • the Natural Science Foundation of Guangdong
  • the National Key Research and Development Plan
  • the National Natural Science Foundation of China
  • the Program for Guangdong Introducing Innovative and Entrepreneurial Teams

Conference

ICPP '20

Acceptance Rates

Overall Acceptance Rate 91 of 313 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)237
  • Downloads (Last 6 weeks)7
Reflects downloads up to 30 Aug 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Scalability of Blockchain Using ShardingEnsuring Security and End-to-End Visibility Through Blockchain and Digital Twins10.4018/979-8-3693-3494-2.ch018(326-349)Online publication date: 28-Jun-2024
  • (2024)SPRING: Improving the Throughput of Sharding Blockchain via Deep Reinforcement Learning Based State PlacementProceedings of the ACM Web Conference 202410.1145/3589334.3645386(2836-2846)Online publication date: 13-May-2024
  • (2024)SmartChain: A Dynamic and Self-Adaptive Sharding Framework for IoT BlockchainIEEE Transactions on Services Computing10.1109/TSC.2024.337624217:2(674-688)Online publication date: Mar-2024
  • (2024)LMChain: An Efficient Load-Migratable Beacon-Based Sharding Blockchain SystemIEEE Transactions on Computers10.1109/TC.2024.340405773:9(2178-2191)Online publication date: Sep-2024
  • (2024)A Dynamic Adaptive Framework for Practical Byzantine Fault Tolerance Consensus Protocol in the Internet of ThingsIEEE Transactions on Computers10.1109/TC.2024.337792173:7(1669-1682)Online publication date: 18-Mar-2024
  • (2024)Efficient Execution of Arbitrarily Complex Cross-Shard Contracts for Blockchain ShardingIEEE Transactions on Computers10.1109/TC.2024.336592973:5(1190-1205)Online publication date: 14-Feb-2024
  • (2024)An Overlapping Self-Organizing Sharding Scheme Based on DRL for Large-Scale IIoT BlockchainIEEE Internet of Things Journal10.1109/JIOT.2023.331141411:4(5681-5695)Online publication date: 15-Feb-2024
  • (2024)Account Migration across Blockchain Shards using Fine-tuned Lock MechanismIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621244(271-280)Online publication date: 20-May-2024
  • (2024)Porygon: Scaling Blockchain via 3D Parallelism2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00153(1944-1957)Online publication date: 13-May-2024
  • (2024)SoK: Public Blockchain Sharding2024 IEEE International Conference on Blockchain and Cryptocurrency (ICBC)10.1109/ICBC59979.2024.10634422(766-783)Online publication date: 27-May-2024
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media