Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3448016.3452807acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article
Open access

SharPer: Sharding Permissioned Blockchains Over Network Clusters

Published: 18 June 2021 Publication History

Abstract

Scalability is one of the main roadblocks to business adoption of blockchain systems. Despite recent intensive research on using sharding techniques to enhance the scalability of blockchain systems, existing solutions do not efficiently address cross-shard transactions. In this paper, we introduce SharPer, a scalable permissioned blockchain system. In SharPer, nodes are clustered and each data shard is replicated on the nodes of a cluster. SharPer supports networks consisting of either crash-only or Byzantine nodes. In SharPer, the blockchain ledger is formed as a directed acyclic graph and each cluster maintains only a view of the ledger. SharPer incorporates decentralized flattened protocols to establish cross-shard consensus. The decentralized nature of the cross-shard consensus in SharPer enables parallel processing of transactions with nonoverlapping clusters. Furthermore, SharPer provides deterministic safety guarantees. The experimental results reveal the efficiency of SharPer in terms of performance and scalability especially in workloads with a low percentage of cross-shard transactions.

Supplementary Material

MP4 File (3448016.3452807.mp4)
Scalability is one of the main roadblocks to business adoption of blockchain systems. Despite recent intensive research on using sharding techniques to enhance the scalability of blockchain systems, existing solutions do not efficiently address cross-shard transactions. In this paper, we introduce SharPer, a permissioned blockchain system that improves scalability by clustering (partitioning) the nodes and assigning different data shards to different clusters where each data shard is replicated on the nodes of a cluster. SharPer supports both intra-shard and cross-shard transactions and processes intra-shard transactions of different clusters as well as cross-shard transactions with non-overlapping clusters simultaneously. In SharPer, the blockchain ledger is formed as a directed acyclic graph and each cluster maintains only a view of the ledger. SharPer also incorporates a flattened protocol to establish consensus among clusters on the order of cross-shard transactions. The experimental results reveal the efficiency of SharPer in terms of performance and scalability especially in workloads with a low percentage of cross-shard transactions.

References

[1]
Mohammad Javad Amiri, Divyakant Agrawal, and Amr El Abbadi. 2019 a. CAPER: a cross-application permissioned blockchain. Proceedings of the VLDB Endowment, Vol. 12, 11 (2019), 1385--1398.
[2]
Mohammad Javad Amiri, Divyakant Agrawal, and Amr El Abbadi. 2019 b. On Sharding Permissioned Blockchains. In Int. Conf. on Blockchain. IEEE, 282--285.
[3]
Mohammad Javad Amiri, Divyakant Agrawal, and Amr El Abbadi. 2019 c. ParBlockchain: Leveraging Transaction Parallelism in Permissioned Blockchain Systems. In Int. Conf. on Distributed Computing Systems (ICDCS). IEEE, 1337--1347.
[4]
Mohammad Javad Amiri, Divyakant Agrawal, and Amr El Abbadi. 2019 d. SharPer: Sharding Permissioned Blockchains Over Network Clusters. arXiv preprint arXiv:1910.00765 (2019).
[5]
Elli Androulaki, Artem Barger, Vita Bortnikov, Christian Cachin, et almbox. 2018a. Hyperledger Fabric: a distributed operating system for permissioned blockchains. In European Conf. on Computer Systems (EuroSys). ACM, 30.
[6]
Elli Androulaki, Christian Cachin, Angelo De Caro, and Eleftherios Kokoris-Kogias. 2018b. Channels: Horizontal scaling and confidentiality on permissioned blockchains. In European Symposium on Research in Computer Security (ESORICS). Springer, 111--131.
[7]
Gabriel Bracha and Sam Toueg. 1985. Asynchronous consensus and broadcast protocols. Journal of the ACM (JACM), Vol. 32, 4 (1985), 824--840.
[8]
Christian Cachin, Rachid Guerraoui, and Lu'is Rodrigues. 2011. Introduction to reliable and secure distributed programming .Springer Science & Business Media.
[9]
Christian Cachin and Marko Vukolić. 2017. Blockchain Consensus Protocols in the Wild. In Int. Symposium on Distributed Computing (DISC) . 1--16.
[10]
Miguel Castro, Barbara Liskov, et almbox. 1999. Practical Byzantine fault tolerance. In Symposium on Operating systems design and implementation (OSDI), Vol. 99. USENIX Association, 173--186.
[11]
JP Morgan Chase. 2016. Quorum white paper. (2016).
[12]
Byung-Gon Chun, Petros Maniatis, Scott Shenker, and John Kubiatowicz. 2007. Attested append-only memory: Making adversaries stick to their word. In Operating Systems Review (OSR), Vol. 41--6. ACM SIGOPS, 189--204.
[13]
James C Corbett, Jeffrey Dean, Michael Epstein, Andrew Fikes, et almbox. 2013. Spanner: Google's globally distributed database. ACM Transactions on Computer Systems (TOCS), Vol. 31, 3 (2013), 8.
[14]
Carlo Curino, Evan Jones, Yang Zhang, and Sam Madden. 2010. Schism: a workload-driven approach to database replication and partitioning. Proceedings of the VLDB Endowment, Vol. 3, 1--2 (2010), 48--57.
[15]
Hung Dang, Tien Tuan Anh Dinh, Dumitrel Loghin, Ee-Chien Chang, Qian Lin, and Beng Chin Ooi. 2019. Towards Scaling Blockchain Systems via Sharding. SIGMOD Int. Conf. on Management of Data. ACM.
[16]
Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall, and Werner Vogels. 2007. Dynamo: amazon's highly available key-value store. Operating Systems Review (OSR), Vol. 41. ACM SIGOPS, 205--220.
[17]
Amr El Abbadi, Dale Skeen, and Flaviu Cristian. 1985. An efficient, fault-tolerant protocol for replicated data management. In SIGACT-SIGMOD symposium on Principles of database systems. ACM, 215--229.
[18]
Amr El Abbadi and Sam Toueg. 1985. Availability in partitioned replicated databases. SIGACT-SIGMOD symposium on Principles of database systems. ACM, 240--251.
[19]
Michael J Fischer, Nancy A Lynch, and Michael S Paterson. 1985. Impossibility of distributed consensus with one faulty process. Journal of the ACM (JACM), Vol. 32, 2 (1985), 374--382.
[20]
Ethan Frey and Christopher Goes. [n. d.]. Cosmos Inter-Blockchain Communication (IBC) Protocol. https://cosmos.network . ([n. d.]). 2018.
[21]
Danezis George and Sarah Meiklejohn. 2016. Centrally Banked Cryptocurrencies. In Network and Distributed System Security Symposium (NDSS) .
[22]
Christian Gorenflo, Stephen Lee, Lukasz Golab, and Srinivasan Keshav. 2019. Fastfabric: Scaling hyperledger fabric to 20,000 transactions per second. In Int. Conf. on Blockchain and Cryptocurrency (ICBC). IEEE, 455--463.
[23]
Suyash Gupta, Sajjad Rahnama, Jelle Hellings, and Mohammad Sadoghi. 2020. ResilientDB: Global Scale Resilient Blockchain Fabric. arXiv preprint arXiv:2002.00160 (2020).
[24]
Jelle Hellings, Daniel P Hughes, Joshua Primero, and Mohammad Sadoghi. 2020. Cerberus: Minimalistic Multi-shard Byzantine-resilient Transaction Processing. arXiv preprint arXiv:2008.04450 (2020).
[25]
Zsolt István, Alessandro Sorniotti, and Marko Vukolić. 2018. StreamChain: Do Blockchains Need Blocks?. In Workshop on Scalable and Resilient Infrastructures for Distributed Ledgers (SERIAL). ACM, 1--6.
[26]
Eleftherios Kokoris-Kogias, Philipp Jovanovic, Linus Gasser, Nicolas Gailly, Ewa Syta, and Bryan Ford. 2018. Omniledger: A secure, scale-out, decentralized ledger via sharding. In Symposium on Security and Privacy (SP). IEEE, 583--598.
[27]
Jae Kwon. 2014. Tendermint: Consensus without mining. Draft v. 0.6, fall (2014).
[28]
Leslie Lamport. 1978. Time, clocks, and the ordering of events in a distributed system. Commun. ACM, Vol. 21, 7 (1978), 558--565.
[29]
Leslie Lamport. 2006. Fast paxos. Distributed Computing, Vol. 19, 2 (2006), 79--103.
[30]
Leslie Lamport et almbox. 2001. Paxos made simple. ACM Sigact News, Vol. 32, 4 (2001), 18--25.
[31]
Loi Luu, Viswesh Narayanan, Chaodong Zheng, Kunal Baweja, Seth Gilbert, and Prateek Saxena. 2016. A secure sharding protocol for open blockchains. SIGSAC Conf. on Computer and Communications Security (CCS). ACM, 17--30.
[32]
J-P Martin and Lorenzo Alvisi. 2006. Fast byzantine consensus. Transactions on Dependable and Secure Computing, Vol. 3, 3 (2006), 202--215.
[33]
Satoshi Nakamoto. 2008. Bitcoin: A peer-to-peer electronic cash system. (2008).
[34]
Faisal Nawab and Mohammad Sadoghi. 2019. Blockplane: A global-scale byzantizing middleware. 2019 IEEE 35th International Conference on Data Engineering (ICDE). IEEE, 124--135.
[35]
Diego Ongaro and John K Ousterhout. 2014. In search of an understandable consensus algorithm. In Annual Technical Conference (ATC) . USENIX Association, 305--319.
[36]
Andrew Pavlo, Carlo Curino, and Stanley Zdonik. 2012. Skew-aware automatic database partitioning in shared-nothing, parallel OLTP systems. In SIGMOD Int. Conf. on Management of Data. ACM, 61--72.
[37]
Pingcheng Ruan, Dumitrel Loghin, Quang-Trung Ta, Meihui Zhang, Gang Chen, and Beng Chin Ooi. 2020. A Transactional Perspective on Execute-order-validate Blockchains. In SIGMOD International Conference on Management of Data. ACM, 543--557.
[38]
Ankur Sharma, Felix Martin Schuhknecht, Divya Agrawal, and Jens Dittrich. 2019. Blurring the lines between blockchains and database systems: the case of hyperledger fabric. In SIGMOD International Conference on Management of Data. ACM, 105--122.
[39]
Rebecca Taft, Essam Mansour, Marco Serafini, Jennie Duggan, Aaron J Elmore, Ashraf Aboulnaga, Andrew Pavlo, and Michael Stonebraker. 2014. E-store: Fine-grained elastic partitioning for distributed transaction processing systems. Proceedings of the VLDB Endowment, Vol. 8, 3 (2014), 245--256.
[40]
Alexander Thomson, Thaddeus Diamond, Shu-Chun Weng, Kun Ren, Philip Shao, and Daniel J Abadi. 2012. Calvin: fast distributed transactions for partitioned database systems. In SIGMOD Int. Conf. on Management of Data. ACM, 1--12.
[41]
Giuliana Santos Veronese, Miguel Correia, Alysson Neves Bessani, and Lau Cheuk Lung. 2010. EBAWA: Efficient Byzantine agreement for wide-area networks. In Int. Symposium on High Assurance Systems Engineering (HASE). IEEE, 10--19.
[42]
Giuliana Santos Veronese, Miguel Correia, Alysson Neves Bessani, Lau Cheuk Lung, and Paulo Verissimo. 2013. Efficient byzantine fault-tolerance. IEEE Trans. Comput., Vol. 62, 1 (2013), 16--30.
[43]
Jiaping Wang and Hao Wang. 2019. Monoxide: Scale out blockchains with asynchronous consensus zones. In 16th $$USENIX$$ Symposium on Networked Systems Design and Implementation ($$NSDI$$ 19) . 95--112.
[44]
Mahdi Zamani, Mahnush Movahedi, and Mariana Raykova. 2018. RapidChain: Scaling blockchain via full sharding. SIGSAC Conf. on Computer and Communications Security. ACM, 931--948.

Cited By

View all
  • (2024)SnapshotPrune: A Novel Bitcoin-Based Protocol Toward Efficient Pruning and Fast Node BootstrappingTsinghua Science and Technology10.26599/TST.2023.901001429:4(1037-1052)Online publication date: Aug-2024
  • (2024)Co-Sharding: A Sharding Scheme for Large-Scale Internet of Things ApplicationDistributed Ledger Technologies: Research and Practice10.1145/36412903:1(1-16)Online publication date: 18-Mar-2024
  • (2024)HTFabric: A Fast Re-ordering and Parallel Re-execution Method for a High-Throughput BlockchainProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679606(2118-2127)Online publication date: 21-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGMOD '21: Proceedings of the 2021 International Conference on Management of Data
June 2021
2969 pages
ISBN:9781450383431
DOI:10.1145/3448016
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2021

Check for updates

Author Tags

  1. blockchain
  2. consensus
  3. permissioned
  4. scalability
  5. sharding

Qualifiers

  • Research-article

Funding Sources

Conference

SIGMOD/PODS '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)674
  • Downloads (Last 6 weeks)88
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)SnapshotPrune: A Novel Bitcoin-Based Protocol Toward Efficient Pruning and Fast Node BootstrappingTsinghua Science and Technology10.26599/TST.2023.901001429:4(1037-1052)Online publication date: Aug-2024
  • (2024)Co-Sharding: A Sharding Scheme for Large-Scale Internet of Things ApplicationDistributed Ledger Technologies: Research and Practice10.1145/36412903:1(1-16)Online publication date: 18-Mar-2024
  • (2024)HTFabric: A Fast Re-ordering and Parallel Re-execution Method for a High-Throughput BlockchainProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679606(2118-2127)Online publication date: 21-Oct-2024
  • (2024)LETUS: A Log-Structured Efficient Trusted Universal BlockChain StorageCompanion of the 2024 International Conference on Management of Data10.1145/3626246.3653390(161-174)Online publication date: 9-Jun-2024
  • (2024)Stable Blockchain Sharding under Adversarial Transaction GenerationProceedings of the 36th ACM Symposium on Parallelism in Algorithms and Architectures10.1145/3626183.3659970(451-461)Online publication date: 17-Jun-2024
  • (2024)Monkey King: An Enhanced Asynchronous Consensus Protocol with Provable Security2024 7th World Conference on Computing and Communication Technologies (WCCCT)10.1109/WCCCT60665.2024.10541715(24-30)Online publication date: 12-Apr-2024
  • (2024)Accelerating Cross-Shard Blockchain Consensus via Decentralized Coordinators Service With Verifiable Global StatesIEEE Transactions on Services Computing10.1109/TSC.2024.334953917:4(1340-1353)Online publication date: Jul-2024
  • (2024)X-Shard: Optimistic Cross-Shard Transaction Processing for Sharding-Based BlockchainsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.336118035:4(548-559)Online publication date: 1-Feb-2024
  • (2024)Reducing Storage Requirement in Blockchain via Node-Oriented Block PlacementIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.328914111:1(64-76)Online publication date: Jan-2024
  • (2024)Blockchain and Digital Asset Transactions- Based Carbon Emissions Trading Scheme for Industrial Internet of ThingsIEEE Transactions on Industrial Informatics10.1109/TII.2024.335433820:4(6963-6973)Online publication date: Apr-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media