Abstract
Peer-to-Peer cloud storage has emerged as an alternative to address the high installation and maintenance costs in conventional cloud storage based on client/server architectures. Since P2P cloud storage must guarantee the same level of data availability as conventional cloud storage, it has employed replication and erasure coding to redundantly store data among peers in P2P environments where the peer churn rate is high. However, most studies using two techniques have focused only on increasing data availability. Especially for video files stored in P2P cloud storage, in addition to guaranteeing their availability, it is critical but challenging to ensure that they are played back in real time by video player applications as if they were being read from local storage. To address this challenge in this paper, we propose a novel hybrid redundancy scheme to support efficient video file streaming while ensuring the availability of video files in P2P cloud storage. The main contributions of our work are threefold. First, we can achieve higher storage efficiency and better streaming performance by employing both erasure coding and replication simultaneously. Second, we can maximize the number of concurrent playback requests supported while minimizing the decrease in file availability by dynamically adjusting the redundancy degree of each video file according to its popularity. Third, we can further improve the performance by efficiently using storage space with our proposed two-phase replacement policy. Finally, we demonstrate through extensive experiments that our scheme outperforms other techniques by utilizing the benefits of both replication and erasure coding.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Sadiku M, Musa S, Momoh O (2014) Cloud Computing: opportunities and Challenges. IEEE Potentials 33:34–36
Dikaiakos M, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud Computing: distributed Internet Computing for IT and Scientific Research. IEEE Internet Comput 13(5):10–13
Dai X, Wang X, Liu N (2017) Optimal Scheduling of Data-Intensive Applications in Cloud-Based Video Distribution Services. IEEE Trans Circuits Syst Video Technol 27(1):73–83
Huang Y, Li Z, Liu G, Dai Y (2011) Cloud download: using cloud utilities to achieve high-quality content distribution for unpopular videos. In: Proceedings ACM international conference on multimedia, pp 213–222
Chu Y, Huang N, Lin S (2014) Quality of Service Provision in Cloud-Based Storage System for Multimedia Delivery. IEEE Syst J 8(1):292–303
Sosa-Sosa V, Barron A, Gonzalez-Compean JL, Carretero J, Lopez-Arevalo I (2022) Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services. IEEE Transactions on Cloud Computing. 10(1):439–450
Xiong H, Zhang X, Zhu W, Yao D (2012) CloudSeal: End-to-End Content Protection in Cloud-Based Storage and Delivery Services. In Lecture Notes of the Institute for Computer Sciences. 96:491–500
Hu H, Wen Y, Niyato D (2017) Public Cloud Storage-Assisted Mobile Social Video Sharing: A Supermodular Game Approach. IEEE J Sel Areas Commun 35(3):545–556
Babaoglu O, Marzolla M, Tamburini M (2012) Design and implementation of a P2P Cloud system. In: Proceedings ACM symposium on applied computing, pp 412–417
Li J, Wu J, Chen L (2018) Block-secure: Blockchain based scheme for secure P2P cloud storage. Inf Sci 465:219–231
Hassanzadeh-Nazarabadi Y, Kupcu A, Ozkasap O (2016) Awake: Decentralized and Availability Aware Replication for P2P Cloud Storage. In: IEEE International conference on smart cloud, pp 289–294
Majed A, Raji F, Miri A (2022) Replication management in peer-to-peer cloud storage systems. Clust Comput 25:401–416
Kim J, Kim E (2015) A Hybrid Data Redundancy Scheme for Video Streaming in P2P Cloud Storage. Journal of Korean Institute of Next Generation Computing. 11(1):16–24
Huang Z, Yuan Y, Peng Y (2011) Storage allocation for redundancy scheme in reliability-aware cloud systems. In: Proceedings IEEE international conference on communication software and networks, pp 275–279
Panda S, Naik S (2018) An Efficient Data Replication Algorithm for Distributed Systems. International Journal of Cloud Applications and Computing. 8(3):18–18
Wiesmann M, Pedone F, Schiper A, Kemme B, Alonso G (2000) Understanding replication in databases and distributed systems. In: Proceedings IEEE international conference on distributed computing systems, pp 464–474
Bhagwan R, Savage S, Voelker G (2003) Understanding Availability. In: Proceedings peer-to-peer systems, pp 256–267
Balaji S, Krishnan M, Vajha M, Ramkumar V, Sasidharan B, Kumar P (2018) Erasure coding for distributed storage: an overview. SCIENCE CHINA Inf Sci 61(100301):1869–1919
Li J, Li B (2013) Erasure coding for cloud storage systems: a survey. Tsinghua Science and Technology. 18(3):259–272
Weatherspoon H, Kubiatowicz J (2002) Erasure Coding Vs. Replication: a Quantitative Comparison. In: Proceedings peer-to-peer systems, pp 2429–2429
Ma Y, Nandagopal T, Puttaswamy K, Banerjee S (2013) An ensemble of replication and erasure codes for cloud file systems. In: Proceedings IEEE international conference on computer communications, pp 1276–1284
Kim J (2015) An Efficient Data Redundancy Scheme for Video Streaming in P2P Cloud Storage. In: Hongik University
Google Drive, http://drive.google.com
Rodrigues R, Liskov B (2005) High Availability in DHTs: Erasure Coding vs. Replication. In: Peer-to-peer systems, pp 226–239
Araujo J, Giroire F, Monteiro J (2011) Hybrid Approaches for Distributed Storage System. In: Proceedings data management in grid and peer-to-peer systems, pp 1–12
Dimakis A, Godfrey P, Wu Y, Wainwright M, Ramchandran K (2010) Network Coding for Distributed Storage Systems. IEEE Trans Inf Theory 56(9):4539–4551
Houri Y, Fuhrmann T (2010) Hybrid Redundancy Schemes with Random Linear Coding for Peer-to-Peer Storage Systems. In: Proceedings international conference on computer communications and networks, pp 1–6
Li Z, Xiao C (2021) ER-Store: A Hybrid Storage Mechanism with Erasure Coding and Replication in Distributed Database Systems. Sci Program 2021:1058–9244
Cowling J, Liskov B (2012) Granola: Low-Overhead Distributed Transaction Coordination. In: Proceedings USENIX annual technical conference, pp 223–235
Bhagwan R, Tati K, Cheng Y, Savage S, Voelker G (2004) Total Recall: System Support for Automated Availability Management. In: Proceedings ACM/USENIX symposium on networked systems design and implementation
Cheng Z, Luan Z, Meng Y, Xu Y, Qian D, Roy A, Zhang N, Guan G (2012) ERMS: An Elastic Replication Management System for HDFS. In: Proceedings IEEE international conference on cluster computing workshops, pp 32–40
Liu F, Shen S, Li B, Li B, Jin H (2013) Cinematic-Quality VoD in a P2P Storage Cloud: Design, Implementation and Measurements. IEEE J Sel Areas Commun 31(9):214–226
Zhao W, Liu J, Hara T (2018) Optimal Replica Distribution in Edge-Node-Assisted Cloud-P2P Platforms for Real-Time Streaming. IEEE Trans Veh Technol 67(9):8637–8646
Amoretti M, Grazioli A, Zanichelli F (2016) An autonomic approach for P2P/cloud collaborative environments. Peer-to-Peer Netw Appl 9:1226–1241
Zhao J, Wu C, Lin X (2015) Locality-aware streaming in hybrid P2P-cloud CDN systems. Peer-to-Peer Netw Appl 8:320–335
Sina M, Dehghan M, Rahmani A (2019) CaR-PLive: Cloud-assisted reinforcement learning based P2P live video streaming: a hybrid approach. Multimed Tools Appl 78:34095–34127
Torres-Cruz N, Rivero-Angeles M, Rubino G, Menchaca-Mendez R, Menchaca-Mendez R, Ramirez D (2020) A comprehensive analytical framework for VoD services in hybrid CDN-P2P systems. J Netw Comput Appl 161:1–17
Mondal A, Lifu Y, Kitsuregawa M (2004) P2PR-tree: An R-tree-based spatial index for peer-to-peer environments. In: Proceedings current trends in database technology, pp 516–525
Hudzia B, Kechadi M, Ottewill A (2005) TreeP: A Tree Based P2P Network Architecture. In: Proceedings IEEE international conference on cluster computing, pp 1–15
Li Z, Cao J, Chen G (2008) ContinuStreaming: Achieving high playback continuity of Gossip-based Peer-to-Peer streaming. In: Proceedings IEEE international symposium on parallel and distributed processing, pp 1–12
Kim E, Kim J, Lee C (2019) Efficient neighbor selection through connection switching for P2P live streaming. J Ambient Intell Humaniz Comput 10:1413–1423
Lee C, Kim S, Kim E (2015) Expediting P2P Video Delivery through a Hybrid Push-Pull Protocol. Advances in Electrical and Computer Engineering Journal. 15(4):3–8
Dan A, Sitaram D, Shahabuddin P (1996) Dynamic batching policies for an on-demand video server. Multimedia Syst 4:112–121
Funding
This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (No. RS-2023-00252186).
Author information
Authors and Affiliations
Contributions
Conceptualization and design: Eunsam Kim, Experimentation: Jinsung Kim, Analysis and interpretation of data: Jinsung Kim and Eunsam Kim, Drafting the manuscript: Eunsam Kim.
Corresponding author
Ethics declarations
Ethics approval
This work does not involve any work related to ethics.
Consent for publication
All authors consent to publication.
Conflict of interest
In terms of competing financial and non-financial interests, the authors declare no conflicts of interest.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kim, J., Kim, E. Supporting efficient video file streaming in P2P cloud storage. Peer-to-Peer Netw. Appl. 17, 1865–1884 (2024). https://doi.org/10.1007/s12083-024-01691-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12083-024-01691-1