Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

File block multi-replica management technology in cloud storage

Published: 10 January 2023 Publication History

Abstract

With the rapid development of cloud computing technology and the broad application of the Internet, more and more user data are stored in the cloud storage system online. Data copy technology is an effective technical means to manage various data in cloud storage systems, which has the advantages of improving data access speed and enhancing data availability in cloud storage systems. Since a data copy management strategy has an important impact on the performance of cloud storage systems, how to design a data copy management strategy is of great significance to achieving high-quality cloud storage management. Firstly, this paper analyzes the HDFS random copy placement strategy and its shortcomings. Secondly, proposes a copy placement strategy based on evaluation value and load balancing. Thirdly, gives the evaluation function of rack and node by considering multiple evaluation indicators such as node disk space load capacity, node memory utilization, node CPU utilization, rack load rate and network distance between racks. Fourthly, finds suitable nodes through computer shelf evaluation values and node evaluation values when placing replicas. Finally, through simulation experiments, the experimental results of the HDFS random replica placement strategy and the evaluation results and load balancing-based replica placement strategy are compared and analyzed.

References

[1]
Tao M, Ota K, and Dong M DSARP: dependable scheduling with active replica placement for workflow applications in cloud computing IEEE Trans. Cloud Comput. 2020 4 8
[2]
Mansouri N, Javidi N, and Zade N Hierarchical data replication strategy to improve performance in cloud computing Front. Comput. Sci. 2021 15 2 17
[3]
Al-Ramahi NM, Odeh M, Alrabie Z, et al. The TOEQCC framework for sustainable adoption of cloud computing at higher education institutions in the kingdom of Jordan Sustainability 2022 14 19 12744
[4]
Bhatta D and Mashayekhy L A bifactor approximation algorithm for cloudlet placement in edge computing IEEE Trans. Parallel Distrib. Syst: A Publ. IEEE Comput. Soc. 2022 33 8 1787-1798
[5]
Cui L, Zhang J, Yue L, et al. A genetic algorithm based data replica placement strategy for scientific applications in clouds Serv. Comput. IEEE Trans. 2018 11 4 727-739
[6]
Jiaojiao Wu, Yanping Li, Tianyin W, et al. CPDA: a confidentiality-preserving deduplication cloud storage with public cloud auditing IEEE Access 2019 7 160482-160497
[7]
Guangyan Z, Guiyong Wu, Shupeng W, et al. Ca Co: an efficient Cauchy coding approach for cloud storage systems IEEE Trans. Comput. 2016 65 2 435-477
[8]
He L, Qian Z, and Shang F A novel predicted replication strategy in cloud storage J. Supercomput. 2020 76 4838-4856
[9]
H Xu G Wang L Luo M Lei 2018 "The Design of Reliability Simulation of Cloud System in the Cloudsim," 2018 15th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China 215–219.
[10]
Lizhen C, Junhua Z, Lingxi Y, et al. A genetic algorithm based data replica placement strategy for scientific applications in clouds IEEE Trans. Serv. Comput. 2015 11 4 727-739
[11]
Souravlas S and Sifaleras A Binary-tree based estimation of file requests for efficient data replication IEEE Trans. Parallel Distrib. Syst. 2017 28 7 1839-1852
[12]
Yuhua L and Haiying S EAFR: an energy-efficient adaptive file replication system in data-intensive clusters IEEE Trans. Parallel Distrib. Syst. 2017 28 4 1017-1030
[13]
He Q, Bian G, Zhang W, et al. Research on routing strategy in cluster deduplication system IEEE Access 2021 9 135485-135495
[14]
Ting Y, Haibo P, Wei Li, et al. An energy-efficient storage strategy for cloud datacenters based on variable K-coverage of a hypergraph IEEE Trans. Parallel Distrib. Syst. 2017 28 12 3344-3355
[15]
He Q, Zhimin Yu, Bian G, Zhang W, Liu K, and Li Z Research on key technologies of NBD storage service system based on load classification AIP Adv. 2021 11 125124
[16]
Juipin Y Elastic load balancing using self-adaptive replication management[J] IEEE Access 2017 5 99 7495-7504
[17]
Chitra DD and Rhymend UV Load balancing in cloud computing environment using improved weighted round robin algorithm for nonpreemptive dependent tasks Scientific World J. 2016 2016 1-14
[18]
Junfeng T and Weiping Li Pheromone-based genetic algorithm adaptive selection algorithm in cloud storage Int. J. Grid Distrib. Comput. 2016 9 6 269-278
[19]
Huang C Analysis on application of wavelet neural network in wind electricity power prediction Appl. Mech. Mater. 2022 7 3764-3769
[20]
Armani, V., Faticanti, F., Cretti, S., et al.: A Cost-Effective Workload Allocation Strategy for Cloud-Native Edge Services. (2021).
[21]
Pengden Li and Xiaofan Y On dynamic recovery of cloud storage system under advanced persistent threats IEEE Access 2019 7 103556-103569
[22]
Wang B, Lv B, and Song Y A hybrid genetic algorithm with integer coding for task offloading in edge-cloud cooperative computing IAENG Int. J. Comput. Sci. 2022 49 2 503-510
[23]
Jing W, Zhiyuan Y, Kuanching Li, et al. Local codes with cooperative repair in distributed storage of cyber-physical-social systems[J] IEEE Access 2020 8 38622-38632
[24]
Mansouri N and Javidi MM A review of data replication based on meta-heuristics approach in cloud computing and data grid Soft Comput. 2020 24 11 1-28
[25]
Yan W and Yuankai G Forecasting method of stock market volatility in time series data based on mixed model of ARIMA and XGBoost China Commun. 2020 17 3 205-221
[26]
Park H, Lee D, and Moon J LDPC code design for distributed storage: balancing repair bandwidth, reliability and storage overhead IEEE Trans. Commun. 2018 66 2 507-520
[27]
Scheid EJ, Rodrigues BB, Granville LZ, Enabling Dynamic SLA, Smart C-B, Contracts, et al. IFIP/IEEE symposium on integrated network and service management (IM) Arlington 2019 2019 53-61
[28]
Xu X, Yang C, and Shao J Data replica placement mechanism for open heterogeneous storage systems Procedia Comput. Sci. 2017 109 18-25
[29]
Song PC, Pan JS, and Chu SC A parallel compact cuckoo search algorithm for three-dimensional path planning Appl. Soft Comput. 2022 94 106443
[30]
Saaty TL Decision making with the analytic hierarchy process Int. J. Serv. Sci. 2008 1 1 83-98
[31]
Calheiros RN, Ranjan R, Beloglazov A, et al. CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms Softw. Pract. Exp. 2011 41 1 23-50
[32]
Wang R and Peng L Topology-aware congestion control algorithm in data center network J. Comput. Appl. 2016 36 9 2357

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Cluster Computing
Cluster Computing  Volume 27, Issue 1
Feb 2024
1123 pages

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 10 January 2023
Accepted: 20 December 2022
Revision received: 01 December 2022
Received: 10 August 2022

Author Tags

  1. Cloud storage
  2. HDFS
  3. Replica management strategy
  4. Replica placement

Qualifiers

  • Research-article

Funding Sources

  • Industrial field of general projects of science and Technology Department of Shaanxi Province
  • Industrialization Project of Shaanxi Provincial Department of Education
  • Natural Science Foundation of Shannxi Province, China
  • The project sponsored by the scientific research Foundation for the returned overseas Chinese scholars
  • National Natural Science Foundation of China
  • "Thirteenth Five-Year" National Key R&D Program Project
  • Yulin science and technology project

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Feb 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media