research-article

Database Docker persistence Framework based on Swarm and Ceph

Authors:

Shaojia Hong,

Dong Li,

Xiaobing HuangAuthors Info & Claims

HPCCT '19: Proceedings of the 2019 3rd High Performance Computing and Cluster Technologies Conference

Pages 249 - 253

https://doi.org/10.1145/3341069.3342985

Published: 22 June 2019 Publication History

Get Access

Abstract

The swarm cluster has two main limitations: 1) the data of database container will lost after the container goes down; 2) the lack of migration ability of database container across the hosts. To tackle these issues, we propose a novel persistence framework in both single database and database cluster. To be specific, we use ceph to provide migrable data volumes, and use two frameworks to migrate container from the perspective of container downtime recovery. By comparing the processing time of downtime database container, the experimental results demonstrate that our proposed method is able to shorten the recovery time of database container and improve the availability of database services.

References

[1]

Jaramillo D, Nguyen D V, Smart R. Leveraging microservices architecture by using Docker technology{C}// Southeastcon. 2016.

Google Scholar

[2]

Truyen E, Bruzek M, Van Landuyt D, et al. {IEEE 2018 IEEE 11th International Conference on Cloud Computing (CLOUD) - San Francisco, CA, USA (2018.7.2-2018.7.7)} 2018 IEEE 11th International Conference on Cloud Computing (CLOUD) - Evaluation of Container Orchestration Systems for Deploying and Managing NoSQL Database Clusters{C}// 2018:468--475.

Google Scholar

[3]

Peng L, Xiaodan L, Jiang C, et al. Elastic scheduling strategy for cloud resource based on Docker{J}. Journal of Computer Applications, 2018.

Google Scholar

[4]

Kaewkasi C, Chuenmuneewong K. Improvement of container scheduling for Docker using Ant Colony Optimization{C}// 2017 9th International Conference on Knowledge and Smart Technology (KST). IEEE, 2017.

Google Scholar

[5]

Mohamed M, Engel R, Warke A, et al. Extensible persistence as a service for containers{J}. Future Generation Computer Systems, 2019, 97: 10--20.

Digital Library

Google Scholar

[6]

Karim M B A, Yuan L J, Mingtat W, et al. Improving Performance of Database Appliances on Distributed Object Storage{C}// International Conference on Cloud Computing Research & Innovation. IEEE, 2015.

Digital Library

Google Scholar

[7]

Peinl, René, Holzschuher F, Pfitzer F. Docker Cluster Management for the Cloud - Survey Results and Own Solution{J}. Journal of Grid Computing, 2016, 14(2):265--282.

Digital Library

Google Scholar

[8]

Google Scholar

[9]

Liping P, Xiaodan L, Chaohui J, et al. Elastic scheduling strategy for cloud resource based on Docker{J}. Journal of Computer Applications, 2018.

Google Scholar

[10]

Karim M B A, Yuan L J, Mingtat W, et al. Improving Performance of Database Appliances on Distributed Object Storage{C}// International Conference on Cloud Computing Research & Innovation. IEEE, 2015.

Digital Library

Google Scholar

[11]

Li W, Moghaddam F F, Heidari P, et al. Facilitating Workload Aware Storage Platform by Using Machine Learning Technics{C}// International Conference on Networking. IEEE, 2017.

Google Scholar

[12]

Liu Y. High availability of network service on docker container{C}//2016 5th International Conference on Measurement, Instrumentation and Automation (ICMIA 2016). Atlantis Press, 2016.

Google Scholar

[13]

Docker. Use overlay networks. https://docs.docker.com/network/ overlay/. Accessed: February 14--2018.

Google Scholar

[14]

Sureshkumar M, Rajesh P. {IEEE 2017 2nd International Conference on Computing and Communications Technologies (ICCCT) - Chennai, India (2017.2.23-2017.2.24)} 2017 2nd International Conference on Computing and Communications Technologies (ICCCT) - Optimizing the docker container usage based on load scheduling {J}. 2017:165--168.

Google Scholar

Cited By

View all

Hsieh CXu FKong DYang QMa Y(2024)CSQF-BA: Efficient Container Query Technology for Cloud Security Query Framework with Bat AlgorithmAdvanced Intelligent Computing Technology and Applications10.1007/978-981-97-5606-3_9(97-109)Online publication date: 30-Jul-2024
https://doi.org/10.1007/978-981-97-5606-3_9
Pakrijauskas KMažeika D(2022)A Method of Transparent Graceful Failover in Low Latency Stateful MicroservicesElectronics10.3390/electronics1123393611:23(3936)Online publication date: 28-Nov-2022
https://doi.org/10.3390/electronics11233936

Index Terms

Database Docker persistence Framework based on Swarm and Ceph
1. Information systems
  1. Information storage systems
    1. Storage architectures
      1. Cloud based storage

Recommendations

A particle swarm optimization-based container scheduling algorithm of docker platform
ICCIP '18: Proceedings of the 4th International Conference on Communication and Information Processing

Docker is rapidly changing the rules of operation in the field of cloud computing, and completely subverts the development of cloud technology. Swarm is a Docker container-based cluster management tool. By analyzing and researching the overall ...
Data adapter for querying and transformation between SQL and NoSQL database

As the growing of applications with big data in cloud computing become popular, many existing systems expect to expand their service to support the explosive increase of data. We propose a data adapter system to support hybrid database architecture ...
Extensible persistence as a service for containers
Abstract
Micro-services and containers are becoming the de-facto way of building software and deploying workloads in an agile manner. Following these paradigms leads eventually to replacing the old fashioned monolithic applications by ...
Highlights
- Addressing the challenge of managing different types of persistent storage such as filesystems and block storage in heterogeneous container orchestrators.

Comments

Information & Contributors

Information

Published In

HPCCT '19: Proceedings of the 2019 3rd High Performance Computing and Cluster Technologies Conference

June 2019

293 pages

ISBN:9781450371858

DOI:10.1145/3341069

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

HPCCT 2019

HPCCT 2019: 2019 The 3rd High Performance Computing and Cluster Technologies Conference

June 22 - 24, 2019

Guangzhou, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
131
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hsieh CXu FKong DYang QMa Y(2024)CSQF-BA: Efficient Container Query Technology for Cloud Security Query Framework with Bat AlgorithmAdvanced Intelligent Computing Technology and Applications10.1007/978-981-97-5606-3_9(97-109)Online publication date: 30-Jul-2024
https://doi.org/10.1007/978-981-97-5606-3_9
Pakrijauskas KMažeika D(2022)A Method of Transparent Graceful Failover in Low Latency Stateful MicroservicesElectronics10.3390/electronics1123393611:23(3936)Online publication date: 28-Nov-2022
https://doi.org/10.3390/electronics11233936

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

A particle swarm optimization-based container scheduling algorithm of docker platform

Data adapter for querying and transformation between SQL and NoSQL database

Extensible persistence as a service for containers

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations