Scheduling of Containerized Resources for Microservices in Cloud
Pages 34 - 49
Abstract
Most developers consider that microservice-based application design and development can improve scalability and maintainability. The microservices are developed as small independent modules and deployed in containers. The containers are deployed in virtual machines (VMs), which in turn run in hosts. Effective consolidation of the service requests to the containers may reduce the number of active hosts in a cloud environment, resulting in lesser power consumption of the cloud data centers. This research aims to maximize the resource utilization of the hosts by effectively allocating the containers to the VMs and VMs to the hosts. In this scheduling, a few additional containers and VMs are kept in the available resource pool so that during peak demand for services, the users get their service at the earliest (preferably without any delay). This paper presents a heuristic algorithm for microservice allocation in a containerized cloud environment to achieve these objectives. The performance of the proposed algorithm is validated and justified through the extensive experimental results. We have compared the performance of the proposed technique with the existing state-of-the-art. The number of container deployments in the proposed policy is reduced by 12.2–17.36% compared to the Spread policy and 6.13–10.57% compared to First-Fit and Best-Fit policies.
References
[1]
Amaral, M., Polo, J., Carrera, D., Mohomed, I., Unuvar, M., Steinder, M.: Performance evaluation of microservices architectures using containers. In: 2015 IEEE 14th International Symposium on Network Computing and Applications, pp. 27–34. IEEE (2015)
[2]
Becker, A., Buxmann, P., Widjaja, T., et al.: Value potential and challenges of service-oriented architectures-a user and vendor perspective. In: ECIS, pp. 2085–2096 (2009)
[3]
Tarafdar A, Karmakar K, Khatua S, and Das RK Goswami D and Hoang TA Energy-efficient scheduling of deadline-sensitive and budget-constrained workflows in the cloud Distributed Computing and Internet Technology 2021 Cham Springer 65-80
[4]
Dragoni N et al. Mazzara M, Meyer B, et al. Microservices: yesterday, today, and tomorrow Present and Ulterior Software Engineering 2017 Cham Springer 195-216
[5]
Erl, T.: Service-Oriented Architecture: Concepts, Technology, and Design. Pearson Education India (1900)
[6]
Felter, W., Ferreira, A., Rajamony, R., Rubio, J.: An updated performance comparison of virtual machines and Linux containers. In: 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), pp. 171–172. IEEE (2015)
[7]
Gao, T.T., Huang, F.W., Zhai, X.D., Zhu, P.: Generating data format description language schema. US Patent App. 14/724,851 (2015)
[8]
Hasselbring, W.: Microservices for scalability: keynote talk abstract. In: Proceedings of the 7th ACM/SPEC on International Conference on Performance Engineering, pp. 133–134 (2016)
[9]
Hutchinson, J., Kotonya, G., Walkerdine, J., Sawyer, P., Dobson, G., Onditi, V.: Evolving existing systems to service-oriented architectures: Perspective and challenges. In: IEEE International Conference on Web Services (ICWS 2007), pp. 896–903. IEEE (2007)
[10]
Kang, H., Le, M., Tao, S.: Container and microservice driven design for cloud infrastructure devops. In: 2016 IEEE International Conference on Cloud Engineering (IC2E), pp. 202–211. IEEE (2016)
[11]
Karmakar K, Banerjee S, Das RK, and Khatua S Utilization aware and network I/O intensive virtual machine placement policies for cloud data center J. Netw. Comput. Appl. 2022 205 103442
[12]
Karmakar, K., Das, R.K., Khatua, S.: Minimizing communication cost for virtual machine placement in cloud data center. In: TENCON 2019–2019 IEEE Region 10 Conference (TENCON), pp. 1553–1558. IEEE (2019)
[13]
Karmakar, K., Das, R.K., Khatua, S.: Balanced graph partitioning based I/O intensive virtual cluster placement in cloud data center. In: 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT), pp. 01–06. IEEE (2021)
[14]
Karmakar, K., Das, R.K., Khatua, S.: An ACO-based multi-objective optimization for cooperating VM placement in cloud data center. J. Supercomput. 1–29 (2022)
[15]
Karmakar, K., Khatua, S., Das, R.K.: Efficient virtual machine placement in cloud environment. In: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 1004–1009. IEEE (2017)
[16]
Krafzig, D., Banke, K., Slama, D.: Enterprise SOA: Service-oriented Architecture Best Practices. Prentice Hall Professional (2005)
[17]
Kratzke, N.: About microservices, containers and their underestimated impact on network performance. arXiv preprint arXiv:1710.04049 (2017)
[18]
Lloyd, W., Ramesh, S., Chinthalapati, S., Ly, L., Pallickara, S.: Serverless computing: an investigation of factors influencing microservice performance. In: 2018 IEEE International Conference on Cloud Engineering (IC2E), pp. 159–169. IEEE (2018)
[19]
Luo, M., Goldshlager, B., Zhang, L.J.: Designing and implementing enterprise service bus (ESB) and SOA solutions. In: 2005 IEEE International Conference on Services Computing (SCC 2005), vol. 1, 2, p. xiv-vol. IEEE (2005)
[20]
McGovern J, Sims O, Jain A, and Little M Enterprise Service Oriented Architectures: Concepts, Challenges, Recommendations 2006 Dordrecht Springer
[21]
Nadareishvili, I., Mitra, R., McLarty, M., Amundsen, M.: Microservice Architecture: Aligning Principles, Practices, and Culture. O’Reilly Media, Inc. (2016)
[22]
Pahl, C., Jamshidi, P.: Microservices: a systematic mapping study. In: CLOSER (1), pp. 137–146 (2016)
[23]
Papazoglou MP and Georgakopoulos D Service-oriented computing Commun. ACM 2003 46 10 25-28
[24]
Schlechtendahl J, Kretschmer F, Lechler A, and Verl A Communication mechanisms for cloud based machine controls Procedia CiRp 2014 17 830-834
[25]
Schmidt MT, Hutchison B, Lambros P, and Phippen R The enterprise service bus: making service-oriented architecture real IBM Syst. J. 2005 44 4 781-797
[26]
Sill A Standards at the edge of the cloud IEEE Cloud Comput. 2017 4 2 63-67
[27]
Stubbs, J., Moreira, W., Dooley, R.: Distributed systems of microservices using docker and serfnode. In: 2015 7th International Workshop on Science Gateways, pp. 34–39. IEEE (2015)
[28]
Tarafdar A, Karmakar K, Das RK, and Khatua S Multi-criteria scheduling of scientific workflows in the workflow as a service platform Comput. Electr. Eng. 2023 105 108458
[29]
Thangavel, D., Ma, X., Valera, A., Tan, H.X., Tan, C.K.Y.: Performance evaluation of MQTT and CoAP via a common middleware. In: 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), pp. 1–6. IEEE (2014)
[30]
Verborgh R et al. Pautasso C, Wilde E, Alarcon R, et al. Survey of semantic description of REST APIs REST: Advanced Research Topics and Practical Applications 2014 New York Springer 69-89
[31]
Wilde E and Pautasso C REST: From Research to Practice 2011 New York Springer
[32]
Xu, Y., Mahendran, V., Radhakrishnan, S.: Towards SDN-based fog computing: MQTT broker virtualization for effective and reliable delivery. In: 2016 8th International Conference on Communication Systems and Networks (COMSNETS), pp. 1–6. IEEE (2016)
[33]
Zhang R, Zhong A, Dong B, Tian F, and Li R Luo M and Zhang L-J Container-VM-PM architecture: a novel architecture for docker container placement Cloud Computing – CLOUD 2018 2018 Cham Springer 128-140
[34]
Zhao Y, Dobson J, Foster I, Moreau L, and Wilde M A notation and system for expressing and executing cleanly typed workflows on messy scientific data ACM SIGMOD Rec. 2005 34 3 37-43
[35]
Zhou, X., et al.: Poster: benchmarking microservice systems for software engineering research. In: 2018 IEEE/ACM 40th International Conference on Software Engineering: Companion (ICSE-Companion), pp. 323–324. IEEE (2018)
Index Terms
- Scheduling of Containerized Resources for Microservices in Cloud
Index terms have been assigned to the content through auto-classification.
Recommendations
Designing Locality and NUMA Aware MPI Runtime for Nested Virtualization based HPC Cloud with SR-IOV Enabled InfiniBand
VEE '17: Proceedings of the 13th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution EnvironmentsHypervisor-based virtualization solutions reveal good security and isolation, while container-based solutions make applications and workloads more portable and distributed in an effective, standardized and repeatable way. Therefore, nested ...
Contention-aware container placement strategy for docker swarm with machine learning based clustering algorithms
AbstractContainerization technology utilizes operating system level virtualization to package applications to run with required libraries and are isolated from other processes on the same host. Lightweight and quick deployment make containers popular in ...
The influence of resource allocation on cloud computing performance
SAC '17: Proceedings of the Symposium on Applied ComputingThis paper makes experimental evaluations that involve the allocation of virtual machines in a cloud environment. Virtual machine allocation is an open research field in cloud, which can lead to the best performance for clients. However, the allocations ...
Comments
Information & Contributors
Information
Published In
Jan 2024
394 pages
ISBN:978-3-031-50582-9
DOI:10.1007/978-3-031-50583-6
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 17 January 2024
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025