research-article

Beauty and the Beast: A Case Study on Performance Prototyping of Data-Intensive Containerized Cloud Applications

Authors:

Floriment Klinaku,

Stephan RhodeAuthors Info & Claims

ICPE '22: Companion of the 2022 ACM/SPEC International Conference on Performance Engineering

Pages 53 - 60

https://doi.org/10.1145/3491204.3527482

Published: 19 July 2022 Publication History

Abstract

Data-intensive container-based cloud applications have become popular with the increased use cases in the Internet of Things domain. Challenges arise when engineering such applications to meet quality requirements, both classical ones like performance and emerging ones like resilience. There is a lack of reference use cases, applications, and experiences when prototyping such applications that could benefit the research community. Moreover, it is hard to generate realistic and reliable workloads that exercise the resources according to a specification. Hence, designing reference applications that would exhibit similar performance behavior in such environments is hard. In this paper, we present a work in progress towards a reference use case and application for data-intensive containerized cloud applications having an industrial motivation. Moreover, to generate reliable CPU workloads we make use of ProtoCom, a well-known library for the generation of resource demands, and report the performance under various quality requirements in a Kubernetes cluster of moderate size. Finally, we present the scalability of the current solution assuming a particular autoscaling policy. Results of the calibration show high variability of the ProtoCom library when executed in a cloud environment. We observe a moderate association between the occupancy of node and the relative variability of execution time.

References

[1]

ACME Air: Acme Air Sample and Benchmark. Online: https://github.com/acmeair/acmeair. [Online; 2022-01--25].

[2]

Cluster Proportional Autoscaler. Online: https://github.com/kubernetes-sigs/cluster-proportional-autoscaler. [Online; 2022-01--25].

[3]

Maintenance of all bwCloud regions starting 2022-03-01, subsequent reregistration necessary - FINISHED! textbarbw-cloud.org.

[4]

Sockshop microservice demo application. Online: https://microservices-demo.github.io.

[5]

Spring PetClinic. Online: https://github.com/spring-project:spring-petclinic. [Online; 2022-01--25].

[6]

Kubernetes Horizontal pod autoscaling. https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale/, 2021. [Online; 2021--12-09].

[7]

Amazon EC2 Auto scaling. https://docs.aws.amazon.com/autoscaling/ec2/userguide/what-is-amazon-ec2-auto-scaling.html, 2022. [Online; 2022-01--25].

[8]

Steffen Becker, Tobias Dencker, and Jens Happe. Model-driven generation of performance prototypes. In Samuel Kounev, Ian Gorton, and Kai Sachs, editors, Performance Evaluation: Metrics, Models and Benchmarks, pages 79--98, Berlin, Heidelberg, 2008. Springer Berlin Heidelberg.

Digital Library

[9]

André B. Bondi. Characteristics of scalability and their impact on performance. In Proceedings of the second international workshop on Software and performance - WOSP textquotesingle00. ACM Press, 2000.

Digital Library

[10]

Bosch. Mobility Cloud. https://www.bosch-mobility-solutions.com/media/global/products-and-services/mobility-services/plcs/mobility-cloud/21-08-02_bosc_21028-06_mobilitycloud_onepager-rgb_en.pdf, 2021. [Online; 2021--12--16].

[11]

Marco Di Natale, Haibo Zeng, Paolo Giusto, and Arkadeb Ghosal. Understanding and Using the Controller Area Network Communication Protocol: Theory and Practice. Springer Publishing Company, Incorporated, 2014.

[12]

Sö ren Henning and Wilhelm Hasselbring. How to measure scalability of distributed stream processing engines? In ICPE '21: ACM/SPEC International Conference on Performance Engineering, Virtual Event, France, April 19--21, 2021, Companion Volume, pages 85--88. ACM, 2021.

Digital Library

[13]

Floriment Klinaku, Mir Alireza Hakamian, and Steffen Becker. Architecture-based evaluation of scaling policies for cloud applications. In IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2021, Washington, DC, USA, September 27 - Oct. 1, 2021, pages 151--157. IEEE, 2021.

[14]

Christoph Laaber, Joel Scheuner, and Philipp Leitner. Software microbenchmarking in the cloud. how bad is it really? Empirical Softw. Engg., 24(4):2469--2508, aug 2019.

Digital Library

[15]

Sebastian Lehrig, Richard Sanders, Gunnar Brataas, Mariano Cecowski, Simon Ivanvs ek, and Jure Polutnik. Cloudstore-towards scalability, elasticity, and efficiency benchmarking and analysis in cloud computing. Future Generation Computer Systems, 78:115--126, 2018.

[16]

Sebastian Lehrig and Thomas Zolynski. Performance prototyping with protocom in a virtualised environment: A case study. Proceedings to Palladio Days, pages 17--18, 2011.

[17]

Albert Lutz, Bernhard Schick, Henning Holzmann, Michael Kochem, Harald Meyer-Tuve, Olav Lange, Yiqin Mao, and Guido Tosolin. Simulation methods supporting homologation of electronic stability control in vehicle variants. Vehicle System Dynamics, 55(10):1432--1497, 2017.

[18]

Seyed Hossein Nikounia and Siamak Mohammadi. Hypervisor and neighbors' noise: Performance degradation in virtualized environments. IEEE Transactions on Services Computing, 11(5):757--767, 2015.

[19]

Chris Richardson. microservices.io deployment patterns. https://microservices.io/microservices/news/2015/03/15/deployment-patterns.html, 2021. [Online; 2022-01--25].

[20]

Rami Rosen. Linux containers and the future cloud. Linux J, 240(4):86--95, 2014.

[21]

Max Scheerer, Martina Rapp, and Ralf Reussner. Design-time validation of runtime reconfiguration strategies: An environmental-driven approach. In 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS), pages 75--81, 2020.

[22]

Piyush Shivam, Varun Marupadi, Jeffrey S. Chase, Thileepan Subramaniam, and Shivnath Babu. Cutting corners: Workbench automation for server benchmarking. In Rebecca Isaacs and Yuanyuan Zhou, editors, 2008 USENIX Annual Technical Conference, Boston, MA, USA, June 22--27, 2008. Proceedings, pages 241--254. USENIX Association, 2008.

[23]

Sandro Speth, Sarah Stieß, and Steffen Becker. A Saga Pattern Microservice Reference Architecture for an Elastic SLO Violation Analysis. In Companion Proceedings of 19textsuperscriptth IEEE International Conference on Software Architecture (ICSA-C 2022). IEEE, March 2022.

[24]

Jóakim von Kistowski, Simon Eismann, Norbert Schmitt, André Bauer, Johannes Grohmann, and Samuel Kounev. Teastore: A micro-service reference application for benchmarking, modeling and resource management research. In 2018 IEEE 26th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), pages 223--236. IEEE, 2018.

[25]

Xiang Zhou, Xin Peng, Tao Xie, Jun Sun, Chao Ji, Wenhai Li, and Dan Ding. Fault analysis and debugging of microservice systems: Industrial survey, benchmark system, and empirical study. IEEE Trans. Software Eng., 47(2):243--260, 2021.

Digital Library

Cited By

Klinaku FKatić JStieß SBecker S(2023)Designing Elasticity Policies for Cloud-Native Applications with Slingshot2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C59198.2023.00012(19-23)Online publication date: 1-Oct-2023
https://doi.org/10.1109/MODELS-C59198.2023.00012
Zheng SChen Y(2022)A Cloud Resource Scheduling Method Based on Multi-dimensional Service Evaluation2022 IEEE 4th International Conference on Civil Aviation Safety and Information Technology (ICCASIT)10.1109/ICCASIT55263.2022.9986827(1000-1004)Online publication date: 12-Oct-2022
https://doi.org/10.1109/ICCASIT55263.2022.9986827

Index Terms

Beauty and the Beast: A Case Study on Performance Prototyping of Data-Intensive Containerized Cloud Applications
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Cloud computing
2. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties
      1. Software performance
    2. Software system structures
      1. Software architectures
        Publish-subscribe / event-based architectures

Recommendations

Is your cloud elastic enough?: performance modelling the elasticity of infrastructure as a service (IaaS) cloud applications
ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

Elasticity, the ability to rapidly scale resources up and down on demand, is an essential feature of public cloud platforms. However, it is difficult to understand the elasticity requirements of a given application and workload, and if the elasticity ...
Introducing Monitoring and extended Elasticity support in TOSCA
UCC '23: Proceedings of the IEEE/ACM 16th International Conference on Utility and Cloud Computing

Cloud services and applications become ever more important for enterprises, which profit from the advantages of scalability, flexibility and the pay-as-you-go model which are offered by Cloud service vendors. One of the most well-known standards in the ...
Cloud services brokering for elastic workloads
SYSTOR '15: Proceedings of the 8th ACM International Systems and Storage Conference

With the growing trend of using public clouds for significant portion of enterprise workloads and the multitude of available cloud providers, arises a real need for brokerage of cloud services. The IBM Cloud Service Broker adds value to cloud services ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '22: Companion of the 2022 ACM/SPEC International Conference on Performance Engineering

July 2022

166 pages

ISBN:9781450391597

DOI:10.1145/3491204

General Chairs:
Dan Feng
Huazhong University of Science and Technology, China
,
Steffen Becker
University of Stuttgart, Germany
,
Program Chairs:
Nikolas Herbst
University of Wurzburg, Germany
,
Philipp Leitner
University of L'Aquila, Italy

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium für Bildung und Forschung (BMBF)

Conference

ICPE '22

Sponsor:

ICPE '22: ACM/SPEC International Conference on Performance Engineering

April 9 - 13, 2022

Bejing, China

Acceptance Rates

Overall Acceptance Rate 50 of 210 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
73
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Klinaku FKatić JStieß SBecker S(2023)Designing Elasticity Policies for Cloud-Native Applications with Slingshot2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C59198.2023.00012(19-23)Online publication date: 1-Oct-2023
https://doi.org/10.1109/MODELS-C59198.2023.00012
Zheng SChen Y(2022)A Cloud Resource Scheduling Method Based on Multi-dimensional Service Evaluation2022 IEEE 4th International Conference on Civil Aviation Safety and Information Technology (ICCASIT)10.1109/ICCASIT55263.2022.9986827(1000-1004)Online publication date: 12-Oct-2022
https://doi.org/10.1109/ICCASIT55263.2022.9986827

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents