demonstration

PPTAM: Production and Performance Testing Based Application Monitoring

Authors:

Henning SchulzAuthors Info & Claims

ICPE '19: Companion of the 2019 ACM/SPEC International Conference on Performance Engineering

Pages 39 - 40

https://doi.org/10.1145/3302541.3311961

Published: 27 March 2019 Publication History

Get Access

Abstract

It is mandatory to continuously assess software systems during development and operation, e.g., through testing and monitoring, to make sure that they meet their required level of performance. In our previous work, we have developed an approach to assess the degree to which configurations of a software system meet performance criteria based on a domain metric that is obtained by considering operational profiles and results from load test experiments. This paper presents our PPTAM tooling infrastructure that automates our approach and provides a dashboard visualization of the results.

References

[1]

Alberto Avritzer, Vincenzo Ferme, Andrea Janes, Barbara Russo, Henning Schulz, and André van Hoorn. 2018. A Quantitative Approach for the Assessment of Microservice Architecture Deployment Alternatives by Automated Performance Testing. In Proc. ECSA 2018. 159--174.

Crossref

Google Scholar

[2]

Maria Carla Calzarossa, Luisa Massari, and Daniele Tessera. 2016. Workload Characterization: A Survey Revisited. ACM Comput. Surv., Vol. 48, 3 (2016), 48:1--48:43.

Digital Library

Google Scholar

[3]

Vincenzo Ferme and Cesare Pautasso. 2018. A Declarative Approach for Performance Tests Execution in Continuous Software Development Environments. In Proc. ACM/SPEC ICPE 2018. 261--272.

Digital Library

Google Scholar

[4]

Christoph Heger, André van Hoorn, Mario Mann, and Dusan Okanovic. 2017. Application Performance Management: State of the Art and Challenges for the Future. In Proc. ICPE 2017. 429--432.

Digital Library

Google Scholar

[5]

Henning Schulz, Dusan Okanovic, André van Hoorn, Vincenzo Ferme, and Cesare Pautasso. 2019. Behavior-driven Load Testing Using Contextual Knowledge--Approach and Experiences. ACM. To appear.

Google Scholar

[6]

E. J. Weyuker and A. Avritzer. 2002. A Metric for Predicting the Performance of an Application Under a Growing Workload. IBM Syst. J., Vol. 41, 1 (Jan. 2002), 45--54.

Digital Library

Google Scholar

Cited By

View all

Traini LLeone JStilo GDi Marco AHong JPark J(2024)VAMP: Visual Analytics for Microservices PerformanceProceedings of the 39th ACM/SIGAPP Symposium on Applied Computing10.1145/3605098.3636069(1209-1218)Online publication date: 8-Apr-2024
https://dl.acm.org/doi/10.1145/3605098.3636069
Avritzer ACusick JJanes ACamilli MRusso BTrubiani Cvan Hoorn A(2024)Dependability Modeling in an Industrial Environment2024 IEEE 35th International Symposium on Software Reliability Engineering Workshops (ISSREW)10.1109/ISSREW63542.2024.00045(43-48)Online publication date: 28-Oct-2024
https://doi.org/10.1109/ISSREW63542.2024.00045
Camilli MColarusso CRusso BZimeo E(2023)Actor-driven Decomposition of Microservices through Multi-level Scalability AssessmentACM Transactions on Software Engineering and Methodology10.1145/3583563Online publication date: 15-Feb-2023
https://dl.acm.org/doi/10.1145/3583563
Show More Cited By

PPTAM: Production and Performance Testing Based Application Monitoring
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
  2. Software organization and properties
    1. Extra-functional properties

Recommendations

Kieker: a framework for application performance monitoring and dynamic software analysis
ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

Kieker is an extensible framework for monitoring and analyzing the runtime behavior of concurrent or distributed software systems. It provides measurement probes for application performance monitoring and control-flow tracing. Analysis plugins extract ...
Software Operational Profile vs. Test Profile
SBQS '19: Proceedings of the XVIII Brazilian Symposium on Software Quality

Software Operational Profile (SOP) is a software specification based on how users use the software. This specification corresponds to a quantitative representation of software that identifies the most used software parts. As software reliability depends ...
Cloud-Based Test Tools: A Brief Comparative View
Abstract
The concept of virtualization has brought life to the new methods of software testing. With the help of cloud technology, testing has become much more popular because of the opportunities it provides. Cloud technologies provides everything as a ...

Comments

Information & Contributors

Information

Published In

ICPE '19: Companion of the 2019 ACM/SPEC International Conference on Performance Engineering

March 2019

99 pages

ISBN:9781450362863

DOI:10.1145/3302541

General Chairs:
Varsha Apte
IIT Bombay, India
,
Antinisca Di Marco
University of L'Aquila, Italy
,
Program Chairs:
Marin Litoiu
York University, Canada
,
José Merseguer
Universidad de Zaragoza, Spain

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 March 2019

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

Italian Ministry of Education of Education Universities and Research
German Federal Ministry of Education and Research

Conference

ICPE '19

Sponsor:

ICPE '19: Tenth ACM/SPEC International Conference on Performance Engineering

April 7 - 11, 2019

Mumbai, India

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
230
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)3

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Traini LLeone JStilo GDi Marco AHong JPark J(2024)VAMP: Visual Analytics for Microservices PerformanceProceedings of the 39th ACM/SIGAPP Symposium on Applied Computing10.1145/3605098.3636069(1209-1218)Online publication date: 8-Apr-2024
https://dl.acm.org/doi/10.1145/3605098.3636069
Avritzer ACusick JJanes ACamilli MRusso BTrubiani Cvan Hoorn A(2024)Dependability Modeling in an Industrial Environment2024 IEEE 35th International Symposium on Software Reliability Engineering Workshops (ISSREW)10.1109/ISSREW63542.2024.00045(43-48)Online publication date: 28-Oct-2024
https://doi.org/10.1109/ISSREW63542.2024.00045
Camilli MColarusso CRusso BZimeo E(2023)Actor-driven Decomposition of Microservices through Multi-level Scalability AssessmentACM Transactions on Software Engineering and Methodology10.1145/3583563Online publication date: 15-Feb-2023
https://dl.acm.org/doi/10.1145/3583563
Leone JTraini LVieira MCardellini VDi Marco ATuma P(2023)Enhancing Trace Visualizations for Microservices Performance AnalysisCompanion of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578245.3584729(283-287)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578245.3584729
Traini LCortellessa V(2023)DeLag: Using Multi-Objective Optimization to Enhance the Detection of Latency Degradation Patterns in Service-Based SystemsIEEE Transactions on Software Engineering10.1109/TSE.2023.3266041(1-28)Online publication date: 2023
https://doi.org/10.1109/TSE.2023.3266041
Raeiszadeh MEbrahimzadeh ASaleem AGlitho REker JMini R(2023)Real-Time Anomaly Detection Using Distributed Tracing in Microservice Cloud Applications2023 IEEE 12th International Conference on Cloud Networking (CloudNet)10.1109/CloudNet59005.2023.10490038(36-44)Online publication date: 1-Nov-2023
https://doi.org/10.1109/CloudNet59005.2023.10490038
Avritzer ACamilli MJanes ARusso BTrubiani Cvan Hoorn A(2023)Continuous Dependability Assessment of Microservice SystemsSoftware Architecture. ECSA 2022 Tracks and Workshops10.1007/978-3-031-36889-9_11(138-147)Online publication date: 16-Jul-2023
https://doi.org/10.1007/978-3-031-36889-9_11
Camilli MGuerriero AJanes ARusso BRusso SGarrido AWong WDe Angelis GDo HNguyen B(2022)Microservices integrated performance and reliability testingProceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test10.1145/3524481.3527233(29-39)Online publication date: 17-May-2022
https://dl.acm.org/doi/10.1145/3524481.3527233
Al Maruf ABakhtin ACerny TTaibi D(2022)Using Microservice Telemetry Data for System Dynamic Analysis2022 IEEE International Conference on Service-Oriented System Engineering (SOSE)10.1109/SOSE55356.2022.00010(29-38)Online publication date: Aug-2022
https://doi.org/10.1109/SOSE55356.2022.00010
Sakai MTakahashi K(2022)Constructing a service process model based on distributed tracing for conformance checking of microservicesNOMS 2022-2022 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS54207.2022.9789804(1-6)Online publication date: 25-Apr-2022
https://doi.org/10.1109/NOMS54207.2022.9789804
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Kieker: a framework for application performance monitoring and dynamic software analysis

Software Operational Profile vs. Test Profile

Cloud-Based Test Tools: A Brief Comparative View