research-article

Exploring synergies between bottleneck analysis and performance antipatterns

Authors:

Catia Trubiani,

Antinisca Di Marco,

Vittorio Cortellessa,

Dorina PetriuAuthors Info & Claims

ICPE '14: Proceedings of the 5th ACM/SPEC international conference on Performance engineering

Pages 75 - 86

https://doi.org/10.1145/2568088.2568092

Published: 22 March 2014 Publication History

Abstract

The problem of interpreting the results of performance analysis is quite critical, mostly because the analysis results (i.e. mean values, variances, and probability distributions) are hard to transform into feedback for software engineers that allows to remove performance problems. Approaches aimed at identifying and removing the causes of poor performance in software systems commonly fall in two categories: (i) bottleneck analysis, aimed at identifying overloaded software components and/or hardware resources that affect the whole system performance, and (ii) performance antipatterns, aimed at detecting and removing common design mistakes that notably induce performance degradation.

In this paper, we look for possible synergies between these two categories of approaches in order to empower the performance investigation capabilities. In particular, we aim at showing that the approach combination allows to provide software engineers with broader sets of alternative solutions leading to better performance results. We have explored this research direction in the context of Layered Queueing Network models, and we have considered a case study in the e-commerce domain. After comparing the results achievable with each approach separately, we quantitatively show the benefits of merging bottleneck analysis and performance antipatterns.

References

[1]

UML 2.0 Superstructure Specification, OMG document formal/05-07-04, 2005.

[2]

A. Aleti, B. Buhnova, L. Grunske, A. Koziolek, and I. Meedeniya. Software architecture optimization methods: A systematic literature review. IEEE Trans. Software Eng., 39(5):658--683, 2013.

Digital Library

[3]

D. Arcelli, V. Cortellessa, and D. Di Ruscio. Applying model differences to automate performance-driven refactoring of software models. In European Workshop on Computer Performance Engineering (EPEW), pages 312--324, 2013.

[4]

D. Arcelli, V. Cortellessa, and C. Trubiani. Antipattern-based model refactoring for software performance improvement. In International ACM SIGSOFT conference on Quality of Software Architectures (QoSA), pages 33--42, 2012.

Digital Library

[5]

S. Balsamo, A. Di Marco, P. Inverardi, and M. Simeoni. Model-based performance prediction in software development: A survey. IEEE Trans. Software Eng., 30(5):295--310, 2004.

Digital Library

[6]

A. Cicchetti, D. Di Ruscio, and A. Pierantonio. A metamodel independent approach to difference representation. Journal of Object Technology, 6(9):165--185, 2007.

[7]

V. Cortellessa, A. Di Marco, and P. Inverardi. Model-Based Software Performance Analysis. Springer, 2011.

Digital Library

[8]

V. Cortellessa, A. Di Marco, and C. Trubiani. An approach for modeling and detecting software performance antipatterns based on first-order logics. Journal of Software and Systems Modeling, 2012.

Digital Library

[9]

V. Cortellessa, A. Di Marco, and C. Trubiani. Software performance antipatterns: Modeling and analysis. In Formal Methods for Model-Driven Engineering (SFM), pages 290--335, 2012.

Digital Library

[10]

G. Franks, P. Maly, M. Woodside, D. C. Petriu, A. Hubbard, and M. Mroz. Layered Queueing Network Solver and Simulator, 2013. {online}http://www.sce.carleton.ca/rads/lqns/LQNS-UserMan-jan13.pdf.

[11]

G. Franks, D. C. Petriu, C. M. Woodside, J. Xu, and P. Tregunno. Layered bottlenecks and their mitigation. In International Conference on the Quantitative Evaluation of Systems (QEST), pages 103--114, 2006.

Digital Library

[12]

M. Harman and L. Tratt. Pareto optimal search based refactoring at the design level. In Conference on Genetic and evolutionary computation (GECCO), pages 1106--1113, 2007.

Digital Library

[13]

H. Koziolek. Performance evaluation of component-based software systems: A survey. Perform. Eval., 67(8):634--658, 2010.

Digital Library

[14]

N. Mani, D. C. Petriu, and C. M. Woodside. Studying the impact of design patterns on the performance analysis of service oriented architecture. In EUROMICRO Conference on Software Engineering and Advanced Applications, pages 12--19, 2011.

Digital Library

[15]

N. Mani, D. C. Petriu, and C. M. Woodside. Propagation of incremental changes to performance model due to soa design pattern application. In ACM/SPEC International Conference on Performance Engineering (ICPE), pages 89--100, 2013.

Digital Library

[16]

A. Martens, H. Koziolek, S. Becker, and R. Reussner. Automatically improve software architecture models for performance, reliability, and cost using evolutionary algorithms. In WOSP/SIPEW International Conference on Performance Engineering, pages 105--116, 2010.

Digital Library

[17]

T. Mens and T. Tourwé. A survey of software refactoring. IEEE Trans. Software Eng., 30(2):126--139, 2004.

Digital Library

[18]

Object Management Group (OMG). UML Profile for MARTE, 2009. OMG Document formal/08-06-09.

[19]

M. O'Keeffe and M. í Cinnéide. Search-based refactoring for software maintenance. J. Syst. Softw., 81(4):502--516, Apr. 2008.

Digital Library

[20]

T. Parsons and J. Murphy. Detecting Performance Antipatterns in Component Based Enterprise Systems. Journal of Object Technology, 7(3):55--91, 2008.

[21]

D. C. Petriu and H. Shen. Applying the UML Performance Profile: Graph Grammar-Based Derivation of LQN Models from UML Specifications. In Computer Performance Evaluation / TOOLS, pages 159--177, 2002.

Digital Library

[22]

O. Seng, J. Stammel, and D. Burkhart. Search-based determination of refactorings for improving the class structure of object-oriented systems. In Conference on Genetic and evolutionary computation (GECCO), pages 1909--1916, 2006.

Digital Library

[23]

C. U. Smith. Introduction to software performance engineering: Origins and outstanding problems. In Formal Methods for Performance Evaluation, International School on Formal Methods for the Design of Computer, Communication, and Software Systems (SFM), pages 395--428, 2007.

Digital Library

[24]

C. U. Smith and C. V. Millsap. Software performance engineering for oracle applications: Measurements and models. In International Computer Measurement Group (CMG) Conference, pages 331--342, 2008.

[25]

C. U. Smith and L. G. Williams. More new software antipatterns: Even more ways to shoot yourself in the foot. In International Computer Measurement Group (CMG) Conference, pages 717--725, 2003.

[26]

L. G. Williams and C. U. Smith. Software performance engineering: A tutorial introduction. In International Computer Measurement Group (CMG) Conference, pages 387--398, 2007.

[27]

C. M. Woodside, G. Franks, and D. C. Petriu. The Future of Software Performance Engineering. In International Workshop on the Future of Software Engineering (FOSE), pages 171--187, 2007.

Digital Library

[28]

M. Woodside, D. C. Petriu, J. Merseguer, D. B. Petriu, and M. Alhaj. Transformation challenges: from software models to performance models. Journal of Software and Systems Modeling, 2013. accepted.

[29]

J. Xu. Rule-based automatic software performance diagnosis and improvement. Perform. Eval., 67(8):585--611, 2010.

Digital Library

Cited By

Dave SNowatzki TShrivastava AAamodt TSwift MJerger N(2023)Explainable-DSE: An Agile and Explainable Exploration of Efficient HW/SW Codesigns of Deep Learning Accelerators Using Bottleneck AnalysisProceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 410.1145/3623278.3624772(87-107)Online publication date: 25-Mar-2023
https://dl.acm.org/doi/10.1145/3623278.3624772
Avritzer ACamilli MJanes ARusso BTrubiani Cvan Hoorn A(2023)Continuous Dependability Assessment of Microservice SystemsSoftware Architecture. ECSA 2022 Tracks and Workshops10.1007/978-3-031-36889-9_11(138-147)Online publication date: 16-Jul-2023
https://doi.org/10.1007/978-3-031-36889-9_11
Arcelli D(2021)Envisioning Model-Based Performance Engineering FrameworksProcedia Computer Science10.1016/j.procs.2021.04.008184(541-548)Online publication date: 2021
https://doi.org/10.1016/j.procs.2021.04.008
Show More Cited By

Index Terms

Exploring synergies between bottleneck analysis and performance antipatterns

Recommendations

Antipattern-based model refactoring for software performance improvement
QoSA '12: Proceedings of the 8th international ACM SIGSOFT conference on Quality of Software Architectures

Identifying and removing the causes of poor performance in software systems are complex problems due to a variety of factors to take into account. Nowadays these problems are usually tackled after the software deployment only with human-based means, ...
A model-driven approach to catch performance antipatterns in ADL specifications

Context: While the performance analysis of a software architecture is a quite well-assessed task nowadays, the issue of interpreting the performance results for providing feedback to software architects is still very critical. Performance antipatterns ...
Software Performance Antipatterns in Cyber-Physical Systems
ICPE '20: Proceedings of the ACM/SPEC International Conference on Performance Engineering

Software performance antipatterns (SPAs) document common performance problems in software architecture and design and how to fix them. They differ from software antipatterns in their focus on the performance of the software. This paper addresses ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '14: Proceedings of the 5th ACM/SPEC international conference on Performance engineering

March 2014

310 pages

ISBN:9781450327336

DOI:10.1145/2568088

General Chairs:
Klaus-Dieter Lange
Hewlett-Packard Company, USA
,
John Murphy
University College Dublin, Ireland
,
Program Chairs:
Walter Binder
University of Lugano, Switzerland
,
José Merseguer
Universidad de Zaragoza, Spain

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGSOFT: ACM Special Interest Group on Software Engineering
SPEC: SPEC Research Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

ICPE'14

Sponsor:

ICPE'14: ACM/SPEC International Conference on Performance Engineering

March 22 - 26, 2014

Dublin, Ireland

Acceptance Rates

ICPE '14 Paper Acceptance Rate 21 of 78 submissions, 27%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dave SNowatzki TShrivastava AAamodt TSwift MJerger N(2023)Explainable-DSE: An Agile and Explainable Exploration of Efficient HW/SW Codesigns of Deep Learning Accelerators Using Bottleneck AnalysisProceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 410.1145/3623278.3624772(87-107)Online publication date: 25-Mar-2023
https://dl.acm.org/doi/10.1145/3623278.3624772
Avritzer ACamilli MJanes ARusso BTrubiani Cvan Hoorn A(2023)Continuous Dependability Assessment of Microservice SystemsSoftware Architecture. ECSA 2022 Tracks and Workshops10.1007/978-3-031-36889-9_11(138-147)Online publication date: 16-Jul-2023
https://doi.org/10.1007/978-3-031-36889-9_11
Arcelli D(2021)Envisioning Model-Based Performance Engineering FrameworksProcedia Computer Science10.1016/j.procs.2021.04.008184(541-548)Online publication date: 2021
https://doi.org/10.1016/j.procs.2021.04.008
Petriu D(2021)Integrating the analysis of multiple non-functional properties in model-driven engineeringSoftware and Systems Modeling10.1007/s10270-021-00953-320:6(1777-1791)Online publication date: 28-Nov-2021
https://doi.org/10.1007/s10270-021-00953-3
Trubiani CAleti AGoodwin SJamshidi Pvan Hoorn AGratzl S(2020)VisArch: Visualisation of Performance-based Architectural RefactoringsSoftware Architecture10.1007/978-3-030-58923-3_12(182-190)Online publication date: 8-Sep-2020
https://doi.org/10.1007/978-3-030-58923-3_12
He SManns GSaunders JWang WPollock LSoffa MDumas MPfahl DApel SRusso A(2019)A statistics-based performance testing methodology for cloud applicationsProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3338912(188-199)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3338906.3338912
Iqbal JUl Haq S(2017)Automatic Feedback Generation in Software Performance Engineering: A ReviewOriental journal of computer science and technology10.13005/ojcst/10.02.0810:2(305-310)Online publication date: 6-Apr-2017
https://doi.org/10.13005/ojcst/10.02.08
Dubois DTrubiani CCasale G(2016)Model-Driven Application Refactoring to Minimize Deployment Costs in Preemptible Cloud Resources2016 IEEE 9th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD.2016.0052(335-342)Online publication date: Jun-2016
https://doi.org/10.1109/CLOUD.2016.0052
Arcelli DCortellessa VKruchten PChampagne RKoziolek A(2015)Assisting Software Designers to Identify and Solve Performance ProblemsProceedings of the 1st International Workshop on Future of Software Architecture Design Assistants10.1145/2751491.2751493(1-6)Online publication date: 6-May-2015
https://dl.acm.org/doi/10.1145/2751491.2751493
Petriu DWoodside MWoodside M(2015)Challenges in Integrating the Analysis of Multiple Non-Functional Properties in Model-Driven Software EngineeringProceedings of the 2015 Workshop on Challenges in Performance Methods for Software Development10.1145/2693561.2693566(41-46)Online publication date: 31-Jan-2015
https://dl.acm.org/doi/10.1145/2693561.2693566
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents