research-article

DevOps Performance Engineering: A Quasi-Ethnographical Study

Authors:

Giuseppe Vergori,

Damian A. Tamburri,

Diego Perez-Palacin,

Raffaela MirandolaAuthors Info & Claims

ICPE '17 Companion: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion

Pages 127 - 132

https://doi.org/10.1145/3053600.3053628

Published: 18 April 2017 Publication History

Abstract

DevOps is a software engineering strategy to reduce soft- ware changes' rollout times by adopting any set of tactics that reduce friction in software lifecycles and their organisational variables, for example: coordination, communication, product evolution, deployment, operation, continuous architecting, continuous integration and more. Going DevOps is increasingly demanding that software engineering disciplines which were typically product-oriented such as software performance engineering to rethink their typical comfort zone, enlarging their scope from product, to process or even further to ecosystem and organisational levels of abstraction. This article makes an attempt at understanding what are the dimensions in DevOps organisational scenarios that can be addressed with a performance engineering lens. To do this, we performed a quasi-ethnographical study featuring a real-life industrial DevOps scenario. Discussing our results we conclude that many synergies exist between DevOps and performance engineering each with peculiarities, limitations and challenges - more research is needed to offer a full-spectrum performance-engineering support for DevOps practitioners.

References

[1]

A. Balalaie, A. Heydarnoori, and P. Jamshidi. Microservices architecture enables devops: Migration to a cloud-native architecture. IEEE Software, 33(3):42--52, 2016.

Digital Library

[2]

L. J. Bass, I. M. Weber, and L. Zhu. DevOps - A Software Architect's Perspective. SEI series in software engineering. Addison-Wesley, 2015.

Digital Library

[3]

S. Bernardi, J. Merseguer, and D. C. Petriu. Model-Driven Dependability Assessment of Software Systems. Springer, 2013.

[4]

A. Bertolino, E. Marchetti, and R. Mirandola. Performance measures for supporting project manager decisions. Software Process: Improvement and Practice, 12(2):141--164, 2007.

[5]

P. Bocciarelli and A. D'Ambrogio. Model-driven performability analysis of composite web services. In SIPEW, volume 5119 of Lecture Notes in Computer Science, pages 228--246. Springer, 2008.

[6]

F. P. Brooks. The Mythical Man-Month. Addison-Wesley, Boston, MA, anniversary edition, 1995.

[7]

B. M. Feeley. IDEAL: A User's Guide for Software Process Improvement. Software Engineering Institute (SEI), 1996.

[8]

M. Fleck, L. Berardinelli, P. Langer, T. Mayerhofer, and V. Cortellessa. Resource contention analysis of cloud-based system through fuml-driven model execution. In NiM-ALP@MoDELS, volume 1074 of CEUR Workshop Proceedings, pages 6--15. CEUR-WS.org, 2013.

[9]

R. B. France and B. Rumpe. Model-based lifecycle management of software-intensive systems, applications, and services. Software and System Modeling, 12(3):439--440, 2013.

Digital Library

[10]

V. Grassi and R. Mirandola. Uml modelling and performance analysis of mobile software architectures. In M. Gogolla and C. Kobryn, editors, UML, volume 2185 of Lecture Notes in Computer Science, pages 209--224. Springer, 2001.

[11]

M. Hammersley and P. Atkinson. Ethnography. Routledge, London, 2003.

[12]

H.-F. Hsieh and S. E. Shannon. Three approaches to qualitative content analysis. Qualitative health research, 15(9):1277--1288, 2005.

[13]

G. Kim, K. Behr, and G. Spafford. The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win. IT Revolution Press, 1st edition, 2013.

[14]

MG. Uml profile for marte: Modeling and analysis of real-time embedded systems, 2009.

[15]

M. Niazi, D. Wilson, and D. Zowghi. Critical success factors for software process improvement implementation: an empirical study. Software Process: Improvement and Practice, 11(2):193--211, 2006.

[16]

D. Perez-Palacin and J. Merseguer. Performance sensitive self-adaptive service-oriented software using hidden markov models. In ICPE, pages 201--206. ACM, 2011.

Digital Library

[17]

D. Perez-Palacin and R. Mirandola. Uncertainties in the modeling of self-adaptive systems: a taxonomy and an example of availability evaluation. In ACM/SPEC International Conference on Performance Engineering, ICPE'14, pages 3--14, 2014.

Digital Library

[18]

D. B. Petriu and C. M. Woodside. Software performance models from system scenarios. Perform. Eval., 61(1):65--89, 2005.

Digital Library

[19]

R. Reussner, S. Becker, J. Happe, H. Koziolek, K. Krogmann, and M. Kuperberg. The Palladio component model. Karlsruhe, 2007.

[20]

C. U. Smith. Performance Engineering of Software Systems. Addison-Wesley, Reading, MA, USA, 1990.

Digital Library

[21]

D. A. Tamburri, R. Kazman, and H. Fahimi. The architect's role in community shepherding. IEEE Software, 33(6):70--79, 2016.

Digital Library

[22]

D. A. Tamburri, P. Lago, and H. van Vliet. Organizational social structures for software engineering. ACM Comput. Surv., 46(1):3, 2013.

Digital Library

[23]

K. S. Trivedi and R. A. Wagner. A decision model for closed queuing networks. IEEE Trans. Software Eng., 5(4):328--332, 1979.

Digital Library

Cited By

Kumar ANadeem MShameem M(2024)A Systematic Literature Review for Investigating DevOps Metrics to Implement in Software Development OrganizationsJournal of Software: Evolution and Process10.1002/smr.2733Online publication date: 27-Oct-2024
https://doi.org/10.1002/smr.2733
Toh MSahibuddin SMahrin M(2019)Adoption Issues in DevOps from the Perspective of Continuous Delivery PipelineProceedings of the 2019 8th International Conference on Software and Computer Applications10.1145/3316615.3316619(173-177)Online publication date: 19-Feb-2019
https://dl.acm.org/doi/10.1145/3316615.3316619

Index Terms

DevOps Performance Engineering: A Quasi-Ethnographical Study

Recommendations

DevOps in practice: an exploratory case study
XP '18: Proceedings of the 19th International Conference on Agile Software Development: Companion

DevOps is a cultural movement and technical solution that plays a fundamental role for software-intensive organizations whose business greatly depends on how efficient development and operation are. DevOps is relatively recent, and thus little is known ...
Using ethnographic methods in software engineering research
ICSE '10: Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2

This tutorial provides an overview of the role of ethnography in Software Engineering research. It describes the use of ethnographic methods as a means to provide an in-depth understanding of the socio-technological realities surrounding everyday ...
Security practices in DevOps
HotSos '16: Proceedings of the Symposium and Bootcamp on the Science of Security

DevOps focuses on collaboration between different teams in an organization to achieve rapid deployment of software and services to end-users by automating the software delivery infrastructure. According to Dyck et al. [1] DevOps is a software process ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '17 Companion: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion

April 2017

248 pages

ISBN:9781450348997

DOI:10.1145/3053600

General Chairs:
Walter Binder
Università della Svizzera Italiana, Switzerland
,
Vittorio Cortellessa
Università dell'Aquila, Italy
,
Program Chairs:
Anne Koziolek
Karlsruhe Institute of Technology, Germany
,
Evgenia Smirni
College of William & Mary, USA
,
Meikel Poess
Oracle Corporation, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGSOFT: ACM Special Interest Group on Software Engineering
SPEC: SPEC Research Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Horizon 2020 Framework Programme

Conference

ICPE '17

Sponsor:

ICPE '17: ACM/SPEC International Conference on Performance Engineering

April 22 - 26, 2017

L'Aquila, Italy

Acceptance Rates

ICPE '17 Companion Paper Acceptance Rate 24 of 65 submissions, 37%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
359
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kumar ANadeem MShameem M(2024)A Systematic Literature Review for Investigating DevOps Metrics to Implement in Software Development OrganizationsJournal of Software: Evolution and Process10.1002/smr.2733Online publication date: 27-Oct-2024
https://doi.org/10.1002/smr.2733
Toh MSahibuddin SMahrin M(2019)Adoption Issues in DevOps from the Perspective of Continuous Delivery PipelineProceedings of the 2019 8th International Conference on Software and Computer Applications10.1145/3316615.3316619(173-177)Online publication date: 19-Feb-2019
https://dl.acm.org/doi/10.1145/3316615.3316619

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents