Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
review-article

Mapping DevOps capabilities to the software life cycle: : A systematic literature review

Published: 01 January 2025 Publication History

Abstract

Context:

Many IT organizations are looking towards DevOps to make their software development and delivery processes faster and more reliable, while DevOps revolutionized the industry by emphasizing collaboration between development and operations teams. Nonetheless, there still exist challenges in harmonizing cultural, technical, measurement and process capabilities for its successful adoption.

Objective:

To research improving DevOps adoption, this study explores DevOps Capabilities relevant to the Life Cycle Processes (LCPs) of the IEEE 2675-2021 DevOps standard. Aiming to provide valuable information on increasing efficiency and outcomes by mapping DevOps Capabilities in each phase of the LCPs. Whereas previous research identified and classified 37 DevOps Capabilities, this study aims to determine which capabilities can enhance each of the 30 phases of the LCPs.

Methods:

Out of 102 documents identified in the Systematic Literature Review (SLR), relations among DevOps Capabilities and LCPs have been synthesized and organized. An in-depth analysis of data was conducted over the connections across various categories. The mapping revealed how they relate in terms of their application and impact.

Results:

The SLR shows technical DevOps Capabilities and technical LCPs strongly correlated. DevOps measurement capabilities have a significant impact on agreement processes. Using an impact scale classification, the study identifies eight capabilities that have exceptional impact on LCPs and eleven capabilities that have a very high impact on the supply process, requirements definition, integration process, and validation process.

Conclusion:

The study demonstrates how DevOps Capabilities together with LCPs can improve software delivery, quality, and reliability. It presents a structured approach for improving processes, as well as evidence of DevOps integration in software development and maintenance. The findings help to assess DevOps Capabilities and LCP relations, which is expected to improve successful adoption. Future research should focus on researching practical cases of DevOps integration into LCPs, while overcoming adoption challenges.

References

[1]
Tell P., Klunder J., Kupper S., Raffo D., Macdonell S.G., Munch J., Pfahl D., Linssen O., Kuhrmann M., What are hybrid development methods made of? An evidence-based characterization, in: Proceedings - 2019 IEEE/ACM International Conference on Software and System Processes, ICSSP 2019, IEEE, 2019, pp. 105–114,.
[2]
Solajić D., Petrović A., Devops and modern software delivery, in: Proceedings of the International Scientific Conference - Sinteza 2019, Singidunum University, Novi Sad, Serbia, 2019, pp. 360–368,.
[3]
Amaro R., Pereira R., da Silva M.M., Capabilities and metrics in DevOps: a design science study, Inf. Manag. (2023) 32,.
[4]
Amaro R., Pereira R., Mira da Silva M., Capabilities and practices in DevOps: A multivocal literature review, IEEE Trans. Softw. Eng. 1 (2022) 20,.
[5]
Leite L., Rocha C., Kon F., Milojicic D., Meirelles P., A survey of DevOps concepts and challenges, ACM Comput. Surv. 52 (6) (2019) 35,.
[6]
Azad N., Hyrynsalmi S., DevOps critical success factors — A systematic literature review, Inf. Softw. Technol. 157 (2023),.
[7]
Maroukian K., R. Gulliver S., Synthesis of a leadership model for DevOps adoption, in: 2021 2nd European Symposium on Software Engineering, in: ESSE 2021, Association for Computing Machinery, New York, NY, USA, 2021, pp. 58–66,.
[8]
Rajapakse R.N., Zahedi M., Babar M.A., Shen H., Challenges and solutions when adopting DevSecOps: A systematic review, Inf. Softw. Technol. 141 (2022),.
[9]
Sharma S., The DevOps Adoption Playbook: A Guide to Adopting DevOps in a Multi-Speed IT Enterprise, IBM Press, John Wiley & Sons, Inc., Indianapolis, Indiana, 2017,.
[10]
Kim G., Humble J., Debois P., Willis J., The DevOps Handbook : How to Create World-Class Agility, Reliability, and Security in Technology Organizations, IT Revolution Press, USA, 2016, https://www.amazon.com/DevOps-Handbook-World-Class-Reliability-Organizations/dp/1942788002.
[11]
IEEE G., IEEE Standard for DevOps: Building reliable and secure systems including application build, package, and deployment: IEEE Standard 2675-2021, 1 (16 Apr 2021) (2021) 91,.
[12]
IEEE, ISO/IEC/IEEE International Standard - Systems and Software Engineering – System Life Cycle Processes, ISO/IEC/IEEE 15288 First edition 2015-05-15, 2015, p. 118, https://doi.org/10.1109/IEEESTD.2015.7106435.
[13]
IEEE Standards Association, IEEE Standard for configuration management in systems and software engineering: IEEE Std 828™-2012 (Revision of IEEE Std 828-2005), IEEE Std 828-2012 (Revision of IEEE Std 828-2005), 2012, (March) 2012, https://doi.org/10.1109/IEEESTD.2012.6170935.
[14]
IEEE Standard, ISO/IEC/IEEE international standard - systems and Software Engineering – Software Life Cycle Processes, ISO/IEC/IEEE 12207:2017(E) First edition 2017-11, 2017, p. 157, https://doi.org/10.1109/IEEESTD.2017.8100771.
[15]
Díaz J., López-Fernández D., Pérez J., González-Prieto Á., Why are many businesses installing a DevOps culture into their organization?, Empir. Softw. Eng. 26 (2) (2021) 50,.
[16]
Jones C., A proposal for integrating DevOps into software engineering curricula, in: Meyer B., Mazzara M., Bruel J.-M. (Eds.), Software Engineering Aspects of Continuous Development and New Paradigms of Software Production and Deployment, DEVOPS 2018, vol. 11350 LNCS, Springer Verlag, 2019, pp. 33–47,.
[17]
Senapathi M., Buchan J., Osman H., DevOps capabilities, practices, and challenges: insights from a case study, in: Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018 - EASE’18, in: EASE’18, ACM, Association for Computing Machinery, New York, USA, 2018, pp. 57–67,.
[18]
Forsgren N., Humble J., Kim G., Accelerate: The Science of Lean Software and Devops: Building and Scaling High Performing Technology Organizations, IT Revolution, USA, 2018, URL https://itrevolution.com/accelerate-book/.
[19]
Bass L., Weber I., Zhu L., DevOps: A software architect’s perspective, SEI Series in Software Engineering, Addison-Wesley, New York, 2015, URL http://my.safaribooksonline.com/9780134049847.
[20]
Debois P., Agile infrastructure and operations: How infra-gile are you?, in: Proceedings - Agile 2008 Conference, 2008, pp. 202–207,.
[21]
Waseem M., Liang P., Shahin M., A systematic mapping study on microservices architecture in DevOps, J. Syst. Softw. 170 (2020),.
[22]
Mishra A., Otaiwi Z., Devops and software quality: a systematic mapping, Comp. Sci. Rev. 38 (1) (2020) 14,.
[23]
Rodríguez P., Mäntylä M., Oivo M., Lwakatare L.E., Seppänen P., Kuvaja P., Advances in using agile and lean processes for software development, in: Memon A. (Ed.), Advances in Computers, vol. 113, Academic Press Inc., Faculty of Information Technology and Electrical Engineering, University of Oulu, Finland, 2019, pp. 135–224,.
[24]
Kneuper R., Software Processes and Life Cycle Models: An Introduction to Modelling, Using and Managing Agile, Plan-Driven and Hybrid Processes, Springer International Publishing, Cham, 2018,.
[25]
Benington H.D., Production of large computer programs, Ann. Hist. Comput. 5 (4) (1983) 350–361,.
[26]
Royce W.W., Managing the development of large software systems: Concepts and techniques, in: Proceedings of the 9th International Conference on Software Engineering, in: ICSE ’87, IEEE Computer Society Press, Washington, DC, USA, 1987, pp. 328–338.
[27]
Bell T.E., Thayer T.A., Software requirements: Are they really a problem?, in: Proceedings of the 2nd International Conference on Software Engineering, in: ICSE ’76, IEEE Computer Society Press, Washington, DC, USA, 1976, pp. 61–68.
[28]
Boehm B.W., Software Engineering Economics, first ed., Prentice Hall, Englewood Cliffs, N.J, 1981.
[29]
Münch J., Armbrust O., Kowalczyk M., Soto M., Software process definition and management, The Fraunhofer IESE Series on Software and Systems Engineering, Springer Berlin Heidelberg, Berlin, Heidelberg, 2012,.
[30]
Boehm B.W., Guidelines for verifying and validating software requirements and design specifications, in: Samet P.A. (Ed.), Euro IFIP 79, North Holland, 1979, pp. 711–719.
[31]
Larman C., Basili V., Iterative and incremental developments. a brief history, Computer 36 (6) (2003) 47–56,.
[32]
Floyd C., A systematic look at prototyping, in: Budde R., Kuhlenkamp K., Mathiassen L., Züllighoven H. (Eds.), Approaches To Prototyping, Springer, Berlin, Heidelberg, 1984, p. 18,.
[33]
Boehm B.W., A spiral model of software development and enhancement, Computer 21 (5) (1988) 61–72,.
[34]
Kitchenham B., Charters S., Guidelines for performing systematic literature reviews in software engineering, Technical report, ver. 2.3 ebse technical report. ebse, 2007.
[35]
Kitchenham B., Procedures for performing systematic reviews, Keele, UK, Keele University 33 (2004) 26.
[36]
Moher D., Liberati A., Tetzlaff J., Altman D.G., Group T.P., Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement, PLOS Med. 6 (7) (2009),.
[37]
Wohlin C., Guidelines for snowballing in systematic literature studies and a replication in software engineering, in: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, in: EASE ’14, Association for Computing Machinery, New York, NY, USA, 2014, p. 10,.
[38]
Ali N., Daneth H., Hong J.-E., A hybrid DevOps process supporting software reuse: A pilot project, J. Softw.: Evol. Process 32 (7) (2020),.
[39]
Sánchez-Gordón M., Colomo-Palacios R., Characterizing DevOps culture: A systematic literature review, in: Stamelos I., Rout T., O’Connor R., Dorling A. (Eds.), 18th International Conference on Software Process Improvement and Capability Determination, SPICE 2018, vol. 918, Springer Verlag, Østfold University College, Halden, 1757, Norway, 2018, pp. 3–15,.
[40]
Kumar R., Goyal R., Modeling continuous security: A conceptual model for automated DevSecOps using open-source software over cloud (ADOC), Comput. Secur. 97 (2020),.
[41]
Al-Surmi I., Raddwan B., Al-Baltah I., Next generation mobile core resource orchestration: comprehensive survey, challenges and perspectives, Wirel. Pers. Commun. 120 (2) (2021) 1341–1415,.
[42]
Yang D., Wang D., Yang D., Dong Q., Wang Y., Zhou H., Daocheng H., DevOps in practice for education management information system at ECNU, in: Cristani M., Toro C., Zanni-Merk C., Howlett R.J., Jain L.C. (Eds.), Procedia Computer Science, Vol. 176, 2020, pp. 1382–1391,.
[43]
Miller A.W., Giachetti R.E., Van Bossuyt D.L., Challenges of adopting devops for the combat systems development environment, Def. Acquis. Res. J.: Publ. Def. Acquisit. Univ. 29 (1) (2022) 22–49,.
[44]
Noorani N.M., Zamani A.T., Alenezi M., Shameem M., Singh P., Factor prioritization for effectively implementing DevOps in software development organizations: A SWOT-AHP approach, Axioms (2075-1680) 11 (10) (2022) N.PAG–N.PAG.
[45]
da Silva C.E., Justino Y.d., Adachi E., SPReaD: Service-oriented process for reengineering and DevOps, Serv. Orient. Comput. Appl. 16 (1) (2022) 16,.
[46]
ISO/IEC/IEEE15288, 21840–2019 - ISO/IEC/IEEE International Standard - Systems and Software Engineering – Guidelines for the Utilization of ISO/IEC/IEEE 15288 in the Context of System of Systems (S0S), ISO/IEC/IEEE 15288, 2019, https://doi.org/10.1109/IEEESTD.2019.8929110.
[47]
Muñoz M., Rodríguez M.N., A guidance to implement or reinforce a DevOps approach in organizations: A case study, J. Softw.: Evol. Process 1 (2021) 21,.
[48]
Baron C., Louis V., Towards a continuous certification of safety-critical avionics software, Comput. Ind. 125 (2021),.
[49]
Helwani F., Jahić J., ACIA: A methodology for identification of architectural design patterns that support continuous integration based on continuous assessment, in: 2022 IEEE 19th International Conference on Software Architecture Companion (ICSA-C), 2022, pp. 198–205,.
[50]
Pianini D., Neri A., Breaking down monoliths with Microservices and DevOps: An industrial experience report, in: 2021 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2021, pp. 505–514,.
[51]
Pérez L.J., Salvachúa J., Perez L.J., Salvachua J., An approach to build E-health IoT Reactive Multi-Services based on technologies around cloud computing for elderly care in smart city homes, Appl. Sci.-Basel 11 (11) (2021),.
[52]
Rafi S., Akbar M.A., AlSanad A.A., AlSuwaidan L., Abdulaziz AL-ALShaikh H., AlSagri H.S., Decision-making taxonomy of DevOps success factors using preference ranking organization method of enrichment evaluation, Math. Probl. Eng. (2022) 15,.
[53]
Herbst N., Bauer A., Kounev S., Oikonomou G., Van Eyk E., Kousiouris G., Evangelinou A., Krebs R., Brecht T., Abad C.L., Iosup A., Quantifying cloud performance and dependability: Taxonomy, metric design, and emerging challenges, ACM Trans. Model. Perform. Eval. Comput. Syst. 3 (4) (2018) 36,.
[54]
Poniszewska-Marańda A., Czechowska E., Chen Y.-S., Kubernetes cluster for automating software production environment, Sensors (14248220) 21 (5) (2021) 1910,.
[55]
Leech S., Dunne J., Malone D., A framework to model bursty electronic data interchange messages for queueing systems†, Fut. Int. 14 (5) (2022) 149,.
[56]
Zhou H., Hu Y., Ouyang X., Su J., Koulouzis S., de Laat C., Zhao Z., CloudsStorm: A framework for seamlessly programming and controlling virtual infrastructure functions during the DevOps lifecycle of cloud applications, Softw. - Pract. Exp. 49 (10) (2019) 1421–1447,.
[57]
Usman M., Ferlin S., Brunstrom A., Taheri J., A survey on observability of distributed edge & container-based microservices, IEEE Access 10 (2022) 86904–86919,.
[58]
Haindl P., Plosch R., Focus areas, themes, and objectives of non-functional requirements in DevOps: A systematic mapping study, in: Martini A., Wimmer M., Skavhaug A. (Eds.), Proceedings - 46th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2020, Institute of Electrical and Electronics Engineers Inc., Johannes Kepler University Linz, Institute of Business Informatics - Software Engineering, Linz, Austria, 2020, pp. 394–403,.
[59]
Grunewald E., Wille P., Pallas F., Borges M., Ulbricht M.-R., TIRA: An OpenAPI extension and toolbox for GDPR transparency in RESTful architectures, in: Proceedings - 2021 IEEE European Symposium on Security and Privacy Workshops, Euro S and PW 2021, 2021, pp. 312–319,.
[60]
Alonso J., Orue-Echevarria L., Huarte M., CloudOps: Towards the operationalization of the cloud continuum: Concepts, challenges and a reference framework, Appl. Sci. (Switzerland) 12 (9) (2022),.
[61]
John W., Marchetto G., Nemeth F., Skoldstrom P., Steinert R., Meirosu C., Papafili I., Pentikousis K., Service provider DevOps, IEEE Commun. Mag. 55 (1) (2017) 204–211,.
[62]
Dobaj J., Riel A., Krug T., Seidl M., Macher G., Egretzberger M., Towards digital twin-enabled DevOps for CPS providing architecture-based service adaptation & verification at runtime, in: Proceedings of the 17th Symposium on Software Engineering for Adaptive and Self-Managing Systems, in: SEAMS ’22, Association for Computing Machinery, New York, NY, USA, 2022, pp. 132–143,.
[63]
Khan A.A., Shameem M., Multicriteria decision-making taxonomy for DevOps challenging factors using analytical hierarchy process, J. Softw.: Evol. Process 32 (10) (2020),.
[64]
Singh V., Singh A., Aggarwal A., Aggarwal S., DevOps based migration aspects from legacy version control system to advanced distributed VCS for deploying micro-services, in: CSITSS 2021 - 2021 5th International Conference on Computational Systems and Information Technology for Sustainable Solutions, Proceedings, 2021, p. 5,.
[65]
Sampedro Z., Holt A., Hauser T., Continuous integration and delivery for HPC: Using singularity and Jenkins, in: ACM International Conference Proceeding Series, Association for Computing Machinery, New York, NY, USA, 2018, p. 6,.
[66]
Airaj M., Enable cloud DevOps approach for industry and higher education, Concurr. Comput.-Pract. Exp. 29 (5) (2017),.
[67]
Wang Y., Pyhäjärvi M., Mäntylä M.V., Test automation process improvement in a DevOps team: Experience report, in: 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2020, pp. 314–321,.
[68]
Fitzgerald B., Stol K.-J., Continuous software engineering: A roadmap and agenda, J. Syst. Softw. 123 (2017) 176–189,.
[69]
Gokarna M., Singh R., DevOps: A historical review and future works, in: Astya P., Singh M., Roy N., Raj G. (Eds.), 2021 IEEE International Conference on Computing, Communication, and Intelligent Systems, ICCCIS 2021, Institute of Electrical and Electronics Engineers Inc., IEEE, IBM India Pvt Ltd, Manyata Tech Park, Bangalore, India, 2021, pp. 366–371,.
[70]
Saboor A., Hassan M., Akbar R., Susanto E., Shah S., Siddiqui M., Magsi S., Root-of-trust for continuous integration and continuous deployment pipeline in cloud computing, Comput. Mater. Contin. 73 (2) (2022) 2223–2239,.
[71]
Alnafessah A., Gias A.U., Wang R., Zhu L., Casale G., Filieri A., Quality-aware DevOps research: Where do we stand?, IEEE Access: Pract. Innov. Open Solutions 9 (2021) 44476–44489,.
[72]
Xuan J., Duan T., Guo Q., Gao F., Li J., Qiu X., Wu S., Microservice publishing technology based on DevOps architecture, in: 2021 IEEE 5th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC), Vol. 5, 2021, pp. 1310–1314,.
[73]
Kohyarnejadfard I., Aloise D., Azhari S.V., Dagenais M.R., Anomaly detection in microservice environments using distributed tracing data analysis and NLP, J. Cloud Comput. 11 (1) (2022),.
[74]
Snyder B., Curtis B., Using analytics to guide improvement during an Agile-DevOps transformation, IEEE Softw. 35 (1) (2017) 78–83,.
[75]
Munoz M., Negrete M., Arcilla-Cobian M., Using a platform based on the Basic profile of ISO/IEC 29110 to reinforce DevOps environments, J. Univ. Comput. Sci. 27 (2) (2020) 91–110,.
[76]
Chen X., Badampudi D., Usman M., Reuse in contemporary software engineering practices-an exploratory case study in A medium-sized company, E-Inf. Softw. Eng. J. 16 (1) (2022),.
[77]
Hemon A., Lyonnet B., Rowe F., Fitzgerald B., From Agile to DevOps: Smart skills and collaborations, Inf. Syst. Front. 22 (4) (2020) 927–945,.
[78]
Rafi S., Akbar M.A., Yu W., Alsanad A., Gumaei A., Sarwar M.U., Exploration of DevOps testing process capabilities: An ISM and fuzzy TOPSIS analysis, Appl. Soft Comput. 116 (2022),.
[79]
Banica L., Radulescu M., Rosca D., Hagiu A., Is DevOps another project management methodology?, Inf. Econ. 21 (3) (2017) 39–51,.
[80]
Hemon A., Fitzgerald B., Lyonnet B., Rowe F., Innovative practices for knowledge sharing in large-scale DevOps, IEEE Softw. 37 (3) (2020) 30–37,.
[81]
Jimenez I., Sevilla M., Watkins N., Maltzahn C., Lofstead J., Mohror K., Arpaci-Dusseau A., Arpaci-Dusseau R., The Popper convention: Making reproducible systems evaluation practical, in: Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017, 2017, pp. 1561–1570,.
[82]
Kumara I., Garriga M., Romeu A.U., Di Nucci D., Palomba F., Tamburri D.A., van den Heuvel W.-J., The do’s and don’ts of infrastructure code: A systematic gray literature review, Inf. Softw. Technol. 137 (2021),.
[83]
Zhou Y., Su Y., Chen T., Huang Z., Gall H.C., Panichella S., User review-based change file localization for mobile applications, IEEE Trans. Softw. Eng. (2020) 1,.
[84]
Chen M., Yao W., Chen J., Liang H., Chen Y., Qiao H., Yang C., Li M., Tong J., Critical challenges and solutions for an ultra-large-scale enterprise DevOps platform, in: 2022 7th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA), 2022, pp. 167–171,.
[85]
Firdaouss L., Ayoub B., Manal B., Ikrame Y., Automated VPN configuration using DevOps, in: Procedia Computer Science, in: 12th International Conference on Emerging Ubiquitous Systems and Pervasive Networks / 11th International Conference on Current and Future Trends of Information and Communication Technologies in Healthcare, 198, 2022, pp. 632–637,.
[86]
Lévy L.-N., Bosom J., Guerard G., Amor S., Bui M., Tran H., DevOps model appproach for monitoring smart energy systems, Energies 15 (15) (2022) 27,.
[87]
Jabbari R., bin Ali N., Petersen K., Tanveer B., Towards a benefits dependency network for DevOps based on a systematic literature review, J. Softw.: Evol. Process 30 (11) (2018) 26,.
[88]
Sandobalin J., Insfran E., Abrahao S., Sandobalín J., Insfran E., Abrahão S., On the effectiveness of tools to support infrastructure as code: model-driven versus code-centric, IEEE Access 8 (2020) 17734–17761,.
[89]
Trigo A., Varajão J., Sousa L., DevOps adoption: Insights from a large European Telco, Cogent Eng. 9 (1) (2022),.
[90]
Lie M.F., Sanchez-Gordon M., Colomo-Palacios R., DevOps in an ISO 13485 regulated environment: A multivocal literature review, in: International Symposium on Empirical Software Engineering and Measurement, ACM, New York, NY, USA, 2020, p. 11,.
[91]
Romero E.E., Camacho C.D., Montenegro C.E., Acosta Ó.E., Crespo R.G., Gaona E.E., Martínez M.H., Integration of DevOps practices on a noise monitor system with CircleCI and Terraform, ACM Trans. Manag. Inf. Syst. 13 (4) (2022) 36:1–36:24,.
[92]
Almeida F., Simões J., Lopes S., Exploring the benefits of combining DevOps and Agile, Fut. Int. 14 (2) (2022) 63,.
[93]
Alamin M.A.A., Uddin G., Malakar S., Afroz S., Haider T., Iqbal A., Developer discussion topics on the adoption and barriers of low code software development platforms, Empir. Softw. Eng. 28 (1) (2022),.
[94]
Badshah S., Khan A.A., Khan B., Towards process improvement in DevOps: A systematic literature review, in: 24th Evaluation and Assessment in Software Engineering Conference, EASE 2020, ACM, Association for Computing Machinery, Comsats University Islamabad, Islamabad, Pakistan, 2020, pp. 427–433,.
[95]
Lwakatare L.E., Kilamo T., Karvonen T., Sauvola T., Heikkilä V., Itkonen J., Kuvaja P., Mikkonen T., Oivo M., Lassenius C., DevOps in practice: A multiple case study of five companies, Inf. Softw. Technol. 114 (March 2017) (2019) 217–230,.
[96]
Donca I.-C., Stan O.P., Misaros M., Gota D., Miclea L., Method for continuous integration and deployment using a pipeline generator for agile software projects, Sensors (Basel, Switzerland) 22 (12) (2022),.
[97]
Rafi S., Yu W., Akbar M.A., Alsanad A., Gumaei A., Multicriteria based decision making of DevOps data quality assessment challenges using fuzzy TOPSIS, IEEE Access 8 (1) (2020) 46958–46980,.
[98]
Perera P., Silva R., Perera I., Improve software quality through practicing DevOps, in: 17th International Conference on Advances in ICT for Emerging Regions, ICTer 2017 - Proceedings, 2018-Janua, IEEE, Institute of Electrical and Electronics Engineers Inc., Department of Computer Science aSoftware Development model nd Engineering, University of Moratuwa, Moratuwa, Sri Lanka, 2017, pp. 13–18,.
[99]
Rafi S., Yu W., Akbar M., Alsanad A., Gumaei A., Prioritization based taxonomy of DevOps Security Challenges Using PROMETHEE, IEEE Access 8 (2020) 105426–105446,.
[100]
Akbar M.A., Rafi S., Alsanad A.A., Qadri S.F., Alsanad A., Alothaim A., Toward successful DevOps: A decision-making framework, IEEE Access: Pract. Innov. Open Solutions 10 (2022) 51343–51362,.
[101]
Dallapalma S., Di Nucci D., Palomba F., Tamburri D.A., Within-project defect prediction of infrastructure-as-code using product and process metrics, IEEE Trans. Softw. Eng. (2021) 1,.
[102]
Wiedemann A., Wiesche M., Gewald H., Krcmar H., Understanding how DevOps aligns development and operations: A tripartite model of intra-IT alignment, Eur. J. Inf. Syst. 29 (5) (2020) 458–473,.
[103]
Rafi S., Akbar M.A., Mahmood S., Alsanad A., Alothaim A., Selection of DevOps best test practices: A hybrid approach using ISM and fuzzy TOPSIS analysis, J. Softw.: Evol. Process 34 (5) (2022),.
[104]
Throner S., Hutter H., Sanger N., Schneider M., Hanselmann S., Petrovic P., Abeck S., An advanced DevOps environment for microservice-based applications, in: 2021 IEEE International Conference on Service-Oriented System Engineering (SOSE), 2021, pp. 134–143,.
[105]
Zimmermann O., Microservices tenets, Comput. Sci. - Res. Dev. 32 (3–4) (2017) 301–310,.
[106]
W.P. Luz, G. Pinto, B. Bonifacio, Building a collaborative culture: a grounded theory of well succeeded DevOps adoption in practice, in: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2018), Oulu, Finland, ISBN: 978-1-4503-5823-1, 2018, p. 11, https://doi.org/10.1145/3239235.3240299.
[107]
Al-marsy A., Chaudhary P., Rodger J., A model for examining challenges and opportunities in use of cloud computing for health information systems, Appl. Syst. Innov. 4 (1) (2021) 20,.
[108]
Premchand A., Sandhya M., Sankar S., Simplification of application operations using cloud and DevOps, Indonesian J. Electr. Eng. Comput. Sci. 13 (1) (2019) 85–93,.
[109]
Tuma K., Sandberg C., Thorsson U., Widman M., Herpel T., Scandariato R., Finding security threats that matter: Two industrial case studies, J. Syst. Softw. 179 (2021),.
[110]
Chen B.Y., Jiang Z.M., A survey of software log instrumentation, ACM Comput. Surv. 54 (4) (2021),.
[111]
Liu Y., Ling Z., Huo B., Wang B., Chen T., Mouine E., Building A platform for machine learning operations from open source frameworks, in: IFAC-PapersOnLine, in: 3rd IFAC Workshop on Cyber-Physical & Human Systems CPHS 2020, Vol. 53, 2020, pp. 704–709,.
[112]
Topi H., Spurrier G., Invited paper: a generalized, enterprise-level systems development process framework for systems analysis and design education, J. Inf. Syst. Educ. 30 (4) (2019) 253–265.
[113]
Topi H., Spurrier G., A generalized, enterprise-level systems development process framework for systems analysis and design education, J. Inf. Syst. Educ. 30 (4) (2019) 253–265.
[114]
Akbar M.A., Smolander K., Mahmood S., Alsanad A., Toward successful DevSecOps in software development organizations: A decision-making framework, Inf. Softw. Technol. 147 (2022),.
[115]
Ranawana R., Karunananda A.S., An agile software development life cycle model for machine learning application development, in: 2021 5th SLAAI International Conference on Artificial Intelligence (SLAAI-ICAI), 2021, p. 6,.
[116]
Liu H., Han Q., Wang Y., He F., Mao Z., Li C., An analysis of DevOps architecture for EMIS based on jBPM, in: 2020 International Conference on Service Science (ICSS), 2020-Augus, IEEE, 2020, pp. 96–101,.
[117]
Camilli M., Guerriero A., Janes A., Russo B., Russo S., Microservices integrated performance and reliability testing, in: Proceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test, in: AST ’22, Association for Computing Machinery, New York, NY, USA, 2022, pp. 29–39,.
[118]
Lai S.T., Leu F.Y., A micro services quality measurement model for improving the efficiency and quality of DevOps, in: Barolli L., Xhafa F., Javaid N., Enokido T. (Eds.), Advances in Intelligent Systems and Computing, Vol. 773, Springer International Publishing AG, Gewerbestrasse 11, CHAM, CH-6330, SWITZERLAND, 2019, pp. 565–575,.
[119]
Eramo R., Muttillo V., Berardinelli L., Bruneliere H., Gomez A., Bagnato A., Sadovykh A., Cicchetti A., AIDOaRt: AI-augmented automation for DevOps, a model-based framework for continuous development in cyber-physical systems, in: 2021 24th Euromicro Conference on Digital System Design (DSD), 2021, pp. 303–310,.
[120]
Pardo M., Erazo H., Lozada C., Documenting and implementing DevOps good practices with test automation and continuous deployment tools through software refinement, Period. Eng. Nat. Sci. 9 (4) (2021) 854–863,.
[121]
Vassallo C., Zampetti F., Romano D., Beller M., Panichella A., Di Penta M., Zaidman A., Continuous delivery practices in a large financial organization, in: Proceedings - 2016 IEEE International Conference on Software Maintenance and Evolution, ICSME 2016, 2017, pp. 519–528,.
[122]
Chen J., Performance regression detection in DevOps, in: Proceedings - 2020 ACM/IEEE 42nd International Conference on Software Engineering: Companion, ICSE-Companion 2020, 2020, pp. 206–209,.
[123]
Ayerdi J., Garciandia A., Arrieta A., Afzal W., Enoiu E., Agirre A., Sagardui G., Arratibel M., Sellin O., Towards a taxonomy for eliciting design-operation continuum requirements of cyber-physical systems, in: Proceedings of the IEEE International Conference on Requirements Engineering, 2020-August, 2020, pp. 280–290,.
[124]
Paule C., Dullmann T.F., Van Hoorn A., Vulnerabilities in continuous delivery pipelines? a case study, in: Proceedings - 2019 IEEE International Conference on Software Architecture - Companion, ICSA-C 2019, 2019, pp. 102–108,.
[125]
Wöhrer M., Zdun U., DevOps for ethereum blockchain smart contracts, in: 2021 IEEE International Conference on Blockchain (Blockchain), 2021, pp. 244–251,.
[126]
Rubasinghe I.D., Meedeniya D.A., Perera I., Towards traceability management in continuous integration with sat-analyzer, in: ACM International Conference Proceeding Series, Association for Computing Machinery, New York, NY, USA, 2017, pp. 77–81,.
[127]
Bergelin J., Cicchetti A., Towards continuous modelling to enable DevOps: A preliminary study with practitioners, in: Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings, in: MODELS ’22, Association for Computing Machinery, New York, NY, USA, 2022, pp. 774–783,.
[128]
Castellanos C., Varela C.A., Correal D., ACCORDANT: A domain specific-model and DevOps approach for big data analytics architectures, J. Syst. Softw. 172 (2021),.
[129]
Subramanya R., Sierla S., Vyatkin V., From DevOps to MLOps: Overview and application to electricity market forecasting, Appl. Sci. (Switzerland) 12 (19) (2022),.
[130]
Faustino J., Amaro R., Adriano D., Pereira R., da Silva M.M., DevOps benefits: A systematic literature review, Softw. - Pract. Exp. 52 (9) (2022) 1905–1926,.
[131]
Amaro R., Pereira R., da Silva M.M., DevOps Metrics and KPIs: A multivocal literature review, ACM Comput. Surv. (2024),.
[132]
Guest G., Namey E., Chen M., A simple method to assess and report thematic saturation in qualitative research, PLOS ONE 15 (5) (2020),.
[133]
Garousi Yusifoğlu V., Amannejad Y., Betin Can A., Software test-code engineering: A systematic mapping, Inf. Softw. Technol. 58 (2015) 123–147,.
[134]
Verner J.M., Babar M.A., Cerpa N., Hall T., Beecham S., Factors that motivate software engineering teams: A four country empirical study, J. Syst. Softw. 92 (1) (2014) 115–127,.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Information and Software Technology
Information and Software Technology  Volume 177, Issue C
Jan 2025
400 pages

Publisher

Butterworth-Heinemann

United States

Publication History

Published: 01 January 2025

Author Tags

  1. DevOps
  2. Metrics
  3. Performance
  4. Adoption
  5. Software development life cycle
  6. Information system

Qualifiers

  • Review-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media